system
A system for managing insurance and financial assets provides secure, intuitive input, transmission, and real-time advice, addressing the challenge of asset management after a family member's death by ensuring smooth access and reducing anxiety.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-10-15
- Publication Date
- 2026-04-27
AI Technical Summary
Managing complex asset information such as insurance contracts and financial assets becomes challenging when a family member passes away, leading to difficulties in understanding and managing these assets appropriately due to insufficient information security, access rights management, and lack of real-time asset management advice.
A system that allows users to centrally manage insurance contracts and financial assets through a user interface, encrypting and securely transmitting data to a server, setting access permissions, and providing real-time asset management advice to family members upon the user's death, using AI for guidance.
Ensures efficient and secure management of assets, allowing family members to access and manage assets with peace of mind, reducing anxiety and stress through intuitive input, secure transmission, and real-time advice.
Smart Images

Figure 2026070138000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] Generally, asset management and insurance contracts are complex. Especially when a person who manages assets dies due to a sudden accident or illness, it is difficult for the remaining family members to understand the content and manage it appropriately. Therefore, there is a need for a system that can manage assets quickly and appropriately without the family members having to worry.
Means for Solving the Problems
[0005] This invention provides an input method for users to centrally manage information regarding their insurance contracts, financial assets, and investments, and by centrally managing this information in a database, it provides a management method that allows for quick access when needed. Furthermore, it has a function that allows family members to appropriately access the information based on the access permissions set by the user, and when the user passes away, it automatically sends a notification to registered family members and provides a system that offers real-time asset management advice, thereby reducing the anxiety faced by family members.
[0006] "Input method" refers to the interface used by users to register their insurance contracts, financial assets, and investment information into the system.
[0007] A "management system" is a system that has the function of centrally organizing and storing information obtained through input systems, and making it efficiently accessible when needed.
[0008] "Configuration means" refers to a function that allows users to specify access permissions for information to their family members while they are still alive.
[0009] "Notification method" refers to a function that automatically notifies registered family members about access to asset information upon the user's death.
[0010] A "support system" is a function that provides real-time advice and procedural instructions regarding asset management when family members access asset information. [Brief explanation of the drawing]
[0011] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]
[0012] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.
[0013] First, let's explain the terminology used in the following explanation.
[0014] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0015] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.
[0016] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs, various parameters, and the like. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.
[0017] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor, an antenna, and the like. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0019] [First Embodiment]
[0020] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0021] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0023] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0024] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0026] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0027] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0028] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0029] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0030] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0031] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0032] This invention is a system that helps users efficiently manage their insurance policies, financial assets, and investment information, and to ensure that their families can properly inherit this information. The system consists of terminals, a server, and users.
[0033] Users input insurance contracts, financial assets, investment information, and other data using a dedicated application. This application has an intuitive interface and is designed to allow users to easily input complex information.
[0034] The terminal temporarily stores the user's input information, encrypts it, and sends it to the server. The key here is data security, and the terminal ensures communication security through protocols such as SSL.
[0035] The server analyzes the received data and stores it in the database. This analysis involves categorizing the information and converting it to the correct format as needed, enabling smooth data retrieval and searching later on.
[0036] Next, the user sets the scope and level of information that family members can access within the system. This includes specifying access permissions for individual members of the family. The terminal sends this access permission information to the server, which stores it in a database.
[0037] When a user's death is confirmed, the server notifies pre-registered family members. This notification is sent via pre-configured email or SMS. Upon receiving the notification, family members can access the system and access the specified asset information.
[0038] The server analyzes information based on family access and provides real-time advice on asset management and instructions for necessary procedures. This allows families to manage their assets with peace of mind, even in unexpected situations.
[0039] As a concrete example, in a case where a user manages car insurance, savings, and investment trusts for seniors, all of this information is organized on a server, and a system is in place that allows family members to instantly check the contents and proceed with the necessary procedures.
[0040] A key feature of this invention is that it allows users' families to prepare for unexpected events and manage their assets peacefully and efficiently.
[0041] The following describes the processing flow.
[0042] Step 1:
[0043] Users launch a dedicated application and utilize an interface to input insurance contracts, financial assets, and investment information. Users register detailed data such as contract numbers, financial institution names, and account numbers through this interface.
[0044] Step 2:
[0045] The terminal temporarily stores information entered by the user and prepares it for data transmission. It also has a function to review the input information before transmission and request corrections or supplements from the user as needed.
[0046] Step 3:
[0047] The device encrypts the verified information and securely transmits it to the server. This prevents eavesdropping and tampering with the data in transmission.
[0048] Step 4:
[0049] The server receives the transmitted data and decrypts it. It then converts the data into the appropriate format and stores it in a database. This is where the information is categorized and tagged.
[0050] Step 5:
[0051] The server creates an asset information dashboard for the user based on the information stored in the database. This dashboard is updated in real time to support the user's asset management.
[0052] Step 6:
[0053] The user selects options within the app to configure what information family members can access. This involves setting access permissions, granting family members viewing or editing permissions.
[0054] Step 7:
[0055] The terminal sends data on the configured access permissions to the server, which stores this information in a database. This enables access control according to user-specified conditions.
[0056] Step 8:
[0057] The server manages the procedures that follow when a user dies. The server sends notifications via email or SMS to pre-registered family contacts. The notifications include instructions on how to access asset information and an overview of the procedures.
[0058] Step 9:
[0059] When a family member who has received a notification accesses the system, the server analyzes the registered asset information in real time and provides advice and procedures regarding asset management. AI is used to provide specific and effective guidance during this process.
[0060] Step 10:
[0061] The device provides an interface for family members to carry out procedures based on the advice provided as needed. Families can use the system to perform the actual procedures and continue to manage their assets with peace of mind.
[0062] (Example 1)
[0063] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0064] In modern society, with the increasing variety and volume of personal assets, it is difficult for users to efficiently manage their insurance policies, financial assets, and investment information. Furthermore, ensuring that family members can smoothly inherit and properly manage this information in the event of a user's sudden death is also a challenge. In particular, conventional technologies are insufficient in terms of information security, access rights management, and providing real-time asset management advice.
[0065] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0066] In this invention, the server includes a computing device for providing an intuitive interface for information input, means for temporarily storing information collected by the computing device, securely encrypting it, and transmitting it via a communication path, and information processing means for analyzing the decrypted information and efficiently storing it in a database. This allows users to intuitively input information, transmit it to the server while maintaining its security, and efficiently store it in the database through necessary analysis processing. Furthermore, it enables the setting of appropriate access rights for family members and the provision of real-time advice regarding asset management, allowing family members to smoothly manage assets even after the user's death.
[0067] An "intuitive interface for information input" is a user interface designed to allow users to easily and efficiently input insurance contracts, financial assets, and investment information.
[0068] A "calculating device" is an electronic device that has the function of processing and temporarily storing data entered by a user.
[0069] "Encryption" is the process of transforming data using a specific algorithm in order to protect users' personal information and asset information from third parties.
[0070] A "communication path" is a network path used to securely transmit data from a terminal to a server.
[0071] "Information processing means" refers to a series of processes that analyze decoded data and store it appropriately in a database.
[0072] A "database" is an information management system that stores information in a structured format, enabling efficient management and retrieval.
[0073] "Access permissions" refer to the settings that allow or restrict access to information held by a specific user or group.
[0074] A "notification means" is a method or device for transmitting information to a designated recipient when a specific event occurs.
[0075] "Support design tools" are methods and techniques designed to analyze information and provide users with the necessary support and advice.
[0076] This invention is a system that helps users efficiently manage their insurance policies, financial assets, and investment information, and to ensure that their families can properly inherit this information. The system consists of a user terminal and a server. Users input information using a dedicated application with an intuitive interface. Once the user inputs information, the terminal temporarily stores it and transmits it to the server via the SSL / TLS protocol using encryption technology such as AES to ensure security.
[0077] The server decrypts the received data and efficiently stores it in a database using information processing tools. Specifically, it categorizes the data and converts its format as needed to facilitate later data retrieval and searching. Next, the user sets access permissions for family members and sends this information to the server via their device. The server stores this information in a database and uses it when family members access the information later.
[0078] For example, if a user manages vehicle insurance, bank account information, or investment trusts for seniors, all of this information is securely stored on the server, allowing family members to quickly access and address the situation in an emergency. The notification function ensures that when news of a user's death is confirmed, a notification is sent to pre-designated family members, allowing them to quickly access the necessary information.
[0079] An example of a prompt message might be: "Please describe in detail the process by which, after the user enters their car insurance information into the terminal, that information is securely transmitted to and stored on the server."
[0080] In this way, users' families can manage their assets smoothly even in unexpected situations and continue living with peace of mind.
[0081] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0082] Step 1:
[0083] The user launches a dedicated application and enters insurance contract information, financial asset information, and investment information. This information includes policy number, asset type, and investment risk level. This allows the user to provide specific asset information to the system.
[0084] Step 2:
[0085] The terminal temporarily stores information entered by the user. This stored data is encrypted using AES encryption technology. For example, entered asset information is encoded using a key and converted into a secure state. This ensures that the data is secure and ready for transmission to external parties.
[0086] Step 3:
[0087] The terminal sends encrypted data to the server via the SSL / TLS protocol. To mitigate the risk of information interception during transmission, multiple layers of security are implemented. For example, data packets are encrypted and recorded in the transmission log.
[0088] Step 4:
[0089] The server receives encrypted data sent from the terminal and decrypts it. Decryption allows the server to read the asset information originally entered by the user and prepare it for processing in the next step.
[0090] Step 5:
[0091] The server analyzes the decrypted information and stores it in a database. This analysis includes categorizing the information (e.g., insurance, deposits, investments) and converting it to a different format (e.g., converting it to a tabular format). This facilitates subsequent information retrieval and acquisition.
[0092] Step 6:
[0093] The user sets the scope and level of information that family members can access through the system. Specifically, they can set access permissions, for example, granting family members permission to view specific asset information. This ensures that family members can smoothly take over information upon the user's death.
[0094] Step 7:
[0095] The device sends the user-defined access permissions to the server. The server stores this information in a database for future use by family members when they need to access the information.
[0096] Step 8:
[0097] When a user's death is confirmed, the server sends a notification to pre-registered family members. This notification is sent via a designated communication method (e.g., email or SMS), and the family members access the system based on that notification.
[0098] Step 9:
[0099] The server provides real-time advice and procedural support regarding asset management to family members who access it, if necessary. It can also refer to past data and present future management plans. This allows family members to manage and operate the assets left behind by their parents with peace of mind.
[0100] (Application Example 1)
[0101] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0102] The challenge lies in efficiently and securely managing important asset data such as insurance policies, financial assets, and investment information held by users, and in smoothly transferring and managing this data when life events occur. Furthermore, there is a need to provide a system that allows families to accurately understand the asset situation and receive guidance for appropriate management and investment.
[0103] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0104] In this invention, the server includes information input means, information management means, permission setting means, information provision means, assistance means, monitoring means, and notification generation means. This enables the secure management of users' asset information and allows for the rapid and appropriate transfer of information and asset management by family members.
[0105] "Information input means" refers to a device or software for users to input data, including insurance contract information, financial asset information, and investment information, into a system.
[0106] "Information management means" refers to a device or software that has the function of centrally organizing input information and storing it in a storage device.
[0107] A "permission setting device" is a device or software that has the function of setting access privileges for information for family members designated by the user.
[0108] "Information provision means" refers to a device or software that has the function of notifying a designated recipient of necessary information upon the death of a user.
[0109] "Means of assistance" refers to a device or software that has the function of providing immediate advice on asset management to a family member who has been notified.
[0110] "Monitoring means" refers to a device or software that has the function of continuously monitoring the user's electronic asset status and detecting changes.
[0111] A "notification generation means" is a device or software that has the function of creating notifications for family members in accordance with pre-set life events.
[0112] The system implementing this invention consists of a user terminal, a server, and an associated database. The user inputs insurance contract information, financial asset information, and investment information through an application on the terminal. During information input, the information is securely transmitted to the server using the SSL / TLS protocol. The server centrally manages the received information and stores it encrypted on cloud storage. This prevents information leakage and allows for secure and efficient data management.
[0113] The device also provides an interface for setting access permissions for family members. Users can use this interface to specify access levels for each family member. This configuration information is also sent to the server and securely managed in a database.
[0114] When a user's life event, such as death, is confirmed, the server uses a pre-registered list of recipients to notify designated family members using various information delivery methods. These notifications are sent via email or SMS. A notification generation program developed in Python or similar languages is used in this process.
[0115] Furthermore, as a means of assistance, a generative AI model installed on the server generates asset management advice for families in real time. This model analyzes the user's asset data and proposes an appropriate action plan.
[0116] For example, if a user dies suddenly in an accident, this system instantly provides the surviving family with detailed guidelines regarding the user's savings and insurance claim procedures. This allows the family to take swift action.
[0117] An example of a prompt message is as follows: "We are developing an application that provides real-time, rapid, and accurate asset management advice to families in a system that notifies them after a user's death. Please combine data analysis based on user input information with a function to set access permissions for family members."
[0118] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0119] Step 1:
[0120] Users enter insurance policy information, financial asset information, and investment information using an application on their device. This entered data is encrypted on the device using the SSL / TLS protocol. The input is direct data from the user's actions, while the output is encrypted data. This ensures that the data is ready to be securely transmitted to the server.
[0121] Step 2:
[0122] The terminal sends encrypted data to the server. The server receives this data, decrypts it, and then forwards it to the information management system. The input is the received encrypted data, and the output is the decrypted raw data. The server centrally manages this data and stores it in cloud storage. This ensures centralized availability of the data.
[0123] Step 3:
[0124] Users utilize an interface via their device to set access permissions for each family member. The device inputs user-specified access requirements, and the output is access permission setting data sent to the server. The server analyzes this data and records it in a database. As a result, access to asset information is restricted to the user's family.
[0125] Step 4:
[0126] When a life event such as a user's death occurs, the server sends a notification to pre-registered recipients. The input is the trigger information for the life event, and the output is the notification message to the recipients. The server uses Python to generate the notification during this process and sends the information via email or SMS.
[0127] Step 5:
[0128] Finally, a server-based AI model provides asset management advice to the family. The input is the user's asset data and related information, and the output is an advisory message as guidance. This model analyzes the user's financial situation and proposes an optimal action plan for the family. This enables the family to manage their assets quickly and appropriately.
[0129] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0130] This invention adds an emotion engine that recognizes and responds to user emotions to a system that efficiently manages user asset information and provides advice as needed. This system consists of a terminal, a server, and a user, and the emotion engine plays a central role in the entire system.
[0131] Users input insurance policies, financial assets, and investment information using a dedicated application. The emotion engine analyzes the user's emotions during this process. For example, it can detect stress levels and anxiety using the user's tone of voice, input speed, and facial expressions. The device temporarily stores this emotional data and sends it to a server.
[0132] The server combines and analyzes the received emotional data and asset information data. This analysis is stored in a database and used to dynamically adjust how asset information is displayed and the content of advice based on the user's emotional state.
[0133] Next, the user sets the scope of asset information that family members can access within the application. The emotion engine also evaluates the user's emotions during the setup process and provides guidance to reduce stress. For example, if the user shows anxiety, it provides detailed explanations and additional support information to reassure them.
[0134] If a user dies, the server sends a notification to the family, optimized by an emotion engine. The content and timing of this notification are optimized considering the family's situation. For example, the emotion engine selects language and content that is easy for the family to accept and sends the notification. Upon receiving the notification, the family can access the system with appropriate permissions and check the asset information.
[0135] When family members access their asset information, the server provides real-time advice on specific action plans and asset management procedures based on data obtained using an emotion engine. This allows families to confidently take appropriate action even when faced with unexpected situations.
[0136] For example, if a user manages a large life insurance policy and multiple investment trusts, the emotional engine understands the importance of this information and provides detailed yet concise instructions to ensure the family can proceed without stress. The system's dynamic response, based on the user's emotional state and the family's reactions, is a key feature and unique aspect of this system.
[0137] Thus, according to the present invention, flexible and efficient asset management that responds to the emotional needs of the user and their family becomes possible, minimizing anxiety and stress.
[0138] The following describes the processing flow.
[0139] Step 1:
[0140] Users input asset information through a dedicated application. During the input process, the application captures the user's facial expressions and voice data in preparation for analysis by an emotion engine.
[0141] Step 2:
[0142] The terminal temporarily stores the entered asset information and acquired sentiment data, and verifies that the data is complete and accurate. It then prepares to encrypt and send the data to the server.
[0143] Step 3:
[0144] The server processes received asset information and sentiment data and stores it in a database. Simultaneously, the sentiment engine analyzes the user's emotional state.
[0145] Step 4:
[0146] The server customizes the user's asset information dashboard based on the analysis results of the emotion engine. This adapts the way and order in which information is presented to the user's mental state.
[0147] Step 5:
[0148] Users set access permissions for their family members' asset information. The emotion engine evaluates the user's emotions during the setup process and adaptively displays supportive messages to reduce stress.
[0149] Step 6:
[0150] The server stores the configured access permissions in a database, preparing the family to access the information they need.
[0151] Step 7:
[0152] If a user dies, the server notifies the family through a pre-configured method. An emotion engine adjusts the notification content to a format that is more acceptable to the family.
[0153] Step 8:
[0154] After receiving a notification, the family accesses the system. The server uses an emotion engine to assess the family's emotional state and provides support accordingly.
[0155] Step 9:
[0156] The server provides real-time, specific advice and procedures regarding asset management, tailored to each family member's access. It also considers emotional data to facilitate the most appropriate responses for each family member.
[0157] (Example 2)
[0158] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0159] Traditional asset management systems provide uniform asset information and notifications without considering the user's emotional state, which has the drawback of failing to adequately alleviate the anxiety and stress experienced by users and their families. Furthermore, they make it difficult to respond quickly and appropriately to asset management needs in emergencies or critical situations.
[0160] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0161] In this invention, the server includes: an emotion analysis means that dynamically adjusts the display method and advice content of asset information based on the user's emotional state; an information generation means that analyzes the user's emotional data and asset information and provides real-time guidance on asset management when a family member accesses it; and a notification generation means that adjusts the content of notifications and transmits information to family members who have been granted access by an access setting means. This enables flexible and appropriate asset management that meets the emotional needs of the user and their family.
[0162] "Information input means" refers to a device or software that has the function of allowing users to input insurance contract information, financial asset information, and investment information.
[0163] "Information management means" refers to a device or system that has the function of centrally managing information entered by information input means and storing it in a storage device.
[0164] A "permission setting means" is a device or system that has the function of setting access permissions for asset information to family members designated by the user, based on information managed by an information management means.
[0165] "Emotional analysis means" refers to a device or system that has the function of dynamically adjusting the display method of asset information and the content of advice based on the user's emotional state.
[0166] A "guidance generation means" is a device or system that analyzes user emotion data and asset information and has the function of providing real-time guidance on asset management when family members access it.
[0167] A "notification generation means" is a device or system that has the function of adjusting the content of notifications and transmitting information to family members whose permissions have been set by the permission setting means.
[0168] This invention is a system for efficiently managing users' assets and dynamically providing information while taking into account the user's emotional state. The system mainly consists of a server, terminals, and users.
[0169] Users can input their insurance policy information, financial asset information, and investment information using a dedicated application on their device. As users input this information, the device uses sensors to detect their voice tone, input speed, and facial expressions, acquiring this data as emotional data. This allows the system to detect the user's stress levels and anxiety. This emotional data is temporarily stored and then transmitted to a server.
[0170] The server analyzes the received sentiment data and asset information using a generative AI model. The generative AI model processes the information using prompt statements. For example, a prompt statement such as "Suggest the optimal way to display asset information based on the user's emotional state" is used. Based on this analysis, the server dynamically adjusts the way asset information is displayed and the content of the advice to suit the user.
[0171] Furthermore, users can set the scope of asset information that family members can view from their device. The emotion engine operates throughout this configuration process, monitoring the user's emotions and providing additional support as needed.
[0172] If a user dies, the server uses a notification generation mechanism to send a notification to the family that is tailored based on emotional data. The family can access the system via a device to check asset information. The server provides real-time guidance on specific action plans and procedures regarding asset management, taking into account the family's emotional state.
[0173] For example, if a user manages a large life insurance policy and multiple investment trusts, the emotional engine understands the importance of this information and provides detailed yet concise instructions so that family members can proceed without stress. This system's dynamic response, based on the user's emotional state and family reactions, is a key feature supporting asset management.
[0174] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0175] Step 1:
[0176] Users input insurance contract information, financial asset information, and investment information using a dedicated application on the terminal. The entered data is aggregated by the terminal and stored in digital format. The terminal uses sensors to detect the user's voice tone and input speed during input, and acquires this as emotional data. The input data and emotional data are temporarily stored as output of the initial processing.
[0177] Step 2:
[0178] The terminal sends stored information input data and emotional data to the server. The server receives this data and first verifies the integrity of the data format. Next, it inputs the emotional data into a generating AI model and performs data analysis to identify the user's emotional state (e.g., stress, anxiety). The results of this analysis are saved in a database in preparation for the next processing step.
[0179] Step 3:
[0180] The server uses a generative AI model to adjust how asset information is displayed and what advice is provided based on the emotional state obtained in the previous step. An example of a prompt is, "Please suggest the best way to display asset information based on the user's emotional state." The analysis and adjustment results are sent from the server to the terminal and displayed to the user.
[0181] Step 4:
[0182] Users can set the scope of asset information that family members can view through their device. During this process, the device monitors the user's behavior and facial expressions again, updating emotional data. The server receives this data and, if necessary, provides the device with guidance on settings and reassuring details.
[0183] Step 5:
[0184] If a user's death is confirmed, the server uses a notification generation mechanism to create a notification for the family. The content of the notification is adjusted to match the family's acceptable communication style, as analyzed by the emotion engine. The final adjusted notification is then sent to the family via the device.
[0185] Step 6:
[0186] When family members access asset information using their devices, the server performs real-time sentiment analysis and provides specific action plans and procedures for asset management. Using a generative AI model, the server generates optimized steps based on the prompt "Generate the optimal action plan based on the user's emotional state" and sends them to the device. This allows family members to receive appropriate information and proceed with confidence.
[0187] (Application Example 2)
[0188] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0189] Traditional asset information management systems often focused solely on data entry and management, without considering the user's emotional state, which could cause stress for users and their families. Especially as the importance of asset information and the complexity of procedures increase, consideration is needed to alleviate the anxiety and confusion of users and their relatives. However, traditional systems that ignored emotions were unable to address these issues and failed to provide a satisfactory user experience.
[0190] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0191] In this invention, the server includes input means for inputting user contract information, asset information, and financial information; management means for centrally managing the data input by the input means and storing it in a storage device; and emotion analysis means for analyzing the user's voice tone and facial expressions and recognizing their emotional state. This enables the display of information and advice tailored to the user's emotional state.
[0192] "User" refers to an individual or organization that inputs and manages asset information.
[0193] "Contract information" refers to information related to insurance contracts and financial contracts.
[0194] "Asset information" refers to information about financial assets held and investment details.
[0195] "Financial information" refers to all information related to economic activity.
[0196] "Input means" refers to methods or devices that allow users to register data in a system.
[0197] "Management means" refers to the function of handling input information centrally and storing it in a memory device.
[0198] A "storage device" refers to a device used to store data for a long period of time.
[0199] "Relatives" refers to family members or equivalent individuals designated by the user.
[0200] "Information" refers to data or facts about a specific subject.
[0201] "Access permissions" refer to the scope of permission to view or manipulate specific information.
[0202] "Configuration means" refers to methods or devices for specifying or changing permissions and conditions.
[0203] "Absence" refers to a state in which the user is unable to operate the system due to death or other reasons.
[0204] "Notification means" refers to a function that informs relatives of changes in the user's status or information.
[0205] "Support measures" refer to methods and devices for providing necessary advice and support to relatives.
[0206] "Voice tone" refers to the pitch and intonation of a speaker's voice.
[0207] "Facial expression" refers to the state of emotion expressed through the muscles of the face.
[0208] "Emotional state" refers to the type and intensity of the user's emotions.
[0209] "Emotional analysis methods" refer to technologies and devices used to identify emotions through voice and facial expressions.
[0210] "Display" refers to presenting information in a visible form through a screen or other means.
[0211] "Advice" refers to suggestions given regarding specific actions or decisions.
[0212] The system realizing this invention includes an input means for the user to input insurance contracts, financial assets, and investment information. The terminal centrally manages the input information and stores it in a storage device through a management means, ensuring secure data storage. This management means also includes a setting means for setting access permissions as needed for relatives designated by the user.
[0213] The server has a notification system to alert relatives when the user is absent, and a support system to provide real-time advice on asset management to the notified relatives. This support system presents the necessary procedures and action plans based on the user's asset information, enabling relatives to take appropriate action.
[0214] Furthermore, emotion analysis techniques are used to analyze and recognize the user's voice tone and facial expressions to identify their emotional state. The emotion analysis utilizes the smartphone's camera and microphone, and employs software such as OpenCV and TENSORFLOW®. This data functions as an emotion engine, dynamically adjusting the displayed information and advice based on the user's emotions. This allows users to manage their assets with confidence.
[0215] As a specific example of its use, when a user registers for a life insurance contract or investment trust, if sentiment analysis detects anxiety during the process, the system will display messages providing additional information to alleviate concerns and quick access to support.
[0216] Using a generative AI model, the following prompt sentences can be generated:
[0217] "When users enter their financial information, analyze their tone of voice and facial expressions, and present them with messages that promote relaxation and reassurance."
[0218] This allows for asset management that takes into account the user's emotional needs, thereby reducing stress.
[0219] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0220] Step 1:
[0221] Users input contract information, asset information, and financial information using their smartphones. The entered data is temporarily stored using the device's input method. Input at this stage can be done via voice or manual input. The user's voice tone and input speed are also recorded simultaneously during input.
[0222] Step 2:
[0223] The terminal transfers the input data to a management system and stores it in a storage device for centralized management. At this stage, the input data is formatted to match the data format and encrypted for security purposes. The output is structured data placed in a database.
[0224] Step 3:
[0225] The device uses emotion analysis to collect stored voice tone and input speed data, as well as facial expression data acquired from the camera. Using OpenCV and TensorFlow, this data is analyzed to identify the user's emotional state. This process yields numerical data as an emotion score.
[0226] Step 4:
[0227] The server receives emotion scores and uses adjustment mechanisms to modify the displayed information and advice content according to the emotional state. It utilizes a generative AI model to generate prompt sentences based on the emotional state, creating messages that provide reassurance to the user.
[0228] Step 5:
[0229] The server sends tailored information and prompts to the terminal, displaying them in a format optimized for the user. The user receives this message and, if necessary, has options to seek further support. A user-friendly interface is provided for this display.
[0230] Step 6:
[0231] If a user becomes unavailable, the server will use a notification system to notify designated relatives. The content and timing of the notification are determined based on sentiment analysis to ensure that relatives are likely to receive it. The output is a thoughtful notification message displayed on the relative's device.
[0232] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0233] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0234] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0235] [Second Embodiment]
[0236] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0237] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0238] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0239] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0240] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0241] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0242] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0243] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0244] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0245] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0246] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0247] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0248] This invention is a system that helps users efficiently manage their insurance policies, financial assets, and investment information, and to ensure that their families can properly inherit this information. The system consists of terminals, a server, and users.
[0249] Users input insurance contracts, financial assets, investment information, and other data using a dedicated application. This application has an intuitive interface and is designed to allow users to easily input complex information.
[0250] The terminal temporarily stores the user's input information, encrypts it, and sends it to the server. The key here is data security, and the terminal ensures communication security through protocols such as SSL.
[0251] The server analyzes the received data and stores it in the database. This analysis involves categorizing the information and converting it to the correct format as needed, enabling smooth data retrieval and searching later on.
[0252] Next, the user sets the scope and level of information that family members can access within the system. This includes specifying access permissions for individual members of the family. The terminal sends this access permission information to the server, which stores it in a database.
[0253] When a user's death is confirmed, the server notifies pre-registered family members. This notification is sent via pre-configured email or SMS. Upon receiving the notification, family members can access the system and access the specified asset information.
[0254] The server analyzes information based on family access and provides real-time advice on asset management and instructions for necessary procedures. This allows families to manage their assets with peace of mind, even in unexpected situations.
[0255] As a concrete example, in a case where a user manages car insurance, savings, and investment trusts for seniors, all of this information is organized on a server, and a system is in place that allows family members to instantly check the contents and proceed with the necessary procedures.
[0256] A key feature of this invention is that it allows users' families to prepare for unexpected events and manage their assets peacefully and efficiently.
[0257] The following describes the processing flow.
[0258] Step 1:
[0259] Users launch a dedicated application and utilize an interface to input insurance contracts, financial assets, and investment information. Users register detailed data such as contract numbers, financial institution names, and account numbers through this interface.
[0260] Step 2:
[0261] The terminal temporarily stores information entered by the user and prepares it for data transmission. It also has a function to review the input information before transmission and request corrections or supplements from the user as needed.
[0262] Step 3:
[0263] The device encrypts the verified information and securely transmits it to the server. This prevents eavesdropping and tampering with the data in transmission.
[0264] Step 4:
[0265] The server receives the transmitted data and decrypts it. It then converts the data into the appropriate format and stores it in a database. This is where the information is categorized and tagged.
[0266] Step 5:
[0267] The server creates an asset information dashboard for the user based on the information stored in the database. This dashboard is updated in real time to support the user's asset management.
[0268] Step 6:
[0269] The user selects options within the app to configure what information family members can access. This involves setting access permissions, granting family members viewing or editing permissions.
[0270] Step 7:
[0271] The terminal sends data on the configured access permissions to the server, which stores this information in a database. This enables access control according to user-specified conditions.
[0272] Step 8:
[0273] The server manages the procedures that follow when a user dies. The server sends notifications via email or SMS to pre-registered family contacts. The notifications include instructions on how to access asset information and an overview of the procedures.
[0274] Step 9:
[0275] When a family member who has received a notification accesses the system, the server analyzes the registered asset information in real time and provides advice and procedures regarding asset management. AI is used to provide specific and effective guidance during this process.
[0276] Step 10:
[0277] The device provides an interface for family members to carry out procedures based on the advice provided as needed. Families can use the system to perform the actual procedures and continue to manage their assets with peace of mind.
[0278] (Example 1)
[0279] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0280] In modern society, as the types and amounts of personal assets increase, it is difficult for users to efficiently manage their insurance contracts, financial assets, and investment information. Also, when a user suddenly dies, it is an issue for the family to smoothly inherit and appropriately manage that information. In particular, in terms of aspects such as information security, management of access rights, and provision of advice on real-time asset management, the prior art has not been able to provide sufficient countermeasures.
[0281] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 1 is realized by the following respective means.
[0282] In this invention, the server includes a computing device for providing an intuitive interface for information input, means for temporarily storing the information collected by the computing device, securely encrypting it, and transmitting it via a communication path, and information processing means for analyzing the decrypted information and efficiently storing it in a database. Thereby, the user can intuitively input information, transmit it to the server while maintaining the security of the information, and efficiently store it in the database through the analysis processing as needed. Also, setting appropriate access rights for the family and providing real-time advice regarding asset management are realized, and even when the user dies, the family can smoothly manage the assets.
[0283] The "intuitive interface for information input" is a user interface designed so that users can simply and efficiently input insurance contracts, financial assets, and investment information.
[0284] The "computing device" is an electronic device having a function of processing and temporarily storing data input from a user.
[0285] "Encryption" is a process of converting data using a certain algorithm to protect the user's personal information and asset information from third parties.
[0286] A "communication path" is an information transmission path on a network used to securely transmit data from a terminal to a server.
[0287] "Information processing means" is a technology that analyzes the decrypted data and performs a series of processes to appropriately store it in a database.
[0288] A "database" is an information management system that stores information in a structured form and enables efficient management and retrieval.
[0289] "Access authority" is the setting of permissions and restrictions for information held by a specific user or group.
[0290] "Notification means" is a method or device for transmitting information to a designated recipient when a specific event occurs.
[0291] "Support design means" is a designed method or technology for analyzing information and providing necessary support and advice to users.
[0292] This invention is a system that supports a user in efficiently managing their insurance contracts, financial assets, and investment information, and enables family members to appropriately inherit this information. The system is composed of a user terminal and a server. The user inputs information using a dedicated application with an intuitive interface. When the user inputs information, the terminal temporarily stores it, uses encryption technology such as AES to ensure security, and transmits it to the server via the SSL / TLS protocol.
[0293] The server decrypts the received data and efficiently stores it in the database using information processing means. Specifically, it categorizes the data and converts the format as necessary to facilitate later data search and retrieval. Next, the user sets the access authority for family members and transmits this to the server through the terminal. The server stores this information in the database for use when family members access the information at a later date.
[0294] For example, if a user manages vehicle insurance, bank account information, or investment trusts for seniors, all of this information is securely stored on the server, allowing family members to quickly access and address the situation in an emergency. The notification function ensures that when news of a user's death is confirmed, a notification is sent to pre-designated family members, allowing them to quickly access the necessary information.
[0295] An example of a prompt message might be: "Please describe in detail the process by which, after the user enters their car insurance information into the terminal, that information is securely transmitted to and stored on the server."
[0296] In this way, users' families can manage their assets smoothly even in unexpected situations and continue living with peace of mind.
[0297] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0298] Step 1:
[0299] The user launches a dedicated application and enters insurance contract information, financial asset information, and investment information. This information includes policy number, asset type, and investment risk level. This allows the user to provide specific asset information to the system.
[0300] Step 2:
[0301] The terminal temporarily stores information entered by the user. This stored data is encrypted using AES encryption technology. For example, entered asset information is encoded using a key and converted into a secure state. This ensures that the data is secure and ready for transmission to external parties.
[0302] Step 3:
[0303] The terminal sends the encrypted data to the server via the SSL / TLS protocol. At this time, multiple layers of security are implemented to reduce the risk of information being intercepted on the communication path. For example, data packets are encrypted and recorded in the transmission log.
[0304] Step 4:
[0305] The server receives the encrypted data sent from the terminal and decrypts it. Through decryption, the asset information originally input by the user is decoded and prepared for processing in the next step.
[0306] Step 5:
[0307] The server analyzes the decrypted information and stores it in the database. The analysis includes categorizing the information (e.g., insurance, deposit, investment) and converting the format (e.g., converting to a table format). This facilitates subsequent information search and retrieval.
[0308] Step 6:
[0309] The user sets the scope and level of information that family members can access through the system. Specifically, access rights are set, for example, granting family members permission to view specific asset information. This establishes a system that enables family members to smoothly inherit information upon the user's death.
[0310] Step 7:
[0311] The terminal sends the access rights set by the user to the server. The server saves this information in the database for use when family members retrieve information in the future.
[0312] Step 8:
[0313] When a user's death is confirmed, the server sends a notification to pre-registered family members. This notification is sent via a designated communication method (e.g., email or SMS), and the family members access the system based on that notification.
[0314] Step 9:
[0315] The server provides real-time advice and procedural support regarding asset management to family members who access it, if necessary. It can also refer to past data and present future management plans. This allows family members to manage and operate the assets left behind by their parents with peace of mind.
[0316] (Application Example 1)
[0317] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0318] The challenge lies in efficiently and securely managing important asset data such as insurance policies, financial assets, and investment information held by users, and in smoothly transferring and managing this data when life events occur. Furthermore, there is a need to provide a system that allows families to accurately understand the asset situation and receive guidance for appropriate management and investment.
[0319] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0320] In this invention, the server includes information input means, information management means, permission setting means, information provision means, assistance means, monitoring means, and notification generation means. This enables the secure management of users' asset information and allows for the rapid and appropriate transfer of information and asset management by family members.
[0321] "Information input means" refers to a device or software for users to input data, including insurance contract information, financial asset information, and investment information, into a system.
[0322] "Information management means" refers to a device or software that has the function of centrally organizing input information and storing it in a storage device.
[0323] A "permission setting device" is a device or software that has the function of setting access privileges for information for family members designated by the user.
[0324] "Information provision means" refers to a device or software that has the function of notifying a designated recipient of necessary information upon the death of a user.
[0325] "Means of assistance" refers to a device or software that has the function of providing immediate advice on asset management to a family member who has been notified.
[0326] "Monitoring means" refers to a device or software that has the function of continuously monitoring the user's electronic asset status and detecting changes.
[0327] A "notification generation means" is a device or software that has the function of creating notifications for family members in accordance with pre-set life events.
[0328] The system implementing this invention consists of a user terminal, a server, and an associated database. The user inputs insurance contract information, financial asset information, and investment information through an application on the terminal. During information input, the information is securely transmitted to the server using the SSL / TLS protocol. The server centrally manages the received information and stores it encrypted on cloud storage. This prevents information leakage and allows for secure and efficient data management.
[0329] The device also provides an interface for setting access permissions for family members. Users can use this interface to specify access levels for each family member. This configuration information is also sent to the server and securely managed in a database.
[0330] When a user's life event, such as death, is confirmed, the server uses a pre-registered list of recipients to notify designated family members using various information delivery methods. These notifications are sent via email or SMS. A notification generation program developed in Python or similar languages is used in this process.
[0331] Furthermore, as a means of assistance, a generative AI model installed on the server generates asset management advice for families in real time. This model analyzes the user's asset data and proposes an appropriate action plan.
[0332] For example, if a user dies suddenly in an accident, this system instantly provides the surviving family with detailed guidelines regarding the user's savings and insurance claim procedures. This allows the family to take swift action.
[0333] An example of a prompt message is as follows: "We are developing an application that provides real-time, rapid, and accurate asset management advice to families in a system that notifies them after a user's death. Please combine data analysis based on user input information with a function to set access permissions for family members."
[0334] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0335] Step 1:
[0336] Users enter insurance policy information, financial asset information, and investment information using an application on their device. This entered data is encrypted on the device using the SSL / TLS protocol. The input is direct data from the user's actions, while the output is encrypted data. This ensures that the data is ready to be securely transmitted to the server.
[0337] Step 2:
[0338] The terminal sends encrypted data to the server. The server receives this data, decrypts it, and then forwards it to the information management system. The input is the received encrypted data, and the output is the decrypted raw data. The server centrally manages this data and stores it in cloud storage. This ensures centralized availability of the data.
[0339] Step 3:
[0340] Users utilize an interface via their device to set access permissions for each family member. The device inputs user-specified access requirements, and the output is access permission setting data sent to the server. The server analyzes this data and records it in a database. As a result, access to asset information is restricted to the user's family.
[0341] Step 4:
[0342] When a life event such as a user's death occurs, the server sends a notification to pre-registered recipients. The input is the trigger information for the life event, and the output is the notification message to the recipients. The server uses Python to generate the notification during this process and sends the information via email or SMS.
[0343] Step 5:
[0344] Finally, a server-based AI model provides asset management advice to the family. The input is the user's asset data and related information, and the output is an advisory message as guidance. This model analyzes the user's financial situation and proposes an optimal action plan for the family. This enables the family to manage their assets quickly and appropriately.
[0345] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0346] This invention adds an emotion engine that recognizes and responds to user emotions to a system that efficiently manages user asset information and provides advice as needed. This system consists of a terminal, a server, and a user, and the emotion engine plays a central role in the entire system.
[0347] Users input insurance policies, financial assets, and investment information using a dedicated application. The emotion engine analyzes the user's emotions during this process. For example, it can detect stress levels and anxiety using the user's tone of voice, input speed, and facial expressions. The device temporarily stores this emotional data and sends it to a server.
[0348] The server combines and analyzes the received emotional data and asset information data. This analysis is stored in a database and used to dynamically adjust how asset information is displayed and the content of advice based on the user's emotional state.
[0349] Next, the user sets the scope of asset information that family members can access within the application. The emotion engine also evaluates the user's emotions during the setup process and provides guidance to reduce stress. For example, if the user shows anxiety, it provides detailed explanations and additional support information to reassure them.
[0350] If a user dies, the server sends a notification to the family, optimized by an emotion engine. The content and timing of this notification are optimized considering the family's situation. For example, the emotion engine selects language and content that is easy for the family to accept and sends the notification. Upon receiving the notification, the family can access the system with appropriate permissions and check the asset information.
[0351] When family members access their asset information, the server provides real-time advice on specific action plans and asset management procedures based on data obtained using an emotion engine. This allows families to confidently take appropriate action even when faced with unexpected situations.
[0352] For example, if a user manages a large life insurance policy and multiple investment trusts, the emotional engine understands the importance of this information and provides detailed yet concise instructions to ensure the family can proceed without stress. The system's dynamic response, based on the user's emotional state and the family's reactions, is a key feature and unique aspect of this system.
[0353] Thus, according to the present invention, flexible and efficient asset management that responds to the emotional needs of the user and their family becomes possible, minimizing anxiety and stress.
[0354] The following describes the processing flow.
[0355] Step 1:
[0356] Users input asset information through a dedicated application. During the input process, the application captures the user's facial expressions and voice data in preparation for analysis by an emotion engine.
[0357] Step 2:
[0358] The terminal temporarily stores the entered asset information and acquired sentiment data, and verifies that the data is complete and accurate. It then prepares to encrypt and send the data to the server.
[0359] Step 3:
[0360] The server processes received asset information and sentiment data and stores it in a database. Simultaneously, the sentiment engine analyzes the user's emotional state.
[0361] Step 4:
[0362] The server customizes the user's asset information dashboard based on the analysis results of the emotion engine. This adapts the way and order in which information is presented to the user's mental state.
[0363] Step 5:
[0364] Users set access permissions for their family members' asset information. The emotion engine evaluates the user's emotions during the setup process and adaptively displays supportive messages to reduce stress.
[0365] Step 6:
[0366] The server stores the configured access permissions in a database, preparing the family to access the information they need.
[0367] Step 7:
[0368] If a user dies, the server notifies the family through a pre-configured method. An emotion engine adjusts the notification content to a format that is more acceptable to the family.
[0369] Step 8:
[0370] After receiving a notification, the family accesses the system. The server uses an emotion engine to assess the family's emotional state and provides support accordingly.
[0371] Step 9:
[0372] The server provides real-time, specific advice and procedures regarding asset management, tailored to each family member's access. It also considers emotional data to facilitate the most appropriate responses for each family member.
[0373] (Example 2)
[0374] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0375] Traditional asset management systems provide uniform asset information and notifications without considering the user's emotional state, which has the drawback of failing to adequately alleviate the anxiety and stress experienced by users and their families. Furthermore, they make it difficult to respond quickly and appropriately to asset management needs in emergencies or critical situations.
[0376] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0377] In this invention, the server includes: an emotion analysis means that dynamically adjusts the display method and advice content of asset information based on the user's emotional state; an information generation means that analyzes the user's emotional data and asset information and provides real-time guidance on asset management when a family member accesses it; and a notification generation means that adjusts the content of notifications and transmits information to family members who have been granted access by an access setting means. This enables flexible and appropriate asset management that meets the emotional needs of the user and their family.
[0378] "Information input means" refers to a device or software that has the function of allowing users to input insurance contract information, financial asset information, and investment information.
[0379] "Information management means" refers to a device or system that has the function of centrally managing information entered by information input means and storing it in a storage device.
[0380] A "permission setting means" is a device or system that has the function of setting access permissions for asset information to family members designated by the user, based on information managed by an information management means.
[0381] "Emotional analysis means" refers to a device or system that has the function of dynamically adjusting the display method of asset information and the content of advice based on the user's emotional state.
[0382] A "guidance generation means" is a device or system that analyzes user emotion data and asset information and has the function of providing real-time guidance on asset management when family members access it.
[0383] A "notification generation means" is a device or system that has the function of adjusting the content of notifications and transmitting information to family members whose permissions have been set by the permission setting means.
[0384] This invention is a system for efficiently managing users' assets and dynamically providing information while taking into account the user's emotional state. The system mainly consists of a server, terminals, and users.
[0385] Users can input their insurance policy information, financial asset information, and investment information using a dedicated application on their device. As users input this information, the device uses sensors to detect their voice tone, input speed, and facial expressions, acquiring this data as emotional data. This allows the system to detect the user's stress levels and anxiety. This emotional data is temporarily stored and then transmitted to a server.
[0386] The server analyzes the received sentiment data and asset information using a generative AI model. The generative AI model processes the information using prompt statements. For example, a prompt statement such as "Suggest the optimal way to display asset information based on the user's emotional state" is used. Based on this analysis, the server dynamically adjusts the way asset information is displayed and the content of the advice to suit the user.
[0387] Furthermore, users can set the scope of asset information that family members can view from their device. The emotion engine operates throughout this configuration process, monitoring the user's emotions and providing additional support as needed.
[0388] If a user dies, the server uses a notification generation mechanism to send a notification to the family that is tailored based on emotional data. The family can access the system via a device to check asset information. The server provides real-time guidance on specific action plans and procedures regarding asset management, taking into account the family's emotional state.
[0389] For example, if a user manages a large life insurance policy and multiple investment trusts, the emotional engine understands the importance of this information and provides detailed yet concise instructions so that family members can proceed without stress. This system's dynamic response, based on the user's emotional state and family reactions, is a key feature supporting asset management.
[0390] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0391] Step 1:
[0392] Users input insurance contract information, financial asset information, and investment information using a dedicated application on the terminal. The entered data is aggregated by the terminal and stored in digital format. The terminal uses sensors to detect the user's voice tone and input speed during input, and acquires this as emotional data. The input data and emotional data are temporarily stored as output of the initial processing.
[0393] Step 2:
[0394] The terminal sends stored information input data and emotional data to the server. The server receives this data and first verifies the integrity of the data format. Next, it inputs the emotional data into a generating AI model and performs data analysis to identify the user's emotional state (e.g., stress, anxiety). The results of this analysis are saved in a database in preparation for the next processing step.
[0395] Step 3:
[0396] The server uses a generative AI model to adjust how asset information is displayed and what advice is provided based on the emotional state obtained in the previous step. An example of a prompt is, "Please suggest the best way to display asset information based on the user's emotional state." The analysis and adjustment results are sent from the server to the terminal and displayed to the user.
[0397] Step 4:
[0398] Users can set the scope of asset information that family members can view through their device. During this process, the device monitors the user's behavior and facial expressions again, updating emotional data. The server receives this data and, if necessary, provides the device with guidance on settings and reassuring details.
[0399] Step 5:
[0400] If a user's death is confirmed, the server uses a notification generation mechanism to create a notification for the family. The content of the notification is adjusted to match the family's acceptable communication style, as analyzed by the emotion engine. The final adjusted notification is then sent to the family via the device.
[0401] Step 6:
[0402] When family members access asset information using their devices, the server performs real-time sentiment analysis and provides specific action plans and procedures for asset management. Using a generative AI model, the server generates optimized steps based on the prompt "Generate the optimal action plan based on the user's emotional state" and sends them to the device. This allows family members to receive appropriate information and proceed with confidence.
[0403] (Application Example 2)
[0404] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0405] Traditional asset information management systems often focused solely on data entry and management, without considering the user's emotional state, which could cause stress for users and their families. Especially as the importance of asset information and the complexity of procedures increase, consideration is needed to alleviate the anxiety and confusion of users and their relatives. However, traditional systems that ignored emotions were unable to address these issues and failed to provide a satisfactory user experience.
[0406] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0407] In this invention, the server includes input means for inputting user contract information, asset information, and financial information; management means for centrally managing the data input by the input means and storing it in a storage device; and emotion analysis means for analyzing the user's voice tone and facial expressions and recognizing their emotional state. This enables the display of information and advice tailored to the user's emotional state.
[0408] "User" refers to an individual or organization that inputs and manages asset information.
[0409] "Contract information" refers to information related to insurance contracts and financial contracts.
[0410] "Asset information" refers to information about financial assets held and investment details.
[0411] "Financial information" refers to all information related to economic activity.
[0412] "Input means" refers to methods or devices that allow users to register data in a system.
[0413] "Management means" refers to the function of handling input information centrally and storing it in a memory device.
[0414] A "storage device" refers to a device used to store data for a long period of time.
[0415] "Relatives" refers to family members or equivalent individuals designated by the user.
[0416] "Information" refers to data or facts about a specific subject.
[0417] "Access permissions" refer to the scope of permission to view or manipulate specific information.
[0418] "Configuration means" refers to methods or devices for specifying or changing permissions and conditions.
[0419] "Absence" refers to a state in which the user is unable to operate the system due to death or other reasons.
[0420] "Notification means" refers to a function that informs relatives of changes in the user's status or information.
[0421] "Support measures" refer to methods and devices for providing necessary advice and support to relatives.
[0422] "Voice tone" refers to the pitch and intonation of a speaker's voice.
[0423] "Facial expression" refers to the state of emotion expressed through the muscles of the face.
[0424] "Emotional state" refers to the type and intensity of the user's emotions.
[0425] "Emotional analysis methods" refer to technologies and devices used to identify emotions through voice and facial expressions.
[0426] "Display" refers to presenting information in a visible form through a screen or other means.
[0427] "Advice" refers to suggestions given regarding specific actions or decisions.
[0428] The system realizing this invention includes an input means for the user to input insurance contracts, financial assets, and investment information. The terminal centrally manages the input information and stores it in a storage device through a management means, ensuring secure data storage. This management means also includes a setting means for setting access permissions as needed for relatives designated by the user.
[0429] The server has a notification system to alert relatives when the user is absent, and a support system to provide real-time advice on asset management to the notified relatives. This support system presents the necessary procedures and action plans based on the user's asset information, enabling relatives to take appropriate action.
[0430] Furthermore, emotion analysis techniques are used to analyze and recognize the user's voice tone and facial expressions to identify their emotional state. The emotion analysis utilizes the smartphone's camera and microphone, and employs software such as OpenCV and TensorFlow. This data functions as an emotion engine, dynamically adjusting the displayed information and advice based on the user's emotions. This allows users to manage their assets with confidence.
[0431] As a specific example of its use, when a user registers for a life insurance contract or investment trust, if sentiment analysis detects anxiety during the process, the system will display messages providing additional information to alleviate concerns and quick access to support.
[0432] Using a generative AI model, the following prompt sentences can be generated:
[0433] "When users enter their financial information, analyze their tone of voice and facial expressions, and present them with messages that promote relaxation and reassurance."
[0434] This allows for asset management that takes into account the user's emotional needs, thereby reducing stress.
[0435] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0436] Step 1:
[0437] Users input contract information, asset information, and financial information using their smartphones. The entered data is temporarily stored using the device's input method. Input at this stage can be done via voice or manual input. The user's voice tone and input speed are also recorded simultaneously during input.
[0438] Step 2:
[0439] The terminal transfers the input data to a management system and stores it in a storage device for centralized management. At this stage, the input data is formatted to match the data format and encrypted for security purposes. The output is structured data placed in a database.
[0440] Step 3:
[0441] The device uses emotion analysis to collect stored voice tone and input speed data, as well as facial expression data acquired from the camera. Using OpenCV and TensorFlow, this data is analyzed to identify the user's emotional state. This process yields numerical data as an emotion score.
[0442] Step 4:
[0443] The server receives emotion scores and uses adjustment mechanisms to modify the displayed information and advice content according to the emotional state. It utilizes a generative AI model to generate prompt sentences based on the emotional state, creating messages that provide reassurance to the user.
[0444] Step 5:
[0445] The server sends tailored information and prompts to the terminal, displaying them in a format optimized for the user. The user receives this message and, if necessary, has options to seek further support. A user-friendly interface is provided for this display.
[0446] Step 6:
[0447] If a user becomes unavailable, the server will use a notification system to notify designated relatives. The content and timing of the notification are determined based on sentiment analysis to ensure that relatives are likely to receive it. The output is a thoughtful notification message displayed on the relative's device.
[0448] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0449] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0450] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0451] [Third Embodiment]
[0452] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0453] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0454] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0455] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0456] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0457] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0458] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0459] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0460] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0461] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0462] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0463] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0464] This invention is a system that helps users efficiently manage their insurance policies, financial assets, and investment information, and to ensure that their families can properly inherit this information. The system consists of terminals, a server, and users.
[0465] Users input insurance contracts, financial assets, investment information, and other data using a dedicated application. This application has an intuitive interface and is designed to allow users to easily input complex information.
[0466] The terminal temporarily stores the user's input information, encrypts it, and sends it to the server. The key here is data security, and the terminal ensures communication security through protocols such as SSL.
[0467] The server analyzes the received data and stores it in the database. This analysis involves categorizing the information and converting it to the correct format as needed, enabling smooth data retrieval and searching later on.
[0468] Next, the user sets the scope and level of information that family members can access within the system. This includes specifying access permissions for individual members of the family. The terminal sends this access permission information to the server, which stores it in a database.
[0469] When a user's death is confirmed, the server notifies pre-registered family members. This notification is sent via pre-configured email or SMS. Upon receiving the notification, family members can access the system and access the specified asset information.
[0470] The server analyzes information based on family access and provides real-time advice on asset management and instructions for necessary procedures. This allows families to manage their assets with peace of mind, even in unexpected situations.
[0471] As a concrete example, in a case where a user manages car insurance, savings, and investment trusts for seniors, all of this information is organized on a server, and a system is in place that allows family members to instantly check the contents and proceed with the necessary procedures.
[0472] A key feature of this invention is that it allows users' families to prepare for unexpected events and manage their assets peacefully and efficiently.
[0473] The following describes the processing flow.
[0474] Step 1:
[0475] Users launch a dedicated application and utilize an interface to input insurance contracts, financial assets, and investment information. Users register detailed data such as contract numbers, financial institution names, and account numbers through this interface.
[0476] Step 2:
[0477] The terminal temporarily stores information entered by the user and prepares it for data transmission. It also has a function to review the input information before transmission and request corrections or supplements from the user as needed.
[0478] Step 3:
[0479] The device encrypts the verified information and securely transmits it to the server. This prevents eavesdropping and tampering with the data in transmission.
[0480] Step 4:
[0481] The server receives the transmitted data and decrypts it. It then converts the data into the appropriate format and stores it in a database. This is where the information is categorized and tagged.
[0482] Step 5:
[0483] The server creates an asset information dashboard for the user based on the information stored in the database. This dashboard is updated in real time to support the user's asset management.
[0484] Step 6:
[0485] The user selects options within the app to configure what information family members can access. This involves setting access permissions, granting family members viewing or editing permissions.
[0486] Step 7:
[0487] The terminal sends data on the configured access permissions to the server, which stores this information in a database. This enables access control according to user-specified conditions.
[0488] Step 8:
[0489] The server manages the procedures that follow when a user dies. The server sends notifications via email or SMS to pre-registered family contacts. The notifications include instructions on how to access asset information and an overview of the procedures.
[0490] Step 9:
[0491] When a family member who has received a notification accesses the system, the server analyzes the registered asset information in real time and provides advice and procedures regarding asset management. AI is used to provide specific and effective guidance during this process.
[0492] Step 10:
[0493] The device provides an interface for family members to carry out procedures based on the advice provided as needed. Families can use the system to perform the actual procedures and continue to manage their assets with peace of mind.
[0494] (Example 1)
[0495] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0496] In modern society, with the increasing variety and volume of personal assets, it is difficult for users to efficiently manage their insurance policies, financial assets, and investment information. Furthermore, ensuring that family members can smoothly inherit and properly manage this information in the event of a user's sudden death is also a challenge. In particular, conventional technologies are insufficient in terms of information security, access rights management, and providing real-time asset management advice.
[0497] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0498] In this invention, the server includes a computing device for providing an intuitive interface for information input, means for temporarily storing information collected by the computing device, securely encrypting it, and transmitting it via a communication path, and information processing means for analyzing the decrypted information and efficiently storing it in a database. This allows users to intuitively input information, transmit it to the server while maintaining its security, and efficiently store it in the database through necessary analysis processing. Furthermore, it enables the setting of appropriate access rights for family members and the provision of real-time advice regarding asset management, allowing family members to smoothly manage assets even after the user's death.
[0499] An "intuitive interface for information input" is a user interface designed to allow users to easily and efficiently input insurance contracts, financial assets, and investment information.
[0500] A "calculating device" is an electronic device that has the function of processing and temporarily storing data entered by a user.
[0501] "Encryption" is the process of transforming data using a specific algorithm in order to protect users' personal information and asset information from third parties.
[0502] A "communication path" is a network path used to securely transmit data from a terminal to a server.
[0503] "Information processing means" refers to a series of processes that analyze decoded data and store it appropriately in a database.
[0504] A "database" is an information management system that stores information in a structured format, enabling efficient management and retrieval.
[0505] "Access permissions" refer to the settings that allow or restrict access to information held by a specific user or group.
[0506] A "notification means" is a method or device for transmitting information to a designated recipient when a specific event occurs.
[0507] "Support design tools" are methods and techniques designed to analyze information and provide users with the necessary support and advice.
[0508] This invention is a system that helps users efficiently manage their insurance policies, financial assets, and investment information, and to ensure that their families can properly inherit this information. The system consists of a user terminal and a server. Users input information using a dedicated application with an intuitive interface. Once the user inputs information, the terminal temporarily stores it and transmits it to the server via the SSL / TLS protocol using encryption technology such as AES to ensure security.
[0509] The server decrypts the received data and efficiently stores it in a database using information processing tools. Specifically, it categorizes the data and converts its format as needed to facilitate later data retrieval and searching. Next, the user sets access permissions for family members and sends this information to the server via their device. The server stores this information in a database and uses it when family members access the information later.
[0510] For example, if a user manages vehicle insurance, bank account information, or investment trusts for seniors, all of this information is securely stored on the server, allowing family members to quickly access and address the situation in an emergency. The notification function ensures that when news of a user's death is confirmed, a notification is sent to pre-designated family members, allowing them to quickly access the necessary information.
[0511] An example of a prompt message might be: "Please describe in detail the process by which, after the user enters their car insurance information into the terminal, that information is securely transmitted to and stored on the server."
[0512] In this way, users' families can manage their assets smoothly even in unexpected situations and continue living with peace of mind.
[0513] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0514] Step 1:
[0515] The user launches a dedicated application and enters insurance contract information, financial asset information, and investment information. This information includes policy number, asset type, and investment risk level. This allows the user to provide specific asset information to the system.
[0516] Step 2:
[0517] The terminal temporarily stores information entered by the user. This stored data is encrypted using AES encryption technology. For example, entered asset information is encoded using a key and converted into a secure state. This ensures that the data is secure and ready for transmission to external parties.
[0518] Step 3:
[0519] The terminal sends encrypted data to the server via the SSL / TLS protocol. To mitigate the risk of information interception during transmission, multiple layers of security are implemented. For example, data packets are encrypted and recorded in the transmission log.
[0520] Step 4:
[0521] The server receives encrypted data sent from the terminal and decrypts it. Decryption allows the server to read the asset information originally entered by the user and prepare it for processing in the next step.
[0522] Step 5:
[0523] The server analyzes the decrypted information and stores it in a database. This analysis includes categorizing the information (e.g., insurance, deposits, investments) and converting it to a different format (e.g., converting it to a tabular format). This facilitates subsequent information retrieval and acquisition.
[0524] Step 6:
[0525] The user sets the scope and level of information that family members can access through the system. Specifically, they can set access permissions, for example, granting family members permission to view specific asset information. This ensures that family members can smoothly take over information upon the user's death.
[0526] Step 7:
[0527] The device sends the user-defined access permissions to the server. The server stores this information in a database for future use by family members when they need to access the information.
[0528] Step 8:
[0529] When a user's death is confirmed, the server sends a notification to pre-registered family members. This notification is sent via a designated communication method (e.g., email or SMS), and the family members access the system based on that notification.
[0530] Step 9:
[0531] The server provides real-time advice and procedural support regarding asset management to family members who access it, if necessary. It can also refer to past data and present future management plans. This allows family members to manage and operate the assets left behind by their parents with peace of mind.
[0532] (Application Example 1)
[0533] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0534] The challenge lies in efficiently and securely managing important asset data such as insurance policies, financial assets, and investment information held by users, and in smoothly transferring and managing this data when life events occur. Furthermore, there is a need to provide a system that allows families to accurately understand the asset situation and receive guidance for appropriate management and investment.
[0535] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0536] In this invention, the server includes information input means, information management means, permission setting means, information provision means, assistance means, monitoring means, and notification generation means. This enables the secure management of users' asset information and allows for the rapid and appropriate transfer of information and asset management by family members.
[0537] "Information input means" refers to a device or software for users to input data, including insurance contract information, financial asset information, and investment information, into a system.
[0538] "Information management means" refers to a device or software that has the function of centrally organizing input information and storing it in a storage device.
[0539] A "permission setting device" is a device or software that has the function of setting access privileges for information for family members designated by the user.
[0540] "Information provision means" refers to a device or software that has the function of notifying a designated recipient of necessary information upon the death of a user.
[0541] "Means of assistance" refers to a device or software that has the function of providing immediate advice on asset management to a family member who has been notified.
[0542] "Monitoring means" refers to a device or software that has the function of continuously monitoring the user's electronic asset status and detecting changes.
[0543] A "notification generation means" is a device or software that has the function of creating notifications for family members in accordance with pre-set life events.
[0544] The system implementing this invention consists of a user terminal, a server, and an associated database. The user inputs insurance contract information, financial asset information, and investment information through an application on the terminal. During information input, the information is securely transmitted to the server using the SSL / TLS protocol. The server centrally manages the received information and stores it encrypted on cloud storage. This prevents information leakage and allows for secure and efficient data management.
[0545] The device also provides an interface for setting access permissions for family members. Users can use this interface to specify access levels for each family member. This configuration information is also sent to the server and securely managed in a database.
[0546] When a user's life event, such as death, is confirmed, the server uses a pre-registered list of recipients to notify designated family members using various information delivery methods. These notifications are sent via email or SMS. A notification generation program developed in Python or similar languages is used in this process.
[0547] Furthermore, as a means of assistance, a generative AI model installed on the server generates asset management advice for families in real time. This model analyzes the user's asset data and proposes an appropriate action plan.
[0548] For example, if a user dies suddenly in an accident, this system instantly provides the surviving family with detailed guidelines regarding the user's savings and insurance claim procedures. This allows the family to take swift action.
[0549] An example of a prompt message is as follows: "We are developing an application that provides real-time, rapid, and accurate asset management advice to families in a system that notifies them after a user's death. Please combine data analysis based on user input information with a function to set access permissions for family members."
[0550] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0551] Step 1:
[0552] Users enter insurance policy information, financial asset information, and investment information using an application on their device. This entered data is encrypted on the device using the SSL / TLS protocol. The input is direct data from the user's actions, while the output is encrypted data. This ensures that the data is ready to be securely transmitted to the server.
[0553] Step 2:
[0554] The terminal sends encrypted data to the server. The server receives this data, decrypts it, and then forwards it to the information management system. The input is the received encrypted data, and the output is the decrypted raw data. The server centrally manages this data and stores it in cloud storage. This ensures centralized availability of the data.
[0555] Step 3:
[0556] Users utilize an interface via their device to set access permissions for each family member. The device inputs user-specified access requirements, and the output is access permission setting data sent to the server. The server analyzes this data and records it in a database. As a result, access to asset information is restricted to the user's family.
[0557] Step 4:
[0558] When a life event such as a user's death occurs, the server sends a notification to pre-registered recipients. The input is the trigger information for the life event, and the output is the notification message to the recipients. The server uses Python to generate the notification during this process and sends the information via email or SMS.
[0559] Step 5:
[0560] Finally, a server-based AI model provides asset management advice to the family. The input is the user's asset data and related information, and the output is an advisory message as guidance. This model analyzes the user's financial situation and proposes an optimal action plan for the family. This enables the family to manage their assets quickly and appropriately.
[0561] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0562] This invention adds an emotion engine that recognizes and responds to user emotions to a system that efficiently manages user asset information and provides advice as needed. This system consists of a terminal, a server, and a user, and the emotion engine plays a central role in the entire system.
[0563] Users input insurance policies, financial assets, and investment information using a dedicated application. The emotion engine analyzes the user's emotions during this process. For example, it can detect stress levels and anxiety using the user's tone of voice, input speed, and facial expressions. The device temporarily stores this emotional data and sends it to a server.
[0564] The server combines and analyzes the received emotional data and asset information data. This analysis is stored in a database and used to dynamically adjust how asset information is displayed and the content of advice based on the user's emotional state.
[0565] Next, the user sets the scope of asset information that family members can access within the application. The emotion engine also evaluates the user's emotions during the setup process and provides guidance to reduce stress. For example, if the user shows anxiety, it provides detailed explanations and additional support information to reassure them.
[0566] If a user dies, the server sends a notification to the family, optimized by an emotion engine. The content and timing of this notification are optimized considering the family's situation. For example, the emotion engine selects language and content that is easy for the family to accept and sends the notification. Upon receiving the notification, the family can access the system with appropriate permissions and check the asset information.
[0567] When family members access their asset information, the server provides real-time advice on specific action plans and asset management procedures based on data obtained using an emotion engine. This allows families to confidently take appropriate action even when faced with unexpected situations.
[0568] For example, if a user manages a large life insurance policy and multiple investment trusts, the emotional engine understands the importance of this information and provides detailed yet concise instructions to ensure the family can proceed without stress. The system's dynamic response, based on the user's emotional state and the family's reactions, is a key feature and unique aspect of this system.
[0569] Thus, according to the present invention, flexible and efficient asset management that responds to the emotional needs of the user and their family becomes possible, minimizing anxiety and stress.
[0570] The following describes the processing flow.
[0571] Step 1:
[0572] Users input asset information through a dedicated application. During the input process, the application captures the user's facial expressions and voice data in preparation for analysis by an emotion engine.
[0573] Step 2:
[0574] The terminal temporarily stores the entered asset information and acquired sentiment data, and verifies that the data is complete and accurate. It then prepares to encrypt and send the data to the server.
[0575] Step 3:
[0576] The server processes received asset information and sentiment data and stores it in a database. Simultaneously, the sentiment engine analyzes the user's emotional state.
[0577] Step 4:
[0578] The server customizes the user's asset information dashboard based on the analysis results of the emotion engine. This adapts the way and order in which information is presented to the user's mental state.
[0579] Step 5:
[0580] Users set access permissions for their family members' asset information. The emotion engine evaluates the user's emotions during the setup process and adaptively displays supportive messages to reduce stress.
[0581] Step 6:
[0582] The server stores the configured access permissions in a database, preparing the family to access the information they need.
[0583] Step 7:
[0584] If a user dies, the server notifies the family through a pre-configured method. An emotion engine adjusts the notification content to a format that is more acceptable to the family.
[0585] Step 8:
[0586] After receiving a notification, the family accesses the system. The server uses an emotion engine to assess the family's emotional state and provides support accordingly.
[0587] Step 9:
[0588] The server provides real-time, specific advice and procedures regarding asset management, tailored to each family member's access. It also considers emotional data to facilitate the most appropriate responses for each family member.
[0589] (Example 2)
[0590] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0591] Traditional asset management systems provide uniform asset information and notifications without considering the user's emotional state, which has the drawback of failing to adequately alleviate the anxiety and stress experienced by users and their families. Furthermore, they make it difficult to respond quickly and appropriately to asset management needs in emergencies or critical situations.
[0592] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0593] In this invention, the server includes: an emotion analysis means that dynamically adjusts the display method and advice content of asset information based on the user's emotional state; an information generation means that analyzes the user's emotional data and asset information and provides real-time guidance on asset management when a family member accesses it; and a notification generation means that adjusts the content of notifications and transmits information to family members who have been granted access by an access setting means. This enables flexible and appropriate asset management that meets the emotional needs of the user and their family.
[0594] "Information input means" refers to a device or software that has the function of allowing users to input insurance contract information, financial asset information, and investment information.
[0595] "Information management means" refers to a device or system that has the function of centrally managing information entered by information input means and storing it in a storage device.
[0596] A "permission setting means" is a device or system that has the function of setting access permissions for asset information to family members designated by the user, based on information managed by an information management means.
[0597] "Emotional analysis means" refers to a device or system that has the function of dynamically adjusting the display method of asset information and the content of advice based on the user's emotional state.
[0598] A "guidance generation means" is a device or system that analyzes user emotion data and asset information and has the function of providing real-time guidance on asset management when family members access it.
[0599] A "notification generation means" is a device or system that has the function of adjusting the content of notifications and transmitting information to family members whose permissions have been set by the permission setting means.
[0600] This invention is a system for efficiently managing users' assets and dynamically providing information while taking into account the user's emotional state. The system mainly consists of a server, terminals, and users.
[0601] Users can input their insurance policy information, financial asset information, and investment information using a dedicated application on their device. As users input this information, the device uses sensors to detect their voice tone, input speed, and facial expressions, acquiring this data as emotional data. This allows the system to detect the user's stress levels and anxiety. This emotional data is temporarily stored and then transmitted to a server.
[0602] The server analyzes the received sentiment data and asset information using a generative AI model. The generative AI model processes the information using prompt statements. For example, a prompt statement such as "Suggest the optimal way to display asset information based on the user's emotional state" is used. Based on this analysis, the server dynamically adjusts the way asset information is displayed and the content of the advice to suit the user.
[0603] Furthermore, users can set the scope of asset information that family members can view from their device. The emotion engine operates throughout this configuration process, monitoring the user's emotions and providing additional support as needed.
[0604] If a user dies, the server uses a notification generation mechanism to send a notification to the family that is tailored based on emotional data. The family can access the system via a device to check asset information. The server provides real-time guidance on specific action plans and procedures regarding asset management, taking into account the family's emotional state.
[0605] For example, if a user manages a large life insurance policy and multiple investment trusts, the emotional engine understands the importance of this information and provides detailed yet concise instructions so that family members can proceed without stress. This system's dynamic response, based on the user's emotional state and family reactions, is a key feature supporting asset management.
[0606] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0607] Step 1:
[0608] Users input insurance contract information, financial asset information, and investment information using a dedicated application on the terminal. The entered data is aggregated by the terminal and stored in digital format. The terminal uses sensors to detect the user's voice tone and input speed during input, and acquires this as emotional data. The input data and emotional data are temporarily stored as output of the initial processing.
[0609] Step 2:
[0610] The terminal sends stored information input data and emotional data to the server. The server receives this data and first verifies the integrity of the data format. Next, it inputs the emotional data into a generating AI model and performs data analysis to identify the user's emotional state (e.g., stress, anxiety). The results of this analysis are saved in a database in preparation for the next processing step.
[0611] Step 3:
[0612] The server uses a generative AI model to adjust how asset information is displayed and what advice is provided based on the emotional state obtained in the previous step. An example of a prompt is, "Please suggest the best way to display asset information based on the user's emotional state." The analysis and adjustment results are sent from the server to the terminal and displayed to the user.
[0613] Step 4:
[0614] Users can set the scope of asset information that family members can view through their device. During this process, the device monitors the user's behavior and facial expressions again, updating emotional data. The server receives this data and, if necessary, provides the device with guidance on settings and reassuring details.
[0615] Step 5:
[0616] If a user's death is confirmed, the server uses a notification generation mechanism to create a notification for the family. The content of the notification is adjusted to match the family's acceptable communication style, as analyzed by the emotion engine. The final adjusted notification is then sent to the family via the device.
[0617] Step 6:
[0618] When family members access asset information using their devices, the server performs real-time sentiment analysis and provides specific action plans and procedures for asset management. Using a generative AI model, the server generates optimized steps based on the prompt "Generate the optimal action plan based on the user's emotional state" and sends them to the device. This allows family members to receive appropriate information and proceed with confidence.
[0619] (Application Example 2)
[0620] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0621] Traditional asset information management systems often focused solely on data entry and management, without considering the user's emotional state, which could cause stress for users and their families. Especially as the importance of asset information and the complexity of procedures increase, consideration is needed to alleviate the anxiety and confusion of users and their relatives. However, traditional systems that ignored emotions were unable to address these issues and failed to provide a satisfactory user experience.
[0622] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0623] In this invention, the server includes input means for inputting user contract information, asset information, and financial information; management means for centrally managing the data input by the input means and storing it in a storage device; and emotion analysis means for analyzing the user's voice tone and facial expressions and recognizing their emotional state. This enables the display of information and advice tailored to the user's emotional state.
[0624] "User" refers to an individual or organization that inputs and manages asset information.
[0625] "Contract information" refers to information related to insurance contracts and financial contracts.
[0626] "Asset information" refers to information about financial assets held and investment details.
[0627] "Financial information" refers to all information related to economic activity.
[0628] "Input means" refers to methods or devices that allow users to register data in a system.
[0629] "Management means" refers to the function of handling input information centrally and storing it in a memory device.
[0630] A "storage device" refers to a device used to store data for a long period of time.
[0631] "Relatives" refers to family members or equivalent individuals designated by the user.
[0632] "Information" refers to data or facts about a specific subject.
[0633] "Access permissions" refer to the scope of permission to view or manipulate specific information.
[0634] "Configuration means" refers to methods or devices for specifying or changing permissions and conditions.
[0635] "Absence" refers to a state in which the user is unable to operate the system due to death or other reasons.
[0636] "Notification means" refers to a function that informs relatives of changes in the user's status or information.
[0637] "Support measures" refer to methods and devices for providing necessary advice and support to relatives.
[0638] "Voice tone" refers to the pitch and intonation of a speaker's voice.
[0639] "Facial expression" refers to the state of emotion expressed through the muscles of the face.
[0640] "Emotional state" refers to the type and intensity of the user's emotions.
[0641] "Emotional analysis methods" refer to technologies and devices used to identify emotions through voice and facial expressions.
[0642] "Display" refers to presenting information in a visible form through a screen or other means.
[0643] "Advice" refers to suggestions given regarding specific actions or decisions.
[0644] The system realizing this invention includes an input means for the user to input insurance contracts, financial assets, and investment information. The terminal centrally manages the input information and stores it in a storage device through a management means, ensuring secure data storage. This management means also includes a setting means for setting access permissions as needed for relatives designated by the user.
[0645] The server has a notification system to alert relatives when the user is absent, and a support system to provide real-time advice on asset management to the notified relatives. This support system presents the necessary procedures and action plans based on the user's asset information, enabling relatives to take appropriate action.
[0646] Furthermore, emotion analysis techniques are used to analyze and recognize the user's voice tone and facial expressions to identify their emotional state. The emotion analysis utilizes the smartphone's camera and microphone, and employs software such as OpenCV and TensorFlow. This data functions as an emotion engine, dynamically adjusting the displayed information and advice based on the user's emotions. This allows users to manage their assets with confidence.
[0647] As a specific example of its use, when a user registers for a life insurance contract or investment trust, if sentiment analysis detects anxiety during the process, the system will display messages providing additional information to alleviate concerns and quick access to support.
[0648] Using a generative AI model, the following prompt sentences can be generated:
[0649] "When users enter their financial information, analyze their tone of voice and facial expressions, and present them with messages that promote relaxation and reassurance."
[0650] This allows for asset management that takes into account the user's emotional needs, thereby reducing stress.
[0651] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0652] Step 1:
[0653] Users input contract information, asset information, and financial information using their smartphones. The entered data is temporarily stored using the device's input method. Input at this stage can be done via voice or manual input. The user's voice tone and input speed are also recorded simultaneously during input.
[0654] Step 2:
[0655] The terminal transfers the input data to a management system and stores it in a storage device for centralized management. At this stage, the input data is formatted to match the data format and encrypted for security purposes. The output is structured data placed in a database.
[0656] Step 3:
[0657] The device uses emotion analysis to collect stored voice tone and input speed data, as well as facial expression data acquired from the camera. Using OpenCV and TensorFlow, this data is analyzed to identify the user's emotional state. This process yields numerical data as an emotion score.
[0658] Step 4:
[0659] The server receives emotion scores and uses adjustment mechanisms to modify the displayed information and advice content according to the emotional state. It utilizes a generative AI model to generate prompt sentences based on the emotional state, creating messages that provide reassurance to the user.
[0660] Step 5:
[0661] The server sends tailored information and prompts to the terminal, displaying them in a format optimized for the user. The user receives this message and, if necessary, has options to seek further support. A user-friendly interface is provided for this display.
[0662] Step 6:
[0663] If a user becomes unavailable, the server will use a notification system to notify designated relatives. The content and timing of the notification are determined based on sentiment analysis to ensure that relatives are likely to receive it. The output is a thoughtful notification message displayed on the relative's device.
[0664] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0665] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0666] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[0667] [Fourth Embodiment]
[0668] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[0669] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0670] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0671] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[0672] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0673] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0674] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0675] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[0676] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0677] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0678] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0679] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0680] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0681] This invention is a system that helps users efficiently manage their insurance policies, financial assets, and investment information, and to ensure that their families can properly inherit this information. The system consists of terminals, a server, and users.
[0682] Users input insurance contracts, financial assets, investment information, and other data using a dedicated application. This application has an intuitive interface and is designed to allow users to easily input complex information.
[0683] The terminal temporarily stores the user's input information, encrypts it, and sends it to the server. The key here is data security, and the terminal ensures communication security through protocols such as SSL.
[0684] The server analyzes the received data and stores it in the database. This analysis involves categorizing the information and converting it to the correct format as needed, enabling smooth data retrieval and searching later on.
[0685] Next, the user sets the scope and level of information that family members can access within the system. This includes specifying access permissions for individual members of the family. The terminal sends this access permission information to the server, which stores it in a database.
[0686] When a user's death is confirmed, the server notifies pre-registered family members. This notification is sent via pre-configured email or SMS. Upon receiving the notification, family members can access the system and access the specified asset information.
[0687] The server analyzes information based on family access and provides real-time advice on asset management and instructions for necessary procedures. This allows families to manage their assets with peace of mind, even in unexpected situations.
[0688] As a concrete example, in a case where a user manages car insurance, savings, and investment trusts for seniors, all of this information is organized on a server, and a system is in place that allows family members to instantly check the contents and proceed with the necessary procedures.
[0689] A key feature of this invention is that it allows users' families to prepare for unexpected events and manage their assets peacefully and efficiently.
[0690] The following describes the processing flow.
[0691] Step 1:
[0692] Users launch a dedicated application and utilize an interface to input insurance contracts, financial assets, and investment information. Users register detailed data such as contract numbers, financial institution names, and account numbers through this interface.
[0693] Step 2:
[0694] The terminal temporarily stores information entered by the user and prepares it for data transmission. It also has a function to review the input information before transmission and request corrections or supplements from the user as needed.
[0695] Step 3:
[0696] The device encrypts the verified information and securely transmits it to the server. This prevents eavesdropping and tampering with the data in transmission.
[0697] Step 4:
[0698] The server receives the transmitted data and decrypts it. It then converts the data into the appropriate format and stores it in a database. This is where the information is categorized and tagged.
[0699] Step 5:
[0700] The server creates an asset information dashboard for the user based on the information stored in the database. This dashboard is updated in real time to support the user's asset management.
[0701] Step 6:
[0702] The user selects options within the app to configure what information family members can access. This involves setting access permissions, granting family members viewing or editing permissions.
[0703] Step 7:
[0704] The terminal sends data on the configured access permissions to the server, which stores this information in a database. This enables access control according to user-specified conditions.
[0705] Step 8:
[0706] The server manages the procedures that follow when a user dies. The server sends notifications via email or SMS to pre-registered family contacts. The notifications include instructions on how to access asset information and an overview of the procedures.
[0707] Step 9:
[0708] When a family member who has received a notification accesses the system, the server analyzes the registered asset information in real time and provides advice and procedures regarding asset management. AI is used to provide specific and effective guidance during this process.
[0709] Step 10:
[0710] The device provides an interface for family members to carry out procedures based on the advice provided as needed. Families can use the system to perform the actual procedures and continue to manage their assets with peace of mind.
[0711] (Example 1)
[0712] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0713] In modern society, with the increasing variety and volume of personal assets, it is difficult for users to efficiently manage their insurance policies, financial assets, and investment information. Furthermore, ensuring that family members can smoothly inherit and properly manage this information in the event of a user's sudden death is also a challenge. In particular, conventional technologies are insufficient in terms of information security, access rights management, and providing real-time asset management advice.
[0714] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0715] In this invention, the server includes a computing device for providing an intuitive interface for information input, means for temporarily storing information collected by the computing device, securely encrypting it, and transmitting it via a communication path, and information processing means for analyzing the decrypted information and efficiently storing it in a database. This allows users to intuitively input information, transmit it to the server while maintaining its security, and efficiently store it in the database through necessary analysis processing. Furthermore, it enables the setting of appropriate access rights for family members and the provision of real-time advice regarding asset management, allowing family members to smoothly manage assets even after the user's death.
[0716] An "intuitive interface for information input" is a user interface designed to allow users to easily and efficiently input insurance contracts, financial assets, and investment information.
[0717] A "calculating device" is an electronic device that has the function of processing and temporarily storing data entered by a user.
[0718] "Encryption" is the process of transforming data using a specific algorithm in order to protect users' personal information and asset information from third parties.
[0719] A "communication path" is a network path used to securely transmit data from a terminal to a server.
[0720] "Information processing means" refers to a series of processes that analyze decoded data and store it appropriately in a database.
[0721] A "database" is an information management system that stores information in a structured format, enabling efficient management and retrieval.
[0722] "Access permissions" refer to the settings that allow or restrict access to information held by a specific user or group.
[0723] A "notification means" is a method or device for transmitting information to a designated recipient when a specific event occurs.
[0724] "Support design tools" are methods and techniques designed to analyze information and provide users with the necessary support and advice.
[0725] This invention is a system that helps users efficiently manage their insurance policies, financial assets, and investment information, and to ensure that their families can properly inherit this information. The system consists of a user terminal and a server. Users input information using a dedicated application with an intuitive interface. Once the user inputs information, the terminal temporarily stores it and transmits it to the server via the SSL / TLS protocol using encryption technology such as AES to ensure security.
[0726] The server decrypts the received data and efficiently stores it in a database using information processing tools. Specifically, it categorizes the data and converts its format as needed to facilitate later data retrieval and searching. Next, the user sets access permissions for family members and sends this information to the server via their device. The server stores this information in a database and uses it when family members access the information later.
[0727] For example, if a user manages vehicle insurance, bank account information, or investment trusts for seniors, all of this information is securely stored on the server, allowing family members to quickly access and address the situation in an emergency. The notification function ensures that when news of a user's death is confirmed, a notification is sent to pre-designated family members, allowing them to quickly access the necessary information.
[0728] An example of a prompt message might be: "Please describe in detail the process by which, after the user enters their car insurance information into the terminal, that information is securely transmitted to and stored on the server."
[0729] In this way, users' families can manage their assets smoothly even in unexpected situations and continue living with peace of mind.
[0730] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0731] Step 1:
[0732] The user launches a dedicated application and enters insurance contract information, financial asset information, and investment information. This information includes policy number, asset type, and investment risk level. This allows the user to provide specific asset information to the system.
[0733] Step 2:
[0734] The terminal temporarily stores information entered by the user. This stored data is encrypted using AES encryption technology. For example, entered asset information is encoded using a key and converted into a secure state. This ensures that the data is secure and ready for transmission to external parties.
[0735] Step 3:
[0736] The terminal sends encrypted data to the server via the SSL / TLS protocol. To mitigate the risk of information interception during transmission, multiple layers of security are implemented. For example, data packets are encrypted and recorded in the transmission log.
[0737] Step 4:
[0738] The server receives encrypted data sent from the terminal and decrypts it. Decryption allows the server to read the asset information originally entered by the user and prepare it for processing in the next step.
[0739] Step 5:
[0740] The server analyzes the decrypted information and stores it in a database. This analysis includes categorizing the information (e.g., insurance, deposits, investments) and converting it to a different format (e.g., converting it to a tabular format). This facilitates subsequent information retrieval and acquisition.
[0741] Step 6:
[0742] The user sets the scope and level of information that family members can access through the system. Specifically, they can set access permissions, for example, granting family members permission to view specific asset information. This ensures that family members can smoothly take over information upon the user's death.
[0743] Step 7:
[0744] The device sends the user-defined access permissions to the server. The server stores this information in a database for future use by family members when they need to access the information.
[0745] Step 8:
[0746] When a user's death is confirmed, the server sends a notification to pre-registered family members. This notification is sent via a designated communication method (e.g., email or SMS), and the family members access the system based on that notification.
[0747] Step 9:
[0748] The server provides real-time advice and procedural support regarding asset management to family members who access it, if necessary. It can also refer to past data and present future management plans. This allows family members to manage and operate the assets left behind by their parents with peace of mind.
[0749] (Application Example 1)
[0750] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0751] The challenge lies in efficiently and securely managing important asset data such as insurance policies, financial assets, and investment information held by users, and in smoothly transferring and managing this data when life events occur. Furthermore, there is a need to provide a system that allows families to accurately understand the asset situation and receive guidance for appropriate management and investment.
[0752] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0753] In this invention, the server includes information input means, information management means, permission setting means, information provision means, assistance means, monitoring means, and notification generation means. This enables the secure management of users' asset information and allows for the rapid and appropriate transfer of information and asset management by family members.
[0754] "Information input means" refers to a device or software for users to input data, including insurance contract information, financial asset information, and investment information, into a system.
[0755] "Information management means" refers to a device or software that has the function of centrally organizing input information and storing it in a storage device.
[0756] A "permission setting device" is a device or software that has the function of setting access privileges for information for family members designated by the user.
[0757] "Information provision means" refers to a device or software that has the function of notifying a designated recipient of necessary information upon the death of a user.
[0758] "Means of assistance" refers to a device or software that has the function of providing immediate advice on asset management to a family member who has been notified.
[0759] "Monitoring means" refers to a device or software that has the function of continuously monitoring the user's electronic asset status and detecting changes.
[0760] A "notification generation means" is a device or software that has the function of creating notifications for family members in accordance with pre-set life events.
[0761] The system implementing this invention consists of a user terminal, a server, and an associated database. The user inputs insurance contract information, financial asset information, and investment information through an application on the terminal. During information input, the information is securely transmitted to the server using the SSL / TLS protocol. The server centrally manages the received information and stores it encrypted on cloud storage. This prevents information leakage and allows for secure and efficient data management.
[0762] The device also provides an interface for setting access permissions for family members. Users can use this interface to specify access levels for each family member. This configuration information is also sent to the server and securely managed in a database.
[0763] When a user's life event, such as death, is confirmed, the server uses a pre-registered list of recipients to notify designated family members using various information delivery methods. These notifications are sent via email or SMS. A notification generation program developed in Python or similar languages is used in this process.
[0764] Furthermore, as a means of assistance, a generative AI model installed on the server generates asset management advice for families in real time. This model analyzes the user's asset data and proposes an appropriate action plan.
[0765] For example, if a user dies suddenly in an accident, this system instantly provides the surviving family with detailed guidelines regarding the user's savings and insurance claim procedures. This allows the family to take swift action.
[0766] An example of a prompt message is as follows: "We are developing an application that provides real-time, rapid, and accurate asset management advice to families in a system that notifies them after a user's death. Please combine data analysis based on user input information with a function to set access permissions for family members."
[0767] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0768] Step 1:
[0769] Users enter insurance policy information, financial asset information, and investment information using an application on their device. This entered data is encrypted on the device using the SSL / TLS protocol. The input is direct data from the user's actions, while the output is encrypted data. This ensures that the data is ready to be securely transmitted to the server.
[0770] Step 2:
[0771] The terminal sends encrypted data to the server. The server receives this data, decrypts it, and then forwards it to the information management system. The input is the received encrypted data, and the output is the decrypted raw data. The server centrally manages this data and stores it in cloud storage. This ensures centralized availability of the data.
[0772] Step 3:
[0773] Users utilize an interface via their device to set access permissions for each family member. The device inputs user-specified access requirements, and the output is access permission setting data sent to the server. The server analyzes this data and records it in a database. As a result, access to asset information is restricted to the user's family.
[0774] Step 4:
[0775] When a life event such as a user's death occurs, the server sends a notification to pre-registered recipients. The input is the trigger information for the life event, and the output is the notification message to the recipients. The server uses Python to generate the notification during this process and sends the information via email or SMS.
[0776] Step 5:
[0777] Finally, a server-based AI model provides asset management advice to the family. The input is the user's asset data and related information, and the output is an advisory message as guidance. This model analyzes the user's financial situation and proposes an optimal action plan for the family. This enables the family to manage their assets quickly and appropriately.
[0778] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0779] This invention adds an emotion engine that recognizes and responds to user emotions to a system that efficiently manages user asset information and provides advice as needed. This system consists of a terminal, a server, and a user, and the emotion engine plays a central role in the entire system.
[0780] Users input insurance policies, financial assets, and investment information using a dedicated application. The emotion engine analyzes the user's emotions during this process. For example, it can detect stress levels and anxiety using the user's tone of voice, input speed, and facial expressions. The device temporarily stores this emotional data and sends it to a server.
[0781] The server combines and analyzes the received emotional data and asset information data. This analysis is stored in a database and used to dynamically adjust how asset information is displayed and the content of advice based on the user's emotional state.
[0782] Next, the user sets the scope of asset information that family members can access within the application. The emotion engine also evaluates the user's emotions during the setup process and provides guidance to reduce stress. For example, if the user shows anxiety, it provides detailed explanations and additional support information to reassure them.
[0783] If a user dies, the server sends a notification to the family, optimized by an emotion engine. The content and timing of this notification are optimized considering the family's situation. For example, the emotion engine selects language and content that is easy for the family to accept and sends the notification. Upon receiving the notification, the family can access the system with appropriate permissions and check the asset information.
[0784] When family members access their asset information, the server provides real-time advice on specific action plans and asset management procedures based on data obtained using an emotion engine. This allows families to confidently take appropriate action even when faced with unexpected situations.
[0785] For example, if a user manages a large life insurance policy and multiple investment trusts, the emotional engine understands the importance of this information and provides detailed yet concise instructions to ensure the family can proceed without stress. The system's dynamic response, based on the user's emotional state and the family's reactions, is a key feature and unique aspect of this system.
[0786] Thus, according to the present invention, flexible and efficient asset management that responds to the emotional needs of the user and their family becomes possible, minimizing anxiety and stress.
[0787] The following describes the processing flow.
[0788] Step 1:
[0789] Users input asset information through a dedicated application. During the input process, the application captures the user's facial expressions and voice data in preparation for analysis by an emotion engine.
[0790] Step 2:
[0791] The terminal temporarily stores the entered asset information and acquired sentiment data, and verifies that the data is complete and accurate. It then prepares to encrypt and send the data to the server.
[0792] Step 3:
[0793] The server processes received asset information and sentiment data and stores it in a database. Simultaneously, the sentiment engine analyzes the user's emotional state.
[0794] Step 4:
[0795] The server customizes the user's asset information dashboard based on the analysis results of the emotion engine. This adapts the way and order in which information is presented to the user's mental state.
[0796] Step 5:
[0797] Users set access permissions for their family members' asset information. The emotion engine evaluates the user's emotions during the setup process and adaptively displays supportive messages to reduce stress.
[0798] Step 6:
[0799] The server stores the configured access permissions in a database, preparing the family to access the information they need.
[0800] Step 7:
[0801] If a user dies, the server notifies the family through a pre-configured method. An emotion engine adjusts the notification content to a format that is more acceptable to the family.
[0802] Step 8:
[0803] After receiving a notification, the family accesses the system. The server uses an emotion engine to assess the family's emotional state and provides support accordingly.
[0804] Step 9:
[0805] The server provides real-time, specific advice and procedures regarding asset management, tailored to each family member's access. It also considers emotional data to facilitate the most appropriate responses for each family member.
[0806] (Example 2)
[0807] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0808] Traditional asset management systems provide uniform asset information and notifications without considering the user's emotional state, which has the drawback of failing to adequately alleviate the anxiety and stress experienced by users and their families. Furthermore, they make it difficult to respond quickly and appropriately to asset management needs in emergencies or critical situations.
[0809] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0810] In this invention, the server includes: an emotion analysis means that dynamically adjusts the display method and advice content of asset information based on the user's emotional state; an information generation means that analyzes the user's emotional data and asset information and provides real-time guidance on asset management when a family member accesses it; and a notification generation means that adjusts the content of notifications and transmits information to family members who have been granted access by an access setting means. This enables flexible and appropriate asset management that meets the emotional needs of the user and their family.
[0811] "Information input means" refers to a device or software that has the function of allowing users to input insurance contract information, financial asset information, and investment information.
[0812] "Information management means" refers to a device or system that has the function of centrally managing information entered by information input means and storing it in a storage device.
[0813] A "permission setting means" is a device or system that has the function of setting access permissions for asset information to family members designated by the user, based on information managed by an information management means.
[0814] "Emotional analysis means" refers to a device or system that has the function of dynamically adjusting the display method of asset information and the content of advice based on the user's emotional state.
[0815] A "guidance generation means" is a device or system that analyzes user emotion data and asset information and has the function of providing real-time guidance on asset management when family members access it.
[0816] A "notification generation means" is a device or system that has the function of adjusting the content of notifications and transmitting information to family members whose permissions have been set by the permission setting means.
[0817] This invention is a system for efficiently managing users' assets and dynamically providing information while taking into account the user's emotional state. The system mainly consists of a server, terminals, and users.
[0818] Users can input their insurance policy information, financial asset information, and investment information using a dedicated application on their device. As users input this information, the device uses sensors to detect their voice tone, input speed, and facial expressions, acquiring this data as emotional data. This allows the system to detect the user's stress levels and anxiety. This emotional data is temporarily stored and then transmitted to a server.
[0819] The server analyzes the received sentiment data and asset information using a generative AI model. The generative AI model processes the information using prompt statements. For example, a prompt statement such as "Suggest the optimal way to display asset information based on the user's emotional state" is used. Based on this analysis, the server dynamically adjusts the way asset information is displayed and the content of the advice to suit the user.
[0820] Furthermore, users can set the scope of asset information that family members can view from their device. The emotion engine operates throughout this configuration process, monitoring the user's emotions and providing additional support as needed.
[0821] If a user dies, the server uses a notification generation mechanism to send a notification to the family that is tailored based on emotional data. The family can access the system via a device to check asset information. The server provides real-time guidance on specific action plans and procedures regarding asset management, taking into account the family's emotional state.
[0822] For example, if a user manages a large life insurance policy and multiple investment trusts, the emotional engine understands the importance of this information and provides detailed yet concise instructions so that family members can proceed without stress. This system's dynamic response, based on the user's emotional state and family reactions, is a key feature supporting asset management.
[0823] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0824] Step 1:
[0825] Users input insurance contract information, financial asset information, and investment information using a dedicated application on the terminal. The entered data is aggregated by the terminal and stored in digital format. The terminal uses sensors to detect the user's voice tone and input speed during input, and acquires this as emotional data. The input data and emotional data are temporarily stored as output of the initial processing.
[0826] Step 2:
[0827] The terminal sends stored information input data and emotional data to the server. The server receives this data and first verifies the integrity of the data format. Next, it inputs the emotional data into a generating AI model and performs data analysis to identify the user's emotional state (e.g., stress, anxiety). The results of this analysis are saved in a database in preparation for the next processing step.
[0828] Step 3:
[0829] The server uses a generative AI model to adjust how asset information is displayed and what advice is provided based on the emotional state obtained in the previous step. An example of a prompt is, "Please suggest the best way to display asset information based on the user's emotional state." The analysis and adjustment results are sent from the server to the terminal and displayed to the user.
[0830] Step 4:
[0831] Users can set the scope of asset information that family members can view through their device. During this process, the device monitors the user's behavior and facial expressions again, updating emotional data. The server receives this data and, if necessary, provides the device with guidance on settings and reassuring details.
[0832] Step 5:
[0833] If a user's death is confirmed, the server uses a notification generation mechanism to create a notification for the family. The content of the notification is adjusted to match the family's acceptable communication style, as analyzed by the emotion engine. The final adjusted notification is then sent to the family via the device.
[0834] Step 6:
[0835] When family members access asset information using their devices, the server performs real-time sentiment analysis and provides specific action plans and procedures for asset management. Using a generative AI model, the server generates optimized steps based on the prompt "Generate the optimal action plan based on the user's emotional state" and sends them to the device. This allows family members to receive appropriate information and proceed with confidence.
[0836] (Application Example 2)
[0837] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0838] Traditional asset information management systems often focused solely on data entry and management, without considering the user's emotional state, which could cause stress for users and their families. Especially as the importance of asset information and the complexity of procedures increase, consideration is needed to alleviate the anxiety and confusion of users and their relatives. However, traditional systems that ignored emotions were unable to address these issues and failed to provide a satisfactory user experience.
[0839] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0840] In this invention, the server includes input means for inputting user contract information, asset information, and financial information; management means for centrally managing the data input by the input means and storing it in a storage device; and emotion analysis means for analyzing the user's voice tone and facial expressions and recognizing their emotional state. This enables the display of information and advice tailored to the user's emotional state.
[0841] "User" refers to an individual or organization that inputs and manages asset information.
[0842] "Contract information" refers to information related to insurance contracts and financial contracts.
[0843] "Asset information" refers to information about financial assets held and investment details.
[0844] "Financial information" refers to all information related to economic activity.
[0845] "Input means" refers to methods or devices that allow users to register data in a system.
[0846] "Management means" refers to the function of handling input information centrally and storing it in a memory device.
[0847] A "storage device" refers to a device used to store data for a long period of time.
[0848] "Relatives" refers to family members or equivalent individuals designated by the user.
[0849] "Information" refers to data or facts about a specific subject.
[0850] "Access permissions" refer to the scope of permission to view or manipulate specific information.
[0851] "Configuration means" refers to methods or devices for specifying or changing permissions and conditions.
[0852] "Absence" refers to a state in which the user is unable to operate the system due to death or other reasons.
[0853] "Notification means" refers to a function that informs relatives of changes in the user's status or information.
[0854] "Support measures" refer to methods and devices for providing necessary advice and support to relatives.
[0855] "Voice tone" refers to the pitch and intonation of a speaker's voice.
[0856] "Facial expression" refers to the state of emotion expressed through the muscles of the face.
[0857] "Emotional state" refers to the type and intensity of the user's emotions.
[0858] "Emotional analysis methods" refer to technologies and devices used to identify emotions through voice and facial expressions.
[0859] "Display" refers to presenting information in a visible form through a screen or other means.
[0860] "Advice" refers to suggestions given regarding specific actions or decisions.
[0861] The system realizing this invention includes an input means for the user to input insurance contracts, financial assets, and investment information. The terminal centrally manages the input information and stores it in a storage device through a management means, ensuring secure data storage. This management means also includes a setting means for setting access permissions as needed for relatives designated by the user.
[0862] The server has a notification system to alert relatives when the user is absent, and a support system to provide real-time advice on asset management to the notified relatives. This support system presents the necessary procedures and action plans based on the user's asset information, enabling relatives to take appropriate action.
[0863] Furthermore, emotion analysis techniques are used to analyze and recognize the user's voice tone and facial expressions to identify their emotional state. The emotion analysis utilizes the smartphone's camera and microphone, and employs software such as OpenCV and TensorFlow. This data functions as an emotion engine, dynamically adjusting the displayed information and advice based on the user's emotions. This allows users to manage their assets with confidence.
[0864] As a specific example of its use, when a user registers for a life insurance contract or investment trust, if sentiment analysis detects anxiety during the process, the system will display messages providing additional information to alleviate concerns and quick access to support.
[0865] Using a generative AI model, the following prompt sentences can be generated:
[0866] "When users enter their financial information, analyze their tone of voice and facial expressions, and present them with messages that promote relaxation and reassurance."
[0867] This allows for asset management that takes into account the user's emotional needs, thereby reducing stress.
[0868] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0869] Step 1:
[0870] Users input contract information, asset information, and financial information using their smartphones. The entered data is temporarily stored using the device's input method. Input at this stage can be done via voice or manual input. The user's voice tone and input speed are also recorded simultaneously during input.
[0871] Step 2:
[0872] The terminal transfers the input data to a management system and stores it in a storage device for centralized management. At this stage, the input data is formatted to match the data format and encrypted for security purposes. The output is structured data placed in a database.
[0873] Step 3:
[0874] The device uses emotion analysis to collect stored voice tone and input speed data, as well as facial expression data acquired from the camera. Using OpenCV and TensorFlow, this data is analyzed to identify the user's emotional state. This process yields numerical data as an emotion score.
[0875] Step 4:
[0876] The server receives emotion scores and uses adjustment mechanisms to modify the displayed information and advice content according to the emotional state. It utilizes a generative AI model to generate prompt sentences based on the emotional state, creating messages that provide reassurance to the user.
[0877] Step 5:
[0878] The server sends tailored information and prompts to the terminal, displaying them in a format optimized for the user. The user receives this message and, if necessary, has options to seek further support. A user-friendly interface is provided for this display.
[0879] Step 6:
[0880] If a user becomes unavailable, the server will use a notification system to notify designated relatives. The content and timing of the notification are determined based on sentiment analysis to ensure that relatives are likely to receive it. The output is a thoughtful notification message displayed on the relative's device.
[0881] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0882] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0883] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[0884] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[0885] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[0886] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[0887] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[0888] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[0889] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[0890] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[0891] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[0892] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[0893] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[0894] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[0895] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[0896] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[0897] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[0898] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[0899] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[0900] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[0901] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[0902] The following is further disclosed regarding the embodiments described above.
[0903] (Claim 1)
[0904] An input method for users to enter insurance contract information, financial asset information, and investment information,
[0905] A management means for centrally managing the information entered by the aforementioned input means and storing it in a database,
[0906] A setting means for setting access rights to asset information for family members specified by the user, based on the information managed by the aforementioned management means,
[0907] A notification means for notifying the family when the user dies,
[0908] A support means that provides real-time advice on asset management to family members who have received notification through the aforementioned notification means,
[0909] A system that includes this.
[0910] (Claim 2)
[0911] The system according to claim 1, wherein the setting means specifies the scope and status of access rights.
[0912] (Claim 3)
[0913] The system according to claim 1, wherein the support means generates procedures and specific action plans for asset management.
[0914] "Example 1"
[0915] (Claim 1)
[0916] A computing device that provides an intuitive interface for information input,
[0917] A means for temporarily storing information collected by the aforementioned computing device, securely encrypting it, and transmitting it via a communication path,
[0918] Information processing means for analyzing decrypted information and efficiently storing it in a database,
[0919] A means to categorize and format information, and to facilitate data retrieval,
[0920] A means for configuring access permissions to set the scope of information access for family members,
[0921] A means of communication to notify family members in the event of the user's death,
[0922] A support design means that, upon receiving information through the aforementioned notification means, analyzes the information and provides real-time advice regarding asset management to the family,
[0923] A system that includes this.
[0924] (Claim 2)
[0925] The system according to claim 1, having a configuration for setting the scope and status of access privileges.
[0926] (Claim 3)
[0927] The system according to claim 1, having the capability to generate asset management procedures and implementation plans.
[0928] "Application Example 1"
[0929] (Claim 1)
[0930] An information input method for users to input insurance contract information, financial asset information, and investment information,
[0931] Information management means for centrally managing the information input by the aforementioned information input means and storing it in a storage device,
[0932] A means for setting permissions to grant access privileges to asset information to family members designated by the user, based on the information managed by the aforementioned information management means,
[0933] A means of providing information to notify the family when the user dies,
[0934] A means of providing immediate assistance to families who have received notification through the aforementioned information provision means, including an assistance means to provide advice on asset management,
[0935] A monitoring system that centrally monitors the status of users' electronic assets,
[0936] A notification generation means that generates notifications applied to family members based on pre-set life events,
[0937] A system that includes this.
[0938] (Claim 2)
[0939] The system according to claim 1, wherein the authority setting means specifies the scope and status of access privileges.
[0940] (Claim 3)
[0941] The system according to claim 1, wherein the assistance means generates implementation procedures and specific action plans for asset management.
[0942] "Example 2 of combining an emotion engine"
[0943] (Claim 1)
[0944] An information input method for users to input insurance contract information, financial asset information, and investment information,
[0945] Information management means for centrally managing the information input by the aforementioned information input means and storing it in a storage device,
[0946] A permission setting means that sets access permissions for asset information to family members designated by the user, based on the information managed by the aforementioned information management means,
[0947] A sentiment analysis means that dynamically adjusts the display method of asset information and the content of advice based on the user's emotional state,
[0948] A guidance generation method that analyzes user emotional data and asset information and provides real-time guidance on asset management when family members access the system,
[0949] A notification generation means that adjusts the content of the notification and transmits the information to a family member whose authority has been set by the aforementioned authority setting means,
[0950] A system that includes this.
[0951] (Claim 2)
[0952] The system according to claim 1, wherein the authority setting means specifies the scope and roles of access privileges.
[0953] (Claim 3)
[0954] The system according to claim 1, wherein the guidance generation means generates procedures and specific action plans for asset management.
[0955] "Application example 2 when combining with an emotional engine"
[0956] (Claim 1)
[0957] An input method for users to enter contract information, asset information, and financial information,
[0958] A management means for centrally managing the data input by the aforementioned input means and storing it in a storage device,
[0959] A setting means for setting access permissions for information to relatives specified by the user, based on the data managed by the aforementioned management means,
[0960] A notification means for notifying relatives when the user is absent,
[0961] A support means that provides real-time advice on information management to relatives who have received notification through the aforementioned notification means,
[0962] An emotion analysis method that analyzes the user's voice tone and facial expressions to recognize their emotional state,
[0963] Based on the user's emotions recognized by the emotion analysis means, an adjustment means dynamically adjusts the information and advice displayed.
[0964] A system that includes this.
[0965] (Claim 2)
[0966] The system according to claim 1, wherein the setting means specifies the scope of authority and roles.
[0967] (Claim 3)
[0968] The system according to claim 1, wherein the support means generates procedures for information management and specific action plans. [Explanation of Symbols]
[0969] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. An input method for users to enter insurance contract information, financial asset information, and investment information, A management means for centrally managing the information entered by the aforementioned input means and storing it in a database, A setting means for setting access rights to asset information for family members specified by the user, based on the information managed by the aforementioned management means, A notification means for notifying the family when the user dies, A support means that provides real-time advice on asset management to family members who have received notification through the aforementioned notification means, A system that includes this.
2. The system according to claim 1, wherein the setting means specifies the scope and position of access rights.
3. The system according to claim 1, wherein the support means generates procedures and specific action plans for asset management.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A