system

Abstract

Provide a system. A means for inputting information about the deceased; means for transmitting said information to a server; a means for storing the information of the deceased person received by the server in a database; A means for the server to notify the call center based on the stored information; the means by which the call center communicates with the service provider; A means for the server to calculate a funeral schedule; a means for the server to notify the user of the calculated schedule and costs; a means for a user to input funeral invitees; a means for the server to track progress and notify the user; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, with the advancement of an aging society, the number of procedures that must be completed after a deceased person dies in a hospital has increased. This has made the procedures cumbersome for the bereaved family, and there is a need to reduce the mental burden. Furthermore, numerous arrangements are required, such as scheduling the funeral, calculating costs, and selecting guests, and a system is needed to carry these out efficiently and appropriately. Conventional systems make it difficult to centrally manage these procedures, placing a heavy burden on the bereaved family. The present invention aims to solve these problems and provide a system that provides integrated support for procedures after a deceased person dies in a hospital. [Means for solving the problem]

[0005] The system according to the invention comprises the following means:

[0006] First, a means is provided for users to enter information about the deceased, and that information is sent to a server. Next, the server stores the received information about the deceased in a database and notifies the call center based on the stored information. Based on the received information, the call center contacts the service provider to proceed with the necessary procedures. The server calculates the optimal funeral schedule and notifies the user of the calculated schedule and cost breakdown. The server also provides users with a means to enter the guests for the funeral, and by sending this information to the server, the server tracks the progress and notifies the user in real time. This reduces the burden on bereaved families and realizes a system that allows funeral procedures to be carried out efficiently.

[0007] "Deceased person information" is a set of basic information related to the deceased, such as the name of the deceased, the date and time of death, the place of death, and contact information.

[0008] "Means for input" refers to the interface (e.g., form screen) that a user uses to input information about the deceased into the system.

[0009] "Transmission means" refers to the functions and protocols for transferring input data to the server.

[0010] A "server" is a central processing unit that receives and processes input information and notifies other systems and users of the necessary information.

[0011] A "database" is a collection of data that stores information about the deceased received by the server and allows it to be searched and updated as needed.

[0012] "Means for notifying the call center" is a function that allows the server to automatically send information about the deceased and instructions regarding arrangements to the call center.

[0013] A "call center" is a base for telephone response operations that receives notifications from the server and actually handles funeral arrangements and contacts service providers.

[0014] "Service providers" are funeral homes and other related service providers.

[0015] The "means for calculating the schedule" is a function that allows the server to calculate the optimal funeral schedule based on information about the deceased and information from the call center.

[0016] "Means of notification" refers to the communication means (e.g., email, app notification) by which the server notifies the user of schedule and cost information.

[0017] "Cost" refers to the total amount of the funeral costs, including the basic fee, altar costs, and optional costs.

[0018] The "means for inputting invitees" is an interface that allows the user to input information about invitees to the funeral (e.g., names, contact information) into the system.

[0019] The "means for tracking progress" is a function that allows the server to monitor the completion status of each dispatch task and provide timely updates.

[0020] "Real-time notification means" refers to communication means for instantly informing users of progress and other important information. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0022] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0023] First, the terms used in the following description will be explained.

[0024] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0025] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0026] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0027] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0028] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0029] [First embodiment]

[0030] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0031] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0032] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0033] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0034] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0035] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0036] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0037] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0038] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0039] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0040] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0041] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0042] The present invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital, and can be implemented in the following forms.

[0043] Overall system overview

[0044] The system begins when a user enters information about the deceased using a terminal and sends that information to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with the service provider to schedule the funeral and carry out various procedures. The server then calculates the funeral schedule and specific costs and notifies the user. The user can then select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. This allows for efficient funeral procedures for the deceased.

[0045] Program processing details

[0046] Enter information

[0047] A user logs into the system using a terminal and enters information about the deceased (e.g., name, date and time of death, place of death, contact information). The terminal then sends this information to the server.

[0048] Initial Data Processing

[0049] The terminal sends the entered data to the server, which stores the received data in a database. The server then checks the validity of the data and initiates appropriate processing.

[0050] Collaboration with call centers

[0051] The server uses the stored information to notify the call center, which then contacts funeral homes and other related service providers to arrange for the necessary procedures.

[0052] Funeral arrangement schedule calculation

[0053] The server calculates the optimal funeral schedule based on the received information and information from the service provider. Specifically, it determines the dates for the funeral, memorial service, and burial, taking into account the date and time of the deceased's death and other factors.

[0054] Specific cost calculation

[0055] The server calculates the specific costs of the funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[0056] Specific examples

[0057] Specific examples are given below.

[0058] 1. Enter information

[0059] The user enters the name of the deceased, the date and time of death, the hospital where they died, and their contact information into the terminal.

[0060] The terminal sends the input data to the server.

[0061] 2. Initial Data Processing

[0062] The server stores the received data in a database and checks the validity of the data.

[0063] 3. Collaboration with call centers

[0064] The server notifies the call center and makes the necessary arrangements.

[0065] The call center will contact the funeral home and begin preparations.

[0066] 4. Schedule funeral arrangements

[0067] The server calculates the optimal schedule, and concludes that the funeral will be held on October 5th, the memorial service on October 7th, and the coffin will be placed on October 8th.

[0068] 5. Specific cost calculation

[0069] The server calculates the breakdown of the costs and notifies the user that the total cost is 450,000 yen.

[0070] Selection of invitees and notification of arrangement status

[0071] Users enter funeral invitees into the system, and the server stores this information in a database. The server tracks progress and notifies users in real time about the completion status of each arrangement.

[0072] In this way, the system of the present invention can efficiently handle procedures after the deceased passes away in a hospital and reduce the burden on the bereaved family.

[0073] The processing flow will be explained below.

[0074] Step 1:

[0075] A user logs in to a terminal.

[0076] The user logs into the system and accesses the screen for entering information about the deceased.

[0077] Step 2:

[0078] The user enters information about the deceased.

[0079] The device displays a form for the user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information.

[0080] The user enters the required information into the form and clicks the "Submit" button.

[0081] Step 3:

[0082] The terminal sends the input data to the server.

[0083] The terminal formats the input data and sends it to the server.

[0084] Step 4:

[0085] The server receives the data.

[0086] The server stores the received data in a database.

[0087] The server validates the data (e.g., whether all required fields are filled in, whether the format is correct, etc.).

[0088] Step 5:

[0089] The server notifies the call center.

[0090] The server connects to the call center system and transmits information about the deceased.

[0091] The server instructs the call center to prepare the funeral arrangements.

[0092] Step 6:

[0093] The call center will begin making arrangements.

[0094] The call center will contact the service provider (e.g., funeral home) and carry out the necessary procedures.

[0095] Step 7:

[0096] The server calculates the schedule.

[0097] The server calculates the optimal funeral schedule based on information about the deceased and information from the call center.

[0098] The server saves the calculated schedule (e.g., funeral on October 5th, memorial service on October 7th, and burial on October 8th) in the database.

[0099] Step 8:

[0100] The server notifies the user of the schedule.

[0101] The server uses the notification function to display the schedule on the user's terminal.

[0102] Step 9:

[0103] The server calculates the cost.

[0104] The server takes in the cost information (basic fee, altar fee, optional fee, etc.) provided by the funeral home and calculates the total cost.

[0105] The server stores the calculated breakdown of costs and the total amount in a database.

[0106] Step 10:

[0107] The server presents the cost to the user.

[0108] The server uses a notification function to display the cost on the user's terminal.

[0109] Step 11:

[0110] A user creates a funeral guest list.

[0111] The terminal displays an invitee list input form to the user.

[0112] The user enters the invitee's name and contact information and clicks the "Save" button.

[0113] Step 12:

[0114] The terminal transmits the invitee information to the server.

[0115] The terminal transmits the input invitee information to the server.

[0116] Step 13:

[0117] The server stores the invitee information.

[0118] The server stores the received invitee information in a database.

[0119] Step 14:

[0120] The server tracks the progress.

[0121] The server monitors the completion status of each dispatch task and updates the information in the database.

[0122] Step 15:

[0123] The server notifies the user of the progress.

[0124] The server uses a notification function to display progress and required actions on the user's device in real time.

[0125] Step 16:

[0126] The user performs the final confirmation.

[0127] The device will display a final confirmation screen, prompting the user to verify that all information is correct.

[0128] The user makes any necessary corrections and completes the final check.

[0129] Step 17:

[0130] The server will follow up.

[0131] The server tracks the system's progress and notifies the user whenever follow-up is required.

[0132] By proceeding in this manner, the system of the present invention can provide comprehensive support for procedures after the deceased person has passed away in a hospital, thereby reducing the burden on the user.

[0133] Example 1

[0134] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0135] After a deceased person passes away in a hospital, there are a wide range of procedures to be completed, placing a significant burden on the bereaved family. In particular, tasks such as scheduling the funeral, checking the progress of various procedures, and calculating costs can be both psychologically and time-consuming. This can cause funeral procedures to not proceed smoothly. Furthermore, since there is no system that can centrally manage these tasks, managing each task individually can be cumbersome. Therefore, there is a need for a system that can handle funeral procedures efficiently and in an integrated manner.

[0136] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0137] In this invention, the server includes means for a user to input basic information about the deceased, means for a terminal to transmit the input information to the server, means for the server to store the received information about the deceased in a database, means for the server to verify the validity of the stored information, means for the server to notify a call center, means for the call center to communicate with a service provider, means for the server to calculate a funeral schedule, means for the server to notify the user of the calculated schedule and specific costs, means for the user to input funeral invitees, and means for the server to track progress and notify the user in real time, thereby making it possible to streamline funeral procedures and reduce the psychological and time burden on the bereaved.

[0138] "User" refers to the person who enters information about the deceased and operates the system.

[0139] "Terminal" refers to an electronic device used by a user to input information, including a computer or smartphone.

[0140] "Server" refers to a central system that processes received information, stores it in a database, and sends necessary notifications.

[0141] "Basic information about the deceased" refers to data about the deceased person, such as their name, date and time of death, place of death, and contact information.

[0142] "Database" refers to a storage system for systematically storing information received by a server.

[0143] A "call center" refers to a department that receives information from users and communicates with service providers.

[0144] "Service provider" refers to a funeral home or other provider of related services.

[0145] "Schedule" refers to the planning of time, including the dates of the funeral, memorial service, and interment.

[0146] "Cost" refers to the total amount of the funeral, including the basic fee, altar fee, and optional fees.

[0147] "Invitees" refers to people invited to the funeral, including names and contact information.

[0148] "Progress" refers to the completion status and progress of each dispatch task.

[0149] "Real-time" means that information is processed immediately and communicated to the user without delay.

[0150] The present invention relates to a comprehensive system that efficiently supports procedures after the death of a deceased person in a hospital. This system smoothly manages each step of the funeral procedures by allowing users to input information about the deceased and processing the information between the terminal and the server.

[0151] The terminals used by users to input information are electronic devices such as computers and smartphones. These terminals can access the system using a dedicated interface. The input information is sent to the server via the Internet.

[0152] The server checks the validity of the data based on the received information. Specifically, it checks whether the name is not empty and whether the date and time are entered in the correct format. After checking, the server stores this information in a database. The databases used include common relational databases such as MySQL (registered trademark) and PostgreSQL.

[0153] The server then notifies the call center based on the stored information, which then uses the system to verify the deceased's details and contact funeral homes and other related service providers, so that the necessary procedures can be taken care of.

[0154] Furthermore, the server calculates the optimal funeral schedule based on the received information and information from the call center. This schedule is notified to the user. For example, it may include specific dates such as "funeral on October 5th, funeral on October 7th, and burial on October 8th."

[0155] The server also performs calculations to calculate the specific breakdown of costs. The costs are assessed based on various items such as the base fee, altar fee, and optional fees, and the total is calculated. The calculated cost is notified to the user.

[0156] Additionally, users can select funeral invitees through the system. The server stores this information in a database and tracks the progress. Users are notified in real time of the completion of each arrangement.

[0157] Specific examples

[0158] For example, a user enters information about a deceased person, such as "Yamada Taro, October 5, 1980, Ikoma Hospital, taro@example.com," into a terminal and submits it. The server saves this data in a database and notifies the call center. The call center contacts "Funeral Home XYZ" to arrange the funeral schedule. The server calculates the schedule and notifies the user that "the funeral will be held on October 5, the funeral on October 7, and the coffin on October 8." The server then calculates the breakdown of costs and notifies the user that "the total will be 450,000 yen." When the user enters the information about the guests attending the funeral, the server saves the information and notifies the user of the progress in real time.

[0159] Prompt Sentence Examples

[0160] "Write a program that allows a user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information, and then the system will take that information, store it in a database, calculate the funeral schedule and costs, and notify the user."

[0161] This invention makes it possible to efficiently and comprehensively manage the funeral procedures of the deceased, thereby significantly reducing the psychological and time burden on the bereaved family.

[0162] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0163] Step 1:

[0164] The user logs in to a terminal and accesses a dedicated screen in the system. The user enters basic information about the deceased (name, date and time of death, hospital where death occurred, contact information). The entered information is sent to the system based on the user's current activity. A specific example of this behavior is when the user enters information such as "Yamada Taro, October 5, 1980, Ikoma Hospital, taro@example.com."

[0165] Input: Basic information about the deceased person entered by the user (name, date and time of death, place of death, contact information)

[0166] Output: HTTP request containing the entered data

[0167] Step 2:

[0168] The device sends the information entered by the user to the server. The device sends this information to the server as an HTTP request. The data transmission is confirmed, and the fact that it has been received by the server is recorded in a log.

[0169] Input: Basic information about the deceased person entered by the user

[0170] Output: The deceased person's information sent to the server

[0171] Step 3:

[0172] The server receives the information sent from the terminal. The server saves the received data in a database. When saving, the server checks the validity of the information, for example, to make sure that the name is not empty and that the date and time are in the correct format. Only information that has been confirmed to be valid is saved in the database.

[0173] Input: Information about the deceased person sent from the device

[0174] Output: Information about the deceased person stored in the database

[0175] Step 4:

[0176] The server notifies the call center based on the information stored in the database, generates the notification content, calls the API endpoint associated with the call center to send the notification, and waits for a response to confirm that the call center received the notification.

[0177] Input: Information about the deceased person stored in the database

[0178] Output: Notification to the call center

[0179] Step 5:

[0180] The call center receives the notification, accesses the system to confirm the information of the deceased, and contacts the funeral home and other related service providers to carry out the necessary procedures. The content of the communication with the funeral home and the progress are recorded in the system.

[0181] Input: Notification from the server

[0182] Output: Contacting relevant service providers and recording progress in the system

[0183] Step 6:

[0184] The server calculates the optimal funeral schedule based on the information provided by the call center and the deceased's information. The server uses a scheduling algorithm to determine the dates for the funeral, funeral service, and interment. The calculation results are stored in an internal database and notified to the user.

[0185] Input: Information about the deceased and information provided by the call center

[0186] Output: Calculated funeral schedule and notification to the user

[0187] Step 7:

[0188] The server calculates the breakdown of costs, processes and calculates the data for each item (basic fee, altar fee, optional fee, etc.), and calculates the total amount. The calculation result is notified to the user.

[0189] Input: Information about the deceased and cost information from the service provider

[0190] Output: Calculated cost breakdown and notification to the user

[0191] Step 8:

[0192] The user enters the names and contact information of the guests for the funeral into the system. The user enters the names and contact information of the guests and submits it to the system.

[0193] Input: Invitee's name and contact information

[0194] Output: Sending invitee information from the device to the server

[0195] Step 9:

[0196] The server stores the entered invitee information in a database and tracks the progress, notifying the user in real time of the completion status of each arrangement task.

[0197] Input: Invitee information entered by the user

[0198] Output: Invitee information stored in database and progress notification to user

[0199] This allows the system to efficiently manage each step of the funeral process and provide users with real-time information.

[0200] (Application example 1)

[0201] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0202] Traditional funeral procedures require bereaved families to go through a number of complicated procedures, including scheduling and cost calculations, placing a significant burden on their time and mental well-being. Furthermore, there are relatives and friends who cannot attend the funeral due to physical distance or time constraints. Therefore, there is a growing need for a system that allows for efficient funeral procedures, sharing funeral information through digital content, and enabling real-time confirmation.

[0203] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0204] In this invention, the server includes a means for inputting information about the deceased, a means for transmitting the information to the server, and a means for the call center to communicate with the service provider. This streamlines funeral procedures and allows users to check funeral information in real time through digital content. Users can also complete funeral procedures online using their smart devices.

[0205] "Information about the deceased" includes information necessary for funeral procedures and scheduling, such as the name of the deceased, the date and time of death, the place of death, and contact information.

[0206] A "server" is a computer system that receives information sent by users, stores it in a database, and handles funeral procedures and scheduling.

[0207] "Database" means a data storage system for storing and managing information about deceased persons and other related data received by the Server.

[0208] A "call center" is a facility or system that contacts service providers based on information notified by a server and proceeds with funeral procedures.

[0209] "Service providers" refer to funeral homes and related service providers who work with the call center to arrange and prepare for funerals.

[0210] "Schedule" refers to the dates of the funeral, memorial service, and coffin placement, and is a plan calculated by the server.

[0211] "Costs" refers to the specific costs involved in a funeral, including the basic fee, altar costs, optional fees, etc.

[0212] "User" refers to an individual who enters information about the deceased and processes funeral arrangements through the system.

[0213] "Digital content" refers to digitized information and images provided in a format that allows funeral information to be viewed in real time.

[0214] "Smart devices" refers to advanced mobile devices such as smartphones, smart glasses, and head-mounted displays, which can be used to complete funeral procedures online.

[0215] "Completing online" means that all necessary procedures are carried out in a virtual space via the Internet, eliminating the need for physical travel or the exchange of documents.

[0216] The present invention relates to a system that provides comprehensive support for procedures after a deceased person passes away in a hospital, allowing users to efficiently check funeral information and complete procedures through digital content using a smart device.

[0217] Overall system overview

[0218] The system begins when the user inputs information about the deceased using a smart device (smartphone, smart glasses, head-mounted display, etc.) and sends that information to a server. The server stores the received information in a database and works with a call center to schedule the funeral and handle various procedures. The server then notifies the user of the calculated schedule and specific costs, allowing the user to select and input funeral invitees. This allows users to check funeral information in real time through digital content.

[0219] Program processing details

[0220] Enter information

[0221] Users log in to the system using their smart device and enter information about the deceased (name, date and time of death, place of death, contact information), which is then sent from the device to the server.

[0222] Initial Data Processing

[0223] The server stores the information received from the device in a database and checks the validity of the data, after which the necessary processing begins.

[0224] Collaboration with call centers

[0225] The server then notifies the call center based on the stored information, and the call center then works with the service provider to make preparations such as arranging the funeral schedule.

[0226] Funeral arrangement schedule calculation

[0227] The server calculates the dates for the funeral, memorial service, and coffin based on the received information and information from the service provider.

[0228] Specific cost calculation

[0229] The server calculates the specific costs of a funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[0230] Digital content provision

[0231] Users can check funeral information in real time using their smart devices, and can also use AR with smart glasses to recreate the funeral in a VR space using a head-mounted display.

[0232] Hardware and software used

[0233] Hardware: Smartphones, smart glasses, head-mounted displays

[0234] Software: Flask (backend framework), SQLite (database), ARKit (AR development for smart glasses), Unity (VR development)

[0235] Description and examples

[0236] Description

[0237] The server receives the information about the deceased person sent by the user and stores it in a database. It then notifies the call center and coordinates with the service provider to arrange the funeral schedule. The user can check the calculated schedule and specific costs on their smart device and complete the necessary procedures online. They can also check funeral information in real time through digital content.

[0238] Specific examples

[0239] When a user opens the "Digital Funeral Management Assistant" app and taps "View Funeral Schedule," the next screen displays "Funeral on October 5th," "Funeral on October 7th," and "Coffining on October 8th." The user can also start using the head-mounted display to recreate the funeral scene in a VR space.

[0240] Prompt Sentence Examples

[0241] "Please enter the deceased's information: name, date and time of death, place of death, and contact information."

[0242] "View funeral schedule?"

[0243] "Would you like to be notified of progress?"

[0244] In this way, the system of the present invention provides a specific method for efficiently carrying out funeral procedures and allowing users to check funeral information in real time through digital content.

[0245] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0246] Step 1:

[0247] A user logs in to the system using a smart device.

[0248] Input and Output: The user enters login information, the system receives user authentication data, the server authenticates the user and returns the authentication result.

[0249] Specific operation: The user enters their username and password and taps the login button. The server receives this and verifies it against the authentication information in the database. If it matches, the user is allowed to log in.

[0250] Step 2:

[0251] The user enters information about the deceased.

[0252] Input and Output: The user enters the name of the deceased, the date and time of death, the place of death, and contact information, and presses the send button. The device sends this data to the server.

[0253] Specific behavior: The user enters information into an input form and taps the submit button.

[0254] Step 3:

[0255] The server stores the received information of the deceased in a database.

[0256] Input and Output: The server receives the data of the deceased person from the user, checks the integrity of the data, and stores it in the database. It also logs the results of the storage.

[0257] Specific operation: After receiving the data, the server checks whether the required data fields have been entered correctly and saves it in the database.

[0258] Step 4:

[0259] The server notifies the call center based on the stored information.

[0260] Input and Output: The server retrieves the information of the deceased from the database, generates and sends notification data to the call center, and the call center receives the notification.

[0261] Specific operation: The server reads the necessary information from the database and notifies the call center system via API or email.

[0262] Step 5:

[0263] The call center will contact the service provider.

[0264] Input and Output: Based on the information received from the server, the call center contacts the service provider and initiates the necessary preparations. At the same time, it reports the results of the contact to the server.

[0265] Specific operations: Call center staff will contact the service provider by phone or email, confirm the schedule and service details, and proceed with the arrangements.

[0266] Step 6:

[0267] The server calculates the funeral schedule.

[0268] Input and Output: The server receives information from the call center or service provider, compares it with the information of the deceased, calculates the optimal funeral schedule, saves the calculated schedule in a database, and notifies the user.

[0269] Specific operation: A date and time calculation algorithm is executed on the server, the optimal schedule is calculated, and stored in the database.

[0270] Step 7:

[0271] The server notifies the user of the calculated schedule and costs.

[0272] Input and Output: The server sends the calculated schedule and cost information to the user's device. The user receives a notification and checks the details.

[0273] Specific operation: The server generates a notification message based on the data and sends it to the user's device via push notification or email.

[0274] Step 8:

[0275] The user enters the guests for the funeral.

[0276] Input and Output: The user inputs the information of people to invite to the funeral on the system and sends it to the server, which stores the received data in a database.

[0277] Specific behavior: The user enters the invitee list and taps the send button.

[0278] Step 9:

[0279] The server tracks the progress and notifies the user.

[0280] Input and Output: The server tracks the completion status of each dispatch task in a database and notifies the user of the progress. The user receives notifications to check the progress.

[0281] Specific operation: The server periodically checks the database and notifies the user in real time when it detects any changes in progress.

[0282] Step 10:

[0283] Users can check funeral information in real time through digital content.

[0284] Input and Output: The user uses a smart device to check funeral information through the app, and the server streams the necessary data to the device.

[0285] What happens: A user opens the app and taps the required button to check real-time information. The server streams the data in real time.

[0286] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0287] The present invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital and that recognizes and responds to the user's emotions, and can be implemented in the following forms.

[0288] Overall system overview

[0289] The system begins when a user enters information about the deceased using a terminal and sends it to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with the service provider to schedule the funeral and carry out various procedures. The server then calculates the funeral schedule and specific costs and notifies the user. The user can also select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. In addition, an emotion engine recognizes the user's emotions and can provide appropriate information and responses based on their emotional state. This makes it possible to efficiently process funeral procedures for the deceased while also reducing the emotional burden on the user.

[0290] Program processing details

[0291] Enter information

[0292] A user logs into the system using a terminal and enters information about the deceased (e.g., name, date and time of death, place of death, contact information). The terminal then sends this information to the server.

[0293] Initial Data Processing

[0294] The terminal sends the entered data to the server, which stores the received data in a database. The server then checks the validity of the data and initiates appropriate processing.

[0295] Collaboration with call centers

[0296] The server uses the stored information to notify the call center, which then contacts funeral homes and other related service providers to arrange for the necessary procedures.

[0297] Funeral arrangement schedule calculation

[0298] The server calculates the optimal funeral schedule based on the received information and information from the service provider. Specifically, it determines the dates for the funeral, memorial service, and burial, taking into account the date and time of the deceased's death and other factors.

[0299] Specific cost calculation

[0300] The server calculates the specific costs of the funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[0301] Introducing the Emotion Engine

[0302] The emotion engine analyzes the user's voice and facial expressions to recognize the user's emotional state. For example, when a user provides audio or video input to the device through a microphone or camera, the emotion engine analyzes this and determines the user's emotional state, such as sadness, anger, or surprise. Depending on the emotional state, the system adjusts its response and provides information and support that takes the user's feelings into consideration.

[0303] Specific examples

[0304] Specific examples are given below.

[0305] 1. Enter information

[0306] The user enters the name of the deceased, the date and time of death, the hospital where they died, and their contact information into the terminal.

[0307] The terminal sends the input data to the server.

[0308] 2. Initial Data Processing

[0309] The server stores the received data in a database and checks the validity of the data.

[0310] 3. Collaboration with call centers

[0311] The server notifies the call center and makes the necessary arrangements.

[0312] The call center will contact the funeral home and begin preparations.

[0313] 4. Schedule funeral arrangements

[0314] The server calculates the optimal schedule, and concludes that the funeral will be held on October 5th, the memorial service on October 7th, and the coffin will be placed on October 8th.

[0315] 5. Specific cost calculation

[0316] The server calculates the breakdown of the costs and notifies the user that the total cost is 450,000 yen.

[0317] Use of emotion engine

[0318] When a user speaks into the device, the emotion engine analyzes the voice and if it recognizes sadness, the system will respond with a softer tone that takes that emotion into account. If the camera analyzes the user's facial expressions and detects stress, the system will take appropriate measures, such as reducing the frequency of progress notifications.

[0319] In this way, the system of the present invention can efficiently carry out procedures after the death of a deceased person in a hospital and reduce the emotional burden on the user.

[0320] The processing flow will be explained below.

[0321] Step 1:

[0322] A user logs in to a terminal.

[0323] The user logs into the system and accesses the screen for entering information about the deceased.

[0324] Step 2:

[0325] The user enters information about the deceased.

[0326] The device displays a form for the user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information.

[0327] The user enters the required information into the form and clicks the "Submit" button.

[0328] Step 3:

[0329] The terminal sends the input data to the server.

[0330] The terminal formats the input data and sends it to the server.

[0331] Step 4:

[0332] The server receives the data.

[0333] The server stores the received data in a database.

[0334] The server validates the data (e.g., whether all required fields are filled in, whether the format is correct, etc.).

[0335] Step 5:

[0336] The server notifies the call center.

[0337] The server connects to the call center system and transmits information about the deceased.

[0338] The server instructs the call center to prepare the funeral arrangements.

[0339] Step 6:

[0340] The call center will begin making arrangements.

[0341] The call center will contact the service provider (e.g., funeral home) and carry out the necessary procedures.

[0342] Step 7:

[0343] The server calculates the schedule.

[0344] The server calculates the optimal funeral schedule based on information about the deceased and information from the call center.

[0345] The server saves the calculated schedule (e.g., funeral on October 5th, memorial service on October 7th, and burial on October 8th) in the database.

[0346] Step 8:

[0347] The server notifies the user of the schedule.

[0348] The server uses the notification function to display the schedule on the user's terminal.

[0349] Step 9:

[0350] The server calculates the cost.

[0351] The server takes in the cost information (basic fee, altar fee, optional fee, etc.) provided by the funeral home and calculates the total cost.

[0352] The server stores the calculated breakdown of costs and the total amount in a database.

[0353] Step 10:

[0354] The server presents the cost to the user.

[0355] The server uses a notification function to display the cost on the user's terminal.

[0356] Step 11:

[0357] A user creates a funeral guest list.

[0358] The terminal displays an invitee list input form to the user.

[0359] The user enters the invitee's name and contact information and clicks the "Save" button.

[0360] Step 12:

[0361] The terminal transmits the invitee information to the server.

[0362] The terminal transmits the input invitee information to the server.

[0363] Step 13:

[0364] The server stores the invitee information.

[0365] The server stores the received invitee information in a database.

[0366] Step 14:

[0367] The server tracks the progress.

[0368] The server monitors the completion status of each dispatch task and updates the information in the database.

[0369] Step 15:

[0370] The server notifies the user of the progress.

[0371] The server uses a notification function to display progress and required actions on the user's device in real time.

[0372] Step 16:

[0373] The emotion engine analyzes voice input.

[0374] The terminal acquires the user's voice through a microphone.

[0375] The emotion engine analyzes the acquired voice data and recognizes the user's emotional state (sadness, anger, anxiety, etc.).

[0376] Step 17:

[0377] The emotion engine analyzes facial expressions using a camera.

[0378] The device captures the user's facial expression through the camera.

[0379] The emotion engine analyzes the acquired facial expression data and determines the user's emotional state.

[0380] Step 18:

[0381] The server adjusts the response depending on the emotional state.

[0382] The server receives input from the emotion engine and notifies the user of soft-toned messages and additional support information according to the user's emotional state.

[0383] Step 19:

[0384] The user performs the final confirmation.

[0385] The device will display a final confirmation screen, prompting the user to verify that all information is correct.

[0386] The user makes any necessary corrections and completes the final check.

[0387] Step 20:

[0388] The server will follow up.

[0389] The server tracks the system's progress and notifies the user whenever follow-up is required.

[0390] In this way, the system of the present invention can efficiently carry out procedures after the death of a deceased person in a hospital and reduce the emotional burden on the user.

[0391] Example 2

[0392] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0393] Conventional funeral arrangement systems for the deceased lack consideration for the user's emotional state, resulting in significant mental strain on the user. The procedures are also cumbersome and lack smooth progress. Furthermore, the cost transparency is low, making it difficult to estimate the total cost.

[0394] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting information about the deceased, means for transmitting the information to the server, means for storing the received information about the deceased in a database, means for the server to notify a call center based on the stored information, means for the call center to communicate with related service providers, means for the server to calculate a funeral schedule, means for the server to notify a user of the calculated schedule and costs, means for the user to input funeral invitees, means for the server to track progress and notify the user, and means including an emotion recognition engine that analyzes the user's voice and facial expressions and adjusts response content according to the user's emotional state. This makes it possible to efficiently process the funeral procedures for the deceased, reduce the emotional burden on the user, and increase cost transparency.

[0395] "Information about the deceased" is basic data such as the name of the deceased, the date and time of death, the place of death, and contact information.

[0396] A "server" is a central system for storing and calculating data; it is a computer system that stores information in a database and performs notifications and schedule calculations.

[0397] A "database" is a system that stores received information in an organized manner and allows it to be accessed and searched efficiently when needed.

[0398] A "call center" is a department or system that handles user support and contact with related service providers.

[0399] "Related service providers" refers to funeral homes and other companies or individuals that provide services related to funerals.

[0400] "Funeral schedule" refers to the dates of events such as the deceased's funeral, memorial service, and coffin placement.

[0401] "Costs" refers to the specific amount of money involved in a funeral, including the basic fee, altar costs, and optional fees.

[0402] An "emotion recognition engine" is a system that analyzes a user's voice and facial expressions to recognize their emotional state.

[0403] "Means for adjusting response content" refers to a function that changes the system's response content according to the user's emotional state.

[0404] The present invention relates to a system that comprehensively supports procedures after a deceased person passes away in a hospital and recognizes and responds to the user's emotions. The system begins when the user inputs information about the deceased using a terminal and sends the information to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with related service providers to schedule the funeral and carry out various procedures. The server calculates the funeral schedule and specific costs and notifies the user. The user can also select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. In addition, an emotion engine analyzes the user's voice and facial expressions and provides appropriate information and responses based on the user's emotional state. This system efficiently processes the funeral of the deceased while reducing the user's emotional burden.

[0405] Hardware and software used

[0406] The following hardware and software are used to implement this system:

[0407] Devices: computers, smartphones, tablets, etc.

[0408] Server: Database management system (e.g., MySQL, PostgreSQL), web server (e.g., Apache (registered trademark), Nginx)

[0409] Call Center Software: Customer Relationship Management Systems (CRM), Telephone Systems

[0410] Emotion engine: Speech recognition software (e.g., Google® Cloud Speech-to-Text), facial recognition software (e.g., Microsoft® Azure® Face API)

[0411] Specific examples

[0412] User input of deceased person information

[0413] First, the user logs in to the device and enters the name of the deceased, the date and time of death, the place of death, and contact information into a dedicated input form. For example, suppose the user enters "Input amount: Name = Ichiro Tanaka, Date = October 1, 2023, Place = Tokyo Hospital, Contact information = 090-XXXX-XXXX."

[0414] Sending data from the device to the server

[0415] When the user presses the input completion button, the terminal sends the input data to the server using the HTTPS protocol.

[0416] Server initial data processing

[0417] The server saves the data received from the device in a database and checks whether the save was successful. Next, it verifies the validity of the received data. For example, it checks whether the received date and time is in the future.

[0418] Collaboration with call centers

[0419] The server then sends a notification to the call center based on the validated data. This notification includes basic information about the deceased and the urgency of the situation. The server uses a REST API to send the notification to the call center system.

[0420] Arrangements made through the call center

[0421] Based on the notification received from the server, the call center contacts the funeral home or other related service providers and carries out the necessary procedures. For example, the call center may contact them and say, "Please arrange the funeral for the deceased, Mr. Ichiro Tanaka."

[0422] Funeral schedule calculation

[0423] Based on the information returned from the call center, the server calculates the optimal funeral schedule. For example, if the deceased dies on October 1st, the server calculates the schedule as follows: funeral on October 5th, funeral on October 7th, and burial on October 8th.

[0424] Cost calculation

[0425] The server calculates the specific costs of the funeral. For example, if the basic fee is 300,000 yen, the altar fee is 100,000 yen, and the optional fee is 50,000 yen, the server will notify the user that the total cost is 450,000 yen.

[0426] Use of emotion engine

[0427] When a user speaks into the device, their voice and facial expressions are transmitted to the emotion engine via the device's microphone and camera. The emotion engine then uses voice and facial recognition technology to analyze the user's emotions. For example, if the emotion engine detects "sadness," the system will respond in a soft tone, saying, "We will provide services that are considerate of the feelings of bereaved families during this difficult time."

[0428] Prompt Sentence Examples

[0429] "Please enter the name of the deceased, the date and time of death, the place of death, and contact information."

[0430] In this way, by utilizing the specific embodiment of the invention, the user can efficiently proceed with funeral procedures while receiving emotional support.

[0431] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0432] Step 1:

[0433] The user enters information about the deceased. Specifically, after logging in, the user enters the name of the deceased, the date and time of death, the place of death, and contact information into an input form on the device. This information is collected on the device as input data. For example, the user enters "Ichiro Tanaka, October 1, 2023, a hospital in Tokyo, contact information: 090-XXXX-XXXX."

[0434] Input: Data entered by the user into an input form

[0435] Output: Confirmation screen displayed on the device

[0436] Step 2:

[0437] The device sends the entered data to the server. When the user presses the completion button, the device securely sends the data to the server using the HTTPS protocol. For example, the entered data is encrypted and sent to the server.

[0438] Input: The user presses the input completion button.

[0439] Output: The input data sent to the server

[0440] Step 3:

[0441] The server performs initial processing of the received data. The server saves the received data in the database and checks whether the save was successful. After the save is successful, the validity of the data is verified and checked for any omissions or abnormalities. For example, it checks whether the received date and time is a future date.

[0442] Input: Data sent to the server

[0443] Output: Data stored in the database and validation results

[0444] Step 4:

[0445] The server notifies the call center based on the data. After validation is complete, the server sends a notification to the call center using REST API. This notification includes basic information about the deceased and the urgency level. For example, the notification is delivered to the call center in real time.

[0446] Input: Validated data

[0447] Output: Notification sent to the call center

[0448] Step 5:

[0449] The call center contacts related service providers. Based on the notification received from the server, the call center contacts the funeral home and other related service providers. For example, the call center may request the funeral home to handle the procedures, including the funeral for Mr. Ichiro Tanaka.

[0450] Input: Notification sent to call center

[0451] Output: Contact relevant service providers

[0452] Step 6:

[0453] The server calculates the funeral schedule. Based on the information returned from the call center, the server calculates the optimal funeral schedule. For example, if the deceased dies on October 1st, the server determines the schedule as follows: funeral on October 5th, funeral service on October 7th, and coffin placement on October 8th.

[0454] Input: Information from the call center

[0455] Output: Calculated funeral schedule

[0456] Step 7:

[0457] The server calculates the funeral costs. The server calculates the specific costs for the funeral and notifies the user. For example, the total cost would be 450,000 yen, with a basic fee of 300,000 yen, an altar fee of 100,000 yen, and an optional fee of 50,000 yen.

[0458] Input: Funeral schedule and cost information

[0459] Output: Total cost reported to the user

[0460] Step 8:

[0461] The user enters the names and contact information of the people they want to invite to the funeral. The user logs in to the device and enters the names and contact information of the people they want to invite to the funeral. This information is collected by the device.

[0462] Input: Data entered by the user into an input form

[0463] Output: Confirmation screen displayed on the device

[0464] Step 9:

[0465] The server tracks the progress of each procedure in real time and notifies the user of the progress. For example, it provides status such as "Funeral preparations are complete" or "Funeral has begun."

[0466] Input: Progress data for each procedure

[0467] Output: Progress reported to the user

[0468] Step 10:

[0469] The emotion engine analyzes the user's emotional state. When the user speaks into the device, the voice and facial expressions are sent to the emotion engine via the device's microphone and camera. For example, if sadness is detected, the engine responds by saying, "We will provide services that are sensitive to the feelings of bereaved families during this difficult time."

[0470] Input: User's voice and facial expression data

[0471] Output: System response based on analysis results

[0472] (Application example 2)

[0473] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0474] Traditionally, the procedures and funeral preparations after a deceased person passes away in a hospital have been a heavy burden for the bereaved, and it is difficult to make appropriate decisions, especially when they are in an emotionally unstable state. In this situation, a means is needed to efficiently handle a wide range of tasks, including managing the deceased's information, making arrangements, scheduling and calculating the funeral costs, communicating with service providers, managing funeral invitees, and tracking progress.

[0475] In addition, because they lack the ability to recognize and respond to the emotional state of the bereaved, there is a need for support to alleviate the burden of anxiety, sadness, and other feelings.

[0476] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about the deceased; means for transmitting the information to the server; means for storing the received information about the deceased in a database; means for the server to notify a call center based on the stored information; means for the call center to communicate with a service provider; means for the server to calculate a funeral schedule; means for the server to notify the user of the calculated schedule and costs; means for the user to input funeral invitees; means for the server to track progress and notify the user; means for recognizing the user's emotions based on voice or facial expressions; and means for providing information and responses according to the user's emotional state. This enables the funeral procedures for the deceased to be carried out efficiently and reduces the emotional burden on the user. Furthermore, the call center can provide comprehensive support by issuing instructions to a service provider and arranging for enhanced security procedures around the user's home and hospital.

[0477] "Deceased person information" refers to basic data about the deceased, such as their name, date and location of death, and contact information.

[0478] "Server" is a central processing unit that stores received information in a database and manages and executes various procedures.

[0479] A "database" is a system for storing and managing information received by a server in a structured format.

[0480] A "call center" is a contact point that communicates and coordinates with users and service providers and carries out necessary procedures.

[0481] "Service provider" refers to a company or organization that supports funerals and related procedures, such as a funeral home or security company.

[0482] A "schedule" is a plan that lists specific dates and times for the funeral, memorial service, and coffin placement.

[0483] "Cost" refers to the total cost of the funeral, including the basic fee, altar fee, optional fees, etc.

[0484] The "user" is the person who inputs the information of the deceased and manages the progress of the funeral procedures, usually a family member.

[0485] "Invitees" refers to people who should be invited to a funeral or other event, and can be entered by the user.

[0486] "Progress" refers to information that indicates the current state of the procedure, i.e., to what stage it has progressed.

[0487] "Audio or facial expression" refers to media input used for emotion recognition, such as the user's voice or facial movements.

[0488] "Means for recognizing emotions" refers to a system or software that analyzes and determines the user's emotional state from their voice and facial expressions.

[0489] "Information provision and response" refers to providing appropriate information based on the user's emotional state and making the necessary support and arrangements.

[0490] This invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital, and recognizes and responds to the user's emotions. This system is realized by the cooperation of terminals, a server, an emotion engine, and a call center.

[0491] ○ Overview of the entire system

[0492] Information input and notifications:

[0493] The user uses a smartphone to input information about the deceased (e.g., name, date and time of death, location, contact information), which is then sent to the server.

[0494] Initial data processing:

[0495] The server stores the received information of the deceased in a database, verifies the validity of the data, and then notifies the call center to initiate the appropriate procedures.

[0496] Using the Emotion Engine:

[0497] The device uses a microphone and a camera to analyze the user's voice and facial expressions. The server recognizes the user's emotional state through an emotion engine and provides flexible responses according to the emotional state. The emotion engine uses the EmotionRecognition library for analysis.

[0498] Security Arrangements:

[0499] Based on the notification received, the call center will contact service providers such as funeral homes and security companies to initiate necessary preparations, particularly procedures to strengthen security around homes and hospitals.

[0500] Progress Notifications:

[0501] The server notifies the user of the progress of the procedure in real time and visually displays the schedule and arrangement status.

[0502] ○ Hardware and software used

[0503] Hardware:

[0504] Smartphone

[0505] microphone

[0506] Facial Recognition Camera

[0507] software:

[0508] Python

[0509] EmotionRecognition Library

[0510] REST API

[0511] ○ Specific examples

[0512] For example, a user logs in to their smartphone and enters information such as the name of the deceased, the date and time of death, and the location. The emotion engine then analyzes their voice and facial expressions and recognizes that they are sad. In this case, the system suggests security arrangements in a softer tone and begins strengthening security around the home. Furthermore, the user is notified in real time of the progress of the process.

[0513] ○ Example of prompt sentence for generative AI model

[0514] Enter the name, date, and location of the deceased person. We'll analyze their voice and facial expressions to recognize their emotions and make appropriate security arrangements and notify you of their progress.

[0515] Example input:

[0516] Name: Yamada Ichiro

[0517] Date of death: October 10, 2023, 10:00 AM

[0518] Place of death: Tokyo Hospital

[0519] Intended Action:

[0520] Information transmission

[0521] Emotion analysis

[0522] Security Arrangements

[0523] Progress Notifications

[0524] The above is a specific description of an embodiment of the present invention. This system allows the funeral procedures of the deceased to be carried out efficiently and reduces the emotional burden on the user. In addition, efficient security arrangements allow the bereaved family to proceed with the procedures with peace of mind.

[0525] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0526] Step 1:

[0527] The user logs in to their smartphone and enters information about the deceased (e.g., name, date and time of death, location, contact information). The information entered by the user is sent to the server by the device, which then begins receiving information about the deceased.

[0528] Step 2:

[0529] The server receives the information of the deceased and stores it in the database. First, the server checks the validity of the data, and then it is stored in the database. The stored data enables the following processes:

[0530] Step 3:

[0531] The server notifies the call center for appropriate processing. The server retrieves the stored information from the database and sends it to the call center, so that the call center can begin preparing the processing.

[0532] Step 4:

[0533] Based on the notification received by the call center, the service providers such as funeral parlors and security companies are contacted, and the necessary procedures and preparations are carried out. In particular, contact is made to ensure that security procedures are strengthened.

[0534] Step 5:

[0535] The server calculates the funeral schedule. Here, it determines the dates for the funeral, funeral service, and coffin placement based on the date and time of the deceased's death and other necessary information. The calculated schedule is notified to the user in the next step.

[0536] Step 6:

[0537] The server notifies the user of the calculated schedule and costs. The costs are calculated based on the basic fee, altar fee, optional fees, etc. The notification allows the user to check the specific schedule and costs.

[0538] Step 7:

[0539] The user enters the invitees for the funeral. This information is also sent to the server and stored in the database, which manages the contact information of the invitees.

[0540] Step 8:

[0541] The server tracks the progress of the procedure and notifies the user in real time. The progress is determined based on information from the service provider and the progress of internal processing, so the user can always get the latest information.

[0542] Step 9:

[0543] The emotion engine analyzes the user's voice and facial expressions to recognize their emotional state. This is done using the device's microphone and camera. The server uses the EmotionRecognition library to perform the analysis and recognize the user's emotions, such as sadness or anger.

[0544] Step 10:

[0545] The server provides information and responds according to the user's emotional state. Based on the results obtained from the emotion engine, the server responds in a soft tone and suggests necessary support, thereby reducing the emotional burden on the user.

[0546] Through the above steps, the system of the present invention can comprehensively support procedures after the deceased person passes away in a hospital, and can recognize the user's emotions and respond appropriately.

[0547] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0548] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0549] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0550] [Second embodiment]

[0551] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0552] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0553] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0554] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0555] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0556] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0557] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0558] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0559] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0560] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0561] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0562] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0563] The present invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital, and can be implemented in the following forms.

[0564] Overall system overview

[0565] The system begins when a user enters information about the deceased using a terminal and sends that information to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with the service provider to schedule the funeral and carry out various procedures. The server then calculates the funeral schedule and specific costs and notifies the user. The user can then select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. This allows for efficient funeral procedures for the deceased.

[0566] Program processing details

[0567] Enter information

[0568] A user logs into the system using a terminal and enters information about the deceased (e.g., name, date and time of death, place of death, contact information). The terminal then sends this information to the server.

[0569] Initial Data Processing

[0570] The terminal sends the entered data to the server, which stores the received data in a database. The server then checks the validity of the data and initiates appropriate processing.

[0571] Collaboration with call centers

[0572] The server uses the stored information to notify the call center, which then contacts funeral homes and other related service providers to arrange for the necessary procedures.

[0573] Funeral arrangement schedule calculation

[0574] The server calculates the optimal funeral schedule based on the received information and information from the service provider. Specifically, it determines the dates for the funeral, memorial service, and burial, taking into account the date and time of the deceased's death and other factors.

[0575] Specific cost calculation

[0576] The server calculates the specific costs of the funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[0577] Specific examples

[0578] Specific examples are given below.

[0579] 1. Enter information

[0580] The user enters the name of the deceased, the date and time of death, the hospital where they died, and their contact information into the terminal.

[0581] The terminal sends the input data to the server.

[0582] 2. Initial Data Processing

[0583] The server stores the received data in a database and checks the validity of the data.

[0584] 3. Collaboration with call centers

[0585] The server notifies the call center and makes the necessary arrangements.

[0586] The call center will contact the funeral home and begin preparations.

[0587] 4. Schedule funeral arrangements

[0588] The server calculates the optimal schedule, and concludes that the funeral will be held on October 5th, the memorial service on October 7th, and the coffin will be placed on October 8th.

[0589] 5. Specific cost calculation

[0590] The server calculates the breakdown of the costs and notifies the user that the total cost is 450,000 yen.

[0591] Selection of invitees and notification of arrangement status

[0592] Users enter funeral invitees into the system, and the server stores this information in a database. The server tracks progress and notifies users in real time about the completion status of each arrangement.

[0593] In this way, the system of the present invention can efficiently handle procedures after the deceased passes away in a hospital and reduce the burden on the bereaved family.

[0594] The processing flow will be explained below.

[0595] Step 1:

[0596] A user logs in to a terminal.

[0597] The user logs into the system and accesses the screen for entering information about the deceased.

[0598] Step 2:

[0599] The user enters information about the deceased.

[0600] The device displays a form for the user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information.

[0601] The user enters the required information into the form and clicks the "Submit" button.

[0602] Step 3:

[0603] The terminal sends the input data to the server.

[0604] The terminal formats the input data and sends it to the server.

[0605] Step 4:

[0606] The server receives the data.

[0607] The server stores the received data in a database.

[0608] The server validates the data (e.g., whether all required fields are filled in, whether the format is correct, etc.).

[0609] Step 5:

[0610] The server notifies the call center.

[0611] The server connects to the call center system and transmits information about the deceased.

[0612] The server instructs the call center to prepare the funeral arrangements.

[0613] Step 6:

[0614] The call center will begin making arrangements.

[0615] The call center will contact the service provider (e.g., funeral home) and carry out the necessary procedures.

[0616] Step 7:

[0617] The server calculates the schedule.

[0618] The server calculates the optimal funeral schedule based on information about the deceased and information from the call center.

[0619] The server saves the calculated schedule (e.g., funeral on October 5th, memorial service on October 7th, and burial on October 8th) in the database.

[0620] Step 8:

[0621] The server notifies the user of the schedule.

[0622] The server uses the notification function to display the schedule on the user's terminal.

[0623] Step 9:

[0624] The server calculates the cost.

[0625] The server takes in the cost information (basic fee, altar fee, optional fee, etc.) provided by the funeral home and calculates the total cost.

[0626] The server stores the calculated breakdown of costs and the total amount in a database.

[0627] Step 10:

[0628] The server presents the cost to the user.

[0629] The server uses a notification function to display the cost on the user's terminal.

[0630] Step 11:

[0631] A user creates a funeral guest list.

[0632] The terminal displays an invitee list input form to the user.

[0633] The user enters the invitee's name and contact information and clicks the "Save" button.

[0634] Step 12:

[0635] The terminal transmits the invitee information to the server.

[0636] The terminal transmits the input invitee information to the server.

[0637] Step 13:

[0638] The server stores the invitee information.

[0639] The server stores the received invitee information in a database.

[0640] Step 14:

[0641] The server tracks the progress.

[0642] The server monitors the completion status of each dispatch task and updates the information in the database.

[0643] Step 15:

[0644] The server notifies the user of the progress.

[0645] The server uses a notification function to display progress and required actions on the user's device in real time.

[0646] Step 16:

[0647] The user performs the final confirmation.

[0648] The device will display a final confirmation screen, prompting the user to verify that all information is correct.

[0649] The user makes any necessary corrections and completes the final check.

[0650] Step 17:

[0651] The server will follow up.

[0652] The server tracks the system's progress and notifies the user whenever follow-up is required.

[0653] By proceeding in this manner, the system of the present invention can provide comprehensive support for procedures after the deceased person has passed away in a hospital, thereby reducing the burden on the user.

[0654] Example 1

[0655] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0656] After a deceased person passes away in a hospital, there are a wide range of procedures to be completed, placing a significant burden on the bereaved family. In particular, tasks such as scheduling the funeral, checking the progress of various procedures, and calculating costs can be both psychologically and time-consuming. This can cause funeral procedures to not proceed smoothly. Furthermore, since there is no system that can centrally manage these tasks, managing each task individually can be cumbersome. Therefore, there is a need for a system that can handle funeral procedures efficiently and in an integrated manner.

[0657] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0658] In this invention, the server includes means for a user to input basic information about the deceased, means for a terminal to transmit the input information to the server, means for the server to store the received information about the deceased in a database, means for the server to verify the validity of the stored information, means for the server to notify a call center, means for the call center to communicate with a service provider, means for the server to calculate a funeral schedule, means for the server to notify the user of the calculated schedule and specific costs, means for the user to input funeral invitees, and means for the server to track progress and notify the user in real time, thereby making it possible to streamline funeral procedures and reduce the psychological and time burden on the bereaved.

[0659] "User" refers to the person who enters information about the deceased and operates the system.

[0660] "Terminal" refers to an electronic device used by a user to input information, including a computer or smartphone.

[0661] "Server" refers to a central system that processes received information, stores it in a database, and sends necessary notifications.

[0662] "Basic information about the deceased" refers to data about the deceased person, such as their name, date and time of death, place of death, and contact information.

[0663] "Database" refers to a storage system for systematically storing information received by a server.

[0664] A "call center" refers to a department that receives information from users and communicates with service providers.

[0665] "Service provider" refers to a funeral home or other provider of related services.

[0666] "Schedule" refers to the planning of time, including the dates of the funeral, memorial service, and interment.

[0667] "Cost" refers to the total amount of the funeral, including the basic fee, altar fee, and optional fees.

[0668] "Invitees" refers to people invited to the funeral, including names and contact information.

[0669] "Progress" refers to the completion status and progress of each dispatch task.

[0670] "Real-time" means that information is processed immediately and communicated to the user without delay.

[0671] The present invention relates to a comprehensive system that efficiently supports procedures after the death of a deceased person in a hospital. This system smoothly manages each step of the funeral procedures by allowing users to input information about the deceased and processing the information between the terminal and the server.

[0672] The terminals used by users to input information are electronic devices such as computers and smartphones. These terminals can access the system using a dedicated interface. The input information is sent to the server via the Internet.

[0673] The server validates the data based on the information it receives. Specifically, it checks whether the name is not empty and whether the date and time are entered in the correct format. After validation, the server stores this information in a database. The database used can be a common relational database such as MySQL or PostgreSQL.

[0674] The server then notifies the call center based on the stored information, which then uses the system to verify the deceased's details and contact funeral homes and other related service providers, so that the necessary procedures can be taken care of.

[0675] Furthermore, the server calculates the optimal funeral schedule based on the received information and information from the call center. This schedule is notified to the user. For example, it may include specific dates such as "funeral on October 5th, funeral on October 7th, and burial on October 8th."

[0676] The server also performs calculations to calculate the specific breakdown of costs. The costs are assessed based on various items such as the base fee, altar fee, and optional fees, and the total is calculated. The calculated cost is notified to the user.

[0677] Additionally, users can select funeral invitees through the system. The server stores this information in a database and tracks the progress. Users are notified in real time of the completion of each arrangement.

[0678] Specific examples

[0679] For example, a user enters information about a deceased person, such as "Yamada Taro, October 5, 1980, Ikoma Hospital, taro@example.com," into a terminal and submits it. The server saves this data in a database and notifies the call center. The call center contacts "Funeral Home XYZ" to arrange the funeral schedule. The server calculates the schedule and notifies the user that "the funeral will be held on October 5, the funeral on October 7, and the coffin on October 8." The server then calculates the breakdown of costs and notifies the user that "the total will be 450,000 yen." When the user enters the information about the guests attending the funeral, the server saves the information and notifies the user of the progress in real time.

[0680] Prompt Sentence Examples

[0681] "Write a program that allows a user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information, and then the system will take that information, store it in a database, calculate the funeral schedule and costs, and notify the user."

[0682] This invention makes it possible to efficiently and comprehensively manage the funeral procedures of the deceased, thereby significantly reducing the psychological and time burden on the bereaved family.

[0683] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0684] Step 1:

[0685] The user logs in to a terminal and accesses a dedicated screen in the system. The user enters basic information about the deceased (name, date and time of death, hospital where death occurred, contact information). The entered information is sent to the system based on the user's current activity. A specific example of this behavior is when the user enters information such as "Yamada Taro, October 5, 1980, Ikoma Hospital, taro@example.com."

[0686] Input: Basic information about the deceased person entered by the user (name, date and time of death, place of death, contact information)

[0687] Output: HTTP request containing the entered data

[0688] Step 2:

[0689] The device sends the information entered by the user to the server. The device sends this information to the server as an HTTP request. The data transmission is confirmed, and the fact that it has been received by the server is recorded in a log.

[0690] Input: Basic information about the deceased person entered by the user

[0691] Output: The deceased person's information sent to the server

[0692] Step 3:

[0693] The server receives the information sent from the terminal. The server saves the received data in a database. When saving, the server checks the validity of the information, for example, to make sure that the name is not empty and that the date and time are in the correct format. Only information that has been confirmed to be valid is saved in the database.

[0694] Input: Information about the deceased person sent from the device

[0695] Output: Information about the deceased person stored in the database

[0696] Step 4:

[0697] The server notifies the call center based on the information stored in the database, generates the notification content, calls the API endpoint associated with the call center to send the notification, and waits for a response to confirm that the call center received the notification.

[0698] Input: Information about the deceased person stored in the database

[0699] Output: Notification to the call center

[0700] Step 5:

[0701] The call center receives the notification, accesses the system to confirm the information of the deceased, and contacts the funeral home and other related service providers to carry out the necessary procedures. The content of the communication with the funeral home and the progress are recorded in the system.

[0702] Input: Notification from the server

[0703] Output: Contacting relevant service providers and recording progress in the system

[0704] Step 6:

[0705] The server calculates the optimal funeral schedule based on the information provided by the call center and the deceased's information. The server uses a scheduling algorithm to determine the dates for the funeral, funeral service, and interment. The calculation results are stored in an internal database and notified to the user.

[0706] Input: Information about the deceased and information provided by the call center

[0707] Output: Calculated funeral schedule and notification to the user

[0708] Step 7:

[0709] The server calculates the breakdown of costs, processes and calculates the data for each item (basic fee, altar fee, optional fee, etc.), and calculates the total amount. The calculation result is notified to the user.

[0710] Input: Information about the deceased and cost information from the service provider

[0711] Output: Calculated cost breakdown and notification to the user

[0712] Step 8:

[0713] The user enters the names and contact information of the guests for the funeral into the system. The user enters the names and contact information of the guests and submits it to the system.

[0714] Input: Invitee's name and contact information

[0715] Output: Sending invitee information from the device to the server

[0716] Step 9:

[0717] The server stores the entered invitee information in a database and tracks the progress, notifying the user in real time of the completion status of each arrangement task.

[0718] Input: Invitee information entered by the user

[0719] Output: Invitee information stored in database and progress notification to user

[0720] This allows the system to efficiently manage each step of the funeral process and provide users with real-time information.

[0721] (Application example 1)

[0722] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0723] Traditional funeral procedures require bereaved families to go through a number of complicated procedures, including scheduling and cost calculations, placing a significant burden on their time and mental well-being. Furthermore, there are relatives and friends who cannot attend the funeral due to physical distance or time constraints. Therefore, there is a growing need for a system that allows for efficient funeral procedures, sharing funeral information through digital content, and enabling real-time confirmation.

[0724] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0725] In this invention, the server includes a means for inputting information about the deceased, a means for transmitting the information to the server, and a means for the call center to communicate with the service provider. This streamlines funeral procedures and allows users to check funeral information in real time through digital content. Users can also complete funeral procedures online using their smart devices.

[0726] "Information about the deceased" includes information necessary for funeral procedures and scheduling, such as the name of the deceased, the date and time of death, the place of death, and contact information.

[0727] A "server" is a computer system that receives information sent by users, stores it in a database, and handles funeral procedures and scheduling.

[0728] "Database" means a data storage system for storing and managing information about deceased persons and other related data received by the Server.

[0729] A "call center" is a facility or system that contacts service providers based on information notified by a server and proceeds with funeral procedures.

[0730] "Service providers" refer to funeral homes and related service providers who work with the call center to arrange and prepare for funerals.

[0731] "Schedule" refers to the dates of the funeral, memorial service, and coffin placement, and is a plan calculated by the server.

[0732] "Costs" refers to the specific costs involved in a funeral, including the basic fee, altar costs, optional fees, etc.

[0733] "User" refers to an individual who enters information about the deceased and processes funeral arrangements through the system.

[0734] "Digital content" refers to digitized information and images provided in a format that allows funeral information to be viewed in real time.

[0735] "Smart devices" refers to advanced mobile devices such as smartphones, smart glasses, and head-mounted displays, which can be used to complete funeral procedures online.

[0736] "Completing online" means that all necessary procedures are carried out in a virtual space via the Internet, eliminating the need for physical travel or the exchange of documents.

[0737] The present invention relates to a system that provides comprehensive support for procedures after a deceased person passes away in a hospital, allowing users to efficiently check funeral information and complete procedures through digital content using a smart device.

[0738] Overall system overview

[0739] The system begins when the user inputs information about the deceased using a smart device (smartphone, smart glasses, head-mounted display, etc.) and sends that information to a server. The server stores the received information in a database and works with a call center to schedule the funeral and handle various procedures. The server then notifies the user of the calculated schedule and specific costs, allowing the user to select and input funeral invitees. This allows users to check funeral information in real time through digital content.

[0740] Program processing details

[0741] Enter information

[0742] Users log in to the system using their smart device and enter information about the deceased (name, date and time of death, place of death, contact information), which is then sent from the device to the server.

[0743] Initial Data Processing

[0744] The server stores the information received from the device in a database and checks the validity of the data, after which the necessary processing begins.

[0745] Collaboration with call centers

[0746] The server then notifies the call center based on the stored information, and the call center then works with the service provider to make preparations such as arranging the funeral schedule.

[0747] Funeral arrangement schedule calculation

[0748] The server calculates the dates for the funeral, memorial service, and coffin based on the received information and information from the service provider.

[0749] Specific cost calculation

[0750] The server calculates the specific costs of a funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[0751] Digital content provision

[0752] Users can check funeral information in real time using their smart devices, and can also use AR with smart glasses to recreate the funeral in a VR space using a head-mounted display.

[0753] Hardware and software used

[0754] Hardware: Smartphones, smart glasses, head-mounted displays

[0755] Software: Flask (backend framework), SQLite (database), ARKit (AR development for smart glasses), Unity (VR development)

[0756] Description and examples

[0757] Description

[0758] The server receives the information about the deceased person sent by the user and stores it in a database. It then notifies the call center and coordinates with the service provider to arrange the funeral schedule. The user can check the calculated schedule and specific costs on their smart device and complete the necessary procedures online. They can also check funeral information in real time through digital content.

[0759] Specific examples

[0760] When a user opens the "Digital Funeral Management Assistant" app and taps "View Funeral Schedule," the next screen displays "Funeral on October 5th," "Funeral on October 7th," and "Coffining on October 8th." The user can also start using the head-mounted display to recreate the funeral scene in a VR space.

[0761] Prompt Sentence Examples

[0762] "Please enter the deceased's information: name, date and time of death, place of death, and contact information."

[0763] "View funeral schedule?"

[0764] "Would you like to be notified of progress?"

[0765] In this way, the system of the present invention provides a specific method for efficiently carrying out funeral procedures and allowing users to check funeral information in real time through digital content.

[0766] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0767] Step 1:

[0768] A user logs in to the system using a smart device.

[0769] Input and Output: The user enters login information, the system receives user authentication data, the server authenticates the user and returns the authentication result.

[0770] Specific operation: The user enters their username and password and taps the login button. The server receives this and verifies it against the authentication information in the database. If it matches, the user is allowed to log in.

[0771] Step 2:

[0772] The user enters information about the deceased.

[0773] Input and Output: The user enters the name of the deceased, the date and time of death, the place of death, and contact information, and presses the send button. The device sends this data to the server.

[0774] Specific behavior: The user enters information into an input form and taps the submit button.

[0775] Step 3:

[0776] The server stores the received information of the deceased in a database.

[0777] Input and Output: The server receives the data of the deceased person from the user, checks the integrity of the data, and stores it in the database. It also logs the results of the storage.

[0778] Specific operation: After receiving the data, the server checks whether the required data fields have been entered correctly and saves it in the database.

[0779] Step 4:

[0780] The server notifies the call center based on the stored information.

[0781] Input and Output: The server retrieves the information of the deceased from the database, generates and sends notification data to the call center, and the call center receives the notification.

[0782] Specific operation: The server reads the necessary information from the database and notifies the call center system via API or email.

[0783] Step 5:

[0784] The call center will contact the service provider.

[0785] Input and Output: Based on the information received from the server, the call center contacts the service provider and initiates the necessary preparations. At the same time, it reports the results of the contact to the server.

[0786] Specific operations: Call center staff will contact the service provider by phone or email, confirm the schedule and service details, and proceed with the arrangements.

[0787] Step 6:

[0788] The server calculates the funeral schedule.

[0789] Input and Output: The server receives information from the call center or service provider, compares it with the information of the deceased, calculates the optimal funeral schedule, saves the calculated schedule in a database, and notifies the user.

[0790] Specific operation: A date and time calculation algorithm is executed on the server, the optimal schedule is calculated, and stored in the database.

[0791] Step 7:

[0792] The server notifies the user of the calculated schedule and costs.

[0793] Input and Output: The server sends the calculated schedule and cost information to the user's device. The user receives a notification and checks the details.

[0794] Specific operation: The server generates a notification message based on the data and sends it to the user's device via push notification or email.

[0795] Step 8:

[0796] The user enters the guests for the funeral.

[0797] Input and Output: The user inputs the information of people to invite to the funeral on the system and sends it to the server, which stores the received data in a database.

[0798] Specific behavior: The user enters the invitee list and taps the send button.

[0799] Step 9:

[0800] The server tracks the progress and notifies the user.

[0801] Input and Output: The server tracks the completion status of each dispatch task in a database and notifies the user of the progress. The user receives notifications to check the progress.

[0802] Specific operation: The server periodically checks the database and notifies the user in real time when it detects any changes in progress.

[0803] Step 10:

[0804] Users can check funeral information in real time through digital content.

[0805] Input and Output: The user uses a smart device to check funeral information through the app, and the server streams the necessary data to the device.

[0806] What happens: A user opens the app and taps the required button to check real-time information. The server streams the data in real time.

[0807] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0808] The present invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital and that recognizes and responds to the user's emotions, and can be implemented in the following forms.

[0809] Overall system overview

[0810] The system begins when a user enters information about the deceased using a terminal and sends it to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with the service provider to schedule the funeral and carry out various procedures. The server then calculates the funeral schedule and specific costs and notifies the user. The user can also select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. In addition, an emotion engine recognizes the user's emotions and can provide appropriate information and responses based on their emotional state. This makes it possible to efficiently process funeral procedures for the deceased while also reducing the emotional burden on the user.

[0811] Program processing details

[0812] Enter information

[0813] A user logs into the system using a terminal and enters information about the deceased (e.g., name, date and time of death, place of death, contact information). The terminal then sends this information to the server.

[0814] Initial Data Processing

[0815] The terminal sends the entered data to the server, which stores the received data in a database. The server then checks the validity of the data and initiates appropriate processing.

[0816] Collaboration with call centers

[0817] The server uses the stored information to notify the call center, which then contacts funeral homes and other related service providers to arrange for the necessary procedures.

[0818] Funeral arrangement schedule calculation

[0819] The server calculates the optimal funeral schedule based on the received information and information from the service provider. Specifically, it determines the dates for the funeral, memorial service, and burial, taking into account the date and time of the deceased's death and other factors.

[0820] Specific cost calculation

[0821] The server calculates the specific costs of the funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[0822] Introducing the Emotion Engine

[0823] The emotion engine analyzes the user's voice and facial expressions to recognize the user's emotional state. For example, when a user provides audio or video input to the device through a microphone or camera, the emotion engine analyzes this and determines the user's emotional state, such as sadness, anger, or surprise. Depending on the emotional state, the system adjusts its response and provides information and support that takes the user's feelings into consideration.

[0824] Specific examples

[0825] Specific examples are given below.

[0826] 1. Enter information

[0827] The user enters the name of the deceased, the date and time of death, the hospital where they died, and their contact information into the terminal.

[0828] The terminal sends the input data to the server.

[0829] 2. Initial Data Processing

[0830] The server stores the received data in a database and checks the validity of the data.

[0831] 3. Collaboration with call centers

[0832] The server notifies the call center and makes the necessary arrangements.

[0833] The call center will contact the funeral home and begin preparations.

[0834] 4. Schedule funeral arrangements

[0835] The server calculates the optimal schedule, and concludes that the funeral will be held on October 5th, the memorial service on October 7th, and the coffin will be placed on October 8th.

[0836] 5. Specific cost calculation

[0837] The server calculates the breakdown of the costs and notifies the user that the total cost is 450,000 yen.

[0838] Use of emotion engine

[0839] When a user speaks into the device, the emotion engine analyzes the voice and if it recognizes sadness, the system will respond with a softer tone that takes that emotion into account. If the camera analyzes the user's facial expressions and detects stress, the system will take appropriate measures, such as reducing the frequency of progress notifications.

[0840] In this way, the system of the present invention can efficiently carry out procedures after the death of a deceased person in a hospital and reduce the emotional burden on the user.

[0841] The processing flow will be explained below.

[0842] Step 1:

[0843] A user logs in to a terminal.

[0844] The user logs into the system and accesses the screen for entering information about the deceased.

[0845] Step 2:

[0846] The user enters information about the deceased.

[0847] The device displays a form for the user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information.

[0848] The user enters the required information into the form and clicks the "Submit" button.

[0849] Step 3:

[0850] The terminal sends the input data to the server.

[0851] The terminal formats the input data and sends it to the server.

[0852] Step 4:

[0853] The server receives the data.

[0854] The server stores the received data in a database.

[0855] The server validates the data (e.g., whether all required fields are filled in, whether the format is correct, etc.).

[0856] Step 5:

[0857] The server notifies the call center.

[0858] The server connects to the call center system and transmits information about the deceased.

[0859] The server instructs the call center to prepare the funeral arrangements.

[0860] Step 6:

[0861] The call center will begin making arrangements.

[0862] The call center will contact the service provider (e.g., funeral home) and carry out the necessary procedures.

[0863] Step 7:

[0864] The server calculates the schedule.

[0865] The server calculates the optimal funeral schedule based on information about the deceased and information from the call center.

[0866] The server saves the calculated schedule (e.g., funeral on October 5th, memorial service on October 7th, and burial on October 8th) in the database.

[0867] Step 8:

[0868] The server notifies the user of the schedule.

[0869] The server uses the notification function to display the schedule on the user's terminal.

[0870] Step 9:

[0871] The server calculates the cost.

[0872] The server takes in the cost information (basic fee, altar fee, optional fee, etc.) provided by the funeral home and calculates the total cost.

[0873] The server stores the calculated breakdown of costs and the total amount in a database.

[0874] Step 10:

[0875] The server presents the cost to the user.

[0876] The server uses a notification function to display the cost on the user's terminal.

[0877] Step 11:

[0878] A user creates a funeral guest list.

[0879] The terminal displays an invitee list input form to the user.

[0880] The user enters the invitee's name and contact information and clicks the "Save" button.

[0881] Step 12:

[0882] The terminal transmits the invitee information to the server.

[0883] The terminal transmits the input invitee information to the server.

[0884] Step 13:

[0885] The server stores the invitee information.

[0886] The server stores the received invitee information in a database.

[0887] Step 14:

[0888] The server tracks the progress.

[0889] The server monitors the completion status of each dispatch task and updates the information in the database.

[0890] Step 15:

[0891] The server notifies the user of the progress.

[0892] The server uses a notification function to display progress and required actions on the user's device in real time.

[0893] Step 16:

[0894] The emotion engine analyzes voice input.

[0895] The terminal acquires the user's voice through a microphone.

[0896] The emotion engine analyzes the acquired voice data and recognizes the user's emotional state (sadness, anger, anxiety, etc.).

[0897] Step 17:

[0898] The emotion engine analyzes facial expressions using a camera.

[0899] The device captures the user's facial expression through the camera.

[0900] The emotion engine analyzes the acquired facial expression data and determines the user's emotional state.

[0901] Step 18:

[0902] The server adjusts the response depending on the emotional state.

[0903] The server receives input from the emotion engine and notifies the user of soft-toned messages and additional support information according to the user's emotional state.

[0904] Step 19:

[0905] The user performs the final confirmation.

[0906] The device will display a final confirmation screen, prompting the user to verify that all information is correct.

[0907] The user makes any necessary corrections and completes the final check.

[0908] Step 20:

[0909] The server will follow up.

[0910] The server tracks the system's progress and notifies the user whenever follow-up is required.

[0911] In this way, the system of the present invention can efficiently carry out procedures after the death of a deceased person in a hospital and reduce the emotional burden on the user.

[0912] Example 2

[0913] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0914] Conventional funeral arrangement systems for the deceased lack consideration for the user's emotional state, resulting in significant mental strain on the user. The procedures are also cumbersome and lack smooth progress. Furthermore, the cost transparency is low, making it difficult to estimate the total cost.

[0915] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting information about the deceased, means for transmitting the information to the server, means for storing the received information about the deceased in a database, means for the server to notify a call center based on the stored information, means for the call center to communicate with related service providers, means for the server to calculate a funeral schedule, means for the server to notify a user of the calculated schedule and costs, means for the user to input funeral invitees, means for the server to track progress and notify the user, and means including an emotion recognition engine that analyzes the user's voice and facial expressions and adjusts response content according to the user's emotional state. This makes it possible to efficiently process the funeral procedures for the deceased, reduce the emotional burden on the user, and increase cost transparency.

[0916] "Information about the deceased" is basic data such as the name of the deceased, the date and time of death, the place of death, and contact information.

[0917] A "server" is a central system for storing and calculating data; it is a computer system that stores information in a database and performs notifications and schedule calculations.

[0918] A "database" is a system that stores received information in an organized manner and allows it to be accessed and searched efficiently when needed.

[0919] A "call center" is a department or system that handles user support and contact with related service providers.

[0920] "Related service providers" refers to funeral homes and other companies or individuals that provide services related to funerals.

[0921] "Funeral schedule" refers to the dates of events such as the deceased's funeral, memorial service, and coffin placement.

[0922] "Costs" refers to the specific amount of money involved in a funeral, including the basic fee, altar costs, and optional fees.

[0923] An "emotion recognition engine" is a system that analyzes a user's voice and facial expressions to recognize their emotional state.

[0924] "Means for adjusting response content" refers to a function that changes the system's response content according to the user's emotional state.

[0925] The present invention relates to a system that comprehensively supports procedures after a deceased person passes away in a hospital and recognizes and responds to the user's emotions. The system begins when the user inputs information about the deceased using a terminal and sends the information to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with related service providers to schedule the funeral and carry out various procedures. The server calculates the funeral schedule and specific costs and notifies the user. The user can also select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. In addition, an emotion engine analyzes the user's voice and facial expressions and provides appropriate information and responses based on the user's emotional state. This system efficiently processes the funeral of the deceased while reducing the user's emotional burden.

[0926] Hardware and software used

[0927] The following hardware and software are used to implement this system:

[0928] Devices: computers, smartphones, tablets, etc.

[0929] Server: Database management system (e.g., MySQL, PostgreSQL), web server (e.g., Apache, Nginx)

[0930] Call Center Software: Customer Relationship Management Systems (CRM), Telephone Systems

[0931] Emotion engine: speech recognition software (e.g., Google Cloud Speech-to-Text), facial recognition software (e.g., Microsoft Azure Face API)

[0932] Specific examples

[0933] User input of deceased person information

[0934] First, the user logs in to the device and enters the name of the deceased, the date and time of death, the place of death, and contact information into a dedicated input form. For example, suppose the user enters "Input amount: Name = Ichiro Tanaka, Date = October 1, 2023, Place = Tokyo Hospital, Contact information = 090-XXXX-XXXX."

[0935] Sending data from the device to the server

[0936] When the user presses the input completion button, the terminal sends the input data to the server using the HTTPS protocol.

[0937] Server initial data processing

[0938] The server saves the data received from the device in a database and checks whether the save was successful. Next, it verifies the validity of the received data. For example, it checks whether the received date and time is in the future.

[0939] Collaboration with call centers

[0940] The server then sends a notification to the call center based on the validated data. This notification includes basic information about the deceased and the urgency of the situation. The server uses a REST API to send the notification to the call center system.

[0941] Arrangements made through the call center

[0942] Based on the notification received from the server, the call center contacts the funeral home or other related service providers and carries out the necessary procedures. For example, the call center may contact them and say, "Please arrange the funeral for the deceased, Mr. Ichiro Tanaka."

[0943] Funeral schedule calculation

[0944] Based on the information returned from the call center, the server calculates the optimal funeral schedule. For example, if the deceased dies on October 1st, the server calculates the schedule as follows: funeral on October 5th, funeral on October 7th, and burial on October 8th.

[0945] Cost calculation

[0946] The server calculates the specific costs of the funeral. For example, if the basic fee is 300,000 yen, the altar fee is 100,000 yen, and the optional fee is 50,000 yen, the server will notify the user that the total cost is 450,000 yen.

[0947] Use of emotion engine

[0948] When a user speaks into the device, their voice and facial expressions are transmitted to the emotion engine via the device's microphone and camera. The emotion engine then uses voice and facial recognition technology to analyze the user's emotions. For example, if the emotion engine detects "sadness," the system will respond in a soft tone, saying, "We will provide services that are considerate of the feelings of bereaved families during this difficult time."

[0949] Prompt Sentence Examples

[0950] "Please enter the name of the deceased, the date and time of death, the place of death, and contact information."

[0951] In this way, by utilizing the specific embodiment of the invention, the user can efficiently proceed with funeral procedures while receiving emotional support.

[0952] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0953] Step 1:

[0954] The user enters information about the deceased. Specifically, after logging in, the user enters the name of the deceased, the date and time of death, the place of death, and contact information into an input form on the device. This information is collected on the device as input data. For example, the user enters "Ichiro Tanaka, October 1, 2023, a hospital in Tokyo, contact information: 090-XXXX-XXXX."

[0955] Input: Data entered by the user into an input form

[0956] Output: Confirmation screen displayed on the device

[0957] Step 2:

[0958] The device sends the entered data to the server. When the user presses the completion button, the device securely sends the data to the server using the HTTPS protocol. For example, the entered data is encrypted and sent to the server.

[0959] Input: The user presses the input completion button.

[0960] Output: The input data sent to the server

[0961] Step 3:

[0962] The server performs initial processing of the received data. The server saves the received data in the database and checks whether the save was successful. After the save is successful, the validity of the data is verified and checked for any omissions or abnormalities. For example, it checks whether the received date and time is a future date.

[0963] Input: Data sent to the server

[0964] Output: Data stored in the database and validation results

[0965] Step 4:

[0966] The server notifies the call center based on the data. After validation is complete, the server sends a notification to the call center using REST API. This notification includes basic information about the deceased and the urgency level. For example, the notification is delivered to the call center in real time.

[0967] Input: Validated data

[0968] Output: Notification sent to the call center

[0969] Step 5:

[0970] The call center contacts related service providers. Based on the notification received from the server, the call center contacts the funeral home and other related service providers. For example, the call center may request the funeral home to handle the procedures, including the funeral for Mr. Ichiro Tanaka.

[0971] Input: Notification sent to call center

[0972] Output: Contact relevant service providers

[0973] Step 6:

[0974] The server calculates the funeral schedule. Based on the information returned from the call center, the server calculates the optimal funeral schedule. For example, if the deceased dies on October 1st, the server determines the schedule as follows: funeral on October 5th, funeral service on October 7th, and coffin placement on October 8th.

[0975] Input: Information from the call center

[0976] Output: Calculated funeral schedule

[0977] Step 7:

[0978] The server calculates the funeral costs. The server calculates the specific costs for the funeral and notifies the user. For example, the total cost would be 450,000 yen, with a basic fee of 300,000 yen, an altar fee of 100,000 yen, and an optional fee of 50,000 yen.

[0979] Input: Funeral schedule and cost information

[0980] Output: Total cost reported to the user

[0981] Step 8:

[0982] The user enters the names and contact information of the people they want to invite to the funeral. The user logs in to the device and enters the names and contact information of the people they want to invite to the funeral. This information is collected by the device.

[0983] Input: Data entered by the user into an input form

[0984] Output: Confirmation screen displayed on the device

[0985] Step 9:

[0986] The server tracks the progress of each procedure in real time and notifies the user of the progress. For example, it provides status such as "Funeral preparations are complete" or "Funeral has begun."

[0987] Input: Progress data for each procedure

[0988] Output: Progress reported to the user

[0989] Step 10:

[0990] The emotion engine analyzes the user's emotional state. When the user speaks into the device, the voice and facial expressions are sent to the emotion engine via the device's microphone and camera. For example, if sadness is detected, the engine responds by saying, "We will provide services that are sensitive to the feelings of bereaved families during this difficult time."

[0991] Input: User's voice and facial expression data

[0992] Output: System response based on analysis results

[0993] (Application example 2)

[0994] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0995] Traditionally, the procedures and funeral preparations after a deceased person passes away in a hospital have been a heavy burden for the bereaved, and it is difficult to make appropriate decisions, especially when they are in an emotionally unstable state. In this situation, a means is needed to efficiently handle a wide range of tasks, including managing the deceased's information, making arrangements, scheduling and calculating the funeral costs, communicating with service providers, managing funeral invitees, and tracking progress.

[0996] In addition, because they lack the ability to recognize and respond to the emotional state of the bereaved, there is a need for support to alleviate the burden of anxiety, sadness, and other feelings.

[0997] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about the deceased; means for transmitting the information to the server; means for storing the received information about the deceased in a database; means for the server to notify a call center based on the stored information; means for the call center to communicate with a service provider; means for the server to calculate a funeral schedule; means for the server to notify the user of the calculated schedule and costs; means for the user to input funeral invitees; means for the server to track progress and notify the user; means for recognizing the user's emotions based on voice or facial expressions; and means for providing information and responses according to the user's emotional state. This enables the funeral procedures for the deceased to be carried out efficiently and reduces the emotional burden on the user. Furthermore, the call center can provide comprehensive support by issuing instructions to a service provider and arranging for enhanced security procedures around the user's home and hospital.

[0998] "Deceased person information" refers to basic data about the deceased, such as their name, date and location of death, and contact information.

[0999] "Server" is a central processing unit that stores received information in a database and manages and executes various procedures.

[1000] A "database" is a system for storing and managing information received by a server in a structured format.

[1001] A "call center" is a contact point that communicates and coordinates with users and service providers and carries out necessary procedures.

[1002] "Service provider" refers to a company or organization that supports funerals and related procedures, such as a funeral home or security company.

[1003] A "schedule" is a plan that lists specific dates and times for the funeral, memorial service, and coffin placement.

[1004] "Cost" refers to the total cost of the funeral, including the basic fee, altar fee, optional fees, etc.

[1005] The "user" is the person who inputs the information of the deceased and manages the progress of the funeral procedures, usually a family member.

[1006] "Invitees" refers to people who should be invited to a funeral or other event, and can be entered by the user.

[1007] "Progress" refers to information that indicates the current state of the procedure, i.e., to what stage it has progressed.

[1008] "Audio or facial expression" refers to media input used for emotion recognition, such as the user's voice or facial movements.

[1009] "Means for recognizing emotions" refers to a system or software that analyzes and determines the user's emotional state from their voice and facial expressions.

[1010] "Information provision and response" refers to providing appropriate information based on the user's emotional state and making the necessary support and arrangements.

[1011] This invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital, and recognizes and responds to the user's emotions. This system is realized by the cooperation of terminals, a server, an emotion engine, and a call center.

[1012] ○ Overview of the entire system

[1013] Information input and notifications:

[1014] The user uses a smartphone to input information about the deceased (e.g., name, date and time of death, location, contact information), which is then sent to the server.

[1015] Initial data processing:

[1016] The server stores the received information of the deceased in a database, verifies the validity of the data, and then notifies the call center to initiate the appropriate procedures.

[1017] Using the Emotion Engine:

[1018] The device uses a microphone and a camera to analyze the user's voice and facial expressions. The server recognizes the user's emotional state through an emotion engine and provides flexible responses according to the emotional state. The emotion engine uses the EmotionRecognition library for analysis.

[1019] Security Arrangements:

[1020] Based on the notification received, the call center will contact service providers such as funeral homes and security companies to initiate necessary preparations, particularly procedures to strengthen security around homes and hospitals.

[1021] Progress Notifications:

[1022] The server notifies the user of the progress of the procedure in real time and visually displays the schedule and arrangement status.

[1023] ○ Hardware and software used

[1024] Hardware:

[1025] Smartphone

[1026] microphone

[1027] Facial Recognition Camera

[1028] software:

[1029] Python

[1030] EmotionRecognition Library

[1031] REST API

[1032] ○ Specific examples

[1033] For example, a user logs in to their smartphone and enters information such as the name of the deceased, the date and time of death, and the location. The emotion engine then analyzes their voice and facial expressions and recognizes that they are sad. In this case, the system suggests security arrangements in a softer tone and begins strengthening security around the home. Furthermore, the user is notified in real time of the progress of the process.

[1034] ○ Example of prompt sentence for generative AI model

[1035] Enter the name, date, and location of the deceased person. We'll analyze their voice and facial expressions to recognize their emotions and make appropriate security arrangements and notify you of their progress.

[1036] Example input:

[1037] Name: Yamada Ichiro

[1038] Date of death: October 10, 2023, 10:00 AM

[1039] Place of death: Tokyo Hospital

[1040] Intended Action:

[1041] Information transmission

[1042] Emotion analysis

[1043] Security Arrangements

[1044] Progress Notifications

[1045] The above is a specific description of an embodiment of the present invention. This system allows the funeral procedures of the deceased to be carried out efficiently and reduces the emotional burden on the user. In addition, efficient security arrangements allow the bereaved family to proceed with the procedures with peace of mind.

[1046] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1047] Step 1:

[1048] The user logs in to their smartphone and enters information about the deceased (e.g., name, date and time of death, location, contact information). The information entered by the user is sent to the server by the device, which then begins receiving information about the deceased.

[1049] Step 2:

[1050] The server receives the information of the deceased and stores it in the database. First, the server checks the validity of the data, and then it is stored in the database. The stored data enables the following processes:

[1051] Step 3:

[1052] The server notifies the call center for appropriate processing. The server retrieves the stored information from the database and sends it to the call center, so that the call center can begin preparing the processing.

[1053] Step 4:

[1054] Based on the notification received by the call center, the service providers such as funeral parlors and security companies are contacted, and the necessary procedures and preparations are carried out. In particular, contact is made to ensure that security procedures are strengthened.

[1055] Step 5:

[1056] The server calculates the funeral schedule. Here, it determines the dates for the funeral, funeral service, and coffin placement based on the date and time of the deceased's death and other necessary information. The calculated schedule is notified to the user in the next step.

[1057] Step 6:

[1058] The server notifies the user of the calculated schedule and costs. The costs are calculated based on the basic fee, altar fee, optional fees, etc. The notification allows the user to check the specific schedule and costs.

[1059] Step 7:

[1060] The user enters the invitees for the funeral. This information is also sent to the server and stored in the database, which manages the contact information of the invitees.

[1061] Step 8:

[1062] The server tracks the progress of the procedure and notifies the user in real time. The progress is determined based on information from the service provider and the progress of internal processing, so the user can always get the latest information.

[1063] Step 9:

[1064] The emotion engine analyzes the user's voice and facial expressions to recognize their emotional state. This is done using the device's microphone and camera. The server uses the EmotionRecognition library to perform the analysis and recognize the user's emotions, such as sadness or anger.

[1065] Step 10:

[1066] The server provides information and responds according to the user's emotional state. Based on the results obtained from the emotion engine, the server responds in a soft tone and suggests necessary support, thereby reducing the emotional burden on the user.

[1067] Through the above steps, the system of the present invention can comprehensively support procedures after the deceased person has passed away in a hospital, and can recognize the user's emotions and respond appropriately.

[1068] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1069] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1070] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1071] [Third embodiment]

[1072] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1073] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1074] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1075] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1076] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1077] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1078] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1079] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1080] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1081] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1082] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1083] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1084] The present invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital, and can be implemented in the following forms.

[1085] Overall system overview

[1086] The system begins when a user enters information about the deceased using a terminal and sends that information to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with the service provider to schedule the funeral and carry out various procedures. The server then calculates the funeral schedule and specific costs and notifies the user. The user can then select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. This allows for efficient funeral procedures for the deceased.

[1087] Program processing details

[1088] Enter information

[1089] A user logs into the system using a terminal and enters information about the deceased (e.g., name, date and time of death, place of death, contact information). The terminal then sends this information to the server.

[1090] Initial Data Processing

[1091] The terminal sends the entered data to the server, which stores the received data in a database. The server then checks the validity of the data and initiates appropriate processing.

[1092] Collaboration with call centers

[1093] The server uses the stored information to notify the call center, which then contacts funeral homes and other related service providers to arrange for the necessary procedures.

[1094] Funeral arrangement schedule calculation

[1095] The server calculates the optimal funeral schedule based on the received information and information from the service provider. Specifically, it determines the dates for the funeral, memorial service, and burial, taking into account the date and time of the deceased's death and other factors.

[1096] Specific cost calculation

[1097] The server calculates the specific costs of the funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[1098] Specific examples

[1099] Specific examples are given below.

[1100] 1. Enter information

[1101] The user enters the name of the deceased, the date and time of death, the hospital where they died, and their contact information into the terminal.

[1102] The terminal sends the input data to the server.

[1103] 2. Initial Data Processing

[1104] The server stores the received data in a database and checks the validity of the data.

[1105] 3. Collaboration with call centers

[1106] The server notifies the call center and makes the necessary arrangements.

[1107] The call center will contact the funeral home and begin preparations.

[1108] 4. Schedule funeral arrangements

[1109] The server calculates the optimal schedule, and concludes that the funeral will be held on October 5th, the memorial service on October 7th, and the coffin will be placed on October 8th.

[1110] 5. Specific cost calculation

[1111] The server calculates the breakdown of the costs and notifies the user that the total cost is 450,000 yen.

[1112] Selection of invitees and notification of arrangement status

[1113] Users enter funeral invitees into the system, and the server stores this information in a database. The server tracks progress and notifies users in real time about the completion status of each arrangement.

[1114] In this way, the system of the present invention can efficiently handle procedures after the deceased passes away in a hospital and reduce the burden on the bereaved family.

[1115] The processing flow will be explained below.

[1116] Step 1:

[1117] A user logs in to a terminal.

[1118] The user logs into the system and accesses the screen for entering information about the deceased.

[1119] Step 2:

[1120] The user enters information about the deceased.

[1121] The device displays a form for the user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information.

[1122] The user enters the required information into the form and clicks the "Submit" button.

[1123] Step 3:

[1124] The terminal sends the input data to the server.

[1125] The terminal formats the input data and sends it to the server.

[1126] Step 4:

[1127] The server receives the data.

[1128] The server stores the received data in a database.

[1129] The server validates the data (e.g., whether all required fields are filled in, whether the format is correct, etc.).

[1130] Step 5:

[1131] The server notifies the call center.

[1132] The server connects to the call center system and transmits information about the deceased.

[1133] The server instructs the call center to prepare the funeral arrangements.

[1134] Step 6:

[1135] The call center will begin making arrangements.

[1136] The call center will contact the service provider (e.g., funeral home) and carry out the necessary procedures.

[1137] Step 7:

[1138] The server calculates the schedule.

[1139] The server calculates the optimal funeral schedule based on information about the deceased and information from the call center.

[1140] The server saves the calculated schedule (e.g., funeral on October 5th, memorial service on October 7th, and burial on October 8th) in the database.

[1141] Step 8:

[1142] The server notifies the user of the schedule.

[1143] The server uses the notification function to display the schedule on the user's terminal.

[1144] Step 9:

[1145] The server calculates the cost.

[1146] The server takes in the cost information (basic fee, altar fee, optional fee, etc.) provided by the funeral home and calculates the total cost.

[1147] The server stores the calculated breakdown of costs and the total amount in a database.

[1148] Step 10:

[1149] The server presents the cost to the user.

[1150] The server uses a notification function to display the cost on the user's terminal.

[1151] Step 11:

[1152] A user creates a funeral guest list.

[1153] The terminal displays an invitee list input form to the user.

[1154] The user enters the invitee's name and contact information and clicks the "Save" button.

[1155] Step 12:

[1156] The terminal transmits the invitee information to the server.

[1157] The terminal transmits the input invitee information to the server.

[1158] Step 13:

[1159] The server stores the invitee information.

[1160] The server stores the received invitee information in a database.

[1161] Step 14:

[1162] The server tracks the progress.

[1163] The server monitors the completion status of each dispatch task and updates the information in the database.

[1164] Step 15:

[1165] The server notifies the user of the progress.

[1166] The server uses a notification function to display progress and required actions on the user's device in real time.

[1167] Step 16:

[1168] The user performs the final confirmation.

[1169] The device will display a final confirmation screen, prompting the user to verify that all information is correct.

[1170] The user makes any necessary corrections and completes the final check.

[1171] Step 17:

[1172] The server will follow up.

[1173] The server tracks the system's progress and notifies the user whenever follow-up is required.

[1174] By proceeding in this manner, the system of the present invention can provide comprehensive support for procedures after the deceased person has passed away in a hospital, thereby reducing the burden on the user.

[1175] Example 1

[1176] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1177] After a deceased person passes away in a hospital, there are a wide range of procedures to be completed, placing a significant burden on the bereaved family. In particular, tasks such as scheduling the funeral, checking the progress of various procedures, and calculating costs can be both psychologically and time-consuming. This can cause funeral procedures to not proceed smoothly. Furthermore, since there is no system that can centrally manage these tasks, managing each task individually can be cumbersome. Therefore, there is a need for a system that can handle funeral procedures efficiently and in an integrated manner.

[1178] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1179] In this invention, the server includes means for a user to input basic information about the deceased, means for a terminal to transmit the input information to the server, means for the server to store the received information about the deceased in a database, means for the server to verify the validity of the stored information, means for the server to notify a call center, means for the call center to communicate with a service provider, means for the server to calculate a funeral schedule, means for the server to notify the user of the calculated schedule and specific costs, means for the user to input funeral invitees, and means for the server to track progress and notify the user in real time, thereby making it possible to streamline funeral procedures and reduce the psychological and time burden on the bereaved.

[1180] "User" refers to the person who enters information about the deceased and operates the system.

[1181] "Terminal" refers to an electronic device used by a user to input information, including a computer or smartphone.

[1182] "Server" refers to a central system that processes received information, stores it in a database, and sends necessary notifications.

[1183] "Basic information about the deceased" refers to data about the deceased person, such as their name, date and time of death, place of death, and contact information.

[1184] "Database" refers to a storage system for systematically storing information received by a server.

[1185] A "call center" refers to a department that receives information from users and communicates with service providers.

[1186] "Service provider" refers to a funeral home or other provider of related services.

[1187] "Schedule" refers to the planning of time, including the dates of the funeral, memorial service, and interment.

[1188] "Cost" refers to the total amount of the funeral, including the basic fee, altar fee, and optional fees.

[1189] "Invitees" refers to people invited to the funeral, including names and contact information.

[1190] "Progress" refers to the completion status and progress of each dispatch task.

[1191] "Real-time" means that information is processed immediately and communicated to the user without delay.

[1192] The present invention relates to a comprehensive system that efficiently supports procedures after the death of a deceased person in a hospital. This system smoothly manages each step of the funeral procedures by allowing users to input information about the deceased and processing the information between the terminal and the server.

[1193] The terminals used by users to input information are electronic devices such as computers and smartphones. These terminals can access the system using a dedicated interface. The input information is sent to the server via the Internet.

[1194] The server validates the data based on the information it receives. Specifically, it checks whether the name is not empty and whether the date and time are entered in the correct format. After validation, the server stores this information in a database. The database used can be a common relational database such as MySQL or PostgreSQL.

[1195] The server then notifies the call center based on the stored information, which then uses the system to verify the deceased's details and contact funeral homes and other related service providers, so that the necessary procedures can be taken care of.

[1196] Furthermore, the server calculates the optimal funeral schedule based on the received information and information from the call center. This schedule is notified to the user. For example, it may include specific dates such as "funeral on October 5th, funeral on October 7th, and burial on October 8th."

[1197] The server also performs calculations to calculate the specific breakdown of costs. The costs are assessed based on various items such as the base fee, altar fee, and optional fees, and the total is calculated. The calculated cost is notified to the user.

[1198] Additionally, users can select funeral invitees through the system. The server stores this information in a database and tracks the progress. Users are notified in real time of the completion of each arrangement.

[1199] Specific examples

[1200] For example, a user enters information about a deceased person, such as "Yamada Taro, October 5, 1980, Ikoma Hospital, taro@example.com," into a terminal and submits it. The server saves this data in a database and notifies the call center. The call center contacts "Funeral Home XYZ" to arrange the funeral schedule. The server calculates the schedule and notifies the user that "the funeral will be held on October 5, the funeral on October 7, and the coffin on October 8." The server then calculates the breakdown of costs and notifies the user that "the total will be 450,000 yen." When the user enters the information about the guests attending the funeral, the server saves the information and notifies the user of the progress in real time.

[1201] Prompt Sentence Examples

[1202] "Write a program that allows a user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information, and then the system will take that information, store it in a database, calculate the funeral schedule and costs, and notify the user."

[1203] This invention makes it possible to efficiently and comprehensively manage the funeral procedures of the deceased, thereby significantly reducing the psychological and time burden on the bereaved family.

[1204] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1205] Step 1:

[1206] The user logs in to a terminal and accesses a dedicated screen in the system. The user enters basic information about the deceased (name, date and time of death, hospital where death occurred, contact information). The entered information is sent to the system based on the user's current activity. A specific example of this behavior is when the user enters information such as "Yamada Taro, October 5, 1980, Ikoma Hospital, taro@example.com."

[1207] Input: Basic information about the deceased person entered by the user (name, date and time of death, place of death, contact information)

[1208] Output: HTTP request containing the entered data

[1209] Step 2:

[1210] The device sends the information entered by the user to the server. The device sends this information to the server as an HTTP request. The data transmission is confirmed, and the fact that it has been received by the server is recorded in a log.

[1211] Input: Basic information about the deceased person entered by the user

[1212] Output: The deceased person's information sent to the server

[1213] Step 3:

[1214] The server receives the information sent from the terminal. The server saves the received data in a database. When saving, the server checks the validity of the information, for example, to make sure that the name is not empty and that the date and time are in the correct format. Only information that has been confirmed to be valid is saved in the database.

[1215] Input: Information about the deceased person sent from the device

[1216] Output: Information about the deceased person stored in the database

[1217] Step 4:

[1218] The server notifies the call center based on the information stored in the database, generates the notification content, calls the API endpoint associated with the call center to send the notification, and waits for a response to confirm that the call center received the notification.

[1219] Input: Information about the deceased person stored in the database

[1220] Output: Notification to the call center

[1221] Step 5:

[1222] The call center receives the notification, accesses the system to confirm the information of the deceased, and contacts the funeral home and other related service providers to carry out the necessary procedures. The content of the communication with the funeral home and the progress are recorded in the system.

[1223] Input: Notification from the server

[1224] Output: Contacting relevant service providers and recording progress in the system

[1225] Step 6:

[1226] The server calculates the optimal funeral schedule based on the information provided by the call center and the deceased's information. The server uses a scheduling algorithm to determine the dates for the funeral, funeral service, and interment. The calculation results are stored in an internal database and notified to the user.

[1227] Input: Information about the deceased and information provided by the call center

[1228] Output: Calculated funeral schedule and notification to the user

[1229] Step 7:

[1230] The server calculates the breakdown of costs, processes and calculates the data for each item (basic fee, altar fee, optional fee, etc.), and calculates the total amount. The calculation result is notified to the user.

[1231] Input: Information about the deceased and cost information from the service provider

[1232] Output: Calculated cost breakdown and notification to the user

[1233] Step 8:

[1234] The user enters the names and contact information of the guests for the funeral into the system. The user enters the names and contact information of the guests and submits it to the system.

[1235] Input: Invitee's name and contact information

[1236] Output: Sending invitee information from the device to the server

[1237] Step 9:

[1238] The server stores the entered invitee information in a database and tracks the progress, notifying the user in real time of the completion status of each arrangement task.

[1239] Input: Invitee information entered by the user

[1240] Output: Invitee information stored in database and progress notification to user

[1241] This allows the system to efficiently manage each step of the funeral process and provide users with real-time information.

[1242] (Application example 1)

[1243] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1244] Traditional funeral procedures require bereaved families to go through a number of complicated procedures, including scheduling and cost calculations, placing a significant burden on their time and mental well-being. Furthermore, there are relatives and friends who cannot attend the funeral due to physical distance or time constraints. Therefore, there is a growing need for a system that allows for efficient funeral procedures, sharing funeral information through digital content, and enabling real-time confirmation.

[1245] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1246] In this invention, the server includes a means for inputting information about the deceased, a means for transmitting the information to the server, and a means for the call center to communicate with the service provider. This streamlines funeral procedures and allows users to check funeral information in real time through digital content. Users can also complete funeral procedures online using their smart devices.

[1247] "Information about the deceased" includes information necessary for funeral procedures and scheduling, such as the name of the deceased, the date and time of death, the place of death, and contact information.

[1248] A "server" is a computer system that receives information sent by users, stores it in a database, and handles funeral procedures and scheduling.

[1249] "Database" means a data storage system for storing and managing information about deceased persons and other related data received by the Server.

[1250] A "call center" is a facility or system that contacts service providers based on information notified by a server and proceeds with funeral procedures.

[1251] "Service providers" refer to funeral homes and related service providers who work with the call center to arrange and prepare for funerals.

[1252] "Schedule" refers to the dates of the funeral, memorial service, and coffin placement, and is a plan calculated by the server.

[1253] "Costs" refers to the specific costs involved in a funeral, including the basic fee, altar costs, optional fees, etc.

[1254] "User" refers to an individual who enters information about the deceased and processes funeral arrangements through the system.

[1255] "Digital content" refers to digitized information and images provided in a format that allows funeral information to be viewed in real time.

[1256] "Smart devices" refers to advanced mobile devices such as smartphones, smart glasses, and head-mounted displays, which can be used to complete funeral procedures online.

[1257] "Completing online" means that all necessary procedures are carried out in a virtual space via the Internet, eliminating the need for physical travel or the exchange of documents.

[1258] The present invention relates to a system that provides comprehensive support for procedures after a deceased person passes away in a hospital, allowing users to efficiently check funeral information and complete procedures through digital content using a smart device.

[1259] Overall system overview

[1260] The system begins when the user inputs information about the deceased using a smart device (smartphone, smart glasses, head-mounted display, etc.) and sends that information to a server. The server stores the received information in a database and works with a call center to schedule the funeral and handle various procedures. The server then notifies the user of the calculated schedule and specific costs, allowing the user to select and input funeral invitees. This allows users to check funeral information in real time through digital content.

[1261] Program processing details

[1262] Enter information

[1263] Users log in to the system using their smart device and enter information about the deceased (name, date and time of death, place of death, contact information), which is then sent from the device to the server.

[1264] Initial Data Processing

[1265] The server stores the information received from the device in a database and checks the validity of the data, after which the necessary processing begins.

[1266] Collaboration with call centers

[1267] The server then notifies the call center based on the stored information, and the call center then works with the service provider to make preparations such as arranging the funeral schedule.

[1268] Funeral arrangement schedule calculation

[1269] The server calculates the dates for the funeral, memorial service, and coffin based on the received information and information from the service provider.

[1270] Specific cost calculation

[1271] The server calculates the specific costs of a funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[1272] Digital content provision

[1273] Users can check funeral information in real time using their smart devices, and can also use AR with smart glasses to recreate the funeral in a VR space using a head-mounted display.

[1274] Hardware and software used

[1275] Hardware: Smartphones, smart glasses, head-mounted displays

[1276] Software: Flask (backend framework), SQLite (database), ARKit (AR development for smart glasses), Unity (VR development)

[1277] Description and examples

[1278] Description

[1279] The server receives the information about the deceased person sent by the user and stores it in a database. It then notifies the call center and coordinates with the service provider to arrange the funeral schedule. The user can check the calculated schedule and specific costs on their smart device and complete the necessary procedures online. They can also check funeral information in real time through digital content.

[1280] Specific examples

[1281] When a user opens the "Digital Funeral Management Assistant" app and taps "View Funeral Schedule," the next screen displays "Funeral on October 5th," "Funeral on October 7th," and "Coffining on October 8th." The user can also start using the head-mounted display to recreate the funeral scene in a VR space.

[1282] Prompt Sentence Examples

[1283] "Please enter the deceased's information: name, date and time of death, place of death, and contact information."

[1284] "View funeral schedule?"

[1285] "Would you like to be notified of progress?"

[1286] In this way, the system of the present invention provides a specific method for efficiently carrying out funeral procedures and allowing users to check funeral information in real time through digital content.

[1287] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1288] Step 1:

[1289] A user logs in to the system using a smart device.

[1290] Input and Output: The user enters login information, the system receives user authentication data, the server authenticates the user and returns the authentication result.

[1291] Specific operation: The user enters their username and password and taps the login button. The server receives this and verifies it against the authentication information in the database. If it matches, the user is allowed to log in.

[1292] Step 2:

[1293] The user enters information about the deceased.

[1294] Input and Output: The user enters the name of the deceased, the date and time of death, the place of death, and contact information, and presses the send button. The device sends this data to the server.

[1295] Specific behavior: The user enters information into an input form and taps the submit button.

[1296] Step 3:

[1297] The server stores the received information of the deceased in a database.

[1298] Input and Output: The server receives the data of the deceased person from the user, checks the integrity of the data, and stores it in the database. It also logs the results of the storage.

[1299] Specific operation: After receiving the data, the server checks whether the required data fields have been entered correctly and saves it in the database.

[1300] Step 4:

[1301] The server notifies the call center based on the stored information.

[1302] Input and Output: The server retrieves the information of the deceased from the database, generates and sends notification data to the call center, and the call center receives the notification.

[1303] Specific operation: The server reads the necessary information from the database and notifies the call center system via API or email.

[1304] Step 5:

[1305] The call center will contact the service provider.

[1306] Input and Output: Based on the information received from the server, the call center contacts the service provider and initiates the necessary preparations. At the same time, it reports the results of the contact to the server.

[1307] Specific operations: Call center staff will contact the service provider by phone or email, confirm the schedule and service details, and proceed with the arrangements.

[1308] Step 6:

[1309] The server calculates the funeral schedule.

[1310] Input and Output: The server receives information from the call center or service provider, compares it with the information of the deceased, calculates the optimal funeral schedule, saves the calculated schedule in a database, and notifies the user.

[1311] Specific operation: A date and time calculation algorithm is executed on the server, the optimal schedule is calculated, and stored in the database.

[1312] Step 7:

[1313] The server notifies the user of the calculated schedule and costs.

[1314] Input and Output: The server sends the calculated schedule and cost information to the user's device. The user receives a notification and checks the details.

[1315] Specific operation: The server generates a notification message based on the data and sends it to the user's device via push notification or email.

[1316] Step 8:

[1317] The user enters the guests for the funeral.

[1318] Input and Output: The user inputs the information of people to invite to the funeral on the system and sends it to the server, which stores the received data in a database.

[1319] Specific behavior: The user enters the invitee list and taps the send button.

[1320] Step 9:

[1321] The server tracks the progress and notifies the user.

[1322] Input and Output: The server tracks the completion status of each dispatch task in a database and notifies the user of the progress. The user receives notifications to check the progress.

[1323] Specific operation: The server periodically checks the database and notifies the user in real time when it detects any changes in progress.

[1324] Step 10:

[1325] Users can check funeral information in real time through digital content.

[1326] Input and Output: The user uses a smart device to check funeral information through the app, and the server streams the necessary data to the device.

[1327] What happens: A user opens the app and taps the required button to check real-time information. The server streams the data in real time.

[1328] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1329] The present invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital and that recognizes and responds to the user's emotions, and can be implemented in the following forms.

[1330] Overall system overview

[1331] The system begins when a user enters information about the deceased using a terminal and sends it to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with the service provider to schedule the funeral and carry out various procedures. The server then calculates the funeral schedule and specific costs and notifies the user. The user can also select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. In addition, an emotion engine recognizes the user's emotions and can provide appropriate information and responses based on their emotional state. This makes it possible to efficiently process funeral procedures for the deceased while also reducing the emotional burden on the user.

[1332] Program processing details

[1333] Enter information

[1334] A user logs into the system using a terminal and enters information about the deceased (e.g., name, date and time of death, place of death, contact information). The terminal then sends this information to the server.

[1335] Initial Data Processing

[1336] The terminal sends the entered data to the server, which stores the received data in a database. The server then checks the validity of the data and initiates appropriate processing.

[1337] Collaboration with call centers

[1338] The server uses the stored information to notify the call center, which then contacts funeral homes and other related service providers to arrange for the necessary procedures.

[1339] Funeral arrangement schedule calculation

[1340] The server calculates the optimal funeral schedule based on the received information and information from the service provider. Specifically, it determines the dates for the funeral, memorial service, and burial, taking into account the date and time of the deceased's death and other factors.

[1341] Specific cost calculation

[1342] The server calculates the specific costs of the funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[1343] Introducing the Emotion Engine

[1344] The emotion engine analyzes the user's voice and facial expressions to recognize the user's emotional state. For example, when a user provides audio or video input to the device through a microphone or camera, the emotion engine analyzes this and determines the user's emotional state, such as sadness, anger, or surprise. Depending on the emotional state, the system adjusts its response and provides information and support that takes the user's feelings into consideration.

[1345] Specific examples

[1346] Specific examples are given below.

[1347] 1. Enter information

[1348] The user enters the name of the deceased, the date and time of death, the hospital where they died, and their contact information into the terminal.

[1349] The terminal sends the input data to the server.

[1350] 2. Initial Data Processing

[1351] The server stores the received data in a database and checks the validity of the data.

[1352] 3. Collaboration with call centers

[1353] The server notifies the call center and makes the necessary arrangements.

[1354] The call center will contact the funeral home and begin preparations.

[1355] 4. Schedule funeral arrangements

[1356] The server calculates the optimal schedule, and concludes that the funeral will be held on October 5th, the memorial service on October 7th, and the coffin will be placed on October 8th.

[1357] 5. Specific cost calculation

[1358] The server calculates the breakdown of the costs and notifies the user that the total cost is 450,000 yen.

[1359] Use of emotion engine

[1360] When a user speaks into the device, the emotion engine analyzes the voice and if it recognizes sadness, the system will respond with a softer tone that takes that emotion into account. If the camera analyzes the user's facial expressions and detects stress, the system will take appropriate measures, such as reducing the frequency of progress notifications.

[1361] In this way, the system of the present invention can efficiently carry out procedures after the death of a deceased person in a hospital and reduce the emotional burden on the user.

[1362] The processing flow will be explained below.

[1363] Step 1:

[1364] A user logs in to a terminal.

[1365] The user logs into the system and accesses the screen for entering information about the deceased.

[1366] Step 2:

[1367] The user enters information about the deceased.

[1368] The device displays a form for the user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information.

[1369] The user enters the required information into the form and clicks the "Submit" button.

[1370] Step 3:

[1371] The terminal sends the input data to the server.

[1372] The terminal formats the input data and sends it to the server.

[1373] Step 4:

[1374] The server receives the data.

[1375] The server stores the received data in a database.

[1376] The server validates the data (e.g., whether all required fields are filled in, whether the format is correct, etc.).

[1377] Step 5:

[1378] The server notifies the call center.

[1379] The server connects to the call center system and transmits information about the deceased.

[1380] The server instructs the call center to prepare the funeral arrangements.

[1381] Step 6:

[1382] The call center will begin making arrangements.

[1383] The call center will contact the service provider (e.g., funeral home) and carry out the necessary procedures.

[1384] Step 7:

[1385] The server calculates the schedule.

[1386] The server calculates the optimal funeral schedule based on information about the deceased and information from the call center.

[1387] The server saves the calculated schedule (e.g., funeral on October 5th, memorial service on October 7th, and burial on October 8th) in the database.

[1388] Step 8:

[1389] The server notifies the user of the schedule.

[1390] The server uses the notification function to display the schedule on the user's terminal.

[1391] Step 9:

[1392] The server calculates the cost.

[1393] The server takes in the cost information (basic fee, altar fee, optional fee, etc.) provided by the funeral home and calculates the total cost.

[1394] The server stores the calculated breakdown of costs and the total amount in a database.

[1395] Step 10:

[1396] The server presents the cost to the user.

[1397] The server uses a notification function to display the cost on the user's terminal.

[1398] Step 11:

[1399] A user creates a funeral guest list.

[1400] The terminal displays an invitee list input form to the user.

[1401] The user enters the invitee's name and contact information and clicks the "Save" button.

[1402] Step 12:

[1403] The terminal transmits the invitee information to the server.

[1404] The terminal transmits the input invitee information to the server.

[1405] Step 13:

[1406] The server stores the invitee information.

[1407] The server stores the received invitee information in a database.

[1408] Step 14:

[1409] The server tracks the progress.

[1410] The server monitors the completion status of each dispatch task and updates the information in the database.

[1411] Step 15:

[1412] The server notifies the user of the progress.

[1413] The server uses a notification function to display progress and required actions on the user's device in real time.

[1414] Step 16:

[1415] The emotion engine analyzes voice input.

[1416] The terminal acquires the user's voice through a microphone.

[1417] The emotion engine analyzes the acquired voice data and recognizes the user's emotional state (sadness, anger, anxiety, etc.).

[1418] Step 17:

[1419] The emotion engine analyzes facial expressions using a camera.

[1420] The device captures the user's facial expression through the camera.

[1421] The emotion engine analyzes the acquired facial expression data and determines the user's emotional state.

[1422] Step 18:

[1423] The server adjusts the response depending on the emotional state.

[1424] The server receives input from the emotion engine and notifies the user of soft-toned messages and additional support information according to the user's emotional state.

[1425] Step 19:

[1426] The user performs the final confirmation.

[1427] The device will display a final confirmation screen, prompting the user to verify that all information is correct.

[1428] The user makes any necessary corrections and completes the final check.

[1429] Step 20:

[1430] The server will follow up.

[1431] The server tracks the system's progress and notifies the user whenever follow-up is required.

[1432] In this way, the system of the present invention can efficiently carry out procedures after the death of a deceased person in a hospital and reduce the emotional burden on the user.

[1433] Example 2

[1434] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1435] Conventional funeral arrangement systems for the deceased lack consideration for the user's emotional state, resulting in significant mental strain on the user. The procedures are also cumbersome and lack smooth progress. Furthermore, the cost transparency is low, making it difficult to estimate the total cost.

[1436] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting information about the deceased, means for transmitting the information to the server, means for storing the received information about the deceased in a database, means for the server to notify a call center based on the stored information, means for the call center to communicate with related service providers, means for the server to calculate a funeral schedule, means for the server to notify a user of the calculated schedule and costs, means for the user to input funeral invitees, means for the server to track progress and notify the user, and means including an emotion recognition engine that analyzes the user's voice and facial expressions and adjusts response content according to the user's emotional state. This makes it possible to efficiently process the funeral procedures for the deceased, reduce the emotional burden on the user, and increase cost transparency.

[1437] "Information about the deceased" is basic data such as the name of the deceased, the date and time of death, the place of death, and contact information.

[1438] A "server" is a central system for storing and calculating data; it is a computer system that stores information in a database and performs notifications and schedule calculations.

[1439] A "database" is a system that stores received information in an organized manner and allows it to be accessed and searched efficiently when needed.

[1440] A "call center" is a department or system that handles user support and contact with related service providers.

[1441] "Related service providers" refers to funeral homes and other companies or individuals that provide services related to funerals.

[1442] "Funeral schedule" refers to the dates of events such as the deceased's funeral, memorial service, and coffin placement.

[1443] "Costs" refers to the specific amount of money involved in a funeral, including the basic fee, altar costs, and optional fees.

[1444] An "emotion recognition engine" is a system that analyzes a user's voice and facial expressions to recognize their emotional state.

[1445] "Means for adjusting response content" refers to a function that changes the system's response content according to the user's emotional state.

[1446] The present invention relates to a system that comprehensively supports procedures after a deceased person passes away in a hospital and recognizes and responds to the user's emotions. The system begins when the user inputs information about the deceased using a terminal and sends the information to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with related service providers to schedule the funeral and carry out various procedures. The server calculates the funeral schedule and specific costs and notifies the user. The user can also select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. In addition, an emotion engine analyzes the user's voice and facial expressions and provides appropriate information and responses based on the user's emotional state. This system efficiently processes the funeral of the deceased while reducing the user's emotional burden.

[1447] Hardware and software used

[1448] The following hardware and software are used to implement this system:

[1449] Devices: computers, smartphones, tablets, etc.

[1450] Server: Database management system (e.g., MySQL, PostgreSQL), web server (e.g., Apache, Nginx)

[1451] Call Center Software: Customer Relationship Management Systems (CRM), Telephone Systems

[1452] Emotion engine: speech recognition software (e.g., Google Cloud Speech-to-Text), facial recognition software (e.g., Microsoft Azure Face API)

[1453] Specific examples

[1454] User input of deceased person information

[1455] First, the user logs in to the device and enters the name of the deceased, the date and time of death, the place of death, and contact information into a dedicated input form. For example, suppose the user enters "Input amount: Name = Ichiro Tanaka, Date = October 1, 2023, Place = Tokyo Hospital, Contact information = 090-XXXX-XXXX."

[1456] Sending data from the device to the server

[1457] When the user presses the input completion button, the terminal sends the input data to the server using the HTTPS protocol.

[1458] Server initial data processing

[1459] The server saves the data received from the device in a database and checks whether the save was successful. Next, it verifies the validity of the received data. For example, it checks whether the received date and time is in the future.

[1460] Collaboration with call centers

[1461] The server then sends a notification to the call center based on the validated data. This notification includes basic information about the deceased and the urgency of the situation. The server uses a REST API to send the notification to the call center system.

[1462] Arrangements made through the call center

[1463] Based on the notification received from the server, the call center contacts the funeral home or other related service providers and carries out the necessary procedures. For example, the call center may contact them and say, "Please arrange the funeral for the deceased, Mr. Ichiro Tanaka."

[1464] Funeral schedule calculation

[1465] Based on the information returned from the call center, the server calculates the optimal funeral schedule. For example, if the deceased dies on October 1st, the server calculates the schedule as follows: funeral on October 5th, funeral on October 7th, and burial on October 8th.

[1466] Cost calculation

[1467] The server calculates the specific costs of the funeral. For example, if the basic fee is 300,000 yen, the altar fee is 100,000 yen, and the optional fee is 50,000 yen, the server will notify the user that the total cost is 450,000 yen.

[1468] Use of emotion engine

[1469] When a user speaks into the device, their voice and facial expressions are transmitted to the emotion engine via the device's microphone and camera. The emotion engine then uses voice and facial recognition technology to analyze the user's emotions. For example, if the emotion engine detects "sadness," the system will respond in a soft tone, saying, "We will provide services that are considerate of the feelings of bereaved families during this difficult time."

[1470] Prompt Sentence Examples

[1471] "Please enter the name of the deceased, the date and time of death, the place of death, and contact information."

[1472] In this way, by utilizing the specific embodiment of the invention, the user can efficiently proceed with funeral procedures while receiving emotional support.

[1473] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1474] Step 1:

[1475] The user enters information about the deceased. Specifically, after logging in, the user enters the name of the deceased, the date and time of death, the place of death, and contact information into an input form on the device. This information is collected on the device as input data. For example, the user enters "Ichiro Tanaka, October 1, 2023, a hospital in Tokyo, contact information: 090-XXXX-XXXX."

[1476] Input: Data entered by the user into an input form

[1477] Output: Confirmation screen displayed on the device

[1478] Step 2:

[1479] The device sends the entered data to the server. When the user presses the completion button, the device securely sends the data to the server using the HTTPS protocol. For example, the entered data is encrypted and sent to the server.

[1480] Input: The user presses the input completion button.

[1481] Output: The input data sent to the server

[1482] Step 3:

[1483] The server performs initial processing of the received data. The server saves the received data in the database and checks whether the save was successful. After the save is successful, the validity of the data is verified and checked for any omissions or abnormalities. For example, it checks whether the received date and time is a future date.

[1484] Input: Data sent to the server

[1485] Output: Data stored in the database and validation results

[1486] Step 4:

[1487] The server notifies the call center based on the data. After validation is complete, the server sends a notification to the call center using REST API. This notification includes basic information about the deceased and the urgency level. For example, the notification is delivered to the call center in real time.

[1488] Input: Validated data

[1489] Output: Notification sent to the call center

[1490] Step 5:

[1491] The call center contacts related service providers. Based on the notification received from the server, the call center contacts the funeral home and other related service providers. For example, the call center may request the funeral home to handle the procedures, including the funeral for Mr. Ichiro Tanaka.

[1492] Input: Notification sent to call center

[1493] Output: Contact relevant service providers

[1494] Step 6:

[1495] The server calculates the funeral schedule. Based on the information returned from the call center, the server calculates the optimal funeral schedule. For example, if the deceased dies on October 1st, the server determines the schedule as follows: funeral on October 5th, funeral service on October 7th, and coffin placement on October 8th.

[1496] Input: Information from the call center

[1497] Output: Calculated funeral schedule

[1498] Step 7:

[1499] The server calculates the funeral costs. The server calculates the specific costs for the funeral and notifies the user. For example, the total cost would be 450,000 yen, with a basic fee of 300,000 yen, an altar fee of 100,000 yen, and an optional fee of 50,000 yen.

[1500] Input: Funeral schedule and cost information

[1501] Output: Total cost reported to the user

[1502] Step 8:

[1503] The user enters the names and contact information of the people they want to invite to the funeral. The user logs in to the device and enters the names and contact information of the people they want to invite to the funeral. This information is collected by the device.

[1504] Input: Data entered by the user into an input form

[1505] Output: Confirmation screen displayed on the device

[1506] Step 9:

[1507] The server tracks the progress of each procedure in real time and notifies the user of the progress. For example, it provides status such as "Funeral preparations are complete" or "Funeral has begun."

[1508] Input: Progress data for each procedure

[1509] Output: Progress reported to the user

[1510] Step 10:

[1511] The emotion engine analyzes the user's emotional state. When the user speaks into the device, the voice and facial expressions are sent to the emotion engine via the device's microphone and camera. For example, if sadness is detected, the engine responds by saying, "We will provide services that are sensitive to the feelings of bereaved families during this difficult time."

[1512] Input: User's voice and facial expression data

[1513] Output: System response based on analysis results

[1514] (Application example 2)

[1515] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1516] Traditionally, the procedures and funeral preparations after a deceased person passes away in a hospital have been a heavy burden for the bereaved, and it is difficult to make appropriate decisions, especially when they are in an emotionally unstable state. In this situation, a means is needed to efficiently handle a wide range of tasks, including managing the deceased's information, making arrangements, scheduling and calculating the funeral costs, communicating with service providers, managing funeral invitees, and tracking progress.

[1517] In addition, because they lack the ability to recognize and respond to the emotional state of the bereaved, there is a need for support to alleviate the burden of anxiety, sadness, and other feelings.

[1518] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about the deceased; means for transmitting the information to the server; means for storing the received information about the deceased in a database; means for the server to notify a call center based on the stored information; means for the call center to communicate with a service provider; means for the server to calculate a funeral schedule; means for the server to notify the user of the calculated schedule and costs; means for the user to input funeral invitees; means for the server to track progress and notify the user; means for recognizing the user's emotions based on voice or facial expressions; and means for providing information and responses according to the user's emotional state. This enables the funeral procedures for the deceased to be carried out efficiently and reduces the emotional burden on the user. Furthermore, the call center can provide comprehensive support by issuing instructions to a service provider and arranging for enhanced security procedures around the user's home and hospital.

[1519] "Deceased person information" refers to basic data about the deceased, such as their name, date and location of death, and contact information.

[1520] "Server" is a central processing unit that stores received information in a database and manages and executes various procedures.

[1521] A "database" is a system for storing and managing information received by a server in a structured format.

[1522] A "call center" is a contact point that communicates and coordinates with users and service providers and carries out necessary procedures.

[1523] "Service provider" refers to a company or organization that supports funerals and related procedures, such as a funeral home or security company.

[1524] A "schedule" is a plan that lists specific dates and times for the funeral, memorial service, and coffin placement.

[1525] "Cost" refers to the total cost of the funeral, including the basic fee, altar fee, optional fees, etc.

[1526] The "user" is the person who inputs the information of the deceased and manages the progress of the funeral procedures, usually a family member.

[1527] "Invitees" refers to people who should be invited to a funeral or other event, and can be entered by the user.

[1528] "Progress" refers to information that indicates the current state of the procedure, i.e., to what stage it has progressed.

[1529] "Audio or facial expression" refers to media input used for emotion recognition, such as the user's voice or facial movements.

[1530] "Means for recognizing emotions" refers to a system or software that analyzes and determines the user's emotional state from their voice and facial expressions.

[1531] "Information provision and response" refers to providing appropriate information based on the user's emotional state and making the necessary support and arrangements.

[1532] This invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital, and recognizes and responds to the user's emotions. This system is realized by the cooperation of terminals, a server, an emotion engine, and a call center.

[1533] ○ Overview of the entire system

[1534] Information input and notifications:

[1535] The user uses a smartphone to input information about the deceased (e.g., name, date and time of death, location, contact information), which is then sent to the server.

[1536] Initial data processing:

[1537] The server stores the received information of the deceased in a database, verifies the validity of the data, and then notifies the call center to initiate the appropriate procedures.

[1538] Using the Emotion Engine:

[1539] The device uses a microphone and a camera to analyze the user's voice and facial expressions. The server recognizes the user's emotional state through an emotion engine and provides flexible responses according to the emotional state. The emotion engine uses the EmotionRecognition library for analysis.

[1540] Security Arrangements:

[1541] Based on the notification received, the call center will contact service providers such as funeral homes and security companies to initiate necessary preparations, particularly procedures to strengthen security around homes and hospitals.

[1542] Progress Notifications:

[1543] The server notifies the user of the progress of the procedure in real time and visually displays the schedule and arrangement status.

[1544] ○ Hardware and software used

[1545] Hardware:

[1546] Smartphone

[1547] microphone

[1548] Facial Recognition Camera

[1549] software:

[1550] Python

[1551] EmotionRecognition Library

[1552] REST API

[1553] ○ Specific examples

[1554] For example, a user logs in to their smartphone and enters information such as the name of the deceased, the date and time of death, and the location. The emotion engine then analyzes their voice and facial expressions and recognizes that they are sad. In this case, the system suggests security arrangements in a softer tone and begins strengthening security around the home. Furthermore, the user is notified in real time of the progress of the process.

[1555] ○ Example of prompt sentence for generative AI model

[1556] Enter the name, date, and location of the deceased person. We'll analyze their voice and facial expressions to recognize their emotions and make appropriate security arrangements and notify you of their progress.

[1557] Example input:

[1558] Name: Yamada Ichiro

[1559] Date of death: October 10, 2023, 10:00 AM

[1560] Place of death: Tokyo Hospital

[1561] Intended Action:

[1562] Information transmission

[1563] Emotion analysis

[1564] Security Arrangements

[1565] Progress Notifications

[1566] The above is a specific description of an embodiment of the present invention. This system allows the funeral procedures of the deceased to be carried out efficiently and reduces the emotional burden on the user. In addition, efficient security arrangements allow the bereaved family to proceed with the procedures with peace of mind.

[1567] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1568] Step 1:

[1569] The user logs in to their smartphone and enters information about the deceased (e.g., name, date and time of death, location, contact information). The information entered by the user is sent to the server by the device, which then begins receiving information about the deceased.

[1570] Step 2:

[1571] The server receives the information of the deceased and stores it in the database. First, the server checks the validity of the data, and then it is stored in the database. The stored data enables the following processes:

[1572] Step 3:

[1573] The server notifies the call center for appropriate processing. The server retrieves the stored information from the database and sends it to the call center, so that the call center can begin preparing the processing.

[1574] Step 4:

[1575] Based on the notification received by the call center, the service providers such as funeral parlors and security companies are contacted, and the necessary procedures and preparations are carried out. In particular, contact is made to ensure that security procedures are strengthened.

[1576] Step 5:

[1577] The server calculates the funeral schedule. Here, it determines the dates for the funeral, funeral service, and coffin placement based on the date and time of the deceased's death and other necessary information. The calculated schedule is notified to the user in the next step.

[1578] Step 6:

[1579] The server notifies the user of the calculated schedule and costs. The costs are calculated based on the basic fee, altar fee, optional fees, etc. The notification allows the user to check the specific schedule and costs.

[1580] Step 7:

[1581] The user enters the invitees for the funeral. This information is also sent to the server and stored in the database, which manages the contact information of the invitees.

[1582] Step 8:

[1583] The server tracks the progress of the procedure and notifies the user in real time. The progress is determined based on information from the service provider and the progress of internal processing, so the user can always get the latest information.

[1584] Step 9:

[1585] The emotion engine analyzes the user's voice and facial expressions to recognize their emotional state. This is done using the device's microphone and camera. The server uses the EmotionRecognition library to perform the analysis and recognize the user's emotions, such as sadness or anger.

[1586] Step 10:

[1587] The server provides information and responds according to the user's emotional state. Based on the results obtained from the emotion engine, the server responds in a soft tone and suggests necessary support, thereby reducing the emotional burden on the user.

[1588] Through the above steps, the system of the present invention can comprehensively support procedures after the deceased person has passed away in a hospital, and can recognize the user's emotions and respond appropriately.

[1589] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1590] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1591] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1592] [Fourth embodiment]

[1593] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1594] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1595] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1596] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1597] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1598] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1599] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1600] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1601] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1602] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1603] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1604] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1605] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1606] The present invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital, and can be implemented in the following forms.

[1607] Overall system overview

[1608] The system begins when a user enters information about the deceased using a terminal and sends that information to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with the service provider to schedule the funeral and carry out various procedures. The server then calculates the funeral schedule and specific costs and notifies the user. The user can then select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. This allows for efficient funeral procedures for the deceased.

[1609] Program processing details

[1610] Enter information

[1611] A user logs into the system using a terminal and enters information about the deceased (e.g., name, date and time of death, place of death, contact information). The terminal then sends this information to the server.

[1612] Initial Data Processing

[1613] The terminal sends the entered data to the server, which stores the received data in a database. The server then checks the validity of the data and initiates appropriate processing.

[1614] Collaboration with call centers

[1615] The server uses the stored information to notify the call center, which then contacts funeral homes and other related service providers to arrange for the necessary procedures.

[1616] Funeral arrangement schedule calculation

[1617] The server calculates the optimal funeral schedule based on the received information and information from the service provider. Specifically, it determines the dates for the funeral, memorial service, and burial, taking into account the date and time of the deceased's death and other factors.

[1618] Specific cost calculation

[1619] The server calculates the specific costs of the funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[1620] Specific examples

[1621] Specific examples are given below.

[1622] 1. Enter information

[1623] The user enters the name of the deceased, the date and time of death, the hospital where they died, and their contact information into the terminal.

[1624] The terminal sends the input data to the server.

[1625] 2. Initial Data Processing

[1626] The server stores the received data in a database and checks the validity of the data.

[1627] 3. Collaboration with call centers

[1628] The server notifies the call center and makes the necessary arrangements.

[1629] The call center will contact the funeral home and begin preparations.

[1630] 4. Schedule funeral arrangements

[1631] The server calculates the optimal schedule, and concludes that the funeral will be held on October 5th, the memorial service on October 7th, and the coffin will be placed on October 8th.

[1632] 5. Specific cost calculation

[1633] The server calculates the breakdown of the costs and notifies the user that the total cost is 450,000 yen.

[1634] Selection of invitees and notification of arrangement status

[1635] Users enter funeral invitees into the system, and the server stores this information in a database. The server tracks progress and notifies users in real time about the completion status of each arrangement.

[1636] In this way, the system of the present invention can efficiently handle procedures after the deceased passes away in a hospital and reduce the burden on the bereaved family.

[1637] The processing flow will be explained below.

[1638] Step 1:

[1639] A user logs in to a terminal.

[1640] The user logs into the system and accesses the screen for entering information about the deceased.

[1641] Step 2:

[1642] The user enters information about the deceased.

[1643] The device displays a form for the user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information.

[1644] The user enters the required information into the form and clicks the "Submit" button.

[1645] Step 3:

[1646] The terminal sends the input data to the server.

[1647] The terminal formats the input data and sends it to the server.

[1648] Step 4:

[1649] The server receives the data.

[1650] The server stores the received data in a database.

[1651] The server validates the data (e.g., whether all required fields are filled in, whether the format is correct, etc.).

[1652] Step 5:

[1653] The server notifies the call center.

[1654] The server connects to the call center system and transmits information about the deceased.

[1655] The server instructs the call center to prepare the funeral arrangements.

[1656] Step 6:

[1657] The call center will begin making arrangements.

[1658] The call center will contact the service provider (e.g., funeral home) and carry out the necessary procedures.

[1659] Step 7:

[1660] The server calculates the schedule.

[1661] The server calculates the optimal funeral schedule based on information about the deceased and information from the call center.

[1662] The server saves the calculated schedule (e.g., funeral on October 5th, memorial service on October 7th, and burial on October 8th) in the database.

[1663] Step 8:

[1664] The server notifies the user of the schedule.

[1665] The server uses the notification function to display the schedule on the user's terminal.

[1666] Step 9:

[1667] The server calculates the cost.

[1668] The server takes in the cost information (basic fee, altar fee, optional fee, etc.) provided by the funeral home and calculates the total cost.

[1669] The server stores the calculated breakdown of costs and the total amount in a database.

[1670] Step 10:

[1671] The server presents the cost to the user.

[1672] The server uses a notification function to display the cost on the user's terminal.

[1673] Step 11:

[1674] A user creates a funeral guest list.

[1675] The terminal displays an invitee list input form to the user.

[1676] The user enters the invitee's name and contact information and clicks the "Save" button.

[1677] Step 12:

[1678] The terminal transmits the invitee information to the server.

[1679] The terminal transmits the input invitee information to the server.

[1680] Step 13:

[1681] The server stores the invitee information.

[1682] The server stores the received invitee information in a database.

[1683] Step 14:

[1684] The server tracks the progress.

[1685] The server monitors the completion status of each dispatch task and updates the information in the database.

[1686] Step 15:

[1687] The server notifies the user of the progress.

[1688] The server uses a notification function to display progress and required actions on the user's device in real time.

[1689] Step 16:

[1690] The user performs the final confirmation.

[1691] The device will display a final confirmation screen, prompting the user to verify that all information is correct.

[1692] The user makes any necessary corrections and completes the final check.

[1693] Step 17:

[1694] The server will follow up.

[1695] The server tracks the system's progress and notifies the user whenever follow-up is required.

[1696] By proceeding in this manner, the system of the present invention can provide comprehensive support for procedures after the deceased person has passed away in a hospital, thereby reducing the burden on the user.

[1697] Example 1

[1698] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1699] After a deceased person passes away in a hospital, there are a wide range of procedures to be completed, placing a significant burden on the bereaved family. In particular, tasks such as scheduling the funeral, checking the progress of various procedures, and calculating costs can be both psychologically and time-consuming. This can cause funeral procedures to not proceed smoothly. Furthermore, since there is no system that can centrally manage these tasks, managing each task individually can be cumbersome. Therefore, there is a need for a system that can handle funeral procedures efficiently and in an integrated manner.

[1700] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1701] In this invention, the server includes means for a user to input basic information about the deceased, means for a terminal to transmit the input information to the server, means for the server to store the received information about the deceased in a database, means for the server to verify the validity of the stored information, means for the server to notify a call center, means for the call center to communicate with a service provider, means for the server to calculate a funeral schedule, means for the server to notify the user of the calculated schedule and specific costs, means for the user to input funeral invitees, and means for the server to track progress and notify the user in real time, thereby making it possible to streamline funeral procedures and reduce the psychological and time burden on the bereaved.

[1702] "User" refers to the person who enters information about the deceased and operates the system.

[1703] "Terminal" refers to an electronic device used by a user to input information, including a computer or smartphone.

[1704] "Server" refers to a central system that processes received information, stores it in a database, and sends necessary notifications.

[1705] "Basic information about the deceased" refers to data about the deceased person, such as their name, date and time of death, place of death, and contact information.

[1706] "Database" refers to a storage system for systematically storing information received by a server.

[1707] A "call center" refers to a department that receives information from users and communicates with service providers.

[1708] "Service provider" refers to a funeral home or other provider of related services.

[1709] "Schedule" refers to the planning of time, including the dates of the funeral, memorial service, and interment.

[1710] "Cost" refers to the total amount of the funeral, including the basic fee, altar fee, and optional fees.

[1711] "Invitees" refers to people invited to the funeral, including names and contact information.

[1712] "Progress" refers to the completion status and progress of each dispatch task.

[1713] "Real-time" means that information is processed immediately and communicated to the user without delay.

[1714] The present invention relates to a comprehensive system that efficiently supports procedures after the death of a deceased person in a hospital. This system smoothly manages each step of the funeral procedures by allowing users to input information about the deceased and processing the information between the terminal and the server.

[1715] The terminals used by users to input information are electronic devices such as computers and smartphones. These terminals can access the system using a dedicated interface. The input information is sent to the server via the Internet.

[1716] The server validates the data based on the information it receives. Specifically, it checks whether the name is not empty and whether the date and time are entered in the correct format. After validation, the server stores this information in a database. The database used can be a common relational database such as MySQL or PostgreSQL.

[1717] The server then notifies the call center based on the stored information, which then uses the system to verify the deceased's details and contact funeral homes and other related service providers, so that the necessary procedures can be taken care of.

[1718] Furthermore, the server calculates the optimal funeral schedule based on the received information and information from the call center. This schedule is notified to the user. For example, it may include specific dates such as "funeral on October 5th, funeral on October 7th, and burial on October 8th."

[1719] The server also performs calculations to calculate the specific breakdown of costs. The costs are assessed based on various items such as the base fee, altar fee, and optional fees, and the total is calculated. The calculated cost is notified to the user.

[1720] Additionally, users can select funeral invitees through the system. The server stores this information in a database and tracks the progress. Users are notified in real time of the completion of each arrangement.

[1721] Specific examples

[1722] For example, a user enters information about a deceased person, such as "Yamada Taro, October 5, 1980, Ikoma Hospital, taro@example.com," into a terminal and submits it. The server saves this data in a database and notifies the call center. The call center contacts "Funeral Home XYZ" to arrange the funeral schedule. The server calculates the schedule and notifies the user that "the funeral will be held on October 5, the funeral on October 7, and the coffin on October 8." The server then calculates the breakdown of costs and notifies the user that "the total will be 450,000 yen." When the user enters the information about the guests attending the funeral, the server saves the information and notifies the user of the progress in real time.

[1723] Prompt Sentence Examples

[1724] "Write a program that allows a user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information, and then the system will take that information, store it in a database, calculate the funeral schedule and costs, and notify the user."

[1725] This invention makes it possible to efficiently and comprehensively manage the funeral procedures of the deceased, thereby significantly reducing the psychological and time burden on the bereaved family.

[1726] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1727] Step 1:

[1728] The user logs in to a terminal and accesses a dedicated screen in the system. The user enters basic information about the deceased (name, date and time of death, hospital where death occurred, contact information). The entered information is sent to the system based on the user's current activity. A specific example of this behavior is when the user enters information such as "Yamada Taro, October 5, 1980, Ikoma Hospital, taro@example.com."

[1729] Input: Basic information about the deceased person entered by the user (name, date and time of death, place of death, contact information)

[1730] Output: HTTP request containing the entered data

[1731] Step 2:

[1732] The device sends the information entered by the user to the server. The device sends this information to the server as an HTTP request. The data transmission is confirmed, and the fact that it has been received by the server is recorded in a log.

[1733] Input: Basic information about the deceased person entered by the user

[1734] Output: The deceased person's information sent to the server

[1735] Step 3:

[1736] The server receives the information sent from the terminal. The server saves the received data in a database. When saving, the server checks the validity of the information, for example, to make sure that the name is not empty and that the date and time are in the correct format. Only information that has been confirmed to be valid is saved in the database.

[1737] Input: Information about the deceased person sent from the device

[1738] Output: Information about the deceased person stored in the database

[1739] Step 4:

[1740] The server notifies the call center based on the information stored in the database, generates the notification content, calls the API endpoint associated with the call center to send the notification, and waits for a response to confirm that the call center received the notification.

[1741] Input: Information about the deceased person stored in the database

[1742] Output: Notification to the call center

[1743] Step 5:

[1744] The call center receives the notification, accesses the system to confirm the information of the deceased, and contacts the funeral home and other related service providers to carry out the necessary procedures. The content of the communication with the funeral home and the progress are recorded in the system.

[1745] Input: Notification from the server

[1746] Output: Contacting relevant service providers and recording progress in the system

[1747] Step 6:

[1748] The server calculates the optimal funeral schedule based on the information provided by the call center and the deceased's information. The server uses a scheduling algorithm to determine the dates for the funeral, funeral service, and interment. The calculation results are stored in an internal database and notified to the user.

[1749] Input: Information about the deceased and information provided by the call center

[1750] Output: Calculated funeral schedule and notification to the user

[1751] Step 7:

[1752] The server calculates the breakdown of costs, processes and calculates the data for each item (basic fee, altar fee, optional fee, etc.), and calculates the total amount. The calculation result is notified to the user.

[1753] Input: Information about the deceased and cost information from the service provider

[1754] Output: Calculated cost breakdown and notification to the user

[1755] Step 8:

[1756] The user enters the names and contact information of the guests for the funeral into the system. The user enters the names and contact information of the guests and submits it to the system.

[1757] Input: Invitee's name and contact information

[1758] Output: Sending invitee information from the device to the server

[1759] Step 9:

[1760] The server stores the entered invitee information in a database and tracks the progress, notifying the user in real time of the completion status of each arrangement task.

[1761] Input: Invitee information entered by the user

[1762] Output: Invitee information stored in database and progress notification to user

[1763] This allows the system to efficiently manage each step of the funeral process and provide users with real-time information.

[1764] (Application example 1)

[1765] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1766] Traditional funeral procedures require bereaved families to go through a number of complicated procedures, including scheduling and cost calculations, placing a significant burden on their time and mental well-being. Furthermore, there are relatives and friends who cannot attend the funeral due to physical distance or time constraints. Therefore, there is a growing need for a system that allows for efficient funeral procedures, sharing funeral information through digital content, and enabling real-time confirmation.

[1767] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1768] In this invention, the server includes a means for inputting information about the deceased, a means for transmitting the information to the server, and a means for the call center to communicate with the service provider. This streamlines funeral procedures and allows users to check funeral information in real time through digital content. Users can also complete funeral procedures online using their smart devices.

[1769] "Information about the deceased" includes information necessary for funeral procedures and scheduling, such as the name of the deceased, the date and time of death, the place of death, and contact information.

[1770] A "server" is a computer system that receives information sent by users, stores it in a database, and handles funeral procedures and scheduling.

[1771] "Database" means a data storage system for storing and managing information about deceased persons and other related data received by the Server.

[1772] A "call center" is a facility or system that contacts service providers based on information notified by a server and proceeds with funeral procedures.

[1773] "Service providers" refer to funeral homes and related service providers who work with the call center to arrange and prepare for funerals.

[1774] "Schedule" refers to the dates of the funeral, memorial service, and coffin placement, and is a plan calculated by the server.

[1775] "Costs" refers to the specific costs involved in a funeral, including the basic fee, altar costs, optional fees, etc.

[1776] "User" refers to an individual who enters information about the deceased and processes funeral arrangements through the system.

[1777] "Digital content" refers to digitized information and images provided in a format that allows funeral information to be viewed in real time.

[1778] "Smart devices" refers to advanced mobile devices such as smartphones, smart glasses, and head-mounted displays, which can be used to complete funeral procedures online.

[1779] "Completing online" means that all necessary procedures are carried out in a virtual space via the Internet, eliminating the need for physical travel or the exchange of documents.

[1780] The present invention relates to a system that provides comprehensive support for procedures after a deceased person passes away in a hospital, allowing users to efficiently check funeral information and complete procedures through digital content using a smart device.

[1781] Overall system overview

[1782] The system begins when the user inputs information about the deceased using a smart device (smartphone, smart glasses, head-mounted display, etc.) and sends that information to a server. The server stores the received information in a database and works with a call center to schedule the funeral and handle various procedures. The server then notifies the user of the calculated schedule and specific costs, allowing the user to select and input funeral invitees. This allows users to check funeral information in real time through digital content.

[1783] Program processing details

[1784] Enter information

[1785] Users log in to the system using their smart device and enter information about the deceased (name, date and time of death, place of death, contact information), which is then sent from the device to the server.

[1786] Initial Data Processing

[1787] The server stores the information received from the device in a database and checks the validity of the data, after which the necessary processing begins.

[1788] Collaboration with call centers

[1789] The server then notifies the call center based on the stored information, and the call center then works with the service provider to make preparations such as arranging the funeral schedule.

[1790] Funeral arrangement schedule calculation

[1791] The server calculates the dates for the funeral, memorial service, and coffin based on the received information and information from the service provider.

[1792] Specific cost calculation

[1793] The server calculates the specific costs of a funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[1794] Digital content provision

[1795] Users can check funeral information in real time using their smart devices, and can also use AR with smart glasses to recreate the funeral in a VR space using a head-mounted display.

[1796] Hardware and software used

[1797] Hardware: Smartphones, smart glasses, head-mounted displays

[1798] Software: Flask (backend framework), SQLite (database), ARKit (AR development for smart glasses), Unity (VR development)

[1799] Description and examples

[1800] Description

[1801] The server receives the information about the deceased person sent by the user and stores it in a database. It then notifies the call center and coordinates with the service provider to arrange the funeral schedule. The user can check the calculated schedule and specific costs on their smart device and complete the necessary procedures online. They can also check funeral information in real time through digital content.

[1802] Specific examples

[1803] When a user opens the "Digital Funeral Management Assistant" app and taps "View Funeral Schedule," the next screen displays "Funeral on October 5th," "Funeral on October 7th," and "Coffining on October 8th." The user can also start using the head-mounted display to recreate the funeral scene in a VR space.

[1804] Prompt Sentence Examples

[1805] "Please enter the deceased's information: name, date and time of death, place of death, and contact information."

[1806] "View funeral schedule?"

[1807] "Would you like to be notified of progress?"

[1808] In this way, the system of the present invention provides a specific method for efficiently carrying out funeral procedures and allowing users to check funeral information in real time through digital content.

[1809] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1810] Step 1:

[1811] A user logs in to the system using a smart device.

[1812] Input and Output: The user enters login information, the system receives user authentication data, the server authenticates the user and returns the authentication result.

[1813] Specific operation: The user enters their username and password and taps the login button. The server receives this and verifies it against the authentication information in the database. If it matches, the user is allowed to log in.

[1814] Step 2:

[1815] The user enters information about the deceased.

[1816] Input and Output: The user enters the name of the deceased, the date and time of death, the place of death, and contact information, and presses the send button. The device sends this data to the server.

[1817] Specific behavior: The user enters information into an input form and taps the submit button.

[1818] Step 3:

[1819] The server stores the received information of the deceased in a database.

[1820] Input and Output: The server receives the data of the deceased person from the user, checks the integrity of the data, and stores it in the database. It also logs the results of the storage.

[1821] Specific operation: After receiving the data, the server checks whether the required data fields have been entered correctly and saves it in the database.

[1822] Step 4:

[1823] The server notifies the call center based on the stored information.

[1824] Input and Output: The server retrieves the information of the deceased from the database, generates and sends notification data to the call center, and the call center receives the notification.

[1825] Specific operation: The server reads the necessary information from the database and notifies the call center system via API or email.

[1826] Step 5:

[1827] The call center will contact the service provider.

[1828] Input and Output: Based on the information received from the server, the call center contacts the service provider and initiates the necessary preparations. At the same time, it reports the results of the contact to the server.

[1829] Specific operations: Call center staff will contact the service provider by phone or email, confirm the schedule and service details, and proceed with the arrangements.

[1830] Step 6:

[1831] The server calculates the funeral schedule.

[1832] Input and Output: The server receives information from the call center or service provider, compares it with the information of the deceased, calculates the optimal funeral schedule, saves the calculated schedule in a database, and notifies the user.

[1833] Specific operation: A date and time calculation algorithm is executed on the server, the optimal schedule is calculated, and stored in the database.

[1834] Step 7:

[1835] The server notifies the user of the calculated schedule and costs.

[1836] Input and Output: The server sends the calculated schedule and cost information to the user's device. The user receives a notification and checks the details.

[1837] Specific operation: The server generates a notification message based on the data and sends it to the user's device via push notification or email.

[1838] Step 8:

[1839] The user enters the guests for the funeral.

[1840] Input and Output: The user enters the information of people to invite to the funeral on the system and sends it to the server, which stores the received data in a database.

[1841] Specific behavior: The user enters the invitee list and taps the send button.

[1842] Step 9:

[1843] The server tracks the progress and notifies the user.

[1844] Input and Output: The server tracks the completion status of each dispatch task in a database and notifies the user of the progress. The user receives notifications to check the progress.

[1845] Specific operation: The server periodically checks the database and notifies the user in real time when it detects any changes in progress.

[1846] Step 10:

[1847] Users can check funeral information in real time through digital content.

[1848] Input and Output: The user uses a smart device to check funeral information through the app, and the server streams the necessary data to the device.

[1849] What happens: A user opens the app and taps the required button to check real-time information. The server streams the data in real time.

[1850] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1851] The present invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital and that recognizes and responds to the user's emotions, and can be implemented in the following forms.

[1852] Overall system overview

[1853] The system begins when a user enters information about the deceased using a terminal and sends it to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with the service provider to schedule the funeral and carry out various procedures. The server then calculates the funeral schedule and specific costs and notifies the user. The user can also select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. In addition, an emotion engine recognizes the user's emotions and can provide appropriate information and responses based on their emotional state. This makes it possible to efficiently process funeral procedures for the deceased while also reducing the emotional burden on the user.

[1854] Program processing details

[1855] Enter information

[1856] A user logs into the system using a terminal and enters information about the deceased (e.g., name, date and time of death, place of death, contact information). The terminal then sends this information to the server.

[1857] Initial Data Processing

[1858] The terminal sends the entered data to the server, which stores the received data in a database. The server then checks the validity of the data and initiates appropriate processing.

[1859] Collaboration with call centers

[1860] The server uses the stored information to notify the call center, which then contacts funeral homes and other related service providers to arrange for the necessary procedures.

[1861] Funeral arrangement schedule calculation

[1862] The server calculates the optimal funeral schedule based on the received information and information from the service provider. Specifically, it determines the dates for the funeral, memorial service, and burial, taking into account the date and time of the deceased's death and other factors.

[1863] Specific cost calculation

[1864] The server calculates the specific costs of the funeral, based on various items such as the basic fee, altar fee, and optional fees, and then calculates the total amount.

[1865] Introducing the Emotion Engine

[1866] The emotion engine analyzes the user's voice and facial expressions to recognize the user's emotional state. For example, when a user provides audio or video input to the device through a microphone or camera, the emotion engine analyzes this and determines the user's emotional state, such as sadness, anger, or surprise. Depending on the emotional state, the system adjusts its response and provides information and support that takes the user's feelings into consideration.

[1867] Specific examples

[1868] Specific examples are given below.

[1869] 1. Enter information

[1870] The user enters the name of the deceased, the date and time of death, the hospital where they died, and their contact information into the terminal.

[1871] The terminal sends the input data to the server.

[1872] 2. Initial Data Processing

[1873] The server stores the received data in a database and checks the validity of the data.

[1874] 3. Collaboration with call centers

[1875] The server notifies the call center and makes the necessary arrangements.

[1876] The call center will contact the funeral home and begin preparations.

[1877] 4. Schedule funeral arrangements

[1878] The server calculates the optimal schedule, and concludes that the funeral will be held on October 5th, the memorial service on October 7th, and the coffin will be placed on October 8th.

[1879] 5. Specific cost calculation

[1880] The server calculates the breakdown of the costs and notifies the user that the total cost is 450,000 yen.

[1881] Use of emotion engine

[1882] When a user speaks into the device, the emotion engine analyzes the voice and if it recognizes sadness, the system will respond with a softer tone that takes that emotion into account. If the camera analyzes the user's facial expressions and detects stress, the system will take appropriate measures, such as reducing the frequency of progress notifications.

[1883] In this way, the system of the present invention can efficiently carry out procedures after the death of a deceased person in a hospital and reduce the emotional burden on the user.

[1884] The processing flow will be explained below.

[1885] Step 1:

[1886] A user logs in to a terminal.

[1887] The user logs into the system and accesses the screen for entering information about the deceased.

[1888] Step 2:

[1889] The user enters information about the deceased.

[1890] The device displays a form for the user to enter the name of the deceased, the date and time of death, the hospital where they died, and their contact information.

[1891] The user enters the required information into the form and clicks the "Submit" button.

[1892] Step 3:

[1893] The terminal sends the input data to the server.

[1894] The terminal formats the input data and sends it to the server.

[1895] Step 4:

[1896] The server receives the data.

[1897] The server stores the received data in a database.

[1898] The server validates the data (e.g., whether all required fields are filled in, whether the format is correct, etc.).

[1899] Step 5:

[1900] The server notifies the call center.

[1901] The server connects to the call center system and transmits information about the deceased.

[1902] The server instructs the call center to prepare the funeral arrangements.

[1903] Step 6:

[1904] The call center will begin making arrangements.

[1905] The call center will contact the service provider (e.g., funeral home) and carry out the necessary procedures.

[1906] Step 7:

[1907] The server calculates the schedule.

[1908] The server calculates the optimal funeral schedule based on information about the deceased and information from the call center.

[1909] The server saves the calculated schedule (e.g., funeral on October 5th, memorial service on October 7th, and burial on October 8th) in the database.

[1910] Step 8:

[1911] The server notifies the user of the schedule.

[1912] The server uses the notification function to display the schedule on the user's terminal.

[1913] Step 9:

[1914] The server calculates the cost.

[1915] The server takes in the cost information (basic fee, altar fee, optional fee, etc.) provided by the funeral home and calculates the total cost.

[1916] The server stores the calculated breakdown of costs and the total amount in a database.

[1917] Step 10:

[1918] The server presents the cost to the user.

[1919] The server uses a notification function to display the cost on the user's terminal.

[1920] Step 11:

[1921] A user creates a funeral guest list.

[1922] The terminal displays an invitee list input form to the user.

[1923] The user enters the invitee's name and contact information and clicks the "Save" button.

[1924] Step 12:

[1925] The terminal transmits the invitee information to the server.

[1926] The terminal transmits the input invitee information to the server.

[1927] Step 13:

[1928] The server stores the invitee information.

[1929] The server stores the received invitee information in a database.

[1930] Step 14:

[1931] The server tracks the progress.

[1932] The server monitors the completion status of each dispatch task and updates the information in the database.

[1933] Step 15:

[1934] The server notifies the user of the progress.

[1935] The server uses a notification function to display progress and required actions on the user's device in real time.

[1936] Step 16:

[1937] The emotion engine analyzes voice input.

[1938] The terminal acquires the user's voice through a microphone.

[1939] The emotion engine analyzes the acquired voice data and recognizes the user's emotional state (sadness, anger, anxiety, etc.).

[1940] Step 17:

[1941] The emotion engine analyzes facial expressions using a camera.

[1942] The device captures the user's facial expression through the camera.

[1943] The emotion engine analyzes the acquired facial expression data and determines the user's emotional state.

[1944] Step 18:

[1945] The server adjusts the response depending on the emotional state.

[1946] The server receives input from the emotion engine and notifies the user of soft-toned messages and additional support information according to the user's emotional state.

[1947] Step 19:

[1948] The user performs the final confirmation.

[1949] The device will display a final confirmation screen, prompting the user to verify that all information is correct.

[1950] The user makes any necessary corrections and completes the final check.

[1951] Step 20:

[1952] The server will follow up.

[1953] The server tracks the system's progress and notifies the user whenever follow-up is required.

[1954] In this way, the system of the present invention can efficiently carry out procedures after the death of a deceased person in a hospital and reduce the emotional burden on the user.

[1955] Example 2

[1956] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1957] Conventional funeral arrangement systems for the deceased lack consideration for the user's emotional state, resulting in significant mental strain on the user. The procedures are also cumbersome and lack smooth progress. Furthermore, the cost transparency is low, making it difficult to estimate the total cost.

[1958] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting information about the deceased, means for transmitting the information to the server, means for storing the received information about the deceased in a database, means for the server to notify a call center based on the stored information, means for the call center to communicate with related service providers, means for the server to calculate a funeral schedule, means for the server to notify a user of the calculated schedule and costs, means for the user to input funeral invitees, means for the server to track progress and notify the user, and means including an emotion recognition engine that analyzes the user's voice and facial expressions and adjusts response content according to the user's emotional state. This makes it possible to efficiently process the funeral procedures for the deceased, reduce the emotional burden on the user, and increase cost transparency.

[1959] "Information about the deceased" is basic data such as the name of the deceased, the date and time of death, the place of death, and contact information.

[1960] A "server" is a central system for storing and calculating data; it is a computer system that stores information in a database and performs notifications and schedule calculations.

[1961] A "database" is a system that stores received information in an organized manner and allows it to be accessed and searched efficiently when needed.

[1962] A "call center" is a department or system that handles user support and contact with related service providers.

[1963] "Related service providers" refers to funeral homes and other companies or individuals that provide services related to funerals.

[1964] "Funeral schedule" refers to the dates of events such as the deceased's funeral, memorial service, and coffin placement.

[1965] "Costs" refers to the specific amount of money involved in a funeral, including the basic fee, altar costs, and optional fees.

[1966] An "emotion recognition engine" is a system that analyzes a user's voice and facial expressions to recognize their emotional state.

[1967] "Means for adjusting response content" refers to a function that changes the system's response content according to the user's emotional state.

[1968] The present invention relates to a system that comprehensively supports procedures after a deceased person passes away in a hospital and recognizes and responds to the user's emotions. The system begins when the user inputs information about the deceased using a terminal and sends the information to a server. The server then stores the received information in a database and notifies a call center so that appropriate arrangements can be made. The call center then coordinates with related service providers to schedule the funeral and carry out various procedures. The server calculates the funeral schedule and specific costs and notifies the user. The user can also select funeral invitees and enter their contact information. The server tracks the progress and notifies the user in real time. In addition, an emotion engine analyzes the user's voice and facial expressions and provides appropriate information and responses based on the user's emotional state. This system efficiently processes the funeral of the deceased while reducing the user's emotional burden.

[1969] Hardware and software used

[1970] The following hardware and software are used to implement this system:

[1971] Devices: computers, smartphones, tablets, etc.

[1972] Server: Database management system (e.g., MySQL, PostgreSQL), web server (e.g., Apache, Nginx)

[1973] Call Center Software: Customer Relationship Management Systems (CRM), Telephone Systems

[1974] Emotion engine: speech recognition software (e.g., Google Cloud Speech-to-Text), facial recognition software (e.g., Microsoft Azure Face API)

[1975] Specific examples

[1976] User input of deceased person information

[1977] First, the user logs in to the device and enters the name of the deceased, the date and time of death, the place of death, and contact information into a dedicated input form. For example, suppose the user enters "Input amount: Name = Ichiro Tanaka, Date = October 1, 2023, Place = Tokyo Hospital, Contact information = 090-XXXX-XXXX."

[1978] Sending data from the device to the server

[1979] When the user presses the input completion button, the terminal sends the input data to the server using the HTTPS protocol.

[1980] Server initial data processing

[1981] The server saves the data received from the device in a database and checks whether the save was successful. Next, it verifies the validity of the received data. For example, it checks whether the received date and time is in the future.

[1982] Collaboration with call centers

[1983] The server then sends a notification to the call center based on the validated data. This notification includes basic information about the deceased and the urgency of the situation. The server uses a REST API to send the notification to the call center system.

[1984] Arrangements made through the call center

[1985] Based on the notification received from the server, the call center contacts the funeral home or other related service providers and carries out the necessary procedures. For example, the call center may contact them and say, "Please arrange the funeral for the deceased, Mr. Ichiro Tanaka."

[1986] Funeral schedule calculation

[1987] Based on the information returned from the call center, the server calculates the optimal funeral schedule. For example, if the deceased dies on October 1st, the server calculates the schedule as follows: funeral on October 5th, funeral on October 7th, and burial on October 8th.

[1988] Cost calculation

[1989] The server calculates the specific costs of the funeral. For example, if the basic fee is 300,000 yen, the altar fee is 100,000 yen, and the optional fee is 50,000 yen, the server will notify the user that the total cost is 450,000 yen.

[1990] Use of emotion engine

[1991] When a user speaks into the device, their voice and facial expressions are transmitted to the emotion engine via the device's microphone and camera. The emotion engine then uses voice and facial recognition technology to analyze the user's emotions. For example, if the emotion engine detects "sadness," the system will respond in a soft tone, saying, "We will provide services that are considerate of the feelings of bereaved families during this difficult time."

[1992] Prompt Sentence Examples

[1993] "Please enter the name of the deceased, the date and time of death, the place of death, and contact information."

[1994] In this way, by utilizing the specific embodiment of the invention, the user can efficiently proceed with funeral procedures while receiving emotional support.

[1995] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1996] Step 1:

[1997] The user enters information about the deceased. Specifically, after logging in, the user enters the name of the deceased, the date and time of death, the place of death, and contact information into an input form on the device. This information is collected on the device as input data. For example, the user enters "Ichiro Tanaka, October 1, 2023, a hospital in Tokyo, contact information: 090-XXXX-XXXX."

[1998] Input: Data entered by the user into an input form

[1999] Output: Confirmation screen displayed on the device

[2000] Step 2:

[2001] The device sends the entered data to the server. When the user presses the completion button, the device securely sends the data to the server using the HTTPS protocol. For example, the entered data is encrypted and sent to the server.

[2002] Input: The user presses the input completion button.

[2003] Output: The input data sent to the server

[2004] Step 3:

[2005] The server performs initial processing of the received data. The server saves the received data in the database and checks whether the save was successful. After the save is successful, the validity of the data is verified and checked for any omissions or abnormalities. For example, it checks whether the received date and time is a future date.

[2006] Input: Data sent to the server

[2007] Output: Data stored in the database and validation results

[2008] Step 4:

[2009] The server notifies the call center based on the data. After validation is complete, the server sends a notification to the call center using REST API. This notification includes basic information about the deceased and the urgency level. For example, the notification is delivered to the call center in real time.

[2010] Input: Validated data

[2011] Output: Notification sent to the call center

[2012] Step 5:

[2013] The call center contacts related service providers. Based on the notification received from the server, the call center contacts the funeral home and other related service providers. For example, the call center may request the funeral home to handle the procedures, including the funeral for Mr. Ichiro Tanaka.

[2014] Input: Notification sent to call center

[2015] Output: Contact relevant service providers

[2016] Step 6:

[2017] The server calculates the funeral schedule. Based on the information returned from the call center, the server calculates the optimal funeral schedule. For example, if the deceased dies on October 1st, the server determines the schedule as follows: funeral on October 5th, funeral service on October 7th, and coffin placement on October 8th.

[2018] Input: Information from the call center

[2019] Output: Calculated funeral schedule

[2020] Step 7:

[2021] The server calculates the funeral costs. The server calculates the specific costs for the funeral and notifies the user. For example, the total cost would be 450,000 yen, with a basic fee of 300,000 yen, an altar fee of 100,000 yen, and an optional fee of 50,000 yen.

[2022] Input: Funeral schedule and cost information

[2023] Output: Total cost reported to the user

[2024] Step 8:

[2025] The user enters the names and contact information of the people they want to invite to the funeral. The user logs in to the device and enters the names and contact information of the people they want to invite to the funeral. This information is collected by the device.

[2026] Input: Data entered by the user into an input form

[2027] Output: Confirmation screen displayed on the device

[2028] Step 9:

[2029] The server tracks the progress of each procedure in real time and notifies the user of the progress. For example, it provides status such as "Funeral preparations are complete" or "Funeral has begun."

[2030] Input: Progress data for each procedure

[2031] Output: Progress reported to the user

[2032] Step 10:

[2033] The emotion engine analyzes the user's emotional state. When the user speaks into the device, the voice and facial expressions are sent to the emotion engine via the device's microphone and camera. For example, if sadness is detected, the engine responds by saying, "We will provide services that are sensitive to the feelings of bereaved families during this difficult time."

[2034] Input: User's voice and facial expression data

[2035] Output: System response based on analysis results

[2036] (Application example 2)

[2037] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2038] Traditionally, the procedures and funeral preparations after a deceased person passes away in a hospital have been a heavy burden for the bereaved, and it is difficult to make appropriate decisions, especially when they are in an emotionally unstable state. In this situation, a means is needed to efficiently handle a wide range of tasks, including managing the deceased's information, making arrangements, scheduling and calculating the funeral costs, communicating with service providers, managing funeral invitees, and tracking progress.

[2039] In addition, because they lack the ability to recognize and respond to the emotional state of the bereaved, there is a need for support to alleviate the burden of anxiety, sadness, and other feelings.

[2040] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about the deceased; means for transmitting the information to the server; means for storing the received information about the deceased in a database; means for the server to notify a call center based on the stored information; means for the call center to communicate with a service provider; means for the server to calculate a funeral schedule; means for the server to notify the user of the calculated schedule and costs; means for the user to input funeral invitees; means for the server to track progress and notify the user; means for recognizing the user's emotions based on voice or facial expressions; and means for providing information and responses according to the user's emotional state. This enables the funeral procedures for the deceased to be carried out efficiently and reduces the emotional burden on the user. Furthermore, the call center can provide comprehensive support by issuing instructions to a service provider and arranging for enhanced security procedures around the user's home and hospital.

[2041] "Deceased person information" refers to basic data about the deceased, such as their name, date and location of death, and contact information.

[2042] "Server" is a central processing unit that stores received information in a database and manages and executes various procedures.

[2043] A "database" is a system for storing and managing information received by a server in a structured format.

[2044] A "call center" is a contact point that communicates and coordinates with users and service providers and carries out necessary procedures.

[2045] "Service provider" refers to a company or organization that supports funerals and related procedures, such as a funeral home or security company.

[2046] A "schedule" is a plan that lists specific dates and times for the funeral, memorial service, and coffin placement.

[2047] "Cost" refers to the total cost of the funeral, including the basic fee, altar fee, optional fees, etc.

[2048] The "user" is the person who inputs the information of the deceased and manages the progress of the funeral procedures, usually a family member.

[2049] "Invitees" refers to people who should be invited to a funeral or other event, and can be entered by the user.

[2050] "Progress" refers to information that indicates the current state of the procedure, i.e., to what stage it has progressed.

[2051] "Audio or facial expression" refers to media input used for emotion recognition, such as the user's voice or facial movements.

[2052] "Means for recognizing emotions" refers to a system or software that analyzes and determines the user's emotional state from their voice and facial expressions.

[2053] "Information provision and response" refers to providing appropriate information based on the user's emotional state and making the necessary support and arrangements.

[2054] This invention relates to a system that comprehensively supports procedures after a deceased person has passed away in a hospital, and recognizes and responds to the user's emotions. This system is realized by the cooperation of terminals, a server, an emotion engine, and a call center.

[2055] ○ Overview of the entire system

[2056] Information input and notifications:

[2057] The user uses a smartphone to input information about the deceased (e.g., name, date and time of death, location, contact information), which is then sent to the server.

[2058] Initial data processing:

[2059] The server stores the received information of the deceased in a database, verifies the validity of the data, and then notifies the call center to initiate the appropriate procedures.

[2060] Using the Emotion Engine:

[2061] The device uses a microphone and a camera to analyze the user's voice and facial expressions. The server recognizes the user's emotional state through an emotion engine and provides flexible responses according to the emotional state. The emotion engine uses the EmotionRecognition library for analysis.

[2062] Security Arrangements:

[2063] Based on the notification received, the call center will contact service providers such as funeral homes and security companies to initiate necessary preparations, particularly procedures to strengthen security around homes and hospitals.

[2064] Progress Notifications:

[2065] The server notifies the user of the progress of the procedure in real time and visually displays the schedule and arrangement status.

[2066] ○ Hardware and software used

[2067] Hardware:

[2068] Smartphone

[2069] microphone

[2070] Facial Recognition Camera

[2071] software:

[2072] Python

[2073] EmotionRecognition Library

[2074] REST API

[2075] ○ Specific examples

[2076] For example, a user logs in to their smartphone and enters information such as the name of the deceased, the date and time of death, and the location. The emotion engine then analyzes their voice and facial expressions and recognizes that they are sad. In this case, the system suggests security arrangements in a softer tone and begins strengthening security around the home. Furthermore, the user is notified in real time of the progress of the process.

[2077] ○ Example of prompt sentence for generative AI model

[2078] Enter the name, date, and location of the deceased person. We'll analyze their voice and facial expressions to recognize their emotions and make appropriate security arrangements and notify you of their progress.

[2079] Example input:

[2080] Name: Yamada Ichiro

[2081] Date of death: October 10, 2023, 10:00 AM

[2082] Place of death: Tokyo Hospital

[2083] Intended Action:

[2084] Information transmission

[2085] Emotion analysis

[2086] Security Arrangements

[2087] Progress Notifications

[2088] The above is a specific description of an embodiment of the present invention. This system allows the funeral procedures of the deceased to be carried out efficiently and reduces the emotional burden on the user. In addition, efficient security arrangements allow the bereaved family to proceed with the procedures with peace of mind.

[2089] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2090] Step 1:

[2091] The user logs in to their smartphone and enters information about the deceased (e.g., name, date and time of death, location, contact information). The information entered by the user is sent to the server by the device, which then begins receiving information about the deceased.

[2092] Step 2:

[2093] The server receives the information of the deceased and stores it in the database. First, the server checks the validity of the data, and then it is stored in the database. The stored data enables the following processes:

[2094] Step 3:

[2095] The server notifies the call center for appropriate processing. The server retrieves the stored information from the database and sends it to the call center, so that the call center can begin preparing the processing.

[2096] Step 4:

[2097] Based on the notification received by the call center, the service providers such as funeral parlors and security companies are contacted, and the necessary procedures and preparations are carried out. In particular, contact is made to ensure that security procedures are strengthened.

[2098] Step 5:

[2099] The server calculates the funeral schedule. Here, it determines the dates for the funeral, funeral service, and coffin placement based on the date and time of the deceased's death and other necessary information. The calculated schedule is notified to the user in the next step.

[2100] Step 6:

[2101] The server notifies the user of the calculated schedule and costs. The costs are calculated based on the basic fee, altar fee, optional fees, etc. The notification allows the user to check the specific schedule and costs.

[2102] Step 7:

[2103] The user enters the invitees for the funeral. This information is also sent to the server and stored in the database, which manages the contact information of the invitees.

[2104] Step 8:

[2105] The server tracks the progress of the procedure and notifies the user in real time. The progress is determined based on information from the service provider and the progress of internal processing, so the user can always get the latest information.

[2106] Step 9:

[2107] The emotion engine analyzes the user's voice and facial expressions to recognize their emotional state. This is done using the device's microphone and camera. The server uses the EmotionRecognition library to perform the analysis and recognize the user's emotions, such as sadness or anger.

[2108] Step 10:

[2109] The server provides information and responds according to the user's emotional state. Based on the results obtained from the emotion engine, the server responds in a soft tone and suggests necessary support, thereby reducing the emotional burden on the user.

[2110] Through the above steps, the system of the present invention can comprehensively support procedures after the deceased person passes away in a hospital, and can recognize the user's emotions and respond appropriately.

[2111] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2112] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2113] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2114] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2115] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2116] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2117] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2118] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2119] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2120] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2121] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2122] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2123] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Se...

Claims

1. a means for entering information about the deceased; means for transmitting said information to a server; a means for storing the information of the deceased person received by the server in a database; A means for the server to notify the call center based on the stored information; the means by which the call center communicates with the service provider; A means for the server to calculate a funeral schedule; a means for the server to notify the user of the calculated schedule and costs; a means for a user to input funeral invitees; a means for the server to track progress and notify the user; A system including:

2. The system of claim 1 , wherein a breakdown of costs is presented to the user.

3. 10. The system of claim 1, further comprising a method for the call center to issue instructions to a service provider.

Images