system

Abstract

We provide the system. [Solution] A means for receiving request information from a user and analyzing related conditions based on that information, Based on the aforementioned related conditions, a means for searching a database for multiple candidate venues and vendors and selecting the optimal combination, A means for providing the user with detailed information on the selected candidates and for receiving the user's selection, A system that includes means for automatically executing booking procedures with selected venues and vendors based on received selections.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In preparing for a funeral, a user has to spend a great deal of time and effort to select an optimal funeral hall and service provider from a variety of options. This process is particularly burdensome during a particularly mentally difficult time. Also, due to the complex entanglement of individual conditions such as region, budget, and religious wishes, it is not easy for the user to make the selection on their own. Furthermore, there are difficulties in negotiating with multiple service providers to proceed with the procedures, and there is a possibility of misunderstanding and procedural mistakes. In such a situation, there is a desire to provide a system that quickly and effectively selects and arranges a funeral hall and service provider that meet the conditions required by the user.

Means for Solving the Problems

[0005] This invention provides a means for receiving request information from a user and analyzing relevant conditions such as region, budget, and religious preferences based on that information. Based on the analyzed conditions, a generative AI model is used to search a database for multiple candidate funeral halls and service providers and select the optimal combination. The invention also includes a means for providing detailed information on these selected candidates to the user and receiving the user's selection. Furthermore, by having a means for automatically executing reservation procedures with the selected funeral hall and service provider based on the received selection, the invention reduces the burden on the user and enables efficient funeral arrangements. In this way, this invention reduces the time and mental burden involved in preparing for a funeral and enables the user to proceed with the funeral smoothly.

[0006] "User" refers to an individual or group that uses the system to make funeral arrangements.

[0007] "Requested information" refers to the desired conditions and necessary details regarding funerals that users enter into the system.

[0008] "Relevant conditions" refer to individual requirements such as region, budget, and religious preferences, which are analyzed based on the user's request information.

[0009] "Analysis" refers to the process by which a system extracts and understands relevant conditions based on the request information received from the user.

[0010] A "generative AI model" refers to a model that uses artificial intelligence technology to analyze data and generate the optimal choice.

[0011] "Candidates" refers to multiple venues and vendors selected based on relevant criteria.

[0012] A "database" is a collection of information accessed by a system, including detailed information about funeral homes and service providers.

[0013] "Selection" refers to the process of listing the most suitable funeral venues and service providers based on the analyzed criteria.

[0014] "Detailed information" refers to specific information about the selected candidates, including location information, availability dates, cost estimates, and reviews.

[0015] "Reservation procedure" refers to the official procedure for confirming the use of the service between the user and the venue and vendor selected by the user. [Brief explanation of the drawing]

[0016] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.

Embodiments for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the language used in the following description will be explained.

[0019] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0021] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] The system of this invention is designed to streamline funeral preparations. It primarily involves three entities—a server, a terminal, and a user—working together to select the most suitable funeral venue and service provider, and to perform automated procedures.

[0038] The user first enters their wishes and requirements regarding the funeral through a terminal. This interface is designed to be easy to understand and intuitive to use, allowing users to input information such as region, budget, and religious requirements through a simple question-and-answer format.

[0039] The device receives this entered information and sends it to the server. The information is encrypted and transmitted through a secure communication environment, thus protecting your privacy.

[0040] The server analyzes the received information and extracts relevant conditions based on the request. Based on this information, it runs a generative AI model, searching a comprehensive database of funeral-related services to select the most suitable venues and service providers. The AI ​​can then suggest multiple options that best match the user's preferences.

[0041] After the selection is made, the server sends detailed information to the terminal and presents it to the user. This information includes details about each selected candidate, such as the venue's location, availability, reviews, and cost. The user can make the best choice by visually comparing the options.

[0042] Once the selection is complete, the device sends the information back to the server. The server automatically proceeds with the booking process for the selected venues and vendors. This process includes booking confirmation, generation of necessary documents, and verification.

[0043] Finally, the server sends confirmation of the reservation to the terminal, supporting the user in smoothly proceeding with the next necessary steps. This significantly reduces the stress associated with negotiating and making arrangements with multiple vendors, allowing the user to have time to remember their loved one.

[0044] For example, if a user enters "Buddhist funeral in Kyoto City, budget under 500,000 yen," the server will select candidates based on this information and present the selection results to the user's terminal. The user can then choose the most suitable option from the selected candidates and automatically proceed with the reservation process. This entire process allows for efficient and reliable funeral preparations.

[0045] The following describes the processing flow.

[0046] Step 1:

[0047] The user enters their desired funeral arrangements (e.g., location, budget, religious format) into the interface on their device. The interface is designed to be simple and intuitive to use.

[0048] Step 2:

[0049] The terminal collects information entered by the user from the input form, formats the data, and then sends it to the server. During this process, the transmitted data is encrypted and sent using a secure communication channel.

[0050] Step 3:

[0051] The server analyzes the data received from the terminal and extracts relevant conditions based on the user's request. These conditions include factors such as region, budget, and religious preferences.

[0052] Step 4:

[0053] The server runs a generative AI model and searches the database based on relevant conditions. Here, it selects several funeral homes and service providers that meet the criteria as candidates.

[0054] Step 5:

[0055] The server sends detailed information about the selected candidates (e.g., venue name, location, available dates, cost, reviews, etc.) to the terminal.

[0056] Step 6:

[0057] The terminal displays received information to the user in a visually easy-to-understand format. Users can compare the presented information and select the most suitable funeral home or service provider.

[0058] Step 7:

[0059] The user confirms their selected candidate and sends that information to the server via their device.

[0060] Step 8:

[0061] The server confirms the user's selection and automatically initiates the booking process with the chosen venues and vendors. If necessary, it also handles scheduling and contract document generation.

[0062] Step 9:

[0063] The server sends feedback to the terminal indicating that the reservation is complete. The terminal then notifies the user and provides information about the next steps.

[0064] In this way, the entire system provides users with a smooth and efficient funeral preparation process.

[0065] (Example 1)

[0066] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0067] Traditional funeral arrangements required individuals to negotiate and handle procedures with multiple venues and vendors, which was time-consuming and laborious. Furthermore, it was difficult to quickly and accurately select the best option based on the user's needs. These challenges reduced the time available for mourning the deceased and caused stress for those involved.

[0068] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0069] In this invention, the server includes means for receiving request information from a user via a terminal, encrypting the information, and transmitting it through a secure communication environment; means for analyzing the received information, extracting relevant conditions, and then running a generated AI model to search a database for multiple candidate venues and service providers, and selecting candidates; means for transmitting detailed information of the selected candidates back to the terminal to present it to the user and receiving the user's selection; and means for automatically executing the reservation procedure with the selected venue and service provider and transmitting reservation completion information to the terminal. As a result, the user can efficiently and quickly carry out procedures related to funeral preparations and ensure they have enough time to mourn the deceased.

[0070] "User" refers to an individual or organization that uses this system to make funeral arrangements.

[0071] A "terminal" is an electronic device used by a user to input or receive information, and includes computers, smartphones, tablets, and other similar devices.

[0072] A "server" is a computer system that receives, analyzes, and processes information sent by users, and is also responsible for coordinating with databases and generative AI models.

[0073] A "generative AI model" refers to an artificial intelligence algorithm that searches a database based on the user's requested conditions and selects the most suitable funeral venues and service providers.

[0074] A "prompt message" is a sentence that a user enters into the system to clarify their purpose, and may include conditions such as the funeral location, budget, and religious requirements.

[0075] A "database" is an information repository containing detailed information about funeral-related locations and businesses, which is referenced by the server when selecting candidates.

[0076] "Reservation procedures" refer to the series of processes involved in formally concluding a contract with the selected funeral home or service provider and confirming the date and conditions.

[0077] "Detailed information" refers to specific details about the selected candidates, including location data, available dates, and evaluation information.

[0078] The system of this invention operates in cooperation with three entities: a server, a terminal, and a user, in order to streamline funeral preparations.

[0079] The user first uses a terminal to input their wishes and requirements regarding the funeral. This terminal includes electronic devices such as smartphones and computers, and the user interface is designed to be intuitive. The user can input information such as "region," "budget," and "religious requirements" in text format according to the on-screen instructions. For example, the user might input a prompt message such as "Christian funeral in Tokyo, budget under 300,000 yen" into the terminal.

[0080] The terminal encrypts the entered information and sends it to the server using a secure communication protocol. Here, information encryption and secure communication are essential to protect the user's personal information.

[0081] The server analyzes the received information and activates a generative AI model. This AI model searches a database based on the received information and selects the most suitable funeral venues and service providers. In this process, the AI ​​can suggest multiple options that closely match the user's selection criteria.

[0082] The selected options are sent from the server to the terminal and presented to the user. The user can then use the presented information to visually compare the most suitable venues and vendors from the candidates and make a final selection.

[0083] This system significantly reduces the time and effort required for negotiating and dealing with multiple vendors, allowing users to dedicate more time to mourning their loved ones. Furthermore, the system provides comprehensive support for efficiently and safely conducting funeral preparations.

[0084] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0085] Step 1:

[0086] Users input their wishes and requirements regarding the funeral via a terminal. This input is in text format and includes information such as "region," "budget," and "religious requirements." For example, a user might enter the prompt message, "Christian funeral in Tokyo, budget under 300,000 yen." The input data is encrypted on the terminal and transmitted to the server via a secure protocol. This encryption ensures the protection of personal information.

[0087] Step 2:

[0088] The server decrypts the received encrypted data and analyzes its contents. During the analysis, it extracts conditions from the received data and supplies them as prompts to the generative AI model. The generative AI model searches the database based on these conditions and lists several candidate funeral homes and service providers that match the user's criteria. As a result of this calculation, selected candidate information is obtained.

[0089] Step 3:

[0090] The server compiles detailed information on the candidates selected by the generation AI model, including "venue location," "available dates," "reviews," and "cost." The server then sends this candidate information to the terminal. The terminal displays the candidate information in a user-friendly format and presents it to the user.

[0091] Step 4:

[0092] The user compares the options presented on the device and determines the most appropriate choice. Once the user's selection is confirmed, that information is sent back to the server via the device. The input data conversion and selection process outputs detailed information about the selected funeral.

[0093] Step 5:

[0094] Based on the confirmed selection, the server automatically initiates the booking process with the chosen venue and vendor. This process includes booking confirmation, generation of necessary documents, and sending of confirmation emails. After the booking is complete, the server sends completion information to the terminal and provides the user with instructions for the next steps. This series of actions ensures that funeral bookings are completed efficiently and accurately.

[0095] (Application Example 1)

[0096] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0097] In mobility services using autonomous vehicles, there is a lack of means to automate appropriate and efficient operation based on the diverse needs of users. Furthermore, there is a need for a highly accurate system that can quickly select the optimal route and mode of transport from multiple options and provide it to users. This would allow users to reduce waiting times and the hassle of making arrangements, and enjoy an efficient travel experience.

[0098] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0099] In this invention, the server includes means for receiving request information from a user and analyzing relevant conditions based on that information; means for searching a database for multiple candidate facilities and providers and selecting the optimal combination; and means for automatically arranging appropriate means of transportation according to the user's desired travel time. As a result, the user can immediately receive the optimal route and means of transportation and reach their destination efficiently.

[0100] "User request information" refers to information provided by users to communicate their wishes and conditions regarding transportation and service use.

[0101] "Means for analyzing relevant conditions" refers to a device or method that analyzes and extracts conditions necessary for movement or service provision based on received request information.

[0102] "Facilities and providers" refers to places and their operators that offer services or functions based on user requests.

[0103] An "autonomous mobile vehicle" refers to a mode of transportation that operates automatically using AI and sensor technology.

[0104] "Methods for optimizing the operation schedule" refers to the process of formulating the optimal operation plan by considering user requests and real-time traffic conditions.

[0105] "User evaluations" are aggregated information based on feedback from people who have used the service in the past, and serve as a reference in the selection process.

[0106] The system for implementing this invention mainly consists of three components: a server, a terminal, and a user.

[0107] The server is deployed in a cloud environment and utilizes AI models for data analysis and processing. It analyzes the request information received from users and extracts relevant conditions. Accordingly, it searches for multiple candidate facilities and providers using a large-scale database and selects the optimal combination. Furthermore, the server optimizes the operation schedule of the autonomous vehicle according to the user's desired travel time and requests. It also sends detailed information of the selected candidates to the terminal and presents the user with real-time updated travel route and time information. The server uses services such as Google® Maps API and AWS® Lambda to perform efficient data processing and calculations.

[0108] The terminal functions as a user-operated device and is integrated into smartphones or in-vehicle displays. This allows users to easily input requested information and travel preferences. The terminal also visually displays information received from the server on the screen, providing a highly convenient interface. Furthermore, once the user has completed their selection, the terminal sends that information back to the server.

[0109] For example, if a user inputs "I want to travel from my starting point to my destination at 3 PM," the server receives this information and calculates and presents the optimal route and mode of transport. The server can instantly deploy an appropriate autonomous vehicle in response to the user's request. The generative AI model is optimized to operate efficiently and quickly suggest candidates. An example of a prompt would be, "Please calculate the optimal travel route from my starting point to my destination."

[0110] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0111] Step 1:

[0112] The user enters travel request information using a terminal. Specifically, they input and transmit information such as departure point, destination, and desired travel time into the interface of their smartphone or in-car display. This input serves as request information for the system to process in the next step.

[0113] Step 2:

[0114] The terminal receives the user's request information and sends this information to the server using an encrypted, secure communication protocol. The output at this stage consists of numerical and text data formatted for analysis by the server.

[0115] Step 3:

[0116] The server analyzes the received request information and extracts relevant conditions. This process includes data analysis of the user's request, including origin, destination, and desired travel time. Data preprocessing is performed to prepare the server to narrow down the best candidates based on the input information.

[0117] Step 4:

[0118] The server utilizes a generative AI model to search for appropriate transportation facilities and providers from relevant databases and identify the optimal combination. The input here is the conditions extracted in the previous step, and the output is a list of candidate optimal routes and modes of transportation.

[0119] Step 5:

[0120] The server generates and sends detailed information about the optimal route and mode of transport to the terminal. This output includes available modes of transport, route information, and estimated arrival time. Once the data is sent to the user's terminal, the next selection step begins.

[0121] Step 6:

[0122] The terminal visually presents the information received from the server to the user, allowing them to review optimized options. The user selects the most suitable option from those presented on the screen and confirms their selection.

[0123] Step 7:

[0124] User selection information is sent from the terminal to the server, which then optimizes the autonomous vehicle's operating schedule and automatically arranges transportation based on that information. The output includes the confirmed operating schedule and reservation details.

[0125] Step 8:

[0126] The server issues operational commands to the target autonomous mobile vehicle, enabling it to operate in accordance with the user's requests. Ultimately, the user can achieve their desired travel quickly and smoothly.

[0127] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0128] This invention relates to a system that takes into account the user's emotions during funeral preparations and provides a more personalized experience. The system functions in an integrated form, consisting of a server, terminals, and an emotion engine.

[0129] The user first enters the funeral arrangements through their device. The input form is dynamically adjusted by an emotion engine to minimize user stress. For example, if the user indicates fatigue or frustration, the interface becomes simpler.

[0130] The device sends information collected from the user to an emotion engine to identify the user's hidden psychological state. This uses technologies such as text analysis and voice tone analysis. The collected emotion information is used to personalize the user experience.

[0131] Based on feedback from the emotion engine, the server selects appropriate funeral venues and service providers while considering the user's psychological state. It's possible to prioritize displaying candidates that match the user's emotions. For example, if the user appears calm, reliable service providers with many reviews are often suggested.

[0132] After selection, the server sends detailed information about the candidates to the terminal. During this process, the emotion engine adjusts the presentation method to minimize user stress. The user can then review the presented options, tailored to their emotional state, and make their final choice.

[0133] Once the user completes their selection, the device sends that selection information to the server. At this point, the emotion engine can also adjust the guidance for the next step based on the user's current psychological state.

[0134] The server receives the user's selections and automatically proceeds with all booking procedures with the chosen venues and vendors. In this process as well, emotional feedback is utilized to minimize the user's burden.

[0135] For example, if a user exhibits a high level of stress, the emotion engine optimizes the presentation of information to the user, simplifying the selection process. In this way, the present invention realizes a funeral preparation system that uses an emotion engine to support the user experience and contribute to stress reduction.

[0136] The following describes the processing flow.

[0137] Step 1:

[0138] Users input their wishes and conditions regarding the funeral through their device. The input interface is dynamically adjusted by an emotion engine, designed to reduce the user's input burden.

[0139] Step 2:

[0140] The device sends the input information to an emotion engine, which analyzes the user's emotional state. This is done through text sentiment analysis and, if voice input is available, tone analysis.

[0141] Step 3:

[0142] The emotion engine sends the analyzed emotion information to the server, feeding back the user's psychological state to the entire system. This prepares the system to process information while taking the user's emotions into consideration.

[0143] Step 4:

[0144] The server optimizes suggestions for funeral homes and service providers for the user based on emotional information. Specifically, if the emotional state is unstable, it prioritizes presenting options that offer flexibility and choices.

[0145] Step 5:

[0146] The server sends detailed information about the selected candidates to the terminal. The emotion engine adjusts how the information is presented according to the user's emotional state, making it easier for the user to receive the information.

[0147] Step 6:

[0148] Users review the presented options and select the most suitable funeral home or service provider. This process is also supported by an emotional engine, resulting in a less stressful experience.

[0149] Step 7:

[0150] The device sends the user's selection to the server. This information is also used to adjust the guidelines in the next step.

[0151] Step 8:

[0152] The server automatically proceeds with the booking process for the selected venue and vendors. The emotion engine monitors the user's emotions and appropriately notifies the user of the booking progress and the next steps.

[0153] Step 9:

[0154] The server notifies the terminal that the procedure is complete. The terminal then provides the user with confirmation of the reservation and guidance for the next steps. Sentimental information is also taken into consideration here, and the information is provided in a way that is beneficial to the user.

[0155] In this way, the emotion engine understands the user's psychological state at every step and optimizes the operation of the entire system.

[0156] (Example 2)

[0157] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0158] In funeral preparations, it is difficult to consider the emotional state of the bereaved family, which can easily lead to stress. Furthermore, there is a challenge in selecting venues and service providers based on the psychological state of the bereaved family. This can lead to decreased bereaved family satisfaction, making emotionally sensitive selection and guidance essential.

[0159] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0160] In this invention, the server includes means for receiving request information from a user and analyzing relevant conditions based on said information; means for collecting emotional data, performing emotional analysis using natural language processing technology, and estimating the user's psychological state; and means for searching a database for multiple candidate venues and service providers based on the relevant conditions and psychological state, and selecting the optimal combination. This makes it possible to select and guide users through funeral preparations in a way that is considerate of their emotions and minimizes stress.

[0161] "Request information" refers to the conditions and wishes regarding funerals entered by the user, and is data that the system uses to process information.

[0162] "Relevant conditions" are a part of the request information analyzed to identify the elements necessary for funeral preparations, and represent a set of conditions that reflect the user's wishes and constraints.

[0163] "Emotional data" refers to information about emotions contained in text and audio obtained from users, and is the basic data used for emotion analysis.

[0164] "Natural language processing technology" is a data processing technique used to identify potential emotional states by analyzing text and speech input by users.

[0165] "Psychological state" refers to the internal state of a user's emotions and mood, and is analyzed by the system in order to provide services while taking that state into consideration.

[0166] "Venue and service provider" refers to the corporation or individual responsible for providing the physical space available for conducting the user's funeral and the services that will be provided.

[0167] A "database" is a collection of electronic information where venue and service provider information is systematically stored, and is used by systems to search for information and make suggestions to users.

[0168] "Means" refers to a method, process, or apparatus designed to perform a specific function within a system, and is an essential element for realizing the invention.

[0169] The system of this invention is designed to take into account the emotions of users during funeral preparations and to provide personalized services. The system consists of hardware and software components: a server, a terminal, and an emotion engine.

[0170] Users input specific funeral conditions and wishes through a terminal. This terminal features a dynamic interface to facilitate user input, and the complexity of the form can be adjusted by an emotion engine.

[0171] The device collects text and voice information entered by the user to obtain emotional data. This utilizes natural language processing technology and voice tone analysis software, and leverages Python and OpenAI® generative AI models. The data obtained through emotional analysis is used to predict the user's psychological state.

[0172] The server searches the database for venue and service provider information based on the psychological state information analyzed by the emotion engine, and selects the most suitable candidate for the user's conditions. This makes it possible to provide users with choices that are sensitive to their emotions and do not cause them stress.

[0173] For example, if a user is experiencing high levels of stress, the server will adjust the selection process to present information concisely, reduce the number of options, and facilitate decision-making.

[0174] Furthermore, an example of a prompt in a generative AI model is, "Please suggest what services would be effective in reducing stress for a user who is feeling uneasy." This prompt allows the AI ​​model to generate appropriate emotional response strategies, which can then be executed through the server.

[0175] As described above, this system aims to provide funeral preparation services based on the user's emotions by utilizing advanced natural language processing technology and generative AI models.

[0176] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0177] Step 1:

[0178] The user enters details of the funeral (date, time, location, number of attendees, etc.) into the terminal. During this process, the terminal uses an emotion engine to optimize the input form in real time to ensure smooth user input. Specifically, if the terminal detects that the user is fatigued, it simplifies the input process. The terminal receives the user's text and voice information as input and generates an optimized form as output.

[0179] Step 2:

[0180] The device collects text and voice information received from the user as emotional data. This emotional data is analyzed using natural language processing (NLP) and voice tone analysis techniques. Specifically, Python and generative AI models are used to identify the user's psychological state from this data. The input is the user's text and voice information, and the output is emotional state data.

[0181] Step 3:

[0182] The terminal sends the analyzed emotional state data to the emotion engine. The emotion engine further examines the received data and evaluates the user's underlying psychological state in detail. The input here is emotional state data, and the output is the examined psychological state information. The engine converts the user's emotions into a format that the server can use.

[0183] Step 4:

[0184] The server searches a database based on psychological state information from the emotion engine and selects multiple venues and service providers that are best suited to the user. In this process, the user's emotional state influences the selection of candidates. Specifically, if the user is calm, highly-rated venues are prioritized, while if they are stressed, concise information is presented. The input is psychological state information, and the output is a list of optimal candidates.

[0185] Step 5:

[0186] The server transmits detailed information about the selected venue and service provider to the terminal and presents it to the user. During presentation, the display method is adjusted based on the evaluation results of the emotion engine. For example, a user in a high-stress state will be presented with a smaller number of recommended options. The input is a list of options, and the output is the adjusted information presentation.

[0187] Step 6:

[0188] The user selects their preferred option from the presented choices. The terminal then sends this selection information to the server. The selection is narrowed down to specific choices for the final decision, and the selection information is sent back to the server as output.

[0189] Step 7:

[0190] The server automatically executes the booking process with the selected venue and service provider based on the user's selection information received. Here again, feedback from the emotion engine is used to optimize the booking process for a smooth experience. The input is the selection information, and the output is booking confirmation information and the final scheduling result.

[0191] (Application Example 2)

[0192] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0193] Improving the customer experience is crucial in modern retail and service industries. However, traditional technologies have not adequately addressed the need to understand customers' emotional states in real time and provide appropriate services and customer interaction. Therefore, there is a need for systems that enhance customer satisfaction.

[0194] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0195] In this invention, the server includes means for analyzing user request information and related conditions, means for searching for facilities and vendors from information storage and selecting the optimal combination, and means for analyzing emotional states and optimizing customer service methods. This makes it possible to provide a personalized customer experience that responds to the user's emotional state.

[0196] "Request information" refers to information about the wishes and conditions that users enter into the system.

[0197] "Related conditions" are detailed conditions regarding service provision that are generated based on the request information.

[0198] "Facility" refers to the place or area where a service is provided.

[0199] "Service provider" refers to a company or individual that provides a service.

[0200] "Information storage" refers to a device or system that stores data and allows it to be searched and extracted as needed.

[0201] "Emotional state" refers to the psychological and emotional state that the user is experiencing.

[0202] "Customer service methods" refer to the methods of providing and responding to services to customers.

[0203] An "information processing device" is a device that receives data, processes it, and generates results.

[0204] "Customer experience" refers to the overall experience a customer has when using a service or facility.

[0205] The following describes an embodiment for carrying out the invention. This system mainly consists of three components: a server, a terminal, and a user. The server receives request information transmitted from the user and analyzes the relevant conditions based on it. Based on the analyzed relevant conditions, the server searches for the optimal combination of facilities and vendors from its information storage and provides personalized information that takes into account the user's emotional state. The user's terminal has a sensor built in to measure the emotional state, thereby collecting emotional data in real time. For the analysis of the emotional state, facial recognition technology using OpenCV and speech analysis using the Google Cloud Speech-to-Text API are utilized.

[0206] The server sends feedback to the terminal to optimize customer service methods based on collected emotional data. This feedback is presented to the user via an information processing device, contributing to an improved user experience. It also generates prompt messages tailored to the user's emotional state, suggesting the most suitable options. For example, if a user is experiencing stress, providing concise guidance on options can reduce the burden of decision-making.

[0207] A concrete example of the program would be a scenario where a customer is wearing smart glasses. In this case, it's possible to analyze emotions from eye movements and voice tone and provide the server with the most appropriate service style as a selection. An example of a prompt might be, "Instantly identify the emotional state of the next customer you'll be serving in this store and provide feedback to suggest the most appropriate service style."

[0208] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0209] Step 1:

[0210] The terminal receives request information from the user as input. This information includes details and conditions of the service the user desires. The terminal then prepares to send this request information to the server.

[0211] Step 2:

[0212] The server analyzes the relevant conditions based on the received request information. This analysis process includes referencing historical information from the database and data processing to derive appropriate conditions using statistical methods.

[0213] Step 3:

[0214] The server searches its information storage for multiple facilities and vendors based on the analyzed relevant conditions. Here, it performs data calculations to narrow down the candidates that match the conditions and select the optimal combination.

[0215] Step 4:

[0216] The device uses sensors to measure the user's emotional state, collecting facial expressions and voice tone as input. This information is then transmitted to a server in real time.

[0217] Step 5:

[0218] The server uses OpenCV to perform facial recognition and the Google Cloud Speech-to-Text API to analyze voice tone. This generates emotional data, which is then used to calculate feedback for optimizing customer service methods.

[0219] Step 6:

[0220] The server generates information to send to the terminal based on user sentiment data and analysis results. Using a generation AI model, it creates appropriate prompt sentences and presents the information in a way that is easily understandable to the user.

[0221] Step 7:

[0222] The terminal receives feedback and prompts from the server and displays them to the user. The user then makes a selection based on the presented information and prepares to send that selection information back to the server.

[0223] Step 8:

[0224] The server receives the user's selection and automatically executes the reservation process with the selected facilities and vendors. This process involves integration with an external reservation system to confirm the completion of the procedure.

[0225] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0226] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0227] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0228] [Second Embodiment]

[0229] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0230] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0231] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0232] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0233] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0234] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0235] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0236] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0237] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0238] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0239] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0240] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0241] The system of this invention is designed to streamline funeral preparations. It primarily involves three entities—a server, a terminal, and a user—working together to select the most suitable funeral venue and service provider, and to perform automated procedures.

[0242] The user first enters their wishes and requirements regarding the funeral through a terminal. This interface is designed to be easy to understand and intuitive to use, allowing users to input information such as region, budget, and religious requirements through a simple question-and-answer format.

[0243] The device receives this entered information and sends it to the server. The information is encrypted and transmitted through a secure communication environment, thus protecting your privacy.

[0244] The server analyzes the received information and extracts relevant conditions based on the request. Based on this information, it runs a generative AI model, searching a comprehensive database of funeral-related services to select the most suitable venues and service providers. The AI ​​can then suggest multiple options that best match the user's preferences.

[0245] After the selection is made, the server sends detailed information to the terminal and presents it to the user. This information includes details about each selected candidate, such as the venue's location, availability, reviews, and cost. The user can make the best choice by visually comparing the options.

[0246] Once the selection is complete, the device sends the information back to the server. The server automatically proceeds with the booking process for the selected venues and vendors. This process includes booking confirmation, generation of necessary documents, and verification.

[0247] Finally, the server sends confirmation of the reservation to the terminal, supporting the user in smoothly proceeding with the next necessary steps. This significantly reduces the stress associated with negotiating and making arrangements with multiple vendors, allowing the user to have time to remember their loved one.

[0248] For example, if a user enters "Buddhist funeral in Kyoto City, budget under 500,000 yen," the server will select candidates based on this information and present the selection results to the user's terminal. The user can then choose the most suitable option from the selected candidates and automatically proceed with the reservation process. This entire process allows for efficient and reliable funeral preparations.

[0249] The following describes the processing flow.

[0250] Step 1:

[0251] The user enters their desired funeral arrangements (e.g., location, budget, religious format) into the interface on their device. The interface is designed to be simple and intuitive to use.

[0252] Step 2:

[0253] The terminal collects information entered by the user from the input form, formats the data, and then sends it to the server. During this process, the transmitted data is encrypted and sent using a secure communication channel.

[0254] Step 3:

[0255] The server analyzes the data received from the terminal and extracts relevant conditions based on the user's request. These conditions include factors such as region, budget, and religious preferences.

[0256] Step 4:

[0257] The server runs a generative AI model and searches the database based on relevant conditions. Here, it selects several funeral homes and service providers that meet the criteria as candidates.

[0258] Step 5:

[0259] The server sends detailed information about the selected candidates (e.g., venue name, location, available dates, cost, reviews, etc.) to the terminal.

[0260] Step 6:

[0261] The terminal displays received information to the user in a visually easy-to-understand format. Users can compare the presented information and select the most suitable funeral home or service provider.

[0262] Step 7:

[0263] The user confirms their selected candidate and sends that information to the server via their device.

[0264] Step 8:

[0265] The server confirms the user's selection and automatically initiates the booking process with the chosen venues and vendors. If necessary, it also handles scheduling and contract document generation.

[0266] Step 9:

[0267] The server sends feedback to the terminal indicating that the reservation is complete. The terminal then notifies the user and provides information about the next steps.

[0268] In this way, the entire system provides users with a smooth and efficient funeral preparation process.

[0269] (Example 1)

[0270] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0271] Traditional funeral arrangements required individuals to negotiate and handle procedures with multiple venues and vendors, which was time-consuming and laborious. Furthermore, it was difficult to quickly and accurately select the best option based on the user's needs. These challenges reduced the time available for mourning the deceased and caused stress for those involved.

[0272] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0273] In this invention, the server includes means for receiving request information from a user via a terminal, encrypting the information, and transmitting it through a secure communication environment; means for analyzing the received information, extracting relevant conditions, and then running a generated AI model to search a database for multiple candidate venues and service providers, and selecting candidates; means for transmitting detailed information of the selected candidates back to the terminal to present it to the user and receiving the user's selection; and means for automatically executing the reservation procedure with the selected venue and service provider and transmitting reservation completion information to the terminal. As a result, the user can efficiently and quickly carry out procedures related to funeral preparations and ensure they have enough time to mourn the deceased.

[0274] "User" refers to an individual or organization that uses this system to make funeral arrangements.

[0275] A "terminal" is an electronic device used by a user to input or receive information, and includes computers, smartphones, tablets, and other similar devices.

[0276] A "server" is a computer system that receives, analyzes, and processes information sent by users, and is also responsible for coordinating with databases and generative AI models.

[0277] A "generative AI model" refers to an artificial intelligence algorithm that searches a database based on the user's requested conditions and selects the most suitable funeral venues and service providers.

[0278] A "prompt message" is a sentence that a user enters into the system to clarify their purpose, and may include conditions such as the funeral location, budget, and religious requirements.

[0279] A "database" is an information repository containing detailed information about funeral-related locations and businesses, which is referenced by the server when selecting candidates.

[0280] The "reservation procedure" refers to a series of processes for formally concluding a contract with a selected funeral venue or service provider and determining the schedule and conditions.

[0281] The "detailed information" refers to the specific content about the selected candidates, including location data, available schedules, evaluation information, etc.

[0282] The system of the present invention operates in cooperation with three entities: a server, a terminal, and a user, in order to streamline the preparation of funerals.

[0283] First, the user uses the terminal to input their wishes and conditions regarding the funeral. This terminal includes electronic devices such as smartphones and computers, and the user interface is designed to be intuitively operable. The user can input "region", "budget", "religious requirements", etc. in text form according to the screen display. As a specific example, it is conceivable to input a prompt sentence such as "Christian funeral in Tokyo, budget within 300,000 yen" on the terminal.

[0284] The terminal encrypts the input information and transmits it to the server using a secure communication protocol. Here, the encryption of information and secure communication are essential for protecting the user's personal information.

[0285] The server analyzes the received information and operates a generated AI model. This AI model searches the database based on the received information and selects the optimal candidates for funeral venues and service providers. In this process, the AI can propose multiple options that are closest to the user's selection criteria.

[0286] The selected options are transmitted from the server to the terminal and presented to the user. Here, the user can visually compare the most appropriate venues and service providers among the candidates using the presented information and make a final selection.

[0287] This system significantly reduces the time and effort required for negotiating and dealing with multiple vendors, allowing users to dedicate more time to mourning their loved ones. Furthermore, the system provides comprehensive support for efficiently and safely conducting funeral preparations.

[0288] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0289] Step 1:

[0290] Users input their wishes and requirements regarding the funeral via a terminal. This input is in text format and includes information such as "region," "budget," and "religious requirements." For example, a user might enter the prompt message, "Christian funeral in Tokyo, budget under 300,000 yen." The input data is encrypted on the terminal and transmitted to the server via a secure protocol. This encryption ensures the protection of personal information.

[0291] Step 2:

[0292] The server decrypts the received encrypted data and analyzes its contents. During the analysis, it extracts conditions from the received data and supplies them as prompts to the generative AI model. The generative AI model searches the database based on these conditions and lists several candidate funeral homes and service providers that match the user's criteria. As a result of this calculation, selected candidate information is obtained.

[0293] Step 3:

[0294] The server compiles detailed information on the candidates selected by the generation AI model, including "venue location," "available dates," "reviews," and "cost." The server then sends this candidate information to the terminal. The terminal displays the candidate information in a user-friendly format and presents it to the user.

[0295] Step 4:

[0296] The user compares the options presented on the device and determines the most appropriate choice. Once the user's selection is confirmed, that information is sent back to the server via the device. The input data conversion and selection process outputs detailed information about the selected funeral.

[0297] Step 5:

[0298] Based on the confirmed selection, the server automatically initiates the booking process with the chosen venue and vendor. This process includes booking confirmation, generation of necessary documents, and sending of confirmation emails. After the booking is complete, the server sends completion information to the terminal and provides the user with instructions for the next steps. This series of actions ensures that funeral bookings are completed efficiently and accurately.

[0299] (Application Example 1)

[0300] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0301] In mobility services using autonomous vehicles, there is a lack of means to automate appropriate and efficient operation based on the diverse needs of users. Furthermore, there is a need for a highly accurate system that can quickly select the optimal route and mode of transport from multiple options and provide it to users. This would allow users to reduce waiting times and the hassle of making arrangements, and enjoy an efficient travel experience.

[0302] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0303] In this invention, the server includes means for receiving request information from a user, analyzing relevant conditions based on this information, searching for a plurality of candidate facilities and providers from a database, and selecting an optimal combination, and means for automatically arranging appropriate means of transportation in accordance with the user's desired travel time. As a result, the user can immediately receive the optimal route and means of transportation and efficiently reach the destination.

[0304] The "request information from the user" refers to the information provided by the user to convey their wishes and conditions regarding travel and service use.

[0305] The "means for analyzing relevant conditions" refers to a device or method that represents a process of analyzing and extracting the conditions required for travel and service provision based on the received request information.

[0306] The "facilities and providers" refer to the places with services and functions provided based on the user's request information and their operators.

[0307] The "autonomous mobile body" refers to a means of transportation that operates automatically using AI and sensor technologies.

[0308] The "means for optimizing the operation schedule" refers to a means that represents a process of formulating an optimal operation plan considering the user's request information and the real-time traffic situation.

[0309] The "user evaluation" refers to information that aggregates the feedback of people who have used the service in the past and serves as a reference for the selection process.

[0310] The system for implementing this invention mainly consists of three main entities: the server, the terminal, and the user.

[0311] The server is deployed in a cloud environment and utilizes AI models for data analysis and processing. It analyzes the request information received from users and extracts relevant conditions. Based on this, it searches for multiple candidate facilities and providers using a large-scale database and selects the optimal combination. Furthermore, the server optimizes the operation schedule of the autonomous vehicle according to the user's desired travel time and requests. It also sends detailed information of the selected candidates to the terminal and presents the user with real-time updated travel route and time information. The server uses services such as Google Maps API and AWS Lambda to perform efficient data processing and calculations.

[0312] The terminal functions as a user-operated device and is integrated into smartphones or in-vehicle displays. This allows users to easily input requested information and travel preferences. The terminal also visually displays information received from the server on the screen, providing a highly convenient interface. Furthermore, once the user has completed their selection, the terminal sends that information back to the server.

[0313] For example, if a user inputs "I want to travel from my starting point to my destination at 3 PM," the server receives this information and calculates and presents the optimal route and mode of transport. The server can instantly deploy an appropriate autonomous vehicle in response to the user's request. The generative AI model is optimized to operate efficiently and quickly suggest candidates. An example of a prompt would be, "Please calculate the optimal travel route from my starting point to my destination."

[0314] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0315] Step 1:

[0316] The user enters travel request information using a terminal. Specifically, they input and transmit information such as departure point, destination, and desired travel time into the interface of their smartphone or in-car display. This input serves as request information for the system to process in the next step.

[0317] Step 2:

[0318] The terminal receives the user's request information and sends this information to the server using an encrypted, secure communication protocol. The output at this stage consists of numerical and text data formatted for analysis by the server.

[0319] Step 3:

[0320] The server analyzes the received request information and extracts relevant conditions. This process includes data analysis of the user's request, including origin, destination, and desired travel time. Data preprocessing is performed to prepare the server to narrow down the best candidates based on the input information.

[0321] Step 4:

[0322] The server utilizes a generative AI model to search for appropriate transportation facilities and providers from relevant databases and identify the optimal combination. The input here is the conditions extracted in the previous step, and the output is a list of candidate optimal routes and modes of transportation.

[0323] Step 5:

[0324] The server generates and sends detailed information about the optimal route and mode of transport to the terminal. This output includes available modes of transport, route information, and estimated arrival time. Once the data is sent to the user's terminal, the next selection step begins.

[0325] Step 6:

[0326] The terminal visually presents the information received from the server to the user, allowing them to review optimized options. The user selects the most suitable option from those presented on the screen and confirms their selection.

[0327] Step 7:

[0328] User selection information is sent from the terminal to the server, which then optimizes the autonomous vehicle's operating schedule and automatically arranges transportation based on that information. The output includes the confirmed operating schedule and reservation details.

[0329] Step 8:

[0330] The server issues operational commands to the target autonomous mobile vehicle, enabling it to operate in accordance with the user's requests. Ultimately, the user can achieve their desired travel quickly and smoothly.

[0331] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0332] This invention relates to a system that takes into account the user's emotions during funeral preparations and provides a more personalized experience. The system functions in an integrated form, consisting of a server, terminals, and an emotion engine.

[0333] The user first enters the funeral arrangements through their device. The input form is dynamically adjusted by an emotion engine to minimize user stress. For example, if the user indicates fatigue or frustration, the interface becomes simpler.

[0334] The device sends information collected from the user to an emotion engine to identify the user's hidden psychological state. This uses technologies such as text analysis and voice tone analysis. The collected emotion information is used to personalize the user experience.

[0335] Based on feedback from the emotion engine, the server selects appropriate funeral venues and service providers while considering the user's psychological state. It's possible to prioritize displaying candidates that match the user's emotions. For example, if the user appears calm, reliable service providers with many reviews are often suggested.

[0336] After selection, the server sends detailed information about the candidates to the terminal. During this process, the emotion engine adjusts the presentation method to minimize user stress. The user can then review the presented options, tailored to their emotional state, and make their final choice.

[0337] Once the user completes their selection, the device sends that selection information to the server. At this point, the emotion engine can also adjust the guidance for the next step based on the user's current psychological state.

[0338] The server receives the user's selections and automatically proceeds with all booking procedures with the chosen venues and vendors. In this process as well, emotional feedback is utilized to minimize the user's burden.

[0339] For example, if a user exhibits a high level of stress, the emotion engine optimizes the presentation of information to the user, simplifying the selection process. In this way, the present invention realizes a funeral preparation system that uses an emotion engine to support the user experience and contribute to stress reduction.

[0340] The following describes the processing flow.

[0341] Step 1:

[0342] Users input their wishes and conditions regarding the funeral through their device. The input interface is dynamically adjusted by an emotion engine, designed to reduce the user's input burden.

[0343] Step 2:

[0344] The device sends the input information to an emotion engine, which analyzes the user's emotional state. This is done through text sentiment analysis and, if voice input is available, tone analysis.

[0345] Step 3:

[0346] The emotion engine sends the analyzed emotion information to the server, feeding back the user's psychological state to the entire system. This prepares the system to process information while taking the user's emotions into consideration.

[0347] Step 4:

[0348] The server optimizes suggestions for funeral homes and service providers for the user based on emotional information. Specifically, if the emotional state is unstable, it prioritizes presenting options that offer flexibility and choices.

[0349] Step 5:

[0350] The server sends detailed information about the selected candidates to the terminal. The emotion engine adjusts how the information is presented according to the user's emotional state, making it easier for the user to receive the information.

[0351] Step 6:

[0352] Users review the presented options and select the most suitable funeral home or service provider. This process is also supported by an emotional engine, resulting in a less stressful experience.

[0353] Step 7:

[0354] The device sends the user's selection to the server. This information is also used to adjust the guidelines in the next step.

[0355] Step 8:

[0356] The server automatically proceeds with the booking process for the selected venue and vendors. The emotion engine monitors the user's emotions and appropriately notifies the user of the booking progress and the next steps.

[0357] Step 9:

[0358] The server notifies the terminal that the procedure is complete. The terminal then provides the user with confirmation of the reservation and guidance for the next steps. Sentimental information is also taken into consideration here, and the information is provided in a way that is beneficial to the user.

[0359] In this way, the emotion engine understands the user's psychological state at every step and optimizes the operation of the entire system.

[0360] (Example 2)

[0361] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0362] In funeral preparations, it is difficult to consider the emotional state of the bereaved family, which can easily lead to stress. Furthermore, there is a challenge in selecting venues and service providers based on the psychological state of the bereaved family. This can lead to decreased bereaved family satisfaction, making emotionally sensitive selection and guidance essential.

[0363] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0364] In this invention, the server includes means for receiving request information from a user and analyzing relevant conditions based on said information; means for collecting emotional data, performing emotional analysis using natural language processing technology, and estimating the user's psychological state; and means for searching a database for multiple candidate venues and service providers based on the relevant conditions and psychological state, and selecting the optimal combination. This makes it possible to select and guide users through funeral preparations in a way that is considerate of their emotions and minimizes stress.

[0365] "Request information" refers to the conditions and wishes regarding funerals entered by the user, and is data that the system uses to process information.

[0366] "Relevant conditions" are a part of the request information analyzed to identify the elements necessary for funeral preparations, and represent a set of conditions that reflect the user's wishes and constraints.

[0367] "Emotional data" refers to information about emotions contained in text and audio obtained from users, and is the basic data used for emotion analysis.

[0368] "Natural language processing technology" is a data processing technique used to identify potential emotional states by analyzing text and speech input by users.

[0369] "Psychological state" refers to the internal state of a user's emotions and mood, and is analyzed by the system in order to provide services while taking that state into consideration.

[0370] "Venue and service provider" refers to the corporation or individual responsible for providing the physical space available for conducting the user's funeral and the services that will be provided.

[0371] A "database" is a collection of electronic information where venue and service provider information is systematically stored, and is used by systems to search for information and make suggestions to users.

[0372] "Means" refers to a method, process, or apparatus designed to perform a specific function within a system, and is an essential element for realizing the invention.

[0373] The system of this invention is designed to take into account the emotions of users during funeral preparations and to provide personalized services. The system consists of hardware and software components: a server, a terminal, and an emotion engine.

[0374] Users input specific funeral conditions and wishes through a terminal. This terminal features a dynamic interface to facilitate user input, and the complexity of the form can be adjusted by an emotion engine.

[0375] The device collects text and voice information entered by the user to obtain emotional data. This utilizes natural language processing technology and voice tone analysis software, and leverages generative AI models from Python and OpenAI. The data obtained through emotional analysis is used to predict the user's psychological state.

[0376] The server searches the database for venue and service provider information based on the psychological state information analyzed by the emotion engine, and selects the most suitable candidate for the user's conditions. This makes it possible to provide users with choices that are sensitive to their emotions and do not cause them stress.

[0377] For example, if a user is experiencing high levels of stress, the server will adjust the selection process to present information concisely, reduce the number of options, and facilitate decision-making.

[0378] Furthermore, an example of a prompt in a generative AI model is, "Please suggest what services would be effective in reducing stress for a user who is feeling uneasy." This prompt allows the AI ​​model to generate appropriate emotional response strategies, which can then be executed through the server.

[0379] As described above, this system aims to provide funeral preparation services based on the user's emotions by utilizing advanced natural language processing technology and generative AI models.

[0380] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0381] Step 1:

[0382] The user enters details of the funeral (date, time, location, number of attendees, etc.) into the terminal. During this process, the terminal uses an emotion engine to optimize the input form in real time to ensure smooth user input. Specifically, if the terminal detects that the user is fatigued, it simplifies the input process. The terminal receives the user's text and voice information as input and generates an optimized form as output.

[0383] Step 2:

[0384] The device collects text and voice information received from the user as emotional data. This emotional data is analyzed using natural language processing (NLP) and voice tone analysis techniques. Specifically, Python and generative AI models are used to identify the user's psychological state from this data. The input is the user's text and voice information, and the output is emotional state data.

[0385] Step 3:

[0386] The terminal sends the analyzed emotional state data to the emotion engine. The emotion engine further examines the received data and evaluates the user's underlying psychological state in detail. The input here is emotional state data, and the output is the examined psychological state information. The engine converts the user's emotions into a format that the server can use.

[0387] Step 4:

[0388] The server searches a database based on psychological state information from the emotion engine and selects multiple venues and service providers that are best suited to the user. In this process, the user's emotional state influences the selection of candidates. Specifically, if the user is calm, highly-rated venues are prioritized, while if they are stressed, concise information is presented. The input is psychological state information, and the output is a list of optimal candidates.

[0389] Step 5:

[0390] The server transmits detailed information about the selected venue and service provider to the terminal and presents it to the user. During presentation, the display method is adjusted based on the evaluation results of the emotion engine. For example, a user in a high-stress state will be presented with a smaller number of recommended options. The input is a list of options, and the output is the adjusted information presentation.

[0391] Step 6:

[0392] The user selects their preferred option from the presented choices. The terminal then sends this selection information to the server. The selection is narrowed down to specific choices for the final decision, and the selection information is sent back to the server as output.

[0393] Step 7:

[0394] The server automatically executes the booking process with the selected venue and service provider based on the user's selection information received. Here again, feedback from the emotion engine is used to optimize the booking process for a smooth experience. The input is the selection information, and the output is booking confirmation information and the final scheduling result.

[0395] (Application Example 2)

[0396] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0397] Improving the customer experience is crucial in modern retail and service industries. However, traditional technologies have not adequately addressed the need to understand customers' emotional states in real time and provide appropriate services and customer interaction. Therefore, there is a need for systems that enhance customer satisfaction.

[0398] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0399] In this invention, the server includes means for analyzing user request information and related conditions, means for searching for facilities and vendors from information storage and selecting the optimal combination, and means for analyzing emotional states and optimizing customer service methods. This makes it possible to provide a personalized customer experience that responds to the user's emotional state.

[0400] "Request information" refers to information about the wishes and conditions that users enter into the system.

[0401] "Related conditions" are detailed conditions regarding service provision that are generated based on the request information.

[0402] "Facility" refers to the place or area where a service is provided.

[0403] "Service provider" refers to a company or individual that provides a service.

[0404] "Information storage" refers to a device or system that stores data and allows it to be searched and extracted as needed.

[0405] "Emotional state" refers to the psychological and emotional state that the user is experiencing.

[0406] "Customer service methods" refer to the methods of providing and responding to services to customers.

[0407] An "information processing device" is a device that receives data, processes it, and generates results.

[0408] "Customer experience" refers to the overall experience a customer has when using a service or facility.

[0409] The following describes an embodiment for carrying out the invention. This system mainly consists of three components: a server, a terminal, and a user. The server receives request information transmitted from the user and analyzes the relevant conditions based on it. Based on the analyzed relevant conditions, the server searches for the optimal combination of facilities and vendors from its information storage and provides personalized information that takes into account the user's emotional state. The user's terminal has a sensor built in to measure the emotional state, thereby collecting emotional data in real time. For the analysis of the emotional state, facial recognition technology using OpenCV and speech analysis using the Google Cloud Speech-to-Text API are utilized.

[0410] The server sends feedback to the terminal to optimize customer service methods based on collected emotional data. This feedback is presented to the user via an information processing device, contributing to an improved user experience. It also generates prompt messages tailored to the user's emotional state, suggesting the most suitable options. For example, if a user is experiencing stress, providing concise guidance on options can reduce the burden of decision-making.

[0411] A concrete example of the program would be a scenario where a customer is wearing smart glasses. In this case, it's possible to analyze emotions from eye movements and voice tone and provide the server with the most appropriate service style as a selection. An example of a prompt might be, "Instantly identify the emotional state of the next customer you'll be serving in this store and provide feedback to suggest the most appropriate service style."

[0412] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0413] Step 1:

[0414] The terminal receives request information from the user as input. This information includes details and conditions of the service the user desires. The terminal then prepares to send this request information to the server.

[0415] Step 2:

[0416] The server analyzes the relevant conditions based on the received request information. This analysis process includes referencing historical information from the database and data processing to derive appropriate conditions using statistical methods.

[0417] Step 3:

[0418] The server searches its information storage for multiple facilities and vendors based on the analyzed relevant conditions. Here, it performs data calculations to narrow down the candidates that match the conditions and select the optimal combination.

[0419] Step 4:

[0420] The device uses sensors to measure the user's emotional state, collecting facial expressions and voice tone as input. This information is then transmitted to a server in real time.

[0421] Step 5:

[0422] The server uses OpenCV to perform facial recognition and the Google Cloud Speech-to-Text API to analyze voice tone. This generates emotional data, which is then used to calculate feedback for optimizing customer service methods.

[0423] Step 6:

[0424] The server generates information to send to the terminal based on user sentiment data and analysis results. Using a generation AI model, it creates appropriate prompt sentences and presents the information in a way that is easily understandable to the user.

[0425] Step 7:

[0426] The terminal receives feedback and prompts from the server and displays them to the user. The user then makes a selection based on the presented information and prepares to send that selection information back to the server.

[0427] Step 8:

[0428] The server receives the user's selection and automatically executes the reservation process with the selected facilities and vendors. This process involves integration with an external reservation system to confirm the completion of the procedure.

[0429] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0430] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0431] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0432] [Third Embodiment]

[0433] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0434] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0435] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0436] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0437] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0438] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0439] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0440] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0441] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0442] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0443] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0444] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0445] The system of this invention is designed to streamline funeral preparations. It primarily involves three entities—a server, a terminal, and a user—working together to select the most suitable funeral venue and service provider, and to perform automated procedures.

[0446] The user first enters their wishes and requirements regarding the funeral through a terminal. This interface is designed to be easy to understand and intuitive to use, allowing users to input information such as region, budget, and religious requirements through a simple question-and-answer format.

[0447] The device receives this entered information and sends it to the server. The information is encrypted and transmitted through a secure communication environment, thus protecting your privacy.

[0448] The server analyzes the received information and extracts relevant conditions based on the request. Based on this information, it runs a generative AI model, searching a comprehensive database of funeral-related services to select the most suitable venues and service providers. The AI ​​can then suggest multiple options that best match the user's preferences.

[0449] After the selection is made, the server sends detailed information to the terminal and presents it to the user. This information includes details about each selected candidate, such as the venue's location, availability, reviews, and cost. The user can make the best choice by visually comparing the options.

[0450] Once the selection is complete, the device sends the information back to the server. The server automatically proceeds with the booking process for the selected venues and vendors. This process includes booking confirmation, generation of necessary documents, and verification.

[0451] Finally, the server sends confirmation of the reservation to the terminal, supporting the user in smoothly proceeding with the next necessary steps. This significantly reduces the stress associated with negotiating and making arrangements with multiple vendors, allowing the user to have time to remember their loved one.

[0452] For example, if a user enters "Buddhist funeral in Kyoto City, budget under 500,000 yen," the server will select candidates based on this information and present the selection results to the user's terminal. The user can then choose the most suitable option from the selected candidates and automatically proceed with the reservation process. This entire process allows for efficient and reliable funeral preparations.

[0453] The following describes the processing flow.

[0454] Step 1:

[0455] The user enters their desired funeral arrangements (e.g., location, budget, religious format) into the interface on their device. The interface is designed to be simple and intuitive to use.

[0456] Step 2:

[0457] The terminal collects information entered by the user from the input form, formats the data, and then sends it to the server. During this process, the transmitted data is encrypted and sent using a secure communication channel.

[0458] Step 3:

[0459] The server analyzes the data received from the terminal and extracts relevant conditions based on the user's request. These conditions include factors such as region, budget, and religious preferences.

[0460] Step 4:

[0461] The server runs a generative AI model and searches the database based on relevant conditions. Here, it selects several funeral homes and service providers that meet the criteria as candidates.

[0462] Step 5:

[0463] The server sends detailed information about the selected candidates (e.g., venue name, location, available dates, cost, reviews, etc.) to the terminal.

[0464] Step 6:

[0465] The terminal displays received information to the user in a visually easy-to-understand format. Users can compare the presented information and select the most suitable funeral home or service provider.

[0466] Step 7:

[0467] The user confirms their selected candidate and sends that information to the server via their device.

[0468] Step 8:

[0469] The server confirms the user's selection and automatically initiates the booking process with the chosen venues and vendors. If necessary, it also handles scheduling and contract document generation.

[0470] Step 9:

[0471] The server sends feedback to the terminal indicating that the reservation is complete. The terminal then notifies the user and provides information about the next steps.

[0472] In this way, the entire system provides users with a smooth and efficient funeral preparation process.

[0473] (Example 1)

[0474] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0475] Traditional funeral arrangements required individuals to negotiate and handle procedures with multiple venues and vendors, which was time-consuming and laborious. Furthermore, it was difficult to quickly and accurately select the best option based on the user's needs. These challenges reduced the time available for mourning the deceased and caused stress for those involved.

[0476] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0477] In this invention, the server includes means for receiving request information from a user via a terminal, encrypting the information, and transmitting it through a secure communication environment; means for analyzing the received information, extracting relevant conditions, and then running a generated AI model to search a database for multiple candidate venues and service providers, and selecting candidates; means for transmitting detailed information of the selected candidates back to the terminal to present it to the user and receiving the user's selection; and means for automatically executing the reservation procedure with the selected venue and service provider and transmitting reservation completion information to the terminal. As a result, the user can efficiently and quickly carry out procedures related to funeral preparations and ensure they have enough time to mourn the deceased.

[0478] "User" refers to an individual or organization that uses this system to make funeral arrangements.

[0479] A "terminal" is an electronic device used by a user to input or receive information, and includes computers, smartphones, tablets, and other similar devices.

[0480] A "server" is a computer system that receives, analyzes, and processes information sent by users, and is also responsible for coordinating with databases and generative AI models.

[0481] A "generative AI model" refers to an artificial intelligence algorithm that searches a database based on the user's requested conditions and selects the most suitable funeral venues and service providers.

[0482] A "prompt message" is a sentence that a user enters into the system to clarify their purpose, and may include conditions such as the funeral location, budget, and religious requirements.

[0483] A "database" is an information repository containing detailed information about funeral-related locations and businesses, which is referenced by the server when selecting candidates.

[0484] "Reservation procedures" refer to the series of processes involved in formally concluding a contract with the selected funeral home or service provider and confirming the date and conditions.

[0485] "Detailed information" refers to specific details about the selected candidates, including location data, available dates, and evaluation information.

[0486] The system of this invention operates in cooperation with three entities: a server, a terminal, and a user, in order to streamline funeral preparations.

[0487] The user first uses a terminal to input their wishes and requirements regarding the funeral. This terminal includes electronic devices such as smartphones and computers, and the user interface is designed to be intuitive. The user can input information such as "region," "budget," and "religious requirements" in text format according to the on-screen instructions. For example, the user might input a prompt message such as "Christian funeral in Tokyo, budget under 300,000 yen" into the terminal.

[0488] The terminal encrypts the entered information and sends it to the server using a secure communication protocol. Here, information encryption and secure communication are essential to protect the user's personal information.

[0489] The server analyzes the received information and activates a generative AI model. This AI model searches a database based on the received information and selects the most suitable funeral venues and service providers. In this process, the AI ​​can suggest multiple options that closely match the user's selection criteria.

[0490] The selected options are sent from the server to the terminal and presented to the user. The user can then use the presented information to visually compare the most suitable venues and vendors from the candidates and make a final selection.

[0491] This system significantly reduces the time and effort required for negotiating and dealing with multiple vendors, allowing users to dedicate more time to mourning their loved ones. Furthermore, the system provides comprehensive support for efficiently and safely conducting funeral preparations.

[0492] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0493] Step 1:

[0494] Users input their wishes and requirements regarding the funeral via a terminal. This input is in text format and includes information such as "region," "budget," and "religious requirements." For example, a user might enter the prompt message, "Christian funeral in Tokyo, budget under 300,000 yen." The input data is encrypted on the terminal and transmitted to the server via a secure protocol. This encryption ensures the protection of personal information.

[0495] Step 2:

[0496] The server decrypts the received encrypted data and analyzes its contents. During the analysis, it extracts conditions from the received data and supplies them as prompts to the generative AI model. The generative AI model searches the database based on these conditions and lists several candidate funeral homes and service providers that match the user's criteria. As a result of this calculation, selected candidate information is obtained.

[0497] Step 3:

[0498] The server compiles detailed information on the candidates selected by the generation AI model, including "venue location," "available dates," "reviews," and "cost." The server then sends this candidate information to the terminal. The terminal displays the candidate information in a user-friendly format and presents it to the user.

[0499] Step 4:

[0500] The user compares the options presented on the device and determines the most appropriate choice. Once the user's selection is confirmed, that information is sent back to the server via the device. The input data conversion and selection process outputs detailed information about the selected funeral.

[0501] Step 5:

[0502] Based on the confirmed selection, the server automatically initiates the booking process with the chosen venue and vendor. This process includes booking confirmation, generation of necessary documents, and sending of confirmation emails. After the booking is complete, the server sends completion information to the terminal and provides the user with instructions for the next steps. This series of actions ensures that funeral bookings are completed efficiently and accurately.

[0503] (Application Example 1)

[0504] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0505] In mobility services using autonomous vehicles, there is a lack of means to automate appropriate and efficient operation based on the diverse needs of users. Furthermore, there is a need for a highly accurate system that can quickly select the optimal route and mode of transport from multiple options and provide it to users. This would allow users to reduce waiting times and the hassle of making arrangements, and enjoy an efficient travel experience.

[0506] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0507] In this invention, the server includes means for receiving request information from a user and analyzing relevant conditions based on that information; means for searching a database for multiple candidate facilities and providers and selecting the optimal combination; and means for automatically arranging appropriate means of transportation according to the user's desired travel time. As a result, the user can immediately receive the optimal route and means of transportation and reach their destination efficiently.

[0508] "User request information" refers to information provided by users to communicate their wishes and conditions regarding transportation and service use.

[0509] "Means for analyzing relevant conditions" refers to a device or method that analyzes and extracts conditions necessary for movement or service provision based on received request information.

[0510] "Facilities and providers" refers to places and their operators that offer services or functions based on user requests.

[0511] An "autonomous mobile vehicle" refers to a mode of transportation that operates automatically using AI and sensor technology.

[0512] "Methods for optimizing the operation schedule" refers to the process of formulating the optimal operation plan by considering user requests and real-time traffic conditions.

[0513] "User evaluations" are aggregated information based on feedback from people who have used the service in the past, and serve as a reference in the selection process.

[0514] The system for implementing this invention mainly consists of three components: a server, a terminal, and a user.

[0515] The server is deployed in a cloud environment and utilizes AI models for data analysis and processing. It analyzes the request information received from users and extracts relevant conditions. Based on this, it searches for multiple candidate facilities and providers using a large-scale database and selects the optimal combination. Furthermore, the server optimizes the operation schedule of the autonomous vehicle according to the user's desired travel time and requests. It also sends detailed information of the selected candidates to the terminal and presents the user with real-time updated travel route and time information. The server uses services such as Google Maps API and AWS Lambda to perform efficient data processing and calculations.

[0516] The terminal functions as a user-operated device and is integrated into smartphones or in-vehicle displays. This allows users to easily input requested information and travel preferences. The terminal also visually displays information received from the server on the screen, providing a highly convenient interface. Furthermore, once the user has completed their selection, the terminal sends that information back to the server.

[0517] For example, if a user inputs "I want to travel from my starting point to my destination at 3 PM," the server receives this information and calculates and presents the optimal route and mode of transport. The server can instantly deploy an appropriate autonomous vehicle in response to the user's request. The generative AI model is optimized to operate efficiently and quickly suggest candidates. An example of a prompt would be, "Please calculate the optimal travel route from my starting point to my destination."

[0518] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0519] Step 1:

[0520] The user enters travel request information using a terminal. Specifically, they input and transmit information such as departure point, destination, and desired travel time into the interface of their smartphone or in-car display. This input serves as request information for the system to process in the next step.

[0521] Step 2:

[0522] The terminal receives the user's request information and sends this information to the server using an encrypted, secure communication protocol. The output at this stage consists of numerical and text data formatted for analysis by the server.

[0523] Step 3:

[0524] The server analyzes the received request information and extracts relevant conditions. This process includes data analysis of the user's request, including origin, destination, and desired travel time. Data preprocessing is performed to prepare the server to narrow down the best candidates based on the input information.

[0525] Step 4:

[0526] The server utilizes a generative AI model to search for appropriate transportation facilities and providers from relevant databases and identify the optimal combination. The input here is the conditions extracted in the previous step, and the output is a list of candidate optimal routes and modes of transportation.

[0527] Step 5:

[0528] The server generates and sends detailed information about the optimal route and mode of transport to the terminal. This output includes available modes of transport, route information, and estimated arrival time. Once the data is sent to the user's terminal, the next selection step begins.

[0529] Step 6:

[0530] The terminal visually presents the information received from the server to the user, allowing them to review optimized options. The user selects the most suitable option from those presented on the screen and confirms their selection.

[0531] Step 7:

[0532] User selection information is sent from the terminal to the server, which then optimizes the autonomous vehicle's operating schedule and automatically arranges transportation based on that information. The output includes the confirmed operating schedule and reservation details.

[0533] Step 8:

[0534] The server issues operational commands to the target autonomous mobile vehicle, enabling it to operate in accordance with the user's requests. Ultimately, the user can achieve their desired travel quickly and smoothly.

[0535] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0536] This invention relates to a system that takes into account the user's emotions during funeral preparations and provides a more personalized experience. The system functions in an integrated form, consisting of a server, terminals, and an emotion engine.

[0537] The user first enters the funeral arrangements through their device. The input form is dynamically adjusted by an emotion engine to minimize user stress. For example, if the user indicates fatigue or frustration, the interface becomes simpler.

[0538] The device sends information collected from the user to an emotion engine to identify the user's hidden psychological state. This uses technologies such as text analysis and voice tone analysis. The collected emotion information is used to personalize the user experience.

[0539] Based on feedback from the emotion engine, the server selects appropriate funeral venues and service providers while considering the user's psychological state. It's possible to prioritize displaying candidates that match the user's emotions. For example, if the user appears calm, reliable service providers with many reviews are often suggested.

[0540] After selection, the server sends detailed information about the candidates to the terminal. During this process, the emotion engine adjusts the presentation method to minimize user stress. The user can then review the presented options, tailored to their emotional state, and make their final choice.

[0541] Once the user completes their selection, the device sends that selection information to the server. At this point, the emotion engine can also adjust the guidance for the next step based on the user's current psychological state.

[0542] The server receives the user's selections and automatically proceeds with all booking procedures with the chosen venues and vendors. In this process as well, emotional feedback is utilized to minimize the user's burden.

[0543] For example, if a user exhibits a high level of stress, the emotion engine optimizes the presentation of information to the user, simplifying the selection process. In this way, the present invention realizes a funeral preparation system that uses an emotion engine to support the user experience and contribute to stress reduction.

[0544] The following describes the processing flow.

[0545] Step 1:

[0546] Users input their wishes and conditions regarding the funeral through their device. The input interface is dynamically adjusted by an emotion engine, designed to reduce the user's input burden.

[0547] Step 2:

[0548] The device sends the input information to an emotion engine, which analyzes the user's emotional state. This is done through text sentiment analysis and, if voice input is available, tone analysis.

[0549] Step 3:

[0550] The emotion engine sends the analyzed emotion information to the server, feeding back the user's psychological state to the entire system. This prepares the system to process information while taking the user's emotions into consideration.

[0551] Step 4:

[0552] The server optimizes suggestions for funeral homes and service providers for the user based on emotional information. Specifically, if the emotional state is unstable, it prioritizes presenting options that offer flexibility and choices.

[0553] Step 5:

[0554] The server sends detailed information about the selected candidates to the terminal. The emotion engine adjusts how the information is presented according to the user's emotional state, making it easier for the user to receive the information.

[0555] Step 6:

[0556] Users review the presented options and select the most suitable funeral home or service provider. This process is also supported by an emotional engine, resulting in a less stressful experience.

[0557] Step 7:

[0558] The device sends the user's selection to the server. This information is also used to adjust the guidelines in the next step.

[0559] Step 8:

[0560] The server automatically proceeds with the booking process for the selected venue and vendors. The emotion engine monitors the user's emotions and appropriately notifies the user of the booking progress and the next steps.

[0561] Step 9:

[0562] The server notifies the terminal that the procedure is complete. The terminal then provides the user with confirmation of the reservation and guidance for the next steps. Sentimental information is also taken into consideration here, and the information is provided in a way that is beneficial to the user.

[0563] In this way, the emotion engine understands the user's psychological state at every step and optimizes the operation of the entire system.

[0564] (Example 2)

[0565] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0566] In funeral preparations, it is difficult to consider the emotional state of the bereaved family, which can easily lead to stress. Furthermore, there is a challenge in selecting venues and service providers based on the psychological state of the bereaved family. This can lead to decreased bereaved family satisfaction, making emotionally sensitive selection and guidance essential.

[0567] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0568] In this invention, the server includes means for receiving request information from a user and analyzing relevant conditions based on said information; means for collecting emotional data, performing emotional analysis using natural language processing technology, and estimating the user's psychological state; and means for searching a database for multiple candidate venues and service providers based on the relevant conditions and psychological state, and selecting the optimal combination. This makes it possible to select and guide users through funeral preparations in a way that is considerate of their emotions and minimizes stress.

[0569] "Request information" refers to the conditions and wishes regarding funerals entered by the user, and is data that the system uses to process information.

[0570] "Relevant conditions" are a part of the request information analyzed to identify the elements necessary for funeral preparations, and represent a set of conditions that reflect the user's wishes and constraints.

[0571] "Emotional data" refers to information about emotions contained in text and audio obtained from users, and is the basic data used for emotion analysis.

[0572] "Natural language processing technology" is a data processing technique used to identify potential emotional states by analyzing text and speech input by users.

[0573] "Psychological state" refers to the internal state of a user's emotions and mood, and is analyzed by the system in order to provide services while taking that state into consideration.

[0574] "Venue and service provider" refers to the corporation or individual responsible for providing the physical space available for conducting the user's funeral and the services that will be provided.

[0575] A "database" is a collection of electronic information where venue and service provider information is systematically stored, and is used by systems to search for information and make suggestions to users.

[0576] "Means" refers to a method, process, or apparatus designed to perform a specific function within a system, and is an essential element for realizing the invention.

[0577] The system of this invention is designed to take into account the emotions of users during funeral preparations and to provide personalized services. The system consists of hardware and software components: a server, a terminal, and an emotion engine.

[0578] Users input specific funeral conditions and wishes through a terminal. This terminal features a dynamic interface to facilitate user input, and the complexity of the form can be adjusted by an emotion engine.

[0579] The device collects text and voice information entered by the user to obtain emotional data. This utilizes natural language processing technology and voice tone analysis software, and leverages generative AI models from Python and OpenAI. The data obtained through emotional analysis is used to predict the user's psychological state.

[0580] The server searches the database for venue and service provider information based on the psychological state information analyzed by the emotion engine, and selects the most suitable candidate for the user's conditions. This makes it possible to provide users with choices that are sensitive to their emotions and do not cause them stress.

[0581] For example, if a user is experiencing high levels of stress, the server will adjust the selection process to present information concisely, reduce the number of options, and facilitate decision-making.

[0582] Furthermore, an example of a prompt in a generative AI model is, "Please suggest what services would be effective in reducing stress for a user who is feeling uneasy." This prompt allows the AI ​​model to generate appropriate emotional response strategies, which can then be executed through the server.

[0583] As described above, this system aims to provide funeral preparation services based on the user's emotions by utilizing advanced natural language processing technology and generative AI models.

[0584] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0585] Step 1:

[0586] The user enters details of the funeral (date, time, location, number of attendees, etc.) into the terminal. During this process, the terminal uses an emotion engine to optimize the input form in real time to ensure smooth user input. Specifically, if the terminal detects that the user is fatigued, it simplifies the input process. The terminal receives the user's text and voice information as input and generates an optimized form as output.

[0587] Step 2:

[0588] The device collects text and voice information received from the user as emotional data. This emotional data is analyzed using natural language processing (NLP) and voice tone analysis techniques. Specifically, Python and generative AI models are used to identify the user's psychological state from this data. The input is the user's text and voice information, and the output is emotional state data.

[0589] Step 3:

[0590] The terminal sends the analyzed emotional state data to the emotion engine. The emotion engine further examines the received data and evaluates the user's underlying psychological state in detail. The input here is emotional state data, and the output is the examined psychological state information. The engine converts the user's emotions into a format that the server can use.

[0591] Step 4:

[0592] The server searches a database based on psychological state information from the emotion engine and selects multiple venues and service providers that are best suited to the user. In this process, the user's emotional state influences the selection of candidates. Specifically, if the user is calm, highly-rated venues are prioritized, while if they are stressed, concise information is presented. The input is psychological state information, and the output is a list of optimal candidates.

[0593] Step 5:

[0594] The server transmits detailed information about the selected venue and service provider to the terminal and presents it to the user. During presentation, the display method is adjusted based on the evaluation results of the emotion engine. For example, a user in a high-stress state will be presented with a smaller number of recommended options. The input is a list of options, and the output is the adjusted information presentation.

[0595] Step 6:

[0596] The user selects their preferred option from the presented choices. The terminal then sends this selection information to the server. The selection is narrowed down to specific choices for the final decision, and the selection information is sent back to the server as output.

[0597] Step 7:

[0598] The server automatically executes the booking process with the selected venue and service provider based on the user's selection information received. Here again, feedback from the emotion engine is used to optimize the booking process for a smooth experience. The input is the selection information, and the output is booking confirmation information and the final scheduling result.

[0599] (Application Example 2)

[0600] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0601] Improving the customer experience is crucial in modern retail and service industries. However, traditional technologies have not adequately addressed the need to understand customers' emotional states in real time and provide appropriate services and customer interaction. Therefore, there is a need for systems that enhance customer satisfaction.

[0602] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0603] In this invention, the server includes means for analyzing user request information and related conditions, means for searching for facilities and vendors from information storage and selecting the optimal combination, and means for analyzing emotional states and optimizing customer service methods. This makes it possible to provide a personalized customer experience that responds to the user's emotional state.

[0604] "Request information" refers to information about the wishes and conditions that users enter into the system.

[0605] "Related conditions" are detailed conditions regarding service provision that are generated based on the request information.

[0606] "Facility" refers to the place or area where a service is provided.

[0607] "Service provider" refers to a company or individual that provides a service.

[0608] "Information storage" refers to a device or system that stores data and allows it to be searched and extracted as needed.

[0609] "Emotional state" refers to the psychological and emotional state that the user is experiencing.

[0610] "Customer service methods" refer to the methods of providing and responding to services to customers.

[0611] An "information processing device" is a device that receives data, processes it, and generates results.

[0612] "Customer experience" refers to the overall experience a customer has when using a service or facility.

[0613] The following describes an embodiment for carrying out the invention. This system mainly consists of three components: a server, a terminal, and a user. The server receives request information transmitted from the user and analyzes the relevant conditions based on it. Based on the analyzed relevant conditions, the server searches for the optimal combination of facilities and vendors from its information storage and provides personalized information that takes into account the user's emotional state. The user's terminal has a sensor built in to measure the emotional state, thereby collecting emotional data in real time. For the analysis of the emotional state, facial recognition technology using OpenCV and speech analysis using the Google Cloud Speech-to-Text API are utilized.

[0614] The server sends feedback to the terminal to optimize customer service methods based on collected emotional data. This feedback is presented to the user via an information processing device, contributing to an improved user experience. It also generates prompt messages tailored to the user's emotional state, suggesting the most suitable options. For example, if a user is experiencing stress, providing concise guidance on options can reduce the burden of decision-making.

[0615] A concrete example of the program would be a scenario where a customer is wearing smart glasses. In this case, it's possible to analyze emotions from eye movements and voice tone and provide the server with the most appropriate service style as a selection. An example of a prompt might be, "Instantly identify the emotional state of the next customer you'll be serving in this store and provide feedback to suggest the most appropriate service style."

[0616] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0617] Step 1:

[0618] The terminal receives request information from the user as input. This information includes details and conditions of the service the user desires. The terminal then prepares to send this request information to the server.

[0619] Step 2:

[0620] The server analyzes the relevant conditions based on the received request information. This analysis process includes referencing historical information from the database and data processing to derive appropriate conditions using statistical methods.

[0621] Step 3:

[0622] The server searches its information storage for multiple facilities and vendors based on the analyzed relevant conditions. Here, it performs data calculations to narrow down the candidates that match the conditions and select the optimal combination.

[0623] Step 4:

[0624] The device uses sensors to measure the user's emotional state, collecting facial expressions and voice tone as input. This information is then transmitted to a server in real time.

[0625] Step 5:

[0626] The server uses OpenCV to perform facial recognition and the Google Cloud Speech-to-Text API to analyze voice tone. This generates emotional data, which is then used to calculate feedback for optimizing customer service methods.

[0627] Step 6:

[0628] The server generates information to send to the terminal based on user sentiment data and analysis results. Using a generation AI model, it creates appropriate prompt sentences and presents the information in a way that is easily understandable to the user.

[0629] Step 7:

[0630] The terminal receives feedback and prompts from the server and displays them to the user. The user then makes a selection based on the presented information and prepares to send that selection information back to the server.

[0631] Step 8:

[0632] The server receives the user's selection and automatically executes the reservation process with the selected facilities and vendors. This process involves integration with an external reservation system to confirm the completion of the procedure.

[0633] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0634] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0635] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0636] [Fourth Embodiment]

[0637] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0638] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0639] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0640] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0641] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0642] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0643] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0644] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0645] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0646] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0647] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0648] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0649] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0650] The system of this invention is designed to streamline funeral preparations. It primarily involves three entities—a server, a terminal, and a user—working together to select the most suitable funeral venue and service provider, and to perform automated procedures.

[0651] The user first enters their wishes and requirements regarding the funeral through a terminal. This interface is designed to be easy to understand and intuitive to use, allowing users to input information such as region, budget, and religious requirements through a simple question-and-answer format.

[0652] The device receives this entered information and sends it to the server. The information is encrypted and transmitted through a secure communication environment, thus protecting your privacy.

[0653] The server analyzes the received information and extracts relevant conditions based on the request. Based on this information, it runs a generative AI model, searching a comprehensive database of funeral-related services to select the most suitable venues and service providers. The AI ​​can then suggest multiple options that best match the user's preferences.

[0654] After the selection is made, the server sends detailed information to the terminal and presents it to the user. This information includes details about each selected candidate, such as the venue's location, availability, reviews, and cost. The user can make the best choice by visually comparing the options.

[0655] Once the selection is complete, the device sends the information back to the server. The server automatically proceeds with the booking process for the selected venues and vendors. This process includes booking confirmation, generation of necessary documents, and verification.

[0656] Finally, the server sends confirmation of the reservation to the terminal, supporting the user in smoothly proceeding with the next necessary steps. This significantly reduces the stress associated with negotiating and making arrangements with multiple vendors, allowing the user to have time to remember their loved one.

[0657] For example, if a user enters "Buddhist funeral in Kyoto City, budget under 500,000 yen," the server will select candidates based on this information and present the selection results to the user's terminal. The user can then choose the most suitable option from the selected candidates and automatically proceed with the reservation process. This entire process allows for efficient and reliable funeral preparations.

[0658] The following describes the processing flow.

[0659] Step 1:

[0660] The user enters their desired funeral arrangements (e.g., location, budget, religious format) into the interface on their device. The interface is designed to be simple and intuitive to use.

[0661] Step 2:

[0662] The terminal collects information entered by the user from the input form, formats the data, and then sends it to the server. During this process, the transmitted data is encrypted and sent using a secure communication channel.

[0663] Step 3:

[0664] The server analyzes the data received from the terminal and extracts relevant conditions based on the user's request. These conditions include factors such as region, budget, and religious preferences.

[0665] Step 4:

[0666] The server runs a generative AI model and searches the database based on relevant conditions. Here, it selects several funeral homes and service providers that meet the criteria as candidates.

[0667] Step 5:

[0668] The server sends detailed information about the selected candidates (e.g., venue name, location, available dates, cost, reviews, etc.) to the terminal.

[0669] Step 6:

[0670] The terminal displays received information to the user in a visually easy-to-understand format. Users can compare the presented information and select the most suitable funeral home or service provider.

[0671] Step 7:

[0672] The user confirms their selected candidate and sends that information to the server via their device.

[0673] Step 8:

[0674] The server confirms the user's selection and automatically initiates the booking process with the chosen venues and vendors. If necessary, it also handles scheduling and contract document generation.

[0675] Step 9:

[0676] The server sends feedback to the terminal indicating that the reservation is complete. The terminal then notifies the user and provides information about the next steps.

[0677] In this way, the entire system provides users with a smooth and efficient funeral preparation process.

[0678] (Example 1)

[0679] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0680] Traditional funeral arrangements required individuals to negotiate and handle procedures with multiple venues and vendors, which was time-consuming and laborious. Furthermore, it was difficult to quickly and accurately select the best option based on the user's needs. These challenges reduced the time available for mourning the deceased and caused stress for those involved.

[0681] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0682] In this invention, the server includes means for receiving request information from a user via a terminal, encrypting the information, and transmitting it through a secure communication environment; means for analyzing the received information, extracting relevant conditions, and then running a generated AI model to search a database for multiple candidate venues and service providers, and selecting candidates; means for transmitting detailed information of the selected candidates back to the terminal to present it to the user and receiving the user's selection; and means for automatically executing the reservation procedure with the selected venue and service provider and transmitting reservation completion information to the terminal. As a result, the user can efficiently and quickly carry out procedures related to funeral preparations and ensure they have enough time to mourn the deceased.

[0683] "User" refers to an individual or organization that uses this system to make funeral arrangements.

[0684] A "terminal" is an electronic device used by a user to input or receive information, and includes computers, smartphones, tablets, and other similar devices.

[0685] A "server" is a computer system that receives, analyzes, and processes information sent by users, and is also responsible for coordinating with databases and generative AI models.

[0686] A "generative AI model" refers to an artificial intelligence algorithm that searches a database based on the user's requested conditions and selects the most suitable funeral venues and service providers.

[0687] A "prompt message" is a sentence that a user enters into the system to clarify their purpose, and may include conditions such as the funeral location, budget, and religious requirements.

[0688] A "database" is an information repository containing detailed information about funeral-related locations and businesses, which is referenced by the server when selecting candidates.

[0689] "Reservation procedures" refer to the series of processes involved in formally concluding a contract with the selected funeral home or service provider and confirming the date and conditions.

[0690] "Detailed information" refers to specific details about the selected candidates, including location data, available dates, and evaluation information.

[0691] The system of this invention operates in cooperation with three entities: a server, a terminal, and a user, in order to streamline funeral preparations.

[0692] The user first uses a terminal to input their wishes and requirements regarding the funeral. This terminal includes electronic devices such as smartphones and computers, and the user interface is designed to be intuitive. The user can input information such as "region," "budget," and "religious requirements" in text format according to the on-screen instructions. For example, the user might input a prompt message such as "Christian funeral in Tokyo, budget under 300,000 yen" into the terminal.

[0693] The terminal encrypts the entered information and sends it to the server using a secure communication protocol. Here, information encryption and secure communication are essential to protect the user's personal information.

[0694] The server analyzes the received information and activates a generative AI model. This AI model searches a database based on the received information and selects the most suitable funeral venues and service providers. In this process, the AI ​​can suggest multiple options that closely match the user's selection criteria.

[0695] The selected options are sent from the server to the terminal and presented to the user. The user can then use the presented information to visually compare the most suitable venues and vendors from the candidates and make a final selection.

[0696] This system significantly reduces the time and effort required for negotiating and dealing with multiple vendors, allowing users to dedicate more time to mourning their loved ones. Furthermore, the system provides comprehensive support for efficiently and safely conducting funeral preparations.

[0697] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0698] Step 1:

[0699] Users input their wishes and requirements regarding the funeral via a terminal. This input is in text format and includes information such as "region," "budget," and "religious requirements." For example, a user might enter the prompt message, "Christian funeral in Tokyo, budget under 300,000 yen." The input data is encrypted on the terminal and transmitted to the server via a secure protocol. This encryption ensures the protection of personal information.

[0700] Step 2:

[0701] The server decrypts the received encrypted data and analyzes its contents. During the analysis, it extracts conditions from the received data and supplies them as prompts to the generative AI model. The generative AI model searches the database based on these conditions and lists several candidate funeral homes and service providers that match the user's criteria. As a result of this calculation, selected candidate information is obtained.

[0702] Step 3:

[0703] The server compiles detailed information on the candidates selected by the generation AI model, including "venue location," "available dates," "reviews," and "cost." The server then sends this candidate information to the terminal. The terminal displays the candidate information in a user-friendly format and presents it to the user.

[0704] Step 4:

[0705] The user compares the options presented on the device and determines the most appropriate choice. Once the user's selection is confirmed, that information is sent back to the server via the device. The input data conversion and selection process outputs detailed information about the selected funeral.

[0706] Step 5:

[0707] Based on the confirmed selection, the server automatically initiates the booking process with the chosen venue and vendor. This process includes booking confirmation, generation of necessary documents, and sending of confirmation emails. After the booking is complete, the server sends completion information to the terminal and provides the user with instructions for the next steps. This series of actions ensures that funeral bookings are completed efficiently and accurately.

[0708] (Application Example 1)

[0709] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0710] In mobility services using autonomous vehicles, there is a lack of means to automate appropriate and efficient operation based on the diverse needs of users. Furthermore, there is a need for a highly accurate system that can quickly select the optimal route and mode of transport from multiple options and provide it to users. This would allow users to reduce waiting times and the hassle of making arrangements, and enjoy an efficient travel experience.

[0711] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0712] In this invention, the server includes means for receiving request information from a user and analyzing relevant conditions based on that information; means for searching a database for multiple candidate facilities and providers and selecting the optimal combination; and means for automatically arranging appropriate means of transportation according to the user's desired travel time. As a result, the user can immediately receive the optimal route and means of transportation and reach their destination efficiently.

[0713] "User request information" refers to information provided by users to communicate their wishes and conditions regarding transportation and service use.

[0714] "Means for analyzing relevant conditions" refers to a device or method that analyzes and extracts conditions necessary for movement or service provision based on received request information.

[0715] "Facilities and providers" refers to places and their operators that offer services or functions based on user requests.

[0716] An "autonomous mobile vehicle" refers to a mode of transportation that operates automatically using AI and sensor technology.

[0717] "Methods for optimizing the operation schedule" refers to the process of formulating the optimal operation plan by considering user requests and real-time traffic conditions.

[0718] "User evaluations" are aggregated information based on feedback from people who have used the service in the past, and serve as a reference in the selection process.

[0719] The system for implementing this invention mainly consists of three components: a server, a terminal, and a user.

[0720] The server is deployed in a cloud environment and utilizes AI models for data analysis and processing. It analyzes the request information received from users and extracts relevant conditions. Based on this, it searches for multiple candidate facilities and providers using a large-scale database and selects the optimal combination. Furthermore, the server optimizes the operation schedule of the autonomous vehicle according to the user's desired travel time and requests. It also sends detailed information of the selected candidates to the terminal and presents the user with real-time updated travel route and time information. The server uses services such as Google Maps API and AWS Lambda to perform efficient data processing and calculations.

[0721] The terminal functions as a user-operated device and is integrated into smartphones or in-vehicle displays. This allows users to easily input requested information and travel preferences. The terminal also visually displays information received from the server on the screen, providing a highly convenient interface. Furthermore, once the user has completed their selection, the terminal sends that information back to the server.

[0722] For example, if a user inputs "I want to travel from my starting point to my destination at 3 PM," the server receives this information and calculates and presents the optimal route and mode of transport. The server can instantly deploy an appropriate autonomous vehicle in response to the user's request. The generative AI model is optimized to operate efficiently and quickly suggest candidates. An example of a prompt would be, "Please calculate the optimal travel route from my starting point to my destination."

[0723] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0724] Step 1:

[0725] The user enters travel request information using a terminal. Specifically, they input and transmit information such as departure point, destination, and desired travel time into the interface of their smartphone or in-car display. This input serves as request information for the system to process in the next step.

[0726] Step 2:

[0727] The terminal receives the user's request information and sends this information to the server using an encrypted, secure communication protocol. The output at this stage consists of numerical and text data formatted for analysis by the server.

[0728] Step 3:

[0729] The server analyzes the received request information and extracts relevant conditions. This process includes data analysis of the user's request, including origin, destination, and desired travel time. Data preprocessing is performed to prepare the server to narrow down the best candidates based on the input information.

[0730] Step 4:

[0731] The server utilizes a generative AI model to search for appropriate transportation facilities and providers from relevant databases and identify the optimal combination. The input here is the conditions extracted in the previous step, and the output is a list of candidate optimal routes and modes of transportation.

[0732] Step 5:

[0733] The server generates and sends detailed information about the optimal route and mode of transport to the terminal. This output includes available modes of transport, route information, and estimated arrival time. Once the data is sent to the user's terminal, the next selection step begins.

[0734] Step 6:

[0735] The terminal visually presents the information received from the server to the user, allowing them to review optimized options. The user selects the most suitable option from those presented on the screen and confirms their selection.

[0736] Step 7:

[0737] User selection information is sent from the terminal to the server, which then optimizes the autonomous vehicle's operating schedule and automatically arranges transportation based on that information. The output includes the confirmed operating schedule and reservation details.

[0738] Step 8:

[0739] The server issues operational commands to the target autonomous mobile vehicle, enabling it to operate in accordance with the user's requests. Ultimately, the user can achieve their desired travel quickly and smoothly.

[0740] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0741] This invention relates to a system that takes into account the user's emotions during funeral preparations and provides a more personalized experience. The system functions in an integrated form, consisting of a server, terminals, and an emotion engine.

[0742] The user first enters the funeral arrangements through their device. The input form is dynamically adjusted by an emotion engine to minimize user stress. For example, if the user indicates fatigue or frustration, the interface becomes simpler.

[0743] The device sends information collected from the user to an emotion engine to identify the user's hidden psychological state. This uses technologies such as text analysis and voice tone analysis. The collected emotion information is used to personalize the user experience.

[0744] Based on feedback from the emotion engine, the server selects appropriate funeral venues and service providers while considering the user's psychological state. It's possible to prioritize displaying candidates that match the user's emotions. For example, if the user appears calm, reliable service providers with many reviews are often suggested.

[0745] After selection, the server sends detailed information about the candidates to the terminal. During this process, the emotion engine adjusts the presentation method to minimize user stress. The user can then review the presented options, tailored to their emotional state, and make their final choice.

[0746] Once the user completes their selection, the device sends that selection information to the server. At this point, the emotion engine can also adjust the guidance for the next step based on the user's current psychological state.

[0747] The server receives the user's selections and automatically proceeds with all booking procedures with the chosen venues and vendors. In this process as well, emotional feedback is utilized to minimize the user's burden.

[0748] For example, if a user exhibits a high level of stress, the emotion engine optimizes the presentation of information to the user, simplifying the selection process. In this way, the present invention realizes a funeral preparation system that uses an emotion engine to support the user experience and contribute to stress reduction.

[0749] The following describes the processing flow.

[0750] Step 1:

[0751] Users input their wishes and conditions regarding the funeral through their device. The input interface is dynamically adjusted by an emotion engine, designed to reduce the user's input burden.

[0752] Step 2:

[0753] The device sends the input information to an emotion engine, which analyzes the user's emotional state. This is done through text sentiment analysis and, if voice input is available, tone analysis.

[0754] Step 3:

[0755] The emotion engine sends the analyzed emotion information to the server, feeding back the user's psychological state to the entire system. This prepares the system to process information while taking the user's emotions into consideration.

[0756] Step 4:

[0757] The server optimizes suggestions for funeral homes and service providers for the user based on emotional information. Specifically, if the emotional state is unstable, it prioritizes presenting options that offer flexibility and choices.

[0758] Step 5:

[0759] The server sends detailed information about the selected candidates to the terminal. The emotion engine adjusts how the information is presented according to the user's emotional state, making it easier for the user to receive the information.

[0760] Step 6:

[0761] Users review the presented options and select the most suitable funeral home or service provider. This process is also supported by an emotional engine, resulting in a less stressful experience.

[0762] Step 7:

[0763] The device sends the user's selection to the server. This information is also used to adjust the guidelines in the next step.

[0764] Step 8:

[0765] The server automatically proceeds with the booking process for the selected venue and vendors. The emotion engine monitors the user's emotions and appropriately notifies the user of the booking progress and the next steps.

[0766] Step 9:

[0767] The server notifies the terminal that the procedure is complete. The terminal then provides the user with confirmation of the reservation and guidance for the next steps. Sentimental information is also taken into consideration here, and the information is provided in a way that is beneficial to the user.

[0768] In this way, the emotion engine understands the user's psychological state at every step and optimizes the operation of the entire system.

[0769] (Example 2)

[0770] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0771] In funeral preparations, it is difficult to consider the emotional state of the bereaved family, which can easily lead to stress. Furthermore, there is a challenge in selecting venues and service providers based on the psychological state of the bereaved family. This can lead to decreased bereaved family satisfaction, making emotionally sensitive selection and guidance essential.

[0772] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0773] In this invention, the server includes means for receiving request information from a user and analyzing relevant conditions based on said information; means for collecting emotional data, performing emotional analysis using natural language processing technology, and estimating the user's psychological state; and means for searching a database for multiple candidate venues and service providers based on the relevant conditions and psychological state, and selecting the optimal combination. This makes it possible to select and guide users through funeral preparations in a way that is considerate of their emotions and minimizes stress.

[0774] "Request information" refers to the conditions and wishes regarding funerals entered by the user, and is data that the system uses to process information.

[0775] "Relevant conditions" are a part of the request information analyzed to identify the elements necessary for funeral preparations, and represent a set of conditions that reflect the user's wishes and constraints.

[0776] "Emotional data" refers to information about emotions contained in text and audio obtained from users, and is the basic data used for emotion analysis.

[0777] "Natural language processing technology" is a data processing technique used to identify potential emotional states by analyzing text and speech input by users.

[0778] "Psychological state" refers to the internal state of a user's emotions and mood, and is analyzed by the system in order to provide services while taking that state into consideration.

[0779] "Venue and service provider" refers to the corporation or individual responsible for providing the physical space available for conducting the user's funeral and the services that will be provided.

[0780] A "database" is a collection of electronic information where venue and service provider information is systematically stored, and is used by systems to search for information and make suggestions to users.

[0781] "Means" refers to a method, process, or apparatus designed to perform a specific function within a system, and is an essential element for realizing the invention.

[0782] The system of this invention is designed to take into account the emotions of users during funeral preparations and to provide personalized services. The system consists of hardware and software components: a server, a terminal, and an emotion engine.

[0783] Users input specific funeral conditions and wishes through a terminal. This terminal features a dynamic interface to facilitate user input, and the complexity of the form can be adjusted by an emotion engine.

[0784] The device collects text and voice information entered by the user to obtain emotional data. This utilizes natural language processing technology and voice tone analysis software, and leverages generative AI models from Python and OpenAI. The data obtained through emotional analysis is used to predict the user's psychological state.

[0785] The server searches the database for venue and service provider information based on the psychological state information analyzed by the emotion engine, and selects the most suitable candidate for the user's conditions. This makes it possible to provide users with choices that are sensitive to their emotions and do not cause them stress.

[0786] For example, if a user is experiencing high levels of stress, the server will adjust the selection process to present information concisely, reduce the number of options, and facilitate decision-making.

[0787] Furthermore, an example of a prompt in a generative AI model is, "Please suggest what services would be effective in reducing stress for a user who is feeling uneasy." This prompt allows the AI ​​model to generate appropriate emotional response strategies, which can then be executed through the server.

[0788] As described above, this system aims to provide funeral preparation services based on the user's emotions by utilizing advanced natural language processing technology and generative AI models.

[0789] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0790] Step 1:

[0791] The user enters details of the funeral (date, time, location, number of attendees, etc.) into the terminal. During this process, the terminal uses an emotion engine to optimize the input form in real time to ensure smooth user input. Specifically, if the terminal detects that the user is fatigued, it simplifies the input process. The terminal receives the user's text and voice information as input and generates an optimized form as output.

[0792] Step 2:

[0793] The device collects text and voice information received from the user as emotional data. This emotional data is analyzed using natural language processing (NLP) and voice tone analysis techniques. Specifically, Python and generative AI models are used to identify the user's psychological state from this data. The input is the user's text and voice information, and the output is emotional state data.

[0794] Step 3:

[0795] The terminal sends the analyzed emotional state data to the emotion engine. The emotion engine further examines the received data and evaluates the user's underlying psychological state in detail. The input here is emotional state data, and the output is the examined psychological state information. The engine converts the user's emotions into a format that the server can use.

[0796] Step 4:

[0797] The server searches a database based on psychological state information from the emotion engine and selects multiple venues and service providers that are best suited to the user. In this process, the user's emotional state influences the selection of candidates. Specifically, if the user is calm, highly-rated venues are prioritized, while if they are stressed, concise information is presented. The input is psychological state information, and the output is a list of optimal candidates.

[0798] Step 5:

[0799] The server transmits detailed information about the selected venue and service provider to the terminal and presents it to the user. During presentation, the display method is adjusted based on the evaluation results of the emotion engine. For example, a user in a high-stress state will be presented with a smaller number of recommended options. The input is a list of options, and the output is the adjusted information presentation.

[0800] Step 6:

[0801] The user selects their preferred option from the presented choices. The terminal then sends this selection information to the server. The selection is narrowed down to specific choices for the final decision, and the selection information is sent back to the server as output.

[0802] Step 7:

[0803] The server automatically executes the booking process with the selected venue and service provider based on the user's selection information received. Here again, feedback from the emotion engine is used to optimize the booking process for a smooth experience. The input is the selection information, and the output is booking confirmation information and the final scheduling result.

[0804] (Application Example 2)

[0805] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0806] Improving the customer experience is crucial in modern retail and service industries. However, traditional technologies have not adequately addressed the need to understand customers' emotional states in real time and provide appropriate services and customer interaction. Therefore, there is a need for systems that enhance customer satisfaction.

[0807] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0808] In this invention, the server includes means for analyzing user request information and related conditions, means for searching for facilities and vendors from information storage and selecting the optimal combination, and means for analyzing emotional states and optimizing customer service methods. This makes it possible to provide a personalized customer experience that responds to the user's emotional state.

[0809] "Request information" refers to information about the wishes and conditions that users enter into the system.

[0810] "Related conditions" are detailed conditions regarding service provision that are generated based on the request information.

[0811] "Facility" refers to the place or area where a service is provided.

[0812] "Service provider" refers to a company or individual that provides a service.

[0813] "Information storage" refers to a device or system that stores data and allows it to be searched and extracted as needed.

[0814] "Emotional state" refers to the psychological and emotional state that the user is experiencing.

[0815] "Customer service methods" refer to the methods of providing and responding to services to customers.

[0816] An "information processing device" is a device that receives data, processes it, and generates results.

[0817] "Customer experience" refers to the overall experience a customer has when using a service or facility.

[0818] The following describes an embodiment for carrying out the invention. This system mainly consists of three components: a server, a terminal, and a user. The server receives request information transmitted from the user and analyzes the relevant conditions based on it. Based on the analyzed relevant conditions, the server searches for the optimal combination of facilities and vendors from its information storage and provides personalized information that takes into account the user's emotional state. The user's terminal has a sensor built in to measure the emotional state, thereby collecting emotional data in real time. For the analysis of the emotional state, facial recognition technology using OpenCV and speech analysis using the Google Cloud Speech-to-Text API are utilized.

[0819] The server sends feedback to the terminal to optimize customer service methods based on collected emotional data. This feedback is presented to the user via an information processing device, contributing to an improved user experience. It also generates prompt messages tailored to the user's emotional state, suggesting the most suitable options. For example, if a user is experiencing stress, providing concise guidance on options can reduce the burden of decision-making.

[0820] A concrete example of the program would be a scenario where a customer is wearing smart glasses. In this case, it's possible to analyze emotions from eye movements and voice tone and provide the server with the most appropriate service style as a selection. An example of a prompt might be, "Instantly identify the emotional state of the next customer you'll be serving in this store and provide feedback to suggest the most appropriate service style."

[0821] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0822] Step 1:

[0823] The terminal receives request information from the user as input. This information includes details and conditions of the service the user desires. The terminal then prepares to send this request information to the server.

[0824] Step 2:

[0825] The server analyzes the relevant conditions based on the received request information. This analysis process includes referencing historical information from the database and data processing to derive appropriate conditions using statistical methods.

[0826] Step 3:

[0827] The server searches its information storage for multiple facilities and vendors based on the analyzed relevant conditions. Here, it performs data calculations to narrow down the candidates that match the conditions and select the optimal combination.

[0828] Step 4:

[0829] The device uses sensors to measure the user's emotional state, collecting facial expressions and voice tone as input. This information is then transmitted to a server in real time.

[0830] Step 5:

[0831] The server uses OpenCV to perform facial recognition and the Google Cloud Speech-to-Text API to analyze voice tone. This generates emotional data, which is then used to calculate feedback for optimizing customer service methods.

[0832] Step 6:

[0833] The server generates information to send to the terminal based on user sentiment data and analysis results. Using a generation AI model, it creates appropriate prompt sentences and presents the information in a way that is easily understandable to the user.

[0834] Step 7:

[0835] The terminal receives feedback and prompts from the server and displays them to the user. The user then makes a selection based on the presented information and prepares to send that selection information back to the server.

[0836] Step 8:

[0837] The server receives the user's selection and automatically executes the reservation process with the selected facilities and vendors. This process involves integration with an external reservation system to confirm the completion of the procedure.

[0838] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0839] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0840] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0841] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0842] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0843] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0844] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0845] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0846] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0847] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0848] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0849] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0850] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0851] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0852] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0853] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0854] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0855] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0856] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0857] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0858] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0859] The following is further disclosed regarding the embodiments described above.

[0860] (Claim 1)

[0861] A means for receiving request information from a user and analyzing related conditions based on that information,

[0862] Based on the aforementioned related conditions, a means for searching a database for multiple candidate venues and vendors and selecting the optimal combination,

[0863] A means for providing the user with detailed information on the selected candidates and for receiving the user's selection,

[0864] A system that includes means for automatically executing booking procedures with selected venues and vendors based on received selections.

[0865] (Claim 2)

[0866] The system according to claim 1, designed to select the most suitable venue and vendor based on the religious preferences, location, and budget provided by the user.

[0867] (Claim 3)

[0868] The system according to claim 1, comprising means for including location information, availability dates, and user reviews in the detailed information of selected candidates.

[0869] "Example 1"

[0870] (Claim 1)

[0871] A means of receiving request information from a user via a terminal, encrypting that information, and transmitting it to a server through a secure communication environment,

[0872] A method for analyzing information received by a server, extracting relevant conditions, running a generated AI model to search a database for multiple candidate wedding venues and vendors, and selecting candidates.

[0873] A means of sending detailed information of the selected candidates back to the terminal to present it to the user and receiving the user's selection,

[0874] A system that includes means for a server to automatically execute a reservation procedure with the selected venue and vendor based on the received selection, and to send reservation completion information to the terminal.

[0875] (Claim 2)

[0876] The system according to claim 1, configured to analyze religious requirements, region, and budget based on prompt text entered by the user, and to select the most suitable venue and vendor.

[0877] (Claim 3)

[0878] The system according to claim 1, comprising means for including location data, available dates, and evaluation information in the detailed information of selected candidates.

[0879] "Application Example 1"

[0880] (Claim 1)

[0881] A means for receiving request information from a user and analyzing related conditions based on that information,

[0882] A means for searching a database for multiple candidate facilities and providers based on the aforementioned related conditions and selecting the optimal combination,

[0883] A means for providing the user with detailed information on the selected candidates and for receiving the user's selection,

[0884] A means to automatically execute the booking process with the selected facilities and providers based on the received selections,

[0885] A means for analyzing user request information and calculating the optimal route based on the origin and destination,

[0886] A means for optimizing the operation schedule of an autonomous mobile vehicle using the aforementioned route information,

[0887] A system that includes means for automatically arranging appropriate means of transportation according to the user's desired travel time.

[0888] (Claim 2)

[0889] The system according to claim 1, designed to select the optimal route and means of transportation based on the user's travel preferences and time.

[0890] (Claim 3)

[0891] The system according to claim 1, comprising means for including location information, availability time, and user evaluation in the detailed information of selected candidates.

[0892] "Example 2 of combining an emotion engine"

[0893] (Claim 1)

[0894] A means for receiving request information from a user and analyzing related conditions based on that information,

[0895] A means of collecting emotional data, performing emotional analysis using natural language processing technology, and estimating the user's psychological state,

[0896] A means for searching a database for multiple candidate venues and service providers based on the aforementioned related conditions and psychological state, and selecting the optimal combination,

[0897] When presenting detailed information on the selected candidates to the user, means for adjusting the presentation method according to the user's emotional state,

[0898] A system that includes means for receiving user selections and automatically executing booking procedures with selected venues and service providers based on those selections.

[0899] (Claim 2)

[0900] The system according to claim 1, which is designed to select the most suitable venue and service provider based on the user's cultural preferences, geographical conditions, and spending plan, taking into account the user's emotional state in the process.

[0901] (Claim 3)

[0902] The system according to claim 1, comprising means for including location information, available dates and times, and evaluation information in the detailed information of selected candidates, and further adjusting the presentation method individually based on the sentiment analysis results.

[0903] "Application example 2 when combining with an emotional engine"

[0904] (Claim 1)

[0905] A means for receiving request information from a user and analyzing related conditions based on that information,

[0906] A means for searching for multiple candidate facilities and vendors from information storage based on the aforementioned related conditions and selecting the optimal combination,

[0907] A means for providing the user with detailed information on the selected candidates and for receiving the user's selection,

[0908] A means to automatically execute the booking process with the selected facilities and vendors based on the received selections,

[0909] A means of analyzing the emotional state of users and optimizing customer service methods,

[0910] A means of improving the user experience by providing emotion analysis results via an information processing device,

[0911] A system that includes this.

[0912] (Claim 2)

[0913] The system according to claim 1, designed to select the most suitable facilities and vendors based on the user's cultural preferences, regional settings, and budget information.

[0914] (Claim 3)

[0915] The system according to claim 1, comprising means for including location data, availability schedule, and user evaluation in the detailed information of selected candidates. [Explanation of Symbols]

[0916] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for receiving request information from a user and analyzing related conditions based on that information, Based on the aforementioned related conditions, a means for searching a database for multiple candidate venues and vendors and selecting the optimal combination, A means for providing the user with detailed information on the selected candidates and for receiving the user's selection, A system that includes means for automatically executing booking procedures with selected venues and vendors based on received selections.

2. The system according to claim 1, designed to select the most suitable venue and vendor based on the religious preferences, location, and budget provided by the user.

3. The system according to claim 1, comprising means for including location information, availability dates, and user reviews in the detailed information of selected candidates.

Images