System

Abstract

To provide a system for supporting preparation for an ending.SOLUTION: A system includes: means for recognizing a user's feeling by using a feeling engine; means for generating a question by using a prompt sentence for designating generation of the question for creating the user's ending note and a regenerative AI model on the basis of a recognition result of the user's feeling; means for presenting the generated question to the user and receiving an answer to the question; and means for recording the received answer.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Discussing wills and graveyards at home can be a difficult topic for the average person due to emotionality, aversion, legal requirements, and formal restrictions. While new concepts like "end-of-life planning" and "end-of-life notes" are widely accepted, even as humorous stories, there is a lack of methods to promote reflection on life, change of perspective, and awareness, as well as deepen legal understanding. [Means for solving the problem]

[0005] This invention enables casual conversation and consultation between humans and AI, promoting life reflection, a change of perspective, and awareness. It also deepens legal understanding and supports preparation for endings. Furthermore, it provides a system that provides advice that does not violate the Attorneys Act and leads to web services. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] In one embodiment of the present invention, a means for enabling chatting and consultation with AI uses natural language processing technology to analyze human utterances and generate appropriate responses. Specifically, if a human says, "I'm thinking about writing a will," the AI ​​will generate a response such as, "Wills are an important procedure. What specifically are you considering?"

[0029] "Example 2"

[0030] Furthermore, as a means of encouraging reflection on life, a change of perspective, and awareness, AI can provide points of reflection and new perspectives to human speech. For example, if a human says, "Work hasn't been going well lately," the AI ​​can provide questions such as, "That's tough. Have you had any successful experiences in the past? Is there anything you can learn from those experiences?"

[0031] "Example 3"

[0032] Furthermore, as a means of deepening legal understanding, the AI ​​provides general information about the law. For example, if a human says, "I want to know how to write a will," the AI ​​will provide information such as, "There are several ways to write a will, such as a notarized will or a handwritten will. We recommend that you consult an expert for details."

[0033] "Example 4"

[0034] Additionally, as a means of assisting with end-of-life preparations, AI will assist in the creation of an end-of-life note. Specifically, it will provide questions for each item in the end-of-life note and record the human's answers. For example, it will provide questions such as "What would you like to tell your loved ones?" and save the answers as an end-of-life note.

[0035] "Example 5"

[0036] Finally, as a means of providing advice and guidance to web services that do not violate the Lawyers Act, the AI ​​provides general information about the law, recommends consulting a professional, and provides links to appropriate web services, such as a link to a web service for finding a will-writing professional.

[0037] The processing flow of each embodiment will be described below.

[0038] "Example 1"

[0039] Step 1: The AI ​​analyzes human speech using natural language processing technology.

[0040] Step 2: The AI ​​generates an appropriate response based on the analysis results. For example, if a human says, "I'm thinking about writing a will," the AI ​​will generate a response such as, "Willing is an important procedure. What specifically are you considering?"

[0041] "Example 2"

[0042] Step 1: The AI ​​analyzes human speech using natural language processing technology.

[0043] Step 2: The AI ​​provides points for reflection and new perspectives based on the analysis results. For example, if a human says, "Work hasn't been going well lately," the AI ​​will provide questions such as, "That's tough. Have you had any previous successes? Is there anything you can learn from those experiences?"

[0044] "Example 3"

[0045] Step 1: The AI ​​analyzes human speech using natural language processing technology.

[0046] Step 2: The AI ​​provides general legal information based on the analysis results. For example, if a human says, "I want to know how to write a will," the AI ​​will provide information such as, "There are several ways to write a will, such as a notarized will or a handwritten will. We recommend that you consult a specialist for details."

[0047] "Example 4"

[0048] Step 1: The AI ​​provides questions for each item in the end-of-life note.

[0049] Step 2: The AI ​​records the human's answers and saves them as an end-of-life note. For example, it provides questions such as, "What would you like to tell your loved one?" and saves the answers as an end-of-life note.

[0050] "Example 5"

[0051] Step 1: The AI ​​provides general information about the law and recommends consulting an expert.

[0052] Step 2: The AI ​​provides a link to an appropriate web service, such as a link to a web service for finding a will-writing expert.

[0053] Example 1

[0054] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0055] Conventional AI systems have had difficulty generating appropriate responses when chatting or consulting with users. Furthermore, they lacked the technology to accurately analyze user utterances and generate appropriate prompts, resulting in a decline in the quality of responses. Furthermore, they did not provide sufficient support for preparing the ending or deepening legal understanding.

[0056] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0057] In this invention, the server includes means for analyzing user utterances and generating appropriate responses, means for analyzing utterance data using natural language processing technology, means for inputting prompt sentences into a generative AI model to generate responses, and means for displaying the generated responses to the user, thereby enabling the server to generate high-quality responses in casual conversations and consultations with users.

[0058] "Means enabling chatting and consultation between humans and AI" refers to technology that allows users to have natural conversations with AI, exchanging information and solving problems through chatting and consultation.

[0059] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that helps users reflect on their past experiences and gain new perspectives and ideas.

[0060] "Means for deepening legal understanding" are techniques that allow users to deepen their knowledge of the law and promote their understanding of legal issues.

[0061] "Means to support preparation for ending" are technologies that support users in making preparations for the end of their lives.

[0062] "Means for providing legally compliant advice and guidance to web services" refers to technology that provides users with legally compliant advice and introduces appropriate web services.

[0063] The "means for analyzing user utterances and generating an appropriate response" is a technology for analyzing the content of a user utterance and generating an appropriate response based on that content.

[0064] The "means for analyzing speech data using natural language processing technology" is a technology that uses natural language processing technology to analyze user speech data and extract the intention of the speech and keywords.

[0065] "Means for inputting a prompt sentence into a generative AI model to generate a response" refers to a technology that inputs a prompt sentence into a generative AI model and generates an appropriate response based on that prompt sentence.

[0066] The "means for displaying the generated response to the user" is a technique for transmitting the generated response to the user's terminal and displaying it to the user.

[0067] This invention is a system that allows users to have natural conversations with artificial intelligence, exchanging information and solving problems through casual conversations and consultations. The system includes technology for analyzing user utterances and generating appropriate responses.

[0068] Hardware and software used

[0069] Hardware:

[0070] A server (with a high-performance CPU and sufficient memory)

[0071] software:

[0072] Natural language processing libraries (e.g., spaCy, NLTK)

[0073] Generative AI models (e.g., GPT-4 (registered trademark))

[0074] Program processing

[0075] The server receives speech data from the user. Specifically, the user utters "I'm thinking about my will" through a device (such as a smartphone or PC). This speech data is sent from the device to the server.

[0076] The server analyzes the received speech data using a natural language processing library. As a result of the analysis, it extracts the intention of the speech and keywords. Next, it generates a prompt sentence for a generative AI model (such as GPT-4) based on the extracted information. This prompt sentence serves as an instruction for the AI ​​model to generate an appropriate response.

[0077] The generative AI model receives a prompt as input and generates an appropriate response. For example, in response to the utterance "I'm thinking about writing a will," it generates the response "A will is an important procedure. What specifically are you considering?"

[0078] Finally, the server sends the generated response to the user's terminal, where it is displayed to the user.

[0079] Specific examples

[0080] User utterance: "I'm thinking about my will."

[0081] What the device does: Converts speech to text and sends it to the server

[0082] Server analysis: Extract the keyword "will" and the intent "thinking"

[0083] Generate prompt: "The user says they're thinking about a will. Generate an appropriate response about a will."

[0084] The generative AI model responded: "A will is an important procedure. What specifically are you considering?"

[0085] Server Send: Sends the response to the device

[0086] Display terminal: Display the response to the user

[0087] In this way, users can chat and consult with AI.

[0088] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0089] Step 1:

[0090] The user speaks.

[0091] Specific operation: The user uses a device (such as a smartphone or PC) to speak to the system. For example, the user might say, "I'm thinking about my will."

[0092] Input: User's voice data

[0093] Output: Audio data sent to the device

[0094] Step 2:

[0095] The terminal transmits the speech data to the server.

[0096] Specific operation: The device captures the user's speech as audio data and converts it into text data, which is then sent to a server via the Internet.

[0097] Input: User's voice data

[0098] Output: Text data sent to the server

[0099] Step 3:

[0100] The server analyzes the speech data.

[0101] Specific operation: The server analyzes the received text data using a natural language processing library (e.g., spaCy, NLTK). As a result of the analysis, the intention of the utterance and keywords are extracted. For example, the keyword "will" and the intention of "thinking" are extracted.

[0102] Input: Text data

[0103] Output: Extracted intents and keywords

[0104] Step 4:

[0105] The server generates a prompt.

[0106] Specific operation: The server generates a prompt based on the extracted information. This prompt serves as an instruction for the generative AI model to generate an appropriate response. For example, it generates a prompt such as, "The user says they are thinking about a will. Please generate an appropriate response regarding a will."

[0107] Input: Extracted intents and keywords

[0108] Output: prompt statement

[0109] Step 5:

[0110] The server inputs a prompt sentence into the generative AI model.

[0111] Specific operation: The server inputs the generated prompt sentence into a generative AI model (e.g., GPT-4), which generates a response based on the prompt sentence.

[0112] Input: prompt statement

[0113] Output: The prompt sentence that is fed into the generative AI model

[0114] Step 6:

[0115] A generative AI model generates a response.

[0116] Specific behavior: The generative AI model generates an appropriate response based on the prompt sentence, for example, "A will is an important procedure. What specifically are you considering?"

[0117] Input: prompt statement

[0118] Output: The generated response

[0119] Step 7:

[0120] The server sends the generated response to the terminal.

[0121] Specific operation: The server sends the response obtained from the generative AI model to the user's device. The response is sent as text data.

[0122] Input: The generated response

[0123] Output: Text data sent to the terminal

[0124] Step 8:

[0125] The terminal displays the response to the user.

[0126] Specific operation: The terminal displays the received response to the user, who can check the response on the terminal screen.

[0127] Input: Text data sent to the terminal

[0128] Output: The response that is displayed to the user

[0129] (Application example 1)

[0130] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0131] In modern society, individuals face a wide range of problems and worries. In particular, many issues require specialized knowledge, such as life reflection, end-of-life preparations, legal understanding, and even security consultations in everyday life. However, obtaining appropriate advice on these issues is not easy, and consulting with experts takes time and money. Furthermore, there is a demand for advice that does not violate the Lawyers Act, and for people to be directed to appropriate web services. To solve these issues, an efficient and effective system that utilizes AI is needed.

[0132] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0133] In this invention, the server includes a means for enabling chats and consultations between humans and AI, a means for encouraging life reflection, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting preparations for endings, a means for providing advice that does not violate the Lawyers Act and guidance to web services, and a means for consulting AI about security issues. This allows users to efficiently and effectively obtain appropriate advice for a wide range of problems and concerns.

[0134] "Means that enable casual conversation and consultation" refers to a means that uses natural language processing technology to analyze human speech and generate appropriate responses.

[0135] "A means to promote reflection on life, a change of perspective, and awareness" is a means to help users reevaluate their past experiences and thoughts and gain new perspectives and awareness.

[0136] "Means to deepen legal understanding" are means of providing information and explanations to help users understand legal concepts and procedures.

[0137] "Means to support preparation for ending" are means to provide users with the information and guidelines they need when creating their own ending notes.

[0138] "Means of providing advice and directing users to web services that do not violate the Attorneys Act" refers to means of providing information and directing users to appropriate web services when providing legal advice, within the scope of the Attorneys Act.

[0139] "A means for consulting AI about security issues" refers to a means by which users can consult AI about security issues and concerns in their daily lives and receive appropriate advice.

[0140] The system for implementing this invention consists of three main elements: a server, a terminal, and a user. The following explains how each element functions.

[0141] server

[0142] The server is responsible for analyzing the user's speech using a generative AI model and generating an appropriate response. Specifically, the server uses the following software and hardware:

[0143] Software: Python, OpenAI® GPT-3® API

[0144] Hardware: A server machine with a powerful processor and sufficient memory

[0145] The server receives the text data sent by the user and inputs it into the generative AI model, which analyzes the prompt and generates an appropriate response. The generated response is then sent back to the user's device.

[0146] Terminal

[0147] The terminal provides the interface through which the user communicates with the server. The terminal uses the following software and hardware:

[0148] Software: Web browser or dedicated mobile application

[0149] Hardware: Smartphone, tablet, or computer

[0150] The user inputs security questions and other inquiries through the terminal. The input text data is sent to the server via the Internet. The response from the server is also displayed to the user through the terminal.

[0151] User

[0152] Users interact with the system using a terminal. They input questions for security consultations, life reflections, or legal understanding. For example:

[0153] Example prompt sentence:

[0154] User: I've been worried about the security of my home lately.

[0155] AI:

[0156] An example of the response generated:

[0157] AI: So you're concerned about home security. What are you specifically concerned about? For example, we can talk about locking doors and windows, installing security cameras, etc.

[0158] In this way, users can efficiently and effectively obtain appropriate advice for a wide range of problems and concerns.

[0159] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0160] Step 1:

[0161] The user uses the terminal to enter security questions and other questions.

[0162] Input: User text input (e.g., "I've been worried about the security of my home lately.")

[0163] Operation: Obtains the user's text data through the device's input interface.

[0164] Output: The user's text data is saved to the device.

[0165] Step 2:

[0166] The terminal transmits the user's text data to the server.

[0167] Input: User's text data

[0168] How it works: The device sends the user's text data to a server via the Internet.

[0169] Output: The user's text data arrives at the server.

[0170] Step 3:

[0171] The server receives the user's text data and generates prompt sentences to input into the generative AI model.

[0172] Input: User's text data

[0173] How it works: The server analyzes the user's text data and generates a prompt appropriate for the generative AI model.

[0174] Output: Prompt text (e.g. "User: I've been worried about the security of my home lately\nAI:")

[0175] Step 4:

[0176] The server uses a generative AI model to generate an appropriate response based on the prompt sentence.

[0177] Input: prompt statement

[0178] How it works: The server calls the OpenAI GPT-3 API, taking the prompt sentence as input and generating an appropriate response.

[0179] Output: The generated response (e.g., "AI: I understand you're concerned about the security of your home. What specifically are you concerned about?")

[0180] Step 5:

[0181] The server sends the generated response to the terminal.

[0182] Input: The generated response

[0183] How it works: The server sends the generated response to the device over the Internet.

[0184] Output: The generated response arrives at the terminal.

[0185] Step 6:

[0186] The terminal displays the generated response to the user.

[0187] Input: The generated response

[0188] Action: The device displays the generated response to the user through the user interface.

[0189] Output: The user sees the generated response.

[0190] Example 2

[0191] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0192] In modern society, people are faced with a variety of problems and worries, and support is needed to solve them. In particular, there is a lack of means to encourage reflection on life, a change of perspective, and awareness. There is also a need for means to deepen legal understanding and support for preparing for the end of life. Furthermore, when providing this support, there is a need to provide advice that does not violate the law and to guide users to web services. To solve these issues, a system is needed that receives user utterances, uses a generative AI model to generate an appropriate response, and provides it to the user.

[0193] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0194] In this invention, the server includes a means for enabling dialogue between humans and AI, a means for encouraging reflection on life, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting preparation for endings, a means for providing legal advice and guidance to web services, a means for receiving user utterances and inputting prompt sentences into a generative AI model to generate responses, and a means for displaying the generated responses to the user, thereby enabling the user to gain new perspectives on the content of their utterances and identify areas for reflection.

[0195] "Means enabling dialogue between humans and artificial intelligence" refers to technology that enables artificial intelligence to understand what humans say and generate appropriate responses.

[0196] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that helps users reexamine their past experiences and ways of thinking and gain new perspectives and insights.

[0197] "Means for deepening legal understanding" refers to techniques that provide information and explanations to help users deepen their knowledge of the law.

[0198] "Means for supporting end-of-life preparations" are technologies that provide support for users to prepare for their own end-of-life.

[0199] "Means for providing legally compliant advice and guidance to web services" refers to techniques for providing advice to users and introducing appropriate web services within the scope of legally compliant advice.

[0200] "Means for receiving user utterances and inputting prompt sentences into a generative AI model to generate a response" refers to a technology that receives the content of a user's utterance as text data, inputs it into a generative AI model, and generates an appropriate response.

[0201] "Means for displaying the generated reaction to the user" refers to technology for displaying the reaction generated by the generative AI model on the user's device.

[0202] This invention is a system that receives a user's utterance, generates an appropriate response using a generative AI model, and provides the response to the user. Specific embodiments of this system will be described below.

[0203] First, the user uses the terminal to input their thoughts or worries by voice or text. For example, consider the case where the user says, "Recently, things haven't been going well at work."

[0204] The server then receives the speech data sent from the user's device. If the received data is audio, the server uses speech recognition software (e.g., a speech recognition API) to convert it into text data. This text data forms the basis of the prompt sentences to be input into the generative AI model.

[0205] The server generates a prompt sentence to be input to the generative AI model based on the converted text data. For example, it generates a prompt sentence such as, "The user says that work hasn't been going well recently. What lessons or new perspectives can you offer?"

[0206] A generative AI model (e.g., a natural language processing model) receives the prompt sent from the server and generates an appropriate response based on it, such as, "That's tough. Have you had any previous successes? Is there anything you can learn from those experiences?"

[0207] The server receives the responses generated by the generative AI model and sends them to the user's device, formatting the data as needed.

[0208] Finally, the device displays the response of the generated AI model received from the server to the user, who can then gain a new perspective on their own utterances or identify areas for improvement.

[0209] This system allows users to gain a new perspective on their own speech, encouraging them to reflect on their lives, change their way of thinking, and become more aware of their surroundings. It also provides a means to deepen legal understanding and support end-of-life preparations, allowing users to receive appropriate support for a variety of problems and concerns.

[0210] As a specific example, if a user says, "Work hasn't been going well lately," the server inputs this utterance as text data into the generative AI model. An example of a prompt would be, "The user says that work hasn't been going well lately. What lessons can you learn from this or a new perspective?" Based on this prompt, the generative AI model generates a response such as, "That's tough. Have you had any previous successes? Is there anything we can learn from those experiences?" The server then sends this response to the user's device, which then displays it to the user.

[0211] In this way, users can receive responses from the generative AI model and gain a new perspective on what they have said.

[0212] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0213] Step 1:

[0214] A user uses a terminal to input their thoughts or worries by voice or text. For example, the user might say, "Work hasn't been going well recently." The input is voice data or text data.

[0215] Step 2:

[0216] The server receives speech data sent from the user's device. If the received data is voice, the server converts it into text data using speech recognition software (e.g., a speech recognition API). The input is voice data, and the output is text data.

[0217] Step 3:

[0218] The server generates a prompt sentence to be input to the generative AI model based on the converted text data. For example, it generates a prompt sentence such as, "The user says that work hasn't been going well recently. What lessons or new perspectives can you offer?" The input is text data, and the output is a prompt sentence.

[0219] Step 4:

[0220] The server inputs the generated prompt sentence into a generative AI model. The generative AI model (e.g., a natural language processing model) generates an appropriate response based on the prompt sentence. The input is the prompt sentence, and the output is the generated response.

[0221] Step 5:

[0222] The server receives the responses generated by the generative AI model and sends them to the user's device, formatting the data as needed. The input is the generated response, and the output is the formatted response.

[0223] Step 6:

[0224] The device receives the generative AI model's responses from the server and displays them to the user. The user can then view the responses to gain new perspectives on their own utterances and identify areas for improvement. The input is the formatted response, and the output is the response displayed to the user.

[0225] (Application example 2)

[0226] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0227] In modern brick-and-mortar stores, it is important for customer service staff to communicate smoothly with customers. However, there is a lack of means to gain appropriate reflection and new perspectives in real time when staff have questions or problems while serving customers. This is an issue that delays staff self-improvement and learning new customer service methods.

[0228] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0229] In this invention, the server includes a means for enabling chats and consultations between humans and AI, a means for encouraging life reflection, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting end-of-life preparations, a means for providing advice that does not violate the Attorneys Act and guidance to web services, a means used by customer service staff in physical stores through smart glasses, and a means for the AI ​​to provide points for reflection and new perspectives in real time in response to questions or problems that the staff have while serving customers, thereby enabling customer service staff to obtain hints for self-improvement in real time.

[0230] "Means that enable chatting and consultation between humans and AI" refers to technology that enables AI to generate appropriate responses to what humans say and continue the dialogue.

[0231] "A means to promote life reflection, change of perspective, and awareness" is a technology that helps users reevaluate past experiences and current situations and gain new perspectives and insights.

[0232] "Means to deepen legal understanding" refers to techniques that provide information and explanations to help users understand legal concepts and rules.

[0233] "Means to support end-of-life preparation" refers to technology that provides users with the information and support they need to prepare for their own end-of-life.

[0234] "Means of providing advice and guidance to web services that do not violate the Attorneys Act" refers to technology that provides information when providing legal advice within the scope of the Attorneys Act and guides users to appropriate web services.

[0235] "Methods used by customer service staff in brick-and-mortar stores through smart glasses" refers to technology in which customer service staff working in brick-and-mortar stores wear smart glasses and acquire and use information through the glasses.

[0236] "A means for AI to provide points of reflection and new perspectives in real time in response to questions or problems that staff have while serving customers" is a technology in which AI instantly presents appropriate points of reflection and new perspectives in response to questions or problems that staff have while serving customers.

[0237] A system for implementing the present invention includes an application for use by wait staff through smart glasses. A specific embodiment of this system is described below.

[0238] System Configuration

[0239] The system consists of the following major components:

[0240] 1. Smart glasses: devices worn by wait staff that have voice input and display capabilities (e.g., Google® Glass®).

[0241] 2. Server: Hosts the generative AI model and generates responses to the customer service staff's utterances.

[0242] 3. Generative AI model: Using the OpenAI API, we generate points of reflection and new perspectives on the customer service staff's utterances.

[0243] Program processing

[0244] Hardware and Software

[0245] Smart glasses: Takes voice input and displays information on a display.

[0246] Server: Hosts the generative AI model and converts voice input to text.

[0247] Generative AI model: Uses OpenAI APIs to generate appropriate responses based on text input.

[0248] Data processing and calculation

[0249] 1. Acquiring voice input: The speech of the customer service staff is acquired as voice data through the microphone in the smart glasses.

[0250] 2. Speech recognition: The server converts the voice data into text data.

[0251] 3. Prompt generation: Based on the text data, a prompt is generated to be sent to the generative AI model.

[0252] 4. Response generation: A generative AI model generates a response based on the prompt, including reflections and new perspectives.

[0253] 5. Displaying the response: Display the generated response on the display of the smart glasses.

[0254] Specific examples

[0255] If a customer service staff member says, "Recently, I've been having trouble communicating with customers," the system will operate as follows:

[0256] 1. The smart glasses capture the speech as audio data.

[0257] 2. The server converts the audio data into text data.

[0258] 3. Generate the following prompt based on the text data:

[0259] A user said, "Recently, I've been having trouble communicating with customers." Please provide some reflections or new perspectives.

[0260] 4. The generative AI model generates a response based on the prompt, such as, "That's tough. What are some of the experiences you've had where you successfully communicated with someone before? Is there anything you can learn from that experience?"

[0261] 5. The generated response is displayed on the smart glasses display, allowing the wait staff to see it in real time.

[0262] In this way, customer service staff can get real-time tips for self-improvement.

[0263] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0264] Step 1:

[0265] The smart glasses capture the speech of the customer service staff as voice data.

[0266] Input: Customer service staff's speech (audio)

[0267] Output: Audio data

[0268] Specific operation: The microphone in the smart glasses captures the speech of the customer service staff and saves it as audio data.

[0269] Step 2:

[0270] The server converts the voice data into text data.

[0271] Input: Audio data

[0272] Output: Text data

[0273] What happens: The server uses speech recognition software (e.g., Google Cloud Speech-to-Text API) to convert the voice data into text data.

[0274] Step 3:

[0275] The server generates a prompt based on the text data.

[0276] Input: Text data

[0277] Output: prompt statement

[0278] Specific operation: The server analyzes the text data and generates a prompt to send to the generative AI model. For example, it generates a prompt such as, "The user said, 'Recently, I've been having trouble communicating with customers.' Please provide any points of reflection or new perspectives."

[0279] Step 4:

[0280] The server generates a response using a generative AI model.

[0281] Input: prompt statement

[0282] Output: Response text

[0283] Specific operation: The server calls the OpenAI API, sends a prompt, and generates a response text. The generated response text might be something like, "That's difficult. Have you had any successful communication experiences in the past? Is there anything you can learn from those experiences?"

[0284] Step 5:

[0285] The server sends the generated response text to the smart glasses.

[0286] Input: Response text

[0287] Output: Data sent to smart glasses

[0288] Specific operation: The server converts the response text into a data format for transmission to the smart glasses, and transmits it to the smart glasses through the network.

[0289] Step 6:

[0290] The smart glasses display the response text on the display.

[0291] Input: Data to be sent to smart glasses

[0292] Output: Response text displayed on the display

[0293] How it works: The smart glasses analyze the received data and display a response text on the screen, which the wait staff can view in real time.

[0294] Example 3

[0295] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0296] In modern society, it is important to deepen legal understanding and prepare for the end of life, but there are only a limited number of systems that provide this information appropriately and that allow users to easily access it. There is also a need for advice and guidance to specialists in a manner that does not violate the Lawyers Act. Furthermore, when users create an end-of-life note, they also need a means to pose appropriate questions and record the answers. A comprehensive system is needed to solve these issues.

[0297] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0298] In this invention, the server includes means for enabling dialogue between humans and artificial intelligence, means for promoting life reflection, a change of perspective, and awareness, means for deepening legal understanding, means for supporting preparations for the end of one's life, means for providing advice that does not violate the Attorneys' Act and guidance to online services, means for analyzing user input, means for generating appropriate information based on the analysis results, means for providing the generated information to the user, means for generating questions for each item in the end-of-life note and recording the user's answers, and means for providing links to experts and online services. This allows users to easily obtain legal information, receive support in creating their end-of-life note, and access appropriate experts and online services.

[0299] "Means enabling dialogue between humans and artificial intelligence" refers to the ability for humans to communicate with artificial intelligence in natural language.

[0300] "A means to promote reflection on life, a change of perspective, and awareness" refers to a function that helps users reexamine their past experiences and ways of thinking and gain new perspectives and insights.

[0301] "Means for deepening legal understanding" refers to functions that help users obtain general information about the law and deepen their legal knowledge.

[0302] "Means to support preparation for ending" refers to a function that supports the user in preparing for the end of their life.

[0303] "Means of providing advice or links to online services that do not violate the Lawyers Act" refers to functions that provide general information about the law, recommend consulting a professional, and provide links to appropriate online services.

[0304] "Means for analyzing user input" refers to technology for analyzing text or voice input from a user and understanding its content.

[0305] "Means for generating appropriate information based on the analysis results" refers to technology that generates appropriate responses or information based on the results of analyzing the user's input.

[0306] "Means for providing generated information to a user" refers to a function for displaying or transmitting generated responses or information to a user.

[0307] "Means for generating questions for each item in the ending note and recording the user's answers" refers to the function of generating questions necessary for creating the ending note and recording the user's answers.

[0308] "Means for providing links to experts and online services" refers to a function that provides access links to experts and related online services that users need.

[0309] MODE FOR CARRYING OUT THE INVENTION

[0310] This invention is a system that helps users deepen their legal understanding, assists them in creating an end-of-life note, and provides them with access to appropriate experts and online services. This system operates in cooperation with three parties: a server, a terminal, and a user.

[0311] Generate a program for the system

[0312] The server uses the generative AI model to generate a program to deepen the user's legal understanding. The program provides general information about the law, assists in creating an end-of-life note, and provides advice that does not violate the Attorneys' Act and directs users to appropriate online services.

[0313] Explaining the program's processing in natural language

[0314] The server performs the following process.

[0315] 1. Accepting user input

[0316] The user inputs questions or requests into the system through a terminal, for example, by saying, "I want to know how to write a will."

[0317] 2. Parse the input

[0318] The server analyzes the input received from the user using natural language processing (NLP) techniques, specifically tokenizing the input text and extracting meaning.

[0319] 3. Generate the right information

[0320] The server uses the generative AI model to generate appropriate information based on the analysis results. For example, if a user inputs "I want to know how to write a will," the generative AI model will generate a response such as "There are several ways to write a will, such as a notarized will or a handwritten will. We recommend consulting an expert for details."

[0321] 4. Provide information to users

[0322] The server sends the generated information to the terminal and displays it to the user, who can check the information on the screen of the terminal.

[0323] 5. Support for creating an end-of-life note

[0324] The server generates questions for each item in the Ending Note and provides them to the user. For example, it asks questions such as, "What would you like to tell your loved ones?" and saves the user's answers as the Ending Note.

[0325] 6. Referrals to experts and online services

[0326] The server provides general legal information, recommends consulting a legal professional, and provides links to appropriate online services, such as a link to an online service for finding a will-writing professional.

[0327] Specific examples

[0328] A specific example will be given below in which the user says, "I want to know how to write a will."

[0329] Examples:

[0330] User utterance: "I want to know how to create a will."

[0331] Server response: "A will can be created in several ways, including a notarized will or a handwritten will. We recommend consulting a professional for more information."

[0332] Example prompts to input to a generative AI model:

[0333] "Generate a response when a user says they want to know how to create a will."

[0334] This system allows users to easily obtain legal information, assists in creating an end-of-life note, and provides access to appropriate experts and online services. The flow of the identification process in Example 3 will be described with reference to Figure 15.

[0335] Step 1:

[0336] The user inputs a question or request into the system through the terminal. For example, they might say, "I want to know how to write a will." The terminal then sends this voice data to the server.

[0337] Step 2:

[0338] The server converts the received voice data into text using voice recognition technology. The converted text is "I would like to know how to write a will."

[0339] Step 3:

[0340] The server analyzes the converted text using natural language processing (NLP) techniques, specifically tokenizing the text and extracting meaning. The analysis results indicate that the user is seeking information on how to write a will.

[0341] Step 4:

[0342] The server uses a generative AI model to generate appropriate information based on the analysis results. The prompt text is "Generate a response when a user says they want to know how to create a will," and the generative AI model generates a response such as "A will can be created in several ways, such as a notarized will or a handwritten will. We recommend consulting an expert for details."

[0343] Step 5:

[0344] The server sends the generated response to the terminal. The terminal displays this information to the user. The user confirms the following information on the terminal screen: "A will can be created in several ways, such as a notarized will or a handwritten will. We recommend that you consult a professional for details."

[0345] Step 6:

[0346] The server generates questions for each item in the end-of-life note and sends them to the terminal. For example, it generates a question such as, "What would you like to tell your loved ones?" In response to this question, the user might enter, "I would like to express my gratitude to my family." The terminal then sends this answer to the server.

[0347] Step 7:

[0348] The server saves the user's answers as an ending note, which the user can review later.

[0349] Step 8:

[0350] The server provides general legal information and recommends consulting a legal expert. It also generates a link to an appropriate online service and sends it to the terminal. For example, it provides a link to an online service for finding a legal expert. The user clicks the link to access the online service for finding a legal expert.

[0351] (Application example 3)

[0352] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0353] In modern society, it is important to obtain legal information quickly and accurately, but consulting with an expert takes time and money. There is also a lack of means to support end-of-life preparations, such as creating an end-of-life note or preparing a will. Furthermore, when providing this information, it is necessary to ensure that it does not violate the Attorneys Act. To solve these issues, a system is needed that provides legal information in real time using smart devices and supports the creation of an end-of-life note.

[0354] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0355] In this invention, the server includes means for enabling chat and consultation between humans and AI, means for promoting life reflection, mindset change, and awareness, means for deepening legal understanding, means for supporting preparations for the end of life, means for providing advice that does not violate the Attorneys Act and links to web services, means for providing legal information in real time using a smart device, means for providing questions to support the creation of an end-of-life note and recording the answers, and means for acquiring legal information using a generative AI model.This enables users to quickly and accurately obtain legal information through their smart devices and efficiently create an end-of-life note.

[0356] "Means that enable casual conversation and consultation" is a function that allows humans and AI to exchange information and opinions through natural conversation.

[0357] "A means to promote reflection on life, a change of perspective, and awareness" is a function that helps users reflect on their past experiences and gain new perspectives and insights.

[0358] "Legal literacy" is a feature that provides general legal information to help users deepen their legal knowledge.

[0359] "Means to support end-of-life preparations" is a function that assists users in creating an end-of-life note and preparing a will in order to prepare for the end of their lives.

[0360] "Means of providing advice and links to web services that do not violate the Lawyers Act" refers to a function that provides general information about the law and recommends consulting a specialist if necessary.

[0361] "Means for providing legal information in real time using smart devices" refers to a function that provides users with instant legal information using devices such as smart glasses or smartphones.

[0362] "Means for providing questions to assist in the creation of an Ending Note and recording the answers" is a function that presents the user with questions regarding each item in the Ending Note and records the answers.

[0363] "Means for obtaining legal information using a generative AI model" refers to a function that uses a generative AI model to generate and provide legal information in response to a user's question.

[0364] The system for implementing this invention uses a smart device (e.g., smart glasses or a smartphone) to provide users with real-time legal information and assist them in creating an end-of-life note. Specific embodiments of this system are described below.

[0365] System configuration

[0366] The system consists of the following main components:

[0367] 1. Smart Device: A device worn or used by the user to display and input information.

[0368] 2. Server: Generates legal information using generative AI models and sends it to smart devices.

[0369] 3. Generative AI model: An AI model for generating legal information in response to a user question.

[0370] Program processing

[0371] The server receives input from the user and uses a generative AI model to generate appropriate legal information. The generated information is sent to the user's smart device and displayed. To assist in the creation of the end-of-life note, the server also provides a series of questions and records the user's answers.

[0372] Hardware and software used

[0373] Smart devices: smart glasses, smartphones

[0374] Server: Cloud server or on-premise server

[0375] Generative AI model: Uses OpenAI API

[0376] Data processing and calculation

[0377] The server receives input data from the user and sends it to the generative AI model as a prompt. The generative AI model generates legal information based on the prompt and sends it back to the server. The server then sends the generated information to the smart device and displays it to the user. When creating the ending note, the server also records and saves the user's answers in JSON format.

[0378] Specific examples

[0379] The user puts on the smart glasses and launches the application. They select "Get legal information" from the menu and enter "I want to know how to write a will." The server receives this input and sends the following prompt to the generative AI model:

[0380] Example prompt sentence:

[0381] Please provide general legal information: I want to know how to make a will.

[0382] Based on this prompt, the generative AI model generates information on how to write a will and sends it back to the server, which then sends this information to the smart glasses and displays it to the user.

[0383] If a user wants to create an end-of-life note, they select "Create an end-of-life note" from the menu and answer a series of questions provided by the server. For example, when a user answers the question "What would you like to tell your loved one?", the answers are recorded by the server and can be viewed or edited later.

[0384] In this way, users can quickly and accurately obtain legal information through their smart devices and efficiently create their end-of-life notes.

[0385] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0386] Step 1:

[0387] The user starts the smart device and selects an application.

[0388] Input: User actions (launching and selecting applications)

[0389] Output: The application's main menu is displayed.

[0390] Specific operation: The user operates smart glasses or a smartphone to launch the legal consultation support application, and the main menu is displayed on the device screen.

[0391] Step 2:

[0392] The user selects "Get legal information" from the menu and enters the information they want to know.

[0393] Input: User's choice ("Get legal information") and input (information they want to know)

[0394] Output: User input is sent to the server

[0395] Specific operation: The user selects "Get legal information" from the menu and enters, for example, "I want to know how to write a will." The input is sent to the server.

[0396] Step 3:

[0397] The server receives user input and sends prompts to the generative AI model.

[0398] Input: User input (information you want to know)

[0399] Output: The prompt sent to the generative AI model

[0400] Specific operation: The server receives the user's input, generates a prompt saying, "Please provide some general legal information: I would like to know how to write a will," and sends it to the generative AI model.

[0401] Step 4:

[0402] The generative AI model generates legal information based on the prompt text and sends it back to the server.

[0403] Input: prompt statement

[0404] Output: Generated legal information

[0405] Specific operation: The generative AI model analyzes the prompt text, generates information on how to create a will, and sends it back to the server.

[0406] Step 5:

[0407] The server receives the generated legal information and sends it to the smart device.

[0408] Input: Generated legal information

[0409] Output: Legal information sent to smart devices

[0410] Specific operation: The server sends the legal information received from the generative AI model to the smart device.

[0411] Step 6:

[0412] The smart device displays legal information to the user.

[0413] Input: Legal information sent from the server

[0414] Output: Legal information displayed to the user

[0415] Specific operation: The smart device displays the legal information received from the server on the screen so that the user can confirm it.

[0416] Step 7:

[0417] The user selects "Create an Ending Note" from the menu and answers the questions.

[0418] Input: User's choice ("Create an ending note") and answer

[0419] Output: The user's answer is sent to the server

[0420] Specific operation: The user selects "Create an Ending Note" from the menu and enters answers to questions provided by the server. For example, they answer the question, "What would you like to tell your loved one?" The answers are then sent to the server.

[0421] Step 8:

[0422] The server records the user's answers and saves them as an ending note.

[0423] Input: User's answer

[0424] Output: Recorded ending note

[0425] Specific operation: The server receives the user's answers, records them in JSON format, and saves them as an ending note. The user can later view and edit this ending note.

[0426] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0427] "Example 1"

[0428] In one embodiment of the present invention, the means for enabling chat and consultation between humans and AI includes an emotion engine that recognizes human emotions. Specifically, human speech is analyzed using natural language processing technology, and human emotions are recognized based on the analysis results. For example, if a human says, "Work hasn't been going well lately," the AI ​​recognizes from the speech that the human is feeling frustrated.

[0429] "Example 2"

[0430] In another embodiment of the present invention, a means for promoting life reflection, mindset change, and awareness includes an emotion engine that recognizes human emotions. Specifically, human speech is analyzed using natural language processing technology, and human emotions are recognized based on the analysis results. For example, if a person says, "Work hasn't been going well lately," the AI ​​recognizes from the speech that the person is feeling frustrated and provides appropriate points of reflection and new perspectives on those emotions.

[0431] "Example 3"

[0432] In yet another embodiment of the present invention, the means for supporting end-of-life preparations includes an emotion engine that recognizes human emotions. Specifically, the engine analyzes human speech using natural language processing technology and recognizes human emotions based on the analysis results. For example, if a person says, "I'm thinking about writing a will," the AI ​​recognizes from the speech that the person is feeling anxious and provides support for creating an end-of-life note appropriate to that emotion.

[0433] The processing flow of each embodiment will be described below.

[0434] "Example 1"

[0435] Step 1: Receive human speech.

[0436] Step 2: Analyze the received utterance using natural language processing technology.

[0437] Step 3: Recognize human emotions based on the analysis results.

[0438] "Example 2"

[0439] Step 1: Receive human speech.

[0440] Step 2: Analyze the received utterance using natural language processing technology.

[0441] Step 3: Recognize human emotions based on the analysis results.

[0442] Step 4: Provide appropriate reflections and new perspectives on the identified emotions.

[0443] "Example 3"

[0444] Step 1: Receive human speech.

[0445] Step 2: Analyze the received utterance using natural language processing technology.

[0446] Step 3: Recognize human emotions based on the analysis results.

[0447] Step 4: Provide assistance in creating an appropriate end-of-life note for the identified emotions.

[0448] Example 1

[0449] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0450] Conventional AI systems have difficulty smoothly engaging in casual conversations or consultations with humans, particularly in recognizing emotions and generating appropriate responses. Furthermore, they lack support for preparing for the end of a case or deepening legal understanding, making it impossible to provide users with the information and advice they need. Furthermore, providing advice and directing users to online services in a manner that does not violate the Attorneys Act has also been an issue.

[0451] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0452] In this invention, the server includes means for enabling chatting and consultation between humans and AI, means for encouraging life reflection, a change of perspective, and awareness, means for deepening legal understanding, means for supporting closing preparations, means for providing advice and guidance to online services that do not violate the Attorneys' Act, means for converting human speech from voice to text, means for analyzing speech using natural language processing technology, means for recognizing emotions based on the analysis results, means for generating appropriate responses using a generative AI model, and means for converting the generated responses into voice and outputting them. This enables smooth chatting and consultation with users, recognizes emotions, and generates appropriate responses. It also provides support for closing preparations and deepening legal understanding, and can provide advice and guidance to online services that do not violate the Attorneys' Act.

[0453] "Means that enable casual conversation and consultation between humans and AI" refers to the function of analyzing what humans say and allowing AI to generate an appropriate response.

[0454] "A means to promote reflection on life, a change of perspective, and awareness" refers to a function that helps users reflect on past experiences and thoughts and gain new perspectives and awareness.

[0455] "Means for deepening legal understanding" refers to functions that provide information and advice to help users deepen their understanding of legal matters.

[0456] "Means to support preparations for the end of life" refers to functions that support preparations for the end of life, such as allowing users to create their own end-of-life notes.

[0457] "Means of providing advice and directing users to online services that do not violate the Attorneys Act" refers to the function of providing legal advice in a manner that does not violate the Attorneys Act and directing users to appropriate online services as necessary.

[0458] "Means for converting human speech from voice to text" refers to a function for converting speech spoken by a user into text data.

[0459] "Means of analyzing speech using natural language processing technology" refers to technology for analyzing the content of speech acquired as text data and understanding its meaning and intent.

[0460] "Means for recognizing emotions based on analysis results" refers to a function for recognizing a user's emotions based on the analysis results of the content of speech.

[0461] "Means for generating an appropriate response using a generative AI model" refers to the function of generating an appropriate response using a generative AI model based on the analysis results and emotion recognition results.

[0462] The "means for converting the generated response into speech and outputting it" refers to a function for converting the generated text response into speech and conveying it to the user.

[0463] This invention is a system that enables chatting and consultation between humans and AI, and includes a series of processes for analyzing user utterances and generating appropriate responses. Specific embodiments of this system are described below.

[0464] First, a user speaks using a device (such as a smartphone or personal computer). For example, the user might say, "Work hasn't been going well lately." This speech is captured as voice data through the device's microphone.

[0465] The device then converts the captured voice data into text using voice recognition software, such as Google Cloud Speech-to-Text API or Amazon Transcribe.

[0466] The converted text data is sent from the device to a server, which then analyzes it using natural language processing technology. This analysis uses natural language processing software such as Google Cloud Natural Language API or IBM Watson® Natural Language Understanding.

[0467] Based on the analysis results, the server recognizes the user's emotions. This emotion recognition is performed using emotion recognition software such as Microsoft® Azure® Emotion API or Affectiva. For example, if the user says, "Work hasn't been going well lately," the server recognizes that the user is feeling frustrated.

[0468] The server then uses a generative AI model, such as OpenAI's GPT-3, to generate an appropriate response. For example, if the server recognizes that the user is frustrated, it might generate a response like, "That's tough. What exactly are you having trouble with?"

[0469] The generated response is sent from the server to the device, which then converts the received text data into speech and communicates the response to the user using voice synthesis software such as Google Cloud Text-to-Speech API or Amazon Polly.

[0470] As a specific example, the prompt sentence when the user utters "Work hasn't been going well recently" is shown below.

[0471] User utterance: Things haven't been going well at work lately

[0472] Prompt: The user says, "Things haven't been going well at work lately." The user is frustrated. Generate an appropriate response.

[0473] In this way, the server and device can work together to smoothly facilitate casual conversations and consultations with users. Support is also provided for preparing for the end of a conversation and deepening legal understanding, and advice and guidance to online services can be provided in a manner that does not violate the Attorneys Act.

[0474] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0475] Step 1:

[0476] A user uses a terminal to make a speech. For example, the user might say, "Work hasn't been going well lately." The terminal acquires this speech data. The input is the user's speech, and the output is the speech data acquired by the terminal.

[0477] Step 2:

[0478] The device converts the acquired voice data into text data. This process uses voice recognition software. Specifically, voice recognition technology is used to convert voice data into text data. The input is voice data, and the output is text data.

[0479] Step 3:

[0480] The terminal sends the converted text data to the server. The input is the text data, and the output is the text data sent to the server.

[0481] Step 4:

[0482] The server analyzes the received text data using natural language processing technology. This analysis uses natural language processing software. Specifically, it analyzes the meaning and intent of the text data. The input is text data, and the output is the analysis results.

[0483] Step 5:

[0484] The server recognizes the user's emotions based on the analysis results. This emotion recognition is performed using emotion recognition software. Specifically, the user's emotions are identified from the analysis results. The input is the analysis results, and the output is the emotion recognition results.

[0485] Step 6:

[0486] The server generates an appropriate response using a generative AI model. Specifically, it generates an appropriate response based on the emotion recognition results. The input is the emotion recognition results, and the output is the generated response.

[0487] Step 7:

[0488] The server generates a response and sends it to the terminal. The input is the generated response and the output is the response sent to the terminal.

[0489] Step 8:

[0490] The device converts the received text data into speech and responds to the user. This process uses speech synthesis software. Specifically, the device converts the text data into speech data and plays it back to the user. The input is text data, and the output is speech data.

[0491] (Application example 1)

[0492] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0493] Conventional AI systems have had difficulty recognizing emotions and generating appropriate responses when engaging in casual conversations or consultations with humans. They also lacked the ability to provide appropriate responses to security-related questions and inquiries. Furthermore, it was difficult to provide these functions as an application installed on a smartphone.

[0494] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes means for enabling chat and consultation between humans and AI, means for promoting life reflection, mindset change, and awareness, means for deepening legal understanding, means for supporting ending preparation, means for providing advice that does not violate the Attorneys Act and guidance to web services, means for analyzing human speech using natural language processing technology, recognizing emotions, and generating appropriate responses, means for generating appropriate responses to security-related questions and inquiries, and means for providing an application to be installed on a smartphone. As a result, users can receive appropriate responses based on their emotions through chat and consultation with AI, and security-related questions and inquiries can be handled quickly and appropriately.

[0495] "A means to enable chatting and consultation between humans and AI" is a technology that analyzes human speech and generates appropriate responses.

[0496] "A means to promote life reflection, a change of perspective, and awareness" is a technology that helps users reevaluate their past experiences and ways of thinking and gain new perspectives and insights.

[0497] "Legal literacy tools" are technologies that help users understand legal concepts and procedures.

[0498] "Means to support end-of-life preparation" are technologies that assist users in making preparations for their own end-of-life.

[0499] "Means of providing advice and guidance to web services that do not violate the Lawyers Act" refers to technology that provides advice to users and guides them to appropriate web services within the scope of the law.

[0500] "Means of using natural language processing technology to analyze human speech, recognize emotions, and generate appropriate responses" refers to technology that analyzes user speech, recognizes emotions, and generates appropriate responses.

[0501] The "means for generating appropriate responses to security-related questions and inquiries" is a technology that generates appropriate responses when a user asks a security-related question or inquiry.

[0502] "Means for providing an application to be installed on a smartphone" refers to a technology for providing an application that runs on a smartphone.

[0503] As an embodiment of the present invention, the following system is constructed.

[0504] First, the server includes a means for analyzing human utterances using natural language processing techniques, recognizing emotions, and generating appropriate responses. Specifically, the server receives user utterances and uses the TextBlob library for text analysis, thereby classifying the emotions of the utterances as positive, negative, or neutral.

[0505] Next, the server uses a generative AI model to generate an appropriate response. OpenAI's text-davinci-003 is used as the generative AI model. Based on the user's utterance and its emotion, an appropriate prompt sentence is generated and input into the generative AI model. For example, if the user says, "I've been seeing suspicious people around my house lately," the following prompt sentence is generated:

[0506] The user is feeling anxious. Generate an appropriate response to the user's utterance: 'I've been seeing some suspicious people around my house lately.'

[0507] By inputting this prompt into a generative AI model, an appropriate response can be obtained.

[0508] Furthermore, the server includes a means for generating an appropriate response to a security question or inquiry, thereby enabling a user to receive a prompt and appropriate response when the user makes a security question or inquiry.

[0509] Finally, the server includes a means for providing an application to be installed on the smartphone. This application runs on the smartphone that the user uses daily and provides an interface for the user to input utterances. When the user inputs an utterance, the utterance is transmitted to the server for the aforementioned processing.

[0510] In this way, users can chat and consult with AI to receive appropriate responses based on their emotions, making it possible to respond quickly and appropriately to security-related questions and inquiries.

[0511] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0512] Step 1:

[0513] A user starts an application on their smartphone and inputs speech. The inputted speech is sent to the server as text data. The input data is the content of the user's speech, and the output data is the text data sent to the server.

[0514] Step 2:

[0515] The server analyzes the received text data using natural language processing techniques. Specifically, it uses the TextBlob library to analyze the sentiment of the text. The input data is the user's spoken text, and the output data is the sentiment analysis result (positive, negative, neutral).

[0516] Step 3:

[0517] The server generates an appropriate prompt based on the sentiment analysis results. For example, if the user's utterance indicates a negative emotion, the prompt might be, "The user is feeling anxious. Please generate an appropriate response to the user's utterance: 'I've seen suspicious people around the house recently.'" The input data are the sentiment analysis results and the user's utterance text, and the output data is the generated prompt.

[0518] Step 4:

[0519] The server inputs the generated prompt sentence into a generative AI model (OpenAI's text-davinci-003) to generate an appropriate response. The input data is the prompt sentence, and the output data is the generated response text.

[0520] Step 5:

[0521] The server sends the generated response text to the smartphone application, where the input data is the generated response text and the output data is the response text sent to the smartphone.

[0522] Step 6:

[0523] The user's smartphone displays the received response text. The input data is the response text sent from the server, and the output data is the response text displayed to the user.

[0524] In this way, users can chat and consult with the AI ​​to get appropriate responses based on their emotions.

[0525] Example 2

[0526] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0527] In modern society, people are faced with a variety of problems and stresses, and appropriate support is needed to resolve these. However, conventional systems have difficulty accurately recognizing the user's emotions and providing appropriate points of reflection and new perspectives based on those emotions. Effective methods for encouraging reflection on life, changing perspectives, and awareness are also lacking. Furthermore, there are insufficient methods for providing support for deepening legal understanding and preparing for the end of life.

[0528] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for enabling chats and consultations between humans and AI, means for promoting life reflection, a change of perspective, and awareness, means for deepening legal understanding, means for supporting preparation for endings, means for providing legal advice and guidance to web services, means for analyzing human utterances using natural language processing technology, means for recognizing human emotions using emotion recognition technology, and means for providing appropriate points of reflection and new perspectives using a generative AI model. This makes it possible to accurately recognize the user's emotions and, based on the recognition, provide appropriate points of reflection and new perspectives. Furthermore, effective support for promoting life reflection, a change of perspective, and awareness is provided, and means for supporting deepening legal understanding and preparing for endings are also enhanced.

[0529] "Means enabling chatting and consultation between humans and AI" is a function that allows humans to have natural dialogue with AI and obtain information and advice through consultation and chat.

[0530] "A means to promote reflection on life, a change of perspective, and awareness" is a function that helps users reflect on their past experiences and gain new perspectives and insights.

[0531] "Means for deepening legal understanding" is a function that allows users to deepen their knowledge of the law and promote their understanding of legal issues.

[0532] "Means to support end-of-life preparations" is a function that provides users with the information and support they need to prepare for the end of their lives.

[0533] "Means for providing legally compliant advice and guidance to web services" refers to a function for providing advice to users and introducing appropriate web services within the scope of legally compliant advice.

[0534] "Means for analyzing human speech using natural language processing technology" refers to technology that analyzes user speech as text data and understands its content and context.

[0535] "Means for recognizing human emotions using emotion recognition technology" refers to technology that identifies emotions from a user's speech and behavior, and responds appropriately based on those emotions.

[0536] "Means for providing appropriate points of reflection and new perspectives using a generative AI model" is a function that uses a generative AI model to generate and provide points of reflection and new perspectives that correspond to the user's situation and emotions.

[0537] This invention is a system in which a user inputs an utterance using a terminal, the utterance is analyzed by a server, and appropriate points for reflection and new perspectives are provided. Specific embodiments of this system will be described below.

[0538] Hardware and software used

[0539] Hardware: Servers, devices (PCs, smartphones, etc.)

[0540] Software: Natural language processing engines (e.g., Google Cloud Natural Language API), emotion recognition engines (e.g., IBM Watson Tone Analyzer), generative AI models (e.g., OpenAI GPT-3)

[0541] Program processing flow

[0542] 1. User speech input

[0543] The user inputs an utterance using the terminal. For example, the user inputs "Work hasn't been going well recently."

[0544] 2. Sending speech

[0545] The terminal sends the user's speech data to the server, where it is converted into text format.

[0546] 3. Speech Analysis

[0547] The server analyzes the received speech data using a natural language processing engine (e.g., Google Cloud Natural Language API). As a result of the analysis, the context of the speech and keywords are extracted.

[0548] 4. Emotional Recognition

[0549] The server uses an emotion recognition engine (e.g., IBM Watson Tone Analyzer) to recognize the user's emotions from the speech data. For example, emotions such as frustration or sadness are identified.

[0550] 5. Generating questions and perspectives

[0551] The server uses a generative AI model (e.g., OpenAI GPT-3) to generate questions to provide appropriate reflection points and new perspectives on the user's emotions.

[0552] 6. Sending the generated results

[0553] The server sends the generated questions and viewpoints to the user's terminal.

[0554] 7. Displaying the generated results

[0555] The generated results received by the terminal from the server are displayed to the user, who can then look at them and gain points of reflection or new perspectives.

[0556] Specific examples

[0557] User utterance input: "Work hasn't been going well lately."

[0558] Analysis results of natural language processing engine: Keywords "work" and "not going well"

[0559] Emotion Recognition Engine Analysis Results: Frustration

[0560] Generative AI model output: "That's tough. Have you had success before? Is there anything you can learn from that experience?"

[0561] Prompt Sentence Examples

[0562] Prompt: "When a user says, 'I've been having trouble at work lately,' generate a question that will provide appropriate reflection and a new perspective."

[0563] This system analyzes the user's speech, recognizes their emotions, and then provides appropriate points of reflection and new perspectives, encouraging them to reflect on their lives, change their way of thinking, and become more aware of things.

[0564] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0565] Step 1: User utterance input

[0566] Operation: A user uses a device (PC or smartphone) to input speech into the system. For example, the user might input, "Work hasn't been going well recently."

[0567] Input: User's voice data

[0568] Output: Text-formatted speech data

[0569] Step 2: Sending Utterances

[0570] How it works: The device sends the user's speech data to the server, where it is converted into text using speech recognition technology.

[0571] Input: Text utterance data

[0572] Output: Text data sent to the server

[0573] Step 3: Analyze the utterance

[0574] How it works: The server analyzes the received speech data using a natural language processing engine (e.g., Google Cloud Natural Language API). As a result of the analysis, the context of the speech and keywords are extracted.

[0575] Input: Text data sent to the server

[0576] Output: Extracted keywords and context information

[0577] Step 4: Recognize emotions

[0578] How it works: The server uses an emotion recognition engine (e.g., IBM Watson Tone Analyzer) to recognize the user's emotions from the speech data. For example, emotions such as frustration or sadness are identified.

[0579] Input: Extracted keywords and context information

[0580] Output: Recognized emotion information

[0581] Step 5: Generate questions and perspectives

[0582] How it works: The server uses a generative AI model (e.g., OpenAI GPT-3) to generate questions to provide appropriate reflections and new perspectives on the user's emotions.

[0583] Input: Recognized emotion information

[0584] Output: Generated questions and perspectives

[0585] Step 6: Sending the generated results

[0586] How it works: The server generates questions and views and sends them to the user's device.

[0587] Input: Generated questions and perspectives

[0588] Output: The generated results sent to the user's device.

[0589] Step 7: Viewing the generation results

[0590] Operation: The device displays the generated results received from the server to the user, allowing the user to reflect on their work or gain new perspectives.

[0591] Input: The generated result sent to the user's device

[0592] Output: Questions and perspectives displayed on the terminal

[0593] In this way, it is possible to analyze the user's speech, recognize their emotions, and provide appropriate points for reflection and new perspectives.

[0594] (Application example 2)

[0595] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0596] In modern society, there is a need to reduce the anxiety and stress felt by users and provide appropriate advice. However, conventional systems have had difficulty accurately recognizing users' emotions and providing appropriate feedback based on those emotions. Another problem is that users lack the means to appropriately reflect on or gain new perspectives on security-related concerns and problems.

[0597] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0598] In this invention, the server includes a means for enabling chat and consultation between humans and AI, a means for encouraging life reflection, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting end-of-life preparations, a means for providing advice that does not violate the Lawyers Act and guidance to web services, and a means for analyzing the user's speech, recognizing emotions, and providing appropriate points of reflection and new perspectives, thereby reducing the anxiety and stress felt by the user and providing appropriate advice.

[0599] "Means that enable casual conversation and consultation" is a function that allows humans and AI to exchange information and opinions through natural conversation.

[0600] "A means to promote life reflection, a change of perspective, and awareness" is a function that helps users reevaluate their past experiences and current situations and gain new perspectives and insights.

[0601] "Legal literacy" refers to features that allow users to deepen their knowledge of the law and improve their understanding of legal issues.

[0602] "Means to support end-of-life preparations" are functions that assist users in making preparations for the end of their lives.

[0603] "Means of providing advice and guidance to web services that do not violate the Lawyers Act" refers to a function that provides advice to users and introduces appropriate web services within the scope of the law.

[0604] "A means of analyzing the user's speech, recognizing their emotions, and providing appropriate points for reflection and new perspectives" is a function that analyzes the content of the user's speech, recognizes their emotions, and then provides the user with appropriate feedback and new perspectives.

[0605] The system for carrying out this invention has the function of analyzing the user's utterances, recognizing their emotions, and providing appropriate points for reflection and new perspectives. A specific embodiment of this system is described below.

[0606] Hardware and software used

[0607] Hardware: Smartphone, microphone

[0608] Software: Python, OpenAI API, SpeechRecognition library, Transformers library

[0609] System configuration

[0610] 1. Speech Recognition: The server converts the user's speech into text using the SpeechRecognition library. When the user speaks into the smartphone's microphone, the voice data is sent to the server.

[0611] 2. Sentiment Analysis: The server uses the sentiment analysis model from the Transformers library to recognize emotions from the user's speech. The text data is input into the sentiment analysis model to identify the user's sentiment.

[0612] 3. Response Generation: The server uses OpenAI's API to generate text that offers appropriate points of reflection or new perspectives based on the user's speech and the recognized emotions. The generated text is provided to the user as feedback.

[0613] Specific examples

[0614] If a user says, "I've been worried about the security of my home lately," the system analyzes the utterance and recognizes that the user is feeling anxious. The system then provides questions such as, "That sounds worrying. Have you had any experience strengthening your security measures before? Is there anything you can learn from that experience?"

[0615] Prompt Sentence Examples

[0616] A user says, "I've been worried about the security of my home lately." They're feeling anxious. Give them some appropriate reflection or fresh perspective.

[0617] In this way, the system can alleviate users' anxiety and provide appropriate advice.

[0618] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0619] Step 1:

[0620] The user speaks into the smartphone's microphone.

[0621] Input: User's voice data

[0622] Output: Audio data is sent to the server

[0623] What happens: The user says, "I've been worried about the security of my home lately."

[0624] Step 2:

[0625] The server uses the SpeechRecognition library to convert the audio data into text.

[0626] Input: User's voice data

[0627] Output: Text data (e.g., "I've been worried about the security of my home lately.")

[0628] Specific operation: The server starts a speech recognition engine, analyzes the voice data, and converts it into text.

[0629] Step 3:

[0630] The server uses sentiment analysis models from the Transformers library to recognize emotions from text data.

[0631] Input: Text data

[0632] Output: Emotion data (e.g., "anxiety")

[0633] Specific operation: The server inputs text data into the sentiment analysis model and obtains sentiment labels.

[0634] Step 4:

[0635] The server uses OpenAI's API to generate text that provides appropriate points of reflection and new perspectives based on text and emotion data.

[0636] Input: Text data, emotion data

[0637] Output: Response text (e.g., "That's concerning. Have you had experience with strengthening security measures before? Is there anything we can learn from that experience?")

[0638] Specific operation: The server inputs a prompt sentence into the generative AI model and generates an appropriate response text.

[0639] Step 5:

[0640] The server sends the generated response text to the user's smartphone.

[0641] Input: Response text

[0642] Output: Response text displayed on the user's smartphone

[0643] Specific operation: The server sends the response text over the network to the user's smartphone and displays it to the user.

[0644] In this way, the system can analyze the user's speech, recognize emotions, and provide appropriate feedback.

[0645] Example 3

[0646] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0647] Conventional end-of-life preparation support systems provide information without considering the user's feelings, making it difficult to provide appropriate support for the user's anxieties and questions. Furthermore, they do not adequately provide information to deepen legal understanding or support for creating an end-of-life note, making it difficult for users to obtain the information and support they need. Furthermore, they do not adequately guide users to advice or web services that do not violate the Attorneys Act, making it difficult for users to obtain professional help.

[0648] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0649] In this invention, the server includes: means for recognizing a user's emotions using an emotion engine; a prompt sentence for instructing the server to generate a question for creating the user's end-of-life note based on the result of the user's emotion recognition; means for generating the question using a generative AI model; means for presenting the generated question to the user and accepting an answer to the question; and means for recording the accepted answer. This enables the server to provide appropriate information and support that takes the user's emotions into consideration, effectively addressing the user's anxieties and questions. Furthermore, the server provides information to deepen legal understanding and supports the creation of an end-of-life note, making it easier for the user to obtain the information and support they need. Furthermore, the server appropriately provides advice and links to web services within the scope of the Attorneys' Act, making it easier for the user to obtain expert help. In addition, in the server, the means for generating questions generates the questions based on the results of recognizing the user's emotions using a prompt sentence that instructs the generation of questions to promote reflection on life, a change of perspective, or awareness as questions for creating the user's ending note, and the generative AI model.

[0650] "Means that enable casual conversations and consultations between humans and AI" refers to technology that enables AI to generate responses to what humans say and engage in dialogue.

[0651] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that supports users in reviewing their past experiences and ways of thinking, and gaining new perspectives and awareness.

[0652] "Means for deepening legal understanding" refers to techniques that allow users to deepen their legal knowledge and understanding by obtaining general information about the law.

[0653] "Means to support end-of-life preparations" are technologies that provide users with the information and support they need when preparing for the end of their life.

[0654] "Means for providing advice and links to web services that do not violate the Attorneys Act" refers to technology that provides general information about the law and recommends consulting with a professional, thereby providing advice that does not violate the Attorneys Act and links to appropriate web services.

[0655] "Means for analyzing human speech using natural language processing technology" refers to technology for acquiring the content of a user's speech as text data and analyzing that content.

[0656] "Means for recognizing human emotions using emotion recognition technology" refers to technology that identifies emotions from the user's speech and facial expressions, and provides appropriate support based on those emotions.

[0657] "Means for providing appropriate information and assistance based on analysis results" refers to technology that provides appropriate information and assistance to users based on analysis results obtained using natural language processing technology and emotion recognition technology.

[0658] A "means for supporting the creation of an ending note" is a technology that provides necessary questions and records the answers when a user creates an ending note.

[0659] "Means for storing data" refers to the technology used to store the user's answers and provided information in a database.

[0660] This invention is a system that uses natural language processing technology and emotion recognition technology to provide appropriate information and support to a user when preparing for an ending. Specific embodiments of this system are described below.

[0661] System configuration

[0662] Hardware

[0663] Server: A server equipped with a high-performance processor and large memory capacity is used to manage the database and perform natural language processing and emotion recognition.

[0664] Device: A device used by a user (smartphone, tablet, PC, etc.) that is capable of voice input and text display.

[0665] software

[0666] Natural language processing technology: Uses Google Cloud Natural Language API and IBM Watson Natural Language Understanding.

[0667] Emotion recognition technology: Uses Microsoft Azure Emotion API and Affectiva emotion recognition technology.

[0668] Speech Recognition Software: Uses Google Speech-to-Text API.

[0669] Database: Use MySQL (registered trademark) or PostgreSQL.

[0670] System Operation

[0671] 1. The user speaks

[0672] The user speaks a question or request to the system, such as "I want to know how to write a will."

[0673] 2. The device converts the speech into text data

[0674] The device converts the user's speech into text data using voice recognition software (Google Speech-to-Text API).

[0675] 3. The server receives the text data

[0676] The terminal transmits the converted text data to the server, which receives the data.

[0677] 4. The server analyzes the text data using natural language processing technology.

[0678] The server analyzes the received text data using Google Cloud Natural Language API and IBM Watson Natural Language Understanding, thereby understanding the content and intent of the text.

[0679] 5. The server recognizes the user's emotions using emotion recognition technology.

[0680] Based on the analysis results, the server uses the Microsoft Azure Emotion API and Affectiva's emotion recognition technology to recognize the user's emotions. For example, if a user says, "I'm thinking about writing a will," the server recognizes that the user is feeling anxious.

[0681] 6. The server provides appropriate information and assistance

[0682] The server then provides appropriate information based on the emotion it recognizes, such as, "You can create a will in several ways, such as a notarized will or a handwritten will. We recommend that you consult a professional for details."

[0683] 7. The server assists in creating the end-of-life note

[0684] To assist users in creating their end-of-life notes, the server generates and provides questions such as, "What would you like to tell your loved ones?" When the user answers, the content is recorded as an end-of-life note. Specifically, the server generates a question based on the user's emotion recognition result using a prompt sentence instructing the server to generate a question for creating the user's ending note and a generative AI model. The server presents the generated question to the user and accepts an answer to the question. At this time, the question may be generated based on the user's emotion recognition result using a prompt sentence instructing the server to generate a question for creating the user's ending note that promotes reflection on life, a change of perspective, or awareness, and a generative AI model. Example prompt sentence: "The user is feeling anxious. Please generate questions to help the user create an end-of-life note that will encourage reflection on life, change of thinking, or awareness."

[0685] 8. The server stores the data

[0686] The server stores the user's answers and provided information in a database (MySQL or PostgreSQL).

[0687] Specific examples

[0688] For example, a user might say, "I want to know how to write a will." The device converts this speech into text data using the Google Speech-to-Text API and sends it to the server. The server receives the text data and analyzes it using the Google Cloud Natural Language API. As a result, it understands that the user wants to know how to write a will.

[0689] Next, the server uses the Microsoft Azure Emotion API to recognize the user's emotions and determines that the user is feeling anxious. The server then provides information such as, "There are several ways to create a will, such as a notarized will or a handwritten will. We recommend that you consult a professional for details."

[0690] Furthermore, to help users create their end-of-life note, the server asks, "What would you like to tell your loved ones?" If the user answers, "I would like to express my gratitude to my family," the server saves the content of the end-of-life note in a MySQL database.

[0691] Example of user input

[0692] I want to know how to create a will

[0693] "I want help writing an ending note."

[0694] "I want to find a will-writing specialist."

[0695] By accepting these user inputs, the server provides appropriate information and support. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0696] Step 1:

[0697] The user speaks

[0698] The user speaks a question or request to the system, such as "I want to know how to write a will." The input is the user's voice, and the output is voice data.

[0699] Step 2:

[0700] The device converts the speech into text data

[0701] The device converts the user's speech into text data using speech recognition software (Google Speech-to-Text API). The input is voice data and the output is text data. Specifically, the device sends voice data to the API and receives the returned text data.

[0702] Step 3:

[0703] The server receives the text data.

[0704] The terminal sends the converted text data to the server. The server receives this data. The input is text data, and the output is text data stored in the server. In concrete terms, the terminal sends the text data to the server using an HTTP request, and the server receives the request.

[0705] Step 4:

[0706] The server analyzes the text data using natural language processing technology.

[0707] The server analyzes the received text data using Google Cloud Natural Language API or IBM Watson Natural Language Understanding. The input is text data, and the output is the analysis results. Specifically, the server sends the text data to the API and receives the analysis results in return.

[0708] Step 5:

[0709] The server recognizes the user's emotions using emotion recognition technology.

[0710] The server uses the analysis results to recognize the user's emotions using the Microsoft Azure Emotion API and Affectiva's emotion recognition technology. The input is the analysis results, and the output is the emotion recognition results. Specifically, the server sends the analysis results to the API and receives the emotion recognition results in return.

[0711] Step 6:

[0712] The server provides appropriate information and assistance

[0713] The server provides appropriate information based on the recognized emotion. For example, it may provide information such as, "You can create a will in several ways, such as a notarized will or a handwritten will. We recommend that you consult a specialist for details." The input is the emotion recognition result, and the output is an informational message. Specifically, the server generates an appropriate message based on the emotion recognition result and sends it to the user.

[0714] Step 7:

[0715] The server assists in creating an end-of-life note.

[0716] To assist in the creation of an Ending Note, the server provides the user with questions such as "What would you like to tell your loved ones?" When the user answers, the content is recorded as an Ending Note. The input is the user's answer, and the output is the text data of the Ending Note. Specifically, the server generates questions, receives the user's answers, and saves them.

[0717] Step 8:

[0718] The server stores the data

[0719] The server stores the user's answers and provided information in a database (MySQL or PostgreSQL). The input is the text data of the ending note and the informational message, and the output is the data stored in the database. Specifically, the server executes an INSERT query on the database and saves the data. The server may further include means for collecting the recorded answers, means for generating the proposed content of the ending preparation using a prompt sentence that instructs the server to propose content for preparing the ending based on the answer collection result and the generative AI model, and means for presenting the proposed content of the ending preparation to the user. Specifically, the server collects the recorded answers, generates the proposed content of the ending preparation based on the answer collection result using a prompt sentence that instructs the server to propose content for preparing the ending based on the answer collection result and the generative AI model, and presents the proposed content of the ending preparation to the user. Example prompt sentence: After collecting the user's answers to the questions for creating an Ending Note, the system accepts the results as input and asks, "Based on these user answers, please suggest the contents of the end-of-life preparations the user should make toward the end of their life."

[0720] (Application example 3)

[0721] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0722] In modern society, it is important to create an end-of-life note and deepen legal understanding, but many people often feel anxious or resistant to these tasks. Also, while there are tools and systems to support the creation of end-of-life notes, few utilize emotion or voice recognition, and support that is sensitive to the user's emotions is lacking. Furthermore, interactive support systems using smart devices are not widely available, so the environment for easy use by users is not yet in place.

[0723] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes means for enabling chat and consultation between humans and AI, means for promoting life reflection, changing perspectives, and awareness, means for deepening legal understanding, means for supporting end-of-life preparations, means for providing advice that does not violate the Attorneys Act and guidance to web services, means for performing emotion recognition, means for performing voice recognition, means for creating an end-of-life note, and means for collecting user responses using a smart device. This enables users to create an end-of-life note and deepen their legal understanding while receiving emotionally sensitive support.

[0724] "Means that enable chatting and consultation between humans and AI" refers to technology that enables AI to generate appropriate responses to human speech and engage in dialogue.

[0725] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that supports users in reviewing their past experiences and ways of thinking, and gaining new perspectives and discoveries.

[0726] "Means for deepening legal understanding" are technologies that provide users with general information about the law and deepen their legal knowledge.

[0727] "Means to support preparation for ending" refers to technology that provides users with the information and support they need when creating their own ending note.

[0728] "Means for providing advice and links to web services that do not violate the Lawyers Act" refers to technology that provides general information about the law and recommends consulting a legal expert.

[0729] "Means for emotion recognition" refers to technology for analyzing and recognizing emotions from a user's speech and behavior.

[0730] "Means for performing speech recognition" refers to technology for converting a user's speech into text.

[0731] "Means for creating an ending note" refers to technology for collecting users' responses and saving them as an ending note.

[0732] "Means for collecting user responses using smart devices" refers to technology that uses devices such as smart glasses or smartphones to interactively collect user responses.

[0733] The system for implementing the present invention uses the following hardware and software.

[0734] Hardware

[0735] Smart Glasses

[0736] microphone

[0737] server

[0738] software

[0739] Python

[0740] SpeechRecognition Library

[0741] Transformers library

[0742] System configuration

[0743] In this system, users wear smart glasses and engage in interactive dialogue to assist in the creation of an end-of-life note. The user's speech is collected through a microphone and sent to a server. The server performs speech recognition and converts it into text data. Furthermore, a generative AI model is used to recognize emotions and provide appropriate support based on the user's emotions.

[0744] Processing flow

[0745] 1. Speech Recognition: When a user answers a question through the smart glasses, the voice data is collected by the microphone. The server converts the voice data into text using the SpeechRecognition library.

[0746] 2. Emotion Recognition: The converted text data is subjected to emotion recognition using the Transformers library, which analyzes and recognizes emotions from user responses.

[0747] 3. Creation of an Ending Note: The user's answers and the emotion recognition results are saved on the server as an Ending Note, allowing the user to create an Ending Note while receiving emotional support.

[0748] Specific examples

[0749] The user puts on the smart glasses and answers questions such as:

[0750] Question: "What would you like to say to your loved one?"

[0751] User Answer: "I want to express my gratitude to my family."

[0752] The emotion recognition model judges this answer as "positive" and saves it in the ending note.

[0753] Prompt Sentence Examples

[0754] "What would you like to say to your loved one?"

[0755] This prompt sentence is input into a generative AI model to collect user responses and perform emotion recognition.

[0756] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0757] Step 1:

[0758] The user wears the smart glasses and answers questions to create an end-of-life note. The user's speech is collected as voice data through a microphone. The input is the user's voice, and the output is voice data.

[0759] Step 2:

[0760] The device sends the collected voice data to the server, which converts the voice data into text data using the SpeechRecognition library. The input is voice data, and the output is text data.

[0761] Step 3:

[0762] The server inputs the converted text data into a generative AI model for emotion recognition. It uses the Transformers library to analyze and recognize emotions from text data. The input is text data, and the output is the emotion recognition results.

[0763] Step 4:

[0764] The server saves the user's answers and the emotion recognition results as an ending note. The input is text data and the emotion recognition results, and the output is the ending note data.

[0765] Step 5:

[0766] The server feeds back the data of the Ending Note to the user, who can check the contents of the Ending Note through smart glasses. The input is the data of the Ending Note, and the output is the user's visual information.

[0767] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0768] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine). <URL: http

[0769] Examples of such generation AI include the AI ​​based on the neural network model 58 (http: / / openai.com / blog / chatgpt>). The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0770] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[0771] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0772] [Second embodiment]

[0773] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0774] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0775] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0776] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0777] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0778] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0779] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0780] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0781] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0782] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0783] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0784] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0785] "Example 1"

[0786] In one embodiment of the present invention, a means for enabling chatting and consultation with AI uses natural language processing technology to analyze human utterances and generate appropriate responses. Specifically, if a human says, "I'm thinking about writing a will," the AI ​​will generate a response such as, "Wills are an important procedure. What specifically are you considering?"

[0787] "Example 2"

[0788] Furthermore, as a means of encouraging reflection on life, a change of perspective, and awareness, AI can provide points of reflection and new perspectives to human speech. For example, if a human says, "Work hasn't been going well lately," the AI ​​can provide questions such as, "That's tough. Have you had any successful experiences in the past? Is there anything you can learn from those experiences?"

[0789] "Example 3"

[0790] Furthermore, as a means of deepening legal understanding, the AI ​​provides general information about the law. For example, if a human says, "I want to know how to write a will," the AI ​​will provide information such as, "There are several ways to write a will, such as a notarized will or a handwritten will. We recommend that you consult an expert for details."

[0791] "Example 4"

[0792] Additionally, as a means of assisting with end-of-life preparations, AI will assist in the creation of an end-of-life note. Specifically, it will provide questions for each item in the end-of-life note and record the human's answers. For example, it will provide questions such as "What would you like to tell your loved ones?" and save the answers as an end-of-life note.

[0793] "Example 5"

[0794] Finally, as a means of providing advice and guidance to web services that do not violate the Lawyers Act, the AI ​​provides general information about the law, recommends consulting a professional, and provides links to appropriate web services, such as a link to a web service for finding a will-writing professional.

[0795] The processing flow of each embodiment will be described below.

[0796] "Example 1"

[0797] Step 1: The AI ​​analyzes human speech using natural language processing technology.

[0798] Step 2: The AI ​​generates an appropriate response based on the analysis results. For example, if a human says, "I'm thinking about writing a will," the AI ​​will generate a response such as, "Willing is an important procedure. What specifically are you considering?"

[0799] "Example 2"

[0800] Step 1: The AI ​​analyzes human speech using natural language processing technology.

[0801] Step 2: The AI ​​provides points for reflection and new perspectives based on the analysis results. For example, if a human says, "Work hasn't been going well lately," the AI ​​will provide questions such as, "That's tough. Have you had any previous successes? Is there anything you can learn from those experiences?"

[0802] "Example 3"

[0803] Step 1: The AI ​​analyzes human speech using natural language processing technology.

[0804] Step 2: The AI ​​provides general legal information based on the analysis results. For example, if a human says, "I want to know how to write a will," the AI ​​will provide information such as, "There are several ways to write a will, such as a notarized will or a handwritten will. We recommend that you consult a specialist for details."

[0805] "Example 4"

[0806] Step 1: The AI ​​provides questions for each item in the end-of-life note.

[0807] Step 2: The AI ​​records the human's answers and saves them as an end-of-life note. For example, it provides questions such as, "What would you like to tell your loved one?" and saves the answers as an end-of-life note.

[0808] "Example 5"

[0809] Step 1: The AI ​​provides general information about the law and recommends consulting an expert.

[0810] Step 2: The AI ​​provides a link to an appropriate web service, such as a link to a web service for finding a will-writing expert.

[0811] Example 1

[0812] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0813] Conventional AI systems have had difficulty generating appropriate responses when chatting or consulting with users. Furthermore, they lacked the technology to accurately analyze user utterances and generate appropriate prompts, resulting in a decline in the quality of responses. Furthermore, they did not provide sufficient support for preparing the ending or deepening legal understanding.

[0814] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0815] In this invention, the server includes means for analyzing user utterances and generating appropriate responses, means for analyzing utterance data using natural language processing technology, means for inputting prompt sentences into a generative AI model to generate responses, and means for displaying the generated responses to the user, thereby enabling the server to generate high-quality responses in casual conversations and consultations with users.

[0816] "Means enabling chatting and consultation between humans and AI" refers to technology that allows users to have natural conversations with AI, exchanging information and solving problems through chatting and consultation.

[0817] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that helps users reflect on their past experiences and gain new perspectives and ideas.

[0818] "Means for deepening legal understanding" are techniques that allow users to deepen their knowledge of the law and promote their understanding of legal issues.

[0819] "Means to support preparation for ending" are technologies that support users in making preparations for the end of their lives.

[0820] "Means for providing legally compliant advice and guidance to web services" refers to technology that provides users with legally compliant advice and introduces appropriate web services.

[0821] The "means for analyzing user utterances and generating an appropriate response" is a technology for analyzing the content of a user utterance and generating an appropriate response based on that content.

[0822] The "means for analyzing speech data using natural language processing technology" is a technology that uses natural language processing technology to analyze user speech data and extract the intention of the speech and keywords.

[0823] "Means for inputting a prompt sentence into a generative AI model to generate a response" refers to a technology that inputs a prompt sentence into a generative AI model and generates an appropriate response based on that prompt sentence.

[0824] The "means for displaying the generated response to the user" is a technique for transmitting the generated response to the user's terminal and displaying it to the user.

[0825] This invention is a system that allows users to have natural conversations with artificial intelligence, exchanging information and solving problems through casual conversations and consultations. The system includes technology for analyzing user utterances and generating appropriate responses.

[0826] Hardware and software used

[0827] Hardware:

[0828] A server (with a high-performance CPU and sufficient memory)

[0829] software:

[0830] Natural language processing libraries (e.g., spaCy, NLTK)

[0831] Generative AI models (e.g., GPT-4)

[0832] Program processing

[0833] The server receives speech data from the user. Specifically, the user utters "I'm thinking about my will" through a device (such as a smartphone or PC). This speech data is sent from the device to the server.

[0834] The server analyzes the received speech data using a natural language processing library. As a result of the analysis, it extracts the intention of the speech and keywords. Next, it generates a prompt sentence for a generative AI model (such as GPT-4) based on the extracted information. This prompt sentence serves as an instruction for the AI ​​model to generate an appropriate response.

[0835] The generative AI model receives a prompt as input and generates an appropriate response. For example, in response to the utterance "I'm thinking about writing a will," it generates the response "A will is an important procedure. What specifically are you considering?"

[0836] Finally, the server sends the generated response to the user's terminal, where it is displayed to the user.

[0837] Specific examples

[0838] User utterance: "I'm thinking about my will."

[0839] What the device does: Converts speech to text and sends it to the server

[0840] Server analysis: Extract the keyword "will" and the intent "thinking"

[0841] Generate prompt: "The user says they're thinking about a will. Generate an appropriate response about a will."

[0842] The generative AI model responded: "A will is an important procedure. What specifically are you considering?"

[0843] Server Send: Sends the response to the device

[0844] Display terminal: Display the response to the user

[0845] In this way, users can chat and consult with AI.

[0846] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0847] Step 1:

[0848] The user speaks.

[0849] Specific operation: The user uses a device (such as a smartphone or PC) to speak to the system. For example, the user might say, "I'm thinking about my will."

[0850] Input: User's voice data

[0851] Output: Audio data sent to the device

[0852] Step 2:

[0853] The terminal transmits the speech data to the server.

[0854] Specific operation: The device captures the user's speech as audio data and converts it into text data, which is then sent to a server via the Internet.

[0855] Input: User's voice data

[0856] Output: Text data sent to the server

[0857] Step 3:

[0858] The server analyzes the speech data.

[0859] Specific operation: The server analyzes the received text data using a natural language processing library (e.g., spaCy, NLTK). As a result of the analysis, the intention of the utterance and keywords are extracted. For example, the keyword "will" and the intention of "thinking" are extracted.

[0860] Input: Text data

[0861] Output: Extracted intents and keywords

[0862] Step 4:

[0863] The server generates a prompt.

[0864] Specific operation: The server generates a prompt based on the extracted information. This prompt serves as an instruction for the generative AI model to generate an appropriate response. For example, it generates a prompt such as, "The user says they are thinking about a will. Please generate an appropriate response regarding a will."

[0865] Input: Extracted intents and keywords

[0866] Output: prompt statement

[0867] Step 5:

[0868] The server inputs a prompt sentence into the generative AI model.

[0869] Specific operation: The server inputs the generated prompt sentence into a generative AI model (e.g., GPT-4), which generates a response based on the prompt sentence.

[0870] Input: prompt statement

[0871] Output: The prompt sentence that is fed into the generative AI model

[0872] Step 6:

[0873] A generative AI model generates a response.

[0874] Specific behavior: The generative AI model generates an appropriate response based on the prompt sentence, for example, "A will is an important procedure. What specifically are you considering?"

[0875] Input: prompt statement

[0876] Output: The generated response

[0877] Step 7:

[0878] The server sends the generated response to the terminal.

[0879] Specific operation: The server sends the response obtained from the generative AI model to the user's device. The response is sent as text data.

[0880] Input: The generated response

[0881] Output: Text data sent to the terminal

[0882] Step 8:

[0883] The terminal displays the response to the user.

[0884] Specific operation: The terminal displays the received response to the user, who can check the response on the terminal screen.

[0885] Input: Text data sent to the terminal

[0886] Output: The response that is displayed to the user

[0887] (Application example 1)

[0888] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0889] In modern society, individuals face a wide range of problems and worries. In particular, many issues require specialized knowledge, such as life reflection, end-of-life preparations, legal understanding, and even security consultations in everyday life. However, obtaining appropriate advice on these issues is not easy, and consulting with experts takes time and money. Furthermore, there is a demand for advice that does not violate the Lawyers Act, and for people to be directed to appropriate web services. To solve these issues, an efficient and effective system that utilizes AI is needed.

[0890] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0891] In this invention, the server includes a means for enabling chats and consultations between humans and AI, a means for encouraging life reflection, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting preparations for endings, a means for providing advice that does not violate the Lawyers Act and guidance to web services, and a means for consulting AI about security issues. This allows users to efficiently and effectively obtain appropriate advice for a wide range of problems and concerns.

[0892] "Means that enable casual conversation and consultation" refers to a means that uses natural language processing technology to analyze human speech and generate appropriate responses.

[0893] "A means to promote reflection on life, a change of perspective, and awareness" is a means to help users reevaluate their past experiences and thoughts and gain new perspectives and awareness.

[0894] "Means to deepen legal understanding" are means of providing information and explanations to help users understand legal concepts and procedures.

[0895] "Means to support preparation for ending" are means to provide users with the information and guidelines they need when creating their own ending notes.

[0896] "Means of providing advice and directing users to web services that do not violate the Attorneys Act" refers to means of providing information and directing users to appropriate web services when providing legal advice, within the scope of the Attorneys Act.

[0897] "A means for consulting AI about security issues" refers to a means by which users can consult AI about security issues and concerns in their daily lives and receive appropriate advice.

[0898] The system for implementing this invention consists of three main elements: a server, a terminal, and a user. The following explains how each element functions.

[0899] server

[0900] The server is responsible for analyzing the user's speech using a generative AI model and generating an appropriate response. Specifically, the server uses the following software and hardware:

[0901] Software: Python, OpenAI GPT-3 API

[0902] Hardware: A server machine with a powerful processor and sufficient memory

[0903] The server receives the text data sent by the user and inputs it into the generative AI model, which analyzes the prompt and generates an appropriate response. The generated response is then sent back to the user's device.

[0904] Terminal

[0905] The terminal provides the interface through which the user communicates with the server. The terminal uses the following software and hardware:

[0906] Software: Web browser or dedicated mobile application

[0907] Hardware: Smartphone, tablet, or computer

[0908] The user inputs security questions and other inquiries through the terminal. The input text data is sent to the server via the Internet. The response from the server is also displayed to the user through the terminal.

[0909] User

[0910] Users interact with the system using a terminal. They input questions for security consultations, life reflections, or legal understanding. For example:

[0911] Example prompt sentence:

[0912] User: I've been worried about the security of my home lately.

[0913] AI:

[0914] An example of the response generated:

[0915] AI: So you're concerned about home security. What are you specifically concerned about? For example, we can talk about locking doors and windows, installing security cameras, etc.

[0916] In this way, users can efficiently and effectively obtain appropriate advice for a wide range of problems and concerns.

[0917] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0918] Step 1:

[0919] The user uses the terminal to enter security questions and other questions.

[0920] Input: User text input (e.g., "I've been worried about the security of my home lately.")

[0921] Operation: Obtains the user's text data through the device's input interface.

[0922] Output: The user's text data is saved to the device.

[0923] Step 2:

[0924] The terminal transmits the user's text data to the server.

[0925] Input: User's text data

[0926] How it works: The device sends the user's text data to a server via the Internet.

[0927] Output: The user's text data arrives at the server.

[0928] Step 3:

[0929] The server receives the user's text data and generates prompt sentences to input into the generative AI model.

[0930] Input: User's text data

[0931] How it works: The server analyzes the user's text data and generates a prompt appropriate for the generative AI model.

[0932] Output: Prompt text (e.g. "User: I've been worried about the security of my home lately\nAI:")

[0933] Step 4:

[0934] The server uses a generative AI model to generate an appropriate response based on the prompt sentence.

[0935] Input: prompt statement

[0936] How it works: The server calls the OpenAI GPT-3 API, taking the prompt sentence as input and generating an appropriate response.

[0937] Output: The generated response (e.g., "AI: I understand you're concerned about the security of your home. What specifically are you concerned about?")

[0938] Step 5:

[0939] The server sends the generated response to the terminal.

[0940] Input: The generated response

[0941] How it works: The server sends the generated response to the device over the Internet.

[0942] Output: The generated response arrives at the terminal.

[0943] Step 6:

[0944] The terminal displays the generated response to the user.

[0945] Input: The generated response

[0946] Action: The device displays the generated response to the user through the user interface.

[0947] Output: The user sees the generated response.

[0948] Example 2

[0949] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0950] In modern society, people are faced with a variety of problems and worries, and support is needed to solve them. In particular, there is a lack of means to encourage reflection on life, a change of perspective, and awareness. There is also a need for means to deepen legal understanding and support for preparing for the end of life. Furthermore, when providing this support, there is a need to provide advice that does not violate the law and to guide users to web services. To solve these issues, a system is needed that receives user utterances, uses a generative AI model to generate an appropriate response, and provides it to the user.

[0951] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0952] In this invention, the server includes a means for enabling dialogue between humans and AI, a means for encouraging reflection on life, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting preparation for endings, a means for providing legal advice and guidance to web services, a means for receiving user utterances and inputting prompt sentences into a generative AI model to generate responses, and a means for displaying the generated responses to the user, thereby enabling the user to gain new perspectives on the content of their utterances and identify areas for reflection.

[0953] "Means enabling dialogue between humans and artificial intelligence" refers to technology that enables artificial intelligence to understand what humans say and generate appropriate responses.

[0954] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that helps users reexamine their past experiences and ways of thinking and gain new perspectives and insights.

[0955] "Means for deepening legal understanding" refers to techniques that provide information and explanations to help users deepen their knowledge of the law.

[0956] "Means for supporting end-of-life preparations" are technologies that provide support for users to prepare for their own end-of-life.

[0957] "Means for providing legally compliant advice and guidance to web services" refers to techniques for providing advice to users and introducing appropriate web services within the scope of legally compliant advice.

[0958] "Means for receiving user utterances and inputting prompt sentences into a generative AI model to generate a response" refers to a technology that receives the content of a user's utterance as text data, inputs it into a generative AI model, and generates an appropriate response.

[0959] "Means for displaying the generated reaction to the user" refers to technology for displaying the reaction generated by the generative AI model on the user's device.

[0960] This invention is a system that receives a user's utterance, generates an appropriate response using a generative AI model, and provides the response to the user. Specific embodiments of this system will be described below.

[0961] First, the user uses the terminal to input their thoughts or worries by voice or text. For example, consider the case where the user says, "Recently, things haven't been going well at work."

[0962] The server then receives the speech data sent from the user's device. If the received data is audio, the server uses speech recognition software (e.g., a speech recognition API) to convert it into text data. This text data forms the basis of the prompt sentences to be input into the generative AI model.

[0963] The server generates a prompt sentence to be input to the generative AI model based on the converted text data. For example, it generates a prompt sentence such as, "The user says that work hasn't been going well recently. What lessons or new perspectives can you offer?"

[0964] A generative AI model (e.g., a natural language processing model) receives the prompt sent from the server and generates an appropriate response based on it, such as, "That's tough. Have you had any previous successes? Is there anything you can learn from those experiences?"

[0965] The server receives the responses generated by the generative AI model and sends them to the user's device, formatting the data as needed.

[0966] Finally, the device displays the response of the generated AI model received from the server to the user, who can then gain a new perspective on their own utterances or identify areas for improvement.

[0967] This system allows users to gain a new perspective on their own speech, encouraging them to reflect on their lives, change their way of thinking, and become more aware of their surroundings. It also provides a means to deepen legal understanding and support end-of-life preparations, allowing users to receive appropriate support for a variety of problems and concerns.

[0968] As a specific example, if a user says, "Work hasn't been going well lately," the server inputs this utterance as text data into the generative AI model. An example of a prompt would be, "The user says that work hasn't been going well lately. What lessons can you learn from this or a new perspective?" Based on this prompt, the generative AI model generates a response such as, "That's tough. Have you had any previous successes? Is there anything we can learn from those experiences?" The server then sends this response to the user's device, which then displays it to the user.

[0969] In this way, users can receive responses from the generative AI model and gain a new perspective on what they have said.

[0970] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0971] Step 1:

[0972] A user uses a terminal to input their thoughts or worries by voice or text. For example, the user might say, "Work hasn't been going well recently." The input is voice data or text data.

[0973] Step 2:

[0974] The server receives speech data sent from the user's device. If the received data is voice, the server converts it into text data using speech recognition software (e.g., a speech recognition API). The input is voice data, and the output is text data.

[0975] Step 3:

[0976] The server generates a prompt sentence to be input to the generative AI model based on the converted text data. For example, it generates a prompt sentence such as, "The user says that work hasn't been going well recently. What lessons or new perspectives can you offer?" The input is text data, and the output is a prompt sentence.

[0977] Step 4:

[0978] The server inputs the generated prompt sentence into a generative AI model. The generative AI model (e.g., a natural language processing model) generates an appropriate response based on the prompt sentence. The input is the prompt sentence, and the output is the generated response.

[0979] Step 5:

[0980] The server receives the responses generated by the generative AI model and sends them to the user's device, formatting the data as needed. The input is the generated response, and the output is the formatted response.

[0981] Step 6:

[0982] The device receives the generative AI model's responses from the server and displays them to the user. The user can then view the responses to gain new perspectives on their own utterances and identify areas for improvement. The input is the formatted response, and the output is the response displayed to the user.

[0983] (Application example 2)

[0984] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0985] In modern brick-and-mortar stores, it is important for customer service staff to communicate smoothly with customers. However, there is a lack of means to gain appropriate reflection and new perspectives in real time when staff have questions or problems while serving customers. This is an issue that delays staff self-improvement and learning new customer service methods.

[0986] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0987] In this invention, the server includes a means for enabling chats and consultations between humans and AI, a means for encouraging life reflection, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting end-of-life preparations, a means for providing advice that does not violate the Attorneys Act and guidance to web services, a means used by customer service staff in physical stores through smart glasses, and a means for the AI ​​to provide points for reflection and new perspectives in real time in response to questions or problems that the staff have while serving customers, thereby enabling customer service staff to obtain hints for self-improvement in real time.

[0988] "Means that enable chatting and consultation between humans and AI" refers to technology that enables AI to generate appropriate responses to what humans say and continue the dialogue.

[0989] "A means to promote life reflection, change of perspective, and awareness" is a technology that helps users reevaluate past experiences and current situations and gain new perspectives and insights.

[0990] "Means to deepen legal understanding" refers to techniques that provide information and explanations to help users understand legal concepts and rules.

[0991] "Means to support end-of-life preparation" refers to technology that provides users with the information and support they need to prepare for their own end-of-life.

[0992] "Means of providing advice and guidance to web services that do not violate the Attorneys Act" refers to technology that provides information when providing legal advice within the scope of the Attorneys Act and guides users to appropriate web services.

[0993] "Methods used by customer service staff in brick-and-mortar stores through smart glasses" refers to technology in which customer service staff working in brick-and-mortar stores wear smart glasses and acquire and use information through the glasses.

[0994] "A means for AI to provide points of reflection and new perspectives in real time in response to questions or problems that staff have while serving customers" is a technology in which AI instantly presents appropriate points of reflection and new perspectives in response to questions or problems that staff have while serving customers.

[0995] A system for implementing the present invention includes an application for use by wait staff through smart glasses. A specific embodiment of this system is described below.

[0996] System Configuration

[0997] The system consists of the following major components:

[0998] 1. Smart glasses: devices worn by wait staff that have voice input and display capabilities (e.g., Google Glass).

[0999] 2. Server: Hosts the generative AI model and generates responses to the customer service staff's utterances.

[1000] 3. Generative AI model: Using the OpenAI API, we generate points of reflection and new perspectives on the customer service staff's utterances.

[1001] Program processing

[1002] Hardware and Software

[1003] Smart glasses: Takes voice input and displays information on a display.

[1004] Server: Hosts the generative AI model and converts voice input to text.

[1005] Generative AI model: Uses OpenAI APIs to generate appropriate responses based on text input.

[1006] Data processing and calculation

[1007] 1. Acquiring voice input: The speech of the customer service staff is acquired as voice data through the microphone in the smart glasses.

[1008] 2. Speech recognition: The server converts the voice data into text data.

[1009] 3. Prompt generation: Based on the text data, a prompt is generated to be sent to the generative AI model.

[1010] 4. Response generation: A generative AI model generates a response based on the prompt, including reflections and new perspectives.

[1011] 5. Displaying the response: Display the generated response on the display of the smart glasses.

[1012] Specific examples

[1013] If a customer service staff member says, "Recently, I've been having trouble communicating with customers," the system will operate as follows:

[1014] 1. The smart glasses capture the speech as audio data.

[1015] 2. The server converts the audio data into text data.

[1016] 3. Generate the following prompt based on the text data:

[1017] A user said, "Recently, I've been having trouble communicating with customers." Please provide some reflections or new perspectives.

[1018] 4. The generative AI model generates a response based on the prompt, such as, "That's tough. What are some of the experiences you've had where you successfully communicated with someone before? Is there anything you can learn from that experience?"

[1019] 5. The generated response is displayed on the smart glasses display, allowing the wait staff to see it in real time.

[1020] In this way, customer service staff can get real-time tips for self-improvement.

[1021] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1022] Step 1:

[1023] The smart glasses capture the speech of the customer service staff as voice data.

[1024] Input: Customer service staff's speech (audio)

[1025] Output: Audio data

[1026] Specific operation: The microphone in the smart glasses captures the speech of the customer service staff and saves it as audio data.

[1027] Step 2:

[1028] The server converts the voice data into text data.

[1029] Input: Audio data

[1030] Output: Text data

[1031] What happens: The server uses speech recognition software (e.g., Google Cloud Speech-to-Text API) to convert the voice data into text data.

[1032] Step 3:

[1033] The server generates a prompt based on the text data.

[1034] Input: Text data

[1035] Output: prompt statement

[1036] Specific operation: The server analyzes the text data and generates a prompt to send to the generative AI model. For example, it generates a prompt such as, "The user said, 'Recently, I've been having trouble communicating with customers.' Please provide any points of reflection or new perspectives."

[1037] Step 4:

[1038] The server generates a response using a generative AI model.

[1039] Input: prompt statement

[1040] Output: Response text

[1041] Specific operation: The server calls the OpenAI API, sends a prompt, and generates a response text. The generated response text might be something like, "That's difficult. Have you had any successful communication experiences in the past? Is there anything you can learn from those experiences?"

[1042] Step 5:

[1043] The server sends the generated response text to the smart glasses.

[1044] Input: Response text

[1045] Output: Data sent to smart glasses

[1046] Specific operation: The server converts the response text into a data format for transmission to the smart glasses, and transmits it to the smart glasses through the network.

[1047] Step 6:

[1048] The smart glasses display the response text on the display.

[1049] Input: Data to be sent to smart glasses

[1050] Output: Response text displayed on the display

[1051] How it works: The smart glasses analyze the received data and display a response text on the screen, which the wait staff can view in real time.

[1052] Example 3

[1053] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1054] In modern society, it is important to deepen legal understanding and prepare for the end of life, but there are only a limited number of systems that provide this information appropriately and that allow users to easily access it. There is also a need for advice and guidance to specialists in a manner that does not violate the Lawyers Act. Furthermore, when users create an end-of-life note, they also need a means to pose appropriate questions and record the answers. A comprehensive system is needed to solve these issues.

[1055] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1056] In this invention, the server includes means for enabling dialogue between humans and artificial intelligence, means for promoting life reflection, a change of perspective, and awareness, means for deepening legal understanding, means for supporting preparations for the end of one's life, means for providing advice that does not violate the Attorneys' Act and guidance to online services, means for analyzing user input, means for generating appropriate information based on the analysis results, means for providing the generated information to the user, means for generating questions for each item in the end-of-life note and recording the user's answers, and means for providing links to experts and online services. This allows users to easily obtain legal information, receive support in creating their end-of-life note, and access appropriate experts and online services.

[1057] "Means enabling dialogue between humans and artificial intelligence" refers to the ability for humans to communicate with artificial intelligence in natural language.

[1058] "A means to promote reflection on life, a change of perspective, and awareness" refers to a function that helps users reexamine their past experiences and ways of thinking and gain new perspectives and insights.

[1059] "Means for deepening legal understanding" refers to functions that help users obtain general information about the law and deepen their legal knowledge.

[1060] "Means to support preparation for ending" refers to a function that supports the user in preparing for the end of their life.

[1061] "Means of providing advice or links to online services that do not violate the Lawyers Act" refers to functions that provide general information about the law, recommend consulting a professional, and provide links to appropriate online services.

[1062] "Means for analyzing user input" refers to technology for analyzing text or voice input from a user and understanding its content.

[1063] "Means for generating appropriate information based on the analysis results" refers to technology that generates appropriate responses or information based on the results of analyzing the user's input.

[1064] "Means for providing generated information to a user" refers to a function for displaying or transmitting generated responses or information to a user.

[1065] "Means for generating questions for each item in the ending note and recording the user's answers" refers to the function of generating questions necessary for creating the ending note and recording the user's answers.

[1066] "Means for providing links to experts and online services" refers to a function that provides access links to experts and related online services that users need.

[1067] MODE FOR CARRYING OUT THE INVENTION

[1068] This invention is a system that helps users deepen their legal understanding, assists them in creating an end-of-life note, and provides them with access to appropriate experts and online services. This system operates in cooperation with three parties: a server, a terminal, and a user.

[1069] Generate a program for the system

[1070] The server uses the generative AI model to generate a program to deepen the user's legal understanding. The program provides general information about the law, assists in creating an end-of-life note, and provides advice that does not violate the Attorneys' Act and directs users to appropriate online services.

[1071] Explaining the program's processing in natural language

[1072] The server performs the following process.

[1073] 1. Accepting user input

[1074] The user inputs questions or requests into the system through a terminal, for example, by saying, "I want to know how to write a will."

[1075] 2. Parse the input

[1076] The server analyzes the input received from the user using natural language processing (NLP) techniques, specifically tokenizing the input text and extracting meaning.

[1077] 3. Generate the right information

[1078] The server uses the generative AI model to generate appropriate information based on the analysis results. For example, if a user inputs "I want to know how to write a will," the generative AI model will generate a response such as "There are several ways to write a will, such as a notarized will or a handwritten will. We recommend consulting an expert for details."

[1079] 4. Provide information to users

[1080] The server sends the generated information to the terminal and displays it to the user, who can check the information on the screen of the terminal.

[1081] 5. Support for creating an end-of-life note

[1082] The server generates questions for each item in the Ending Note and provides them to the user. For example, it asks questions such as, "What would you like to tell your loved ones?" and saves the user's answers as the Ending Note.

[1083] 6. Referrals to experts and online services

[1084] The server provides general legal information, recommends consulting a legal professional, and provides links to appropriate online services, such as a link to an online service for finding a will-writing professional.

[1085] Specific examples

[1086] A specific example will be given below in which the user says, "I want to know how to write a will."

[1087] Examples:

[1088] User utterance: "I want to know how to create a will."

[1089] Server response: "A will can be created in several ways, including a notarized will or a handwritten will. We recommend consulting a professional for more information."

[1090] Example prompts to input to a generative AI model:

[1091] "Generate a response when a user says they want to know how to create a will."

[1092] This system allows users to easily obtain legal information, assists in creating an end-of-life note, and provides access to appropriate experts and online services. The flow of the identification process in Example 3 will be described with reference to Figure 15.

[1093] Step 1:

[1094] The user inputs a question or request into the system through the terminal. For example, they might say, "I want to know how to write a will." The terminal then sends this voice data to the server.

[1095] Step 2:

[1096] The server converts the received voice data into text using voice recognition technology. The converted text is "I would like to know how to write a will."

[1097] Step 3:

[1098] The server analyzes the converted text using natural language processing (NLP) techniques, specifically tokenizing the text and extracting meaning. The analysis results indicate that the user is seeking information on how to write a will.

[1099] Step 4:

[1100] The server uses a generative AI model to generate appropriate information based on the analysis results. The prompt text is "Generate a response when a user says they want to know how to create a will," and the generative AI model generates a response such as "A will can be created in several ways, such as a notarized will or a handwritten will. We recommend consulting an expert for details."

[1101] Step 5:

[1102] The server sends the generated response to the terminal. The terminal displays this information to the user. The user confirms the following information on the terminal screen: "A will can be created in several ways, such as a notarized will or a handwritten will. We recommend that you consult a professional for details."

[1103] Step 6:

[1104] The server generates questions for each item in the end-of-life note and sends them to the terminal. For example, it generates a question such as, "What would you like to tell your loved ones?" In response to this question, the user might enter, "I would like to express my gratitude to my family." The terminal then sends this answer to the server.

[1105] Step 7:

[1106] The server saves the user's answers as an ending note, which the user can review later.

[1107] Step 8:

[1108] The server provides general legal information and recommends consulting a legal expert. It also generates a link to an appropriate online service and sends it to the terminal. For example, it provides a link to an online service for finding a legal expert. The user clicks the link to access the online service for finding a legal expert.

[1109] (Application example 3)

[1110] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1111] In modern society, it is important to obtain legal information quickly and accurately, but consulting with an expert takes time and money. There is also a lack of means to support end-of-life preparations, such as creating an end-of-life note or preparing a will. Furthermore, when providing this information, it is necessary to ensure that it does not violate the Attorneys Act. To solve these issues, a system is needed that provides legal information in real time using smart devices and supports the creation of an end-of-life note.

[1112] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1113] In this invention, the server includes means for enabling chat and consultation between humans and AI, means for promoting life reflection, mindset change, and awareness, means for deepening legal understanding, means for supporting preparations for the end of life, means for providing advice that does not violate the Attorneys Act and links to web services, means for providing legal information in real time using a smart device, means for providing questions to support the creation of an end-of-life note and recording the answers, and means for acquiring legal information using a generative AI model.This enables users to quickly and accurately obtain legal information through their smart devices and efficiently create an end-of-life note.

[1114] "Means that enable casual conversation and consultation" is a function that allows humans and AI to exchange information and opinions through natural conversation.

[1115] "A means to promote reflection on life, a change of perspective, and awareness" is a function that helps users reflect on their past experiences and gain new perspectives and insights.

[1116] "Legal literacy" is a feature that provides general legal information to help users deepen their legal knowledge.

[1117] "Means to support end-of-life preparations" is a function that assists users in creating an end-of-life note and preparing a will in order to prepare for the end of their lives.

[1118] "Means of providing advice and links to web services that do not violate the Lawyers Act" refers to a function that provides general information about the law and recommends consulting a specialist if necessary.

[1119] "Means for providing legal information in real time using smart devices" refers to a function that provides users with instant legal information using devices such as smart glasses or smartphones.

[1120] "Means for providing questions to assist in the creation of an Ending Note and recording the answers" is a function that presents the user with questions regarding each item in the Ending Note and records the answers.

[1121] "Means for obtaining legal information using a generative AI model" refers to a function that uses a generative AI model to generate and provide legal information in response to a user's question.

[1122] The system for implementing this invention uses a smart device (e.g., smart glasses or a smartphone) to provide users with real-time legal information and assist them in creating an end-of-life note. Specific embodiments of this system are described below.

[1123] System configuration

[1124] The system consists of the following main components:

[1125] 1. Smart Device: A device worn or used by the user to display and input information.

[1126] 2. Server: Generates legal information using generative AI models and sends it to smart devices.

[1127] 3. Generative AI model: An AI model for generating legal information in response to a user question.

[1128] Program processing

[1129] The server receives input from the user and uses a generative AI model to generate appropriate legal information. The generated information is sent to the user's smart device and displayed. To assist in the creation of the end-of-life note, the server also provides a series of questions and records the user's answers.

[1130] Hardware and software used

[1131] Smart devices: smart glasses, smartphones

[1132] Server: Cloud server or on-premise server

[1133] Generative AI model: Uses OpenAI API

[1134] Data processing and calculation

[1135] The server receives input data from the user and sends it to the generative AI model as a prompt. The generative AI model generates legal information based on the prompt and sends it back to the server. The server then sends the generated information to the smart device and displays it to the user. When creating the ending note, the server also records and saves the user's answers in JSON format.

[1136] Specific examples

[1137] The user puts on the smart glasses and launches the application. They select "Get legal information" from the menu and enter "I want to know how to write a will." The server receives this input and sends the following prompt to the generative AI model:

[1138] Example prompt sentence:

[1139] Please provide general legal information: I want to know how to make a will.

[1140] Based on this prompt, the generative AI model generates information on how to write a will and sends it back to the server, which then sends this information to the smart glasses and displays it to the user.

[1141] If a user wants to create an end-of-life note, they select "Create an end-of-life note" from the menu and answer a series of questions provided by the server. For example, when a user answers the question "What would you like to tell your loved one?", the answers are recorded by the server and can be viewed or edited later.

[1142] In this way, users can quickly and accurately obtain legal information through their smart devices and efficiently create their end-of-life notes.

[1143] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1144] Step 1:

[1145] The user starts the smart device and selects an application.

[1146] Input: User actions (launching and selecting applications)

[1147] Output: The application's main menu is displayed.

[1148] Specific operation: The user operates smart glasses or a smartphone to launch the legal consultation support application, and the main menu is displayed on the device screen.

[1149] Step 2:

[1150] The user selects "Get legal information" from the menu and enters the information they want to know.

[1151] Input: User's choice ("Get legal information") and input (information they want to know)

[1152] Output: User input is sent to the server

[1153] Specific operation: The user selects "Get legal information" from the menu and enters, for example, "I want to know how to write a will." The input is sent to the server.

[1154] Step 3:

[1155] The server receives user input and sends prompts to the generative AI model.

[1156] Input: User input (information you want to know)

[1157] Output: The prompt sent to the generative AI model

[1158] Specific operation: The server receives the user's input, generates a prompt saying, "Please provide some general legal information: I would like to know how to write a will," and sends it to the generative AI model.

[1159] Step 4:

[1160] The generative AI model generates legal information based on the prompt text and sends it back to the server.

[1161] Input: prompt statement

[1162] Output: Generated legal information

[1163] Specific operation: The generative AI model analyzes the prompt text, generates information on how to create a will, and sends it back to the server.

[1164] Step 5:

[1165] The server receives the generated legal information and sends it to the smart device.

[1166] Input: Generated legal information

[1167] Output: Legal information sent to smart devices

[1168] Specific operation: The server sends the legal information received from the generative AI model to the smart device.

[1169] Step 6:

[1170] The smart device displays legal information to the user.

[1171] Input: Legal information sent from the server

[1172] Output: Legal information displayed to the user

[1173] Specific operation: The smart device displays the legal information received from the server on the screen so that the user can confirm it.

[1174] Step 7:

[1175] The user selects "Create an Ending Note" from the menu and answers the questions.

[1176] Input: User's choice ("Create an ending note") and answer

[1177] Output: The user's answer is sent to the server

[1178] Specific operation: The user selects "Create an Ending Note" from the menu and enters answers to questions provided by the server. For example, they answer the question, "What would you like to tell your loved one?" The answers are then sent to the server.

[1179] Step 8:

[1180] The server records the user's answers and saves them as an ending note.

[1181] Input: User's answer

[1182] Output: Recorded ending note

[1183] Specific operation: The server receives the user's answers, records them in JSON format, and saves them as an ending note. The user can later view and edit this ending note.

[1184] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1185] "Example 1"

[1186] In one embodiment of the present invention, the means for enabling chat and consultation between humans and AI includes an emotion engine that recognizes human emotions. Specifically, human speech is analyzed using natural language processing technology, and human emotions are recognized based on the analysis results. For example, if a human says, "Work hasn't been going well lately," the AI ​​recognizes from the speech that the human is feeling frustrated.

[1187] "Example 2"

[1188] In another embodiment of the present invention, a means for promoting life reflection, mindset change, and awareness includes an emotion engine that recognizes human emotions. Specifically, human speech is analyzed using natural language processing technology, and human emotions are recognized based on the analysis results. For example, if a person says, "Work hasn't been going well lately," the AI ​​recognizes from the speech that the person is feeling frustrated and provides appropriate points of reflection and new perspectives on those emotions.

[1189] "Example 3"

[1190] In yet another embodiment of the present invention, the means for supporting end-of-life preparations includes an emotion engine that recognizes human emotions. Specifically, the engine analyzes human speech using natural language processing technology and recognizes human emotions based on the analysis results. For example, if a person says, "I'm thinking about writing a will," the AI ​​recognizes from the speech that the person is feeling anxious and provides support for creating an end-of-life note appropriate to that emotion.

[1191] The processing flow of each embodiment will be described below.

[1192] "Example 1"

[1193] Step 1: Receive human speech.

[1194] Step 2: Analyze the received utterance using natural language processing technology.

[1195] Step 3: Recognize human emotions based on the analysis results.

[1196] "Example 2"

[1197] Step 1: Receive human speech.

[1198] Step 2: Analyze the received utterance using natural language processing technology.

[1199] Step 3: Recognize human emotions based on the analysis results.

[1200] Step 4: Provide appropriate reflections and new perspectives on the identified emotions.

[1201] "Example 3"

[1202] Step 1: Receive human speech.

[1203] Step 2: Analyze the received utterance using natural language processing technology.

[1204] Step 3: Recognize human emotions based on the analysis results.

[1205] Step 4: Provide assistance in creating an appropriate end-of-life note for the identified emotions.

[1206] Example 1

[1207] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1208] Conventional AI systems have difficulty smoothly engaging in casual conversations or consultations with humans, particularly in recognizing emotions and generating appropriate responses. Furthermore, they lack support for preparing for the end of a case or deepening legal understanding, making it impossible to provide users with the information and advice they need. Furthermore, providing advice and directing users to online services in a manner that does not violate the Attorneys Act has also been an issue.

[1209] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1210] In this invention, the server includes means for enabling chatting and consultation between humans and AI, means for encouraging life reflection, a change of perspective, and awareness, means for deepening legal understanding, means for supporting closing preparations, means for providing advice and guidance to online services that do not violate the Attorneys' Act, means for converting human speech from voice to text, means for analyzing speech using natural language processing technology, means for recognizing emotions based on the analysis results, means for generating appropriate responses using a generative AI model, and means for converting the generated responses into voice and outputting them. This enables smooth chatting and consultation with users, recognizes emotions, and generates appropriate responses. It also provides support for closing preparations and deepening legal understanding, and can provide advice and guidance to online services that do not violate the Attorneys' Act.

[1211] "Means that enable casual conversation and consultation between humans and AI" refers to the function of analyzing what humans say and allowing AI to generate an appropriate response.

[1212] "A means to promote reflection on life, a change of perspective, and awareness" refers to a function that helps users reflect on past experiences and thoughts and gain new perspectives and awareness.

[1213] "Means for deepening legal understanding" refers to functions that provide information and advice to help users deepen their understanding of legal matters.

[1214] "Means to support preparations for the end of life" refers to functions that support preparations for the end of life, such as allowing users to create their own end-of-life notes.

[1215] "Means of providing advice and directing users to online services that do not violate the Attorneys Act" refers to the function of providing legal advice in a manner that does not violate the Attorneys Act and directing users to appropriate online services as necessary.

[1216] "Means for converting human speech from voice to text" refers to a function for converting speech spoken by a user into text data.

[1217] "Means of analyzing speech using natural language processing technology" refers to technology for analyzing the content of speech acquired as text data and understanding its meaning and intent.

[1218] "Means for recognizing emotions based on analysis results" refers to a function for recognizing a user's emotions based on the analysis results of the content of speech.

[1219] "Means for generating an appropriate response using a generative AI model" refers to the function of generating an appropriate response using a generative AI model based on the analysis results and emotion recognition results.

[1220] The "means for converting the generated response into speech and outputting it" refers to a function for converting the generated text response into speech and conveying it to the user.

[1221] This invention is a system that enables chatting and consultation between humans and AI, and includes a series of processes for analyzing user utterances and generating appropriate responses. Specific embodiments of this system are described below.

[1222] First, a user speaks using a device (such as a smartphone or personal computer). For example, the user might say, "Work hasn't been going well lately." This speech is captured as voice data through the device's microphone.

[1223] The device then converts the captured voice data into text using voice recognition software, such as Google Cloud Speech-to-Text API or Amazon Transcribe.

[1224] The converted text data is sent from the device to a server, which then analyzes it using natural language processing technology. This analysis uses natural language processing software such as Google Cloud Natural Language API or IBM Watson Natural Language Understanding.

[1225] Based on the analysis results, the server recognizes the user's emotions. This emotion recognition is achieved using emotion recognition software such as Microsoft Azure Emotion API or Affectiva. For example, if a user says, "Work hasn't been going well lately," the server recognizes that the user is feeling frustrated.

[1226] The server then uses a generative AI model, such as OpenAI's GPT-3, to generate an appropriate response. For example, if the server recognizes that the user is frustrated, it might generate a response like, "That's tough. What exactly are you having trouble with?"

[1227] The generated response is sent from the server to the device, which then converts the received text data into speech and communicates the response to the user using voice synthesis software such as Google Cloud Text-to-Speech API or Amazon Polly.

[1228] As a specific example, the prompt sentence when the user utters "Work hasn't been going well recently" is shown below.

[1229] User utterance: Things haven't been going well at work lately

[1230] Prompt: The user says, "Things haven't been going well at work lately." The user is frustrated. Generate an appropriate response.

[1231] In this way, the server and device can work together to smoothly facilitate casual conversations and consultations with users. Support is also provided for preparing for the end of a conversation and deepening legal understanding, and advice and guidance to online services can be provided in a manner that does not violate the Attorneys Act.

[1232] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1233] Step 1:

[1234] A user uses a terminal to make a speech. For example, the user might say, "Work hasn't been going well lately." The terminal acquires this speech data. The input is the user's speech, and the output is the speech data acquired by the terminal.

[1235] Step 2:

[1236] The device converts the acquired voice data into text data. This process uses voice recognition software. Specifically, voice recognition technology is used to convert voice data into text data. The input is voice data, and the output is text data.

[1237] Step 3:

[1238] The terminal sends the converted text data to the server. The input is the text data, and the output is the text data sent to the server.

[1239] Step 4:

[1240] The server analyzes the received text data using natural language processing technology. This analysis uses natural language processing software. Specifically, it analyzes the meaning and intent of the text data. The input is text data, and the output is the analysis results.

[1241] Step 5:

[1242] The server recognizes the user's emotions based on the analysis results. This emotion recognition is performed using emotion recognition software. Specifically, the user's emotions are identified from the analysis results. The input is the analysis results, and the output is the emotion recognition results.

[1243] Step 6:

[1244] The server generates an appropriate response using a generative AI model. Specifically, it generates an appropriate response based on the emotion recognition results. The input is the emotion recognition results, and the output is the generated response.

[1245] Step 7:

[1246] The server generates a response and sends it to the terminal. The input is the generated response and the output is the response sent to the terminal.

[1247] Step 8:

[1248] The device converts the received text data into speech and responds to the user. This process uses speech synthesis software. Specifically, the device converts the text data into speech data and plays it back to the user. The input is text data, and the output is speech data.

[1249] (Application example 1)

[1250] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1251] Conventional AI systems have had difficulty recognizing emotions and generating appropriate responses when engaging in casual conversations or consultations with humans. They also lacked the ability to provide appropriate responses to security-related questions and inquiries. Furthermore, it was difficult to provide these functions as an application installed on a smartphone.

[1252] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes means for enabling chat and consultation between humans and AI, means for promoting life reflection, mindset change, and awareness, means for deepening legal understanding, means for supporting ending preparation, means for providing advice that does not violate the Attorneys Act and guidance to web services, means for analyzing human speech using natural language processing technology, recognizing emotions, and generating appropriate responses, means for generating appropriate responses to security-related questions and inquiries, and means for providing an application to be installed on a smartphone. As a result, users can receive appropriate responses based on their emotions through chat and consultation with AI, and security-related questions and inquiries can be handled quickly and appropriately.

[1253] "A means to enable chatting and consultation between humans and AI" is a technology that analyzes human speech and generates appropriate responses.

[1254] "A means to promote life reflection, a change of perspective, and awareness" is a technology that helps users reevaluate their past experiences and ways of thinking and gain new perspectives and insights.

[1255] "Legal literacy tools" are technologies that help users understand legal concepts and procedures.

[1256] "Means to support end-of-life preparation" are technologies that assist users in making preparations for their own end-of-life.

[1257] "Means of providing advice and guidance to web services that do not violate the Lawyers Act" refers to technology that provides advice to users and guides them to appropriate web services within the scope of the law.

[1258] "Means of using natural language processing technology to analyze human speech, recognize emotions, and generate appropriate responses" refers to technology that analyzes user speech, recognizes emotions, and generates appropriate responses.

[1259] The "means for generating appropriate responses to security-related questions and inquiries" is a technology that generates appropriate responses when a user asks a security-related question or inquiry.

[1260] "Means for providing an application to be installed on a smartphone" refers to a technology for providing an application that runs on a smartphone.

[1261] As an embodiment of the present invention, the following system is constructed.

[1262] First, the server includes a means for analyzing human utterances using natural language processing techniques, recognizing emotions, and generating appropriate responses. Specifically, the server receives user utterances and uses the TextBlob library for text analysis, thereby classifying the emotions of the utterances as positive, negative, or neutral.

[1263] Next, the server uses a generative AI model to generate an appropriate response. OpenAI's text-davinci-003 is used as the generative AI model. Based on the user's utterance and its emotion, an appropriate prompt sentence is generated and input into the generative AI model. For example, if the user says, "I've been seeing suspicious people around my house lately," the following prompt sentence is generated:

[1264] The user is feeling anxious. Generate an appropriate response to the user's utterance: 'I've been seeing some suspicious people around my house lately.'

[1265] By inputting this prompt into a generative AI model, an appropriate response can be obtained.

[1266] Furthermore, the server includes a means for generating an appropriate response to a security question or inquiry, thereby enabling a user to receive a prompt and appropriate response when the user makes a security question or inquiry.

[1267] Finally, the server includes a means for providing an application to be installed on the smartphone. This application runs on the smartphone that the user uses daily and provides an interface for the user to input utterances. When the user inputs an utterance, the utterance is transmitted to the server for the aforementioned processing.

[1268] In this way, users can chat and consult with AI to receive appropriate responses based on their emotions, making it possible to respond quickly and appropriately to security-related questions and inquiries.

[1269] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1270] Step 1:

[1271] A user starts an application on their smartphone and inputs speech. The inputted speech is sent to the server as text data. The input data is the content of the user's speech, and the output data is the text data sent to the server.

[1272] Step 2:

[1273] The server analyzes the received text data using natural language processing techniques. Specifically, it uses the TextBlob library to analyze the sentiment of the text. The input data is the user's spoken text, and the output data is the sentiment analysis result (positive, negative, neutral).

[1274] Step 3:

[1275] The server generates an appropriate prompt based on the sentiment analysis results. For example, if the user's utterance indicates a negative emotion, the prompt might be, "The user is feeling anxious. Please generate an appropriate response to the user's utterance: 'I've seen suspicious people around the house recently.'" The input data are the sentiment analysis results and the user's utterance text, and the output data is the generated prompt.

[1276] Step 4:

[1277] The server inputs the generated prompt sentence into a generative AI model (OpenAI's text-davinci-003) to generate an appropriate response. The input data is the prompt sentence, and the output data is the generated response text.

[1278] Step 5:

[1279] The server sends the generated response text to the smartphone application, where the input data is the generated response text and the output data is the response text sent to the smartphone.

[1280] Step 6:

[1281] The user's smartphone displays the received response text. The input data is the response text sent from the server, and the output data is the response text displayed to the user.

[1282] In this way, users can chat and consult with the AI ​​to get appropriate responses based on their emotions.

[1283] Example 2

[1284] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1285] In modern society, people are faced with a variety of problems and stresses, and appropriate support is needed to resolve these. However, conventional systems have difficulty accurately recognizing the user's emotions and providing appropriate points of reflection and new perspectives based on those emotions. Effective methods for encouraging reflection on life, changing perspectives, and awareness are also lacking. Furthermore, there are insufficient methods for providing support for deepening legal understanding and preparing for the end of life.

[1286] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for enabling chats and consultations between humans and AI, means for promoting life reflection, a change of perspective, and awareness, means for deepening legal understanding, means for supporting preparation for endings, means for providing legal advice and guidance to web services, means for analyzing human utterances using natural language processing technology, means for recognizing human emotions using emotion recognition technology, and means for providing appropriate points of reflection and new perspectives using a generative AI model. This makes it possible to accurately recognize the user's emotions and, based on the recognition, provide appropriate points of reflection and new perspectives. Furthermore, effective support for promoting life reflection, a change of perspective, and awareness is provided, and means for supporting deepening legal understanding and preparing for endings are also enhanced.

[1287] "Means enabling chatting and consultation between humans and AI" is a function that allows humans to have natural dialogue with AI and obtain information and advice through consultation and chat.

[1288] "A means to promote reflection on life, a change of perspective, and awareness" is a function that helps users reflect on their past experiences and gain new perspectives and insights.

[1289] "Means for deepening legal understanding" is a function that allows users to deepen their knowledge of the law and promote their understanding of legal issues.

[1290] "Means to support end-of-life preparations" is a function that provides users with the information and support they need to prepare for the end of their lives.

[1291] "Means for providing legally compliant advice and guidance to web services" refers to a function for providing advice to users and introducing appropriate web services within the scope of legally compliant advice.

[1292] "Means for analyzing human speech using natural language processing technology" refers to technology that analyzes user speech as text data and understands its content and context.

[1293] "Means for recognizing human emotions using emotion recognition technology" refers to technology that identifies emotions from a user's speech and behavior, and responds appropriately based on those emotions.

[1294] "Means for providing appropriate points of reflection and new perspectives using a generative AI model" is a function that uses a generative AI model to generate and provide points of reflection and new perspectives that correspond to the user's situation and emotions.

[1295] This invention is a system in which a user inputs an utterance using a terminal, the utterance is analyzed by a server, and appropriate points for reflection and new perspectives are provided. Specific embodiments of this system will be described below.

[1296] Hardware and software used

[1297] Hardware: Servers, devices (PCs, smartphones, etc.)

[1298] Software: Natural language processing engines (e.g., Google Cloud Natural Language API), emotion recognition engines (e.g., IBM Watson Tone Analyzer), generative AI models (e.g., OpenAI GPT-3)

[1299] Program processing flow

[1300] 1. User speech input

[1301] The user inputs an utterance using the terminal. For example, the user inputs "Work hasn't been going well recently."

[1302] 2. Sending speech

[1303] The terminal sends the user's speech data to the server, where it is converted into text format.

[1304] 3. Speech Analysis

[1305] The server analyzes the received speech data using a natural language processing engine (e.g., Google Cloud Natural Language API). As a result of the analysis, the context of the speech and keywords are extracted.

[1306] 4. Emotional Recognition

[1307] The server uses an emotion recognition engine (e.g., IBM Watson Tone Analyzer) to recognize the user's emotions from the speech data. For example, emotions such as frustration or sadness are identified.

[1308] 5. Generating questions and perspectives

[1309] The server uses a generative AI model (e.g., OpenAI GPT-3) to generate questions to provide appropriate reflection points and new perspectives on the user's emotions.

[1310] 6. Sending the generated results

[1311] The server sends the generated questions and viewpoints to the user's terminal.

[1312] 7. Displaying the generated results

[1313] The generated results received by the terminal from the server are displayed to the user, who can then look at them and gain points of reflection or new perspectives.

[1314] Specific examples

[1315] User utterance input: "Work hasn't been going well lately."

[1316] Analysis results of natural language processing engine: Keywords "work" and "not going well"

[1317] Emotion Recognition Engine Analysis Results: Frustration

[1318] Generative AI model output: "That's tough. Have you had success before? Is there anything you can learn from that experience?"

[1319] Prompt Sentence Examples

[1320] Prompt: "When a user says, 'I've been having trouble at work lately,' generate a question that will provide appropriate reflection and a new perspective."

[1321] This system analyzes the user's speech, recognizes their emotions, and then provides appropriate points of reflection and new perspectives, encouraging them to reflect on their lives, change their way of thinking, and become more aware of things.

[1322] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1323] Step 1: User utterance input

[1324] Operation: A user uses a device (PC or smartphone) to input speech into the system. For example, the user might input, "Work hasn't been going well recently."

[1325] Input: User's voice data

[1326] Output: Text-formatted speech data

[1327] Step 2: Sending Utterances

[1328] How it works: The device sends the user's speech data to the server, where it is converted into text using speech recognition technology.

[1329] Input: Text utterance data

[1330] Output: Text data sent to the server

[1331] Step 3: Analyze the utterance

[1332] How it works: The server analyzes the received speech data using a natural language processing engine (e.g., Google Cloud Natural Language API). As a result of the analysis, the context of the speech and keywords are extracted.

[1333] Input: Text data sent to the server

[1334] Output: Extracted keywords and context information

[1335] Step 4: Recognize emotions

[1336] How it works: The server uses an emotion recognition engine (e.g., IBM Watson Tone Analyzer) to recognize the user's emotions from the speech data. For example, emotions such as frustration or sadness are identified.

[1337] Input: Extracted keywords and context information

[1338] Output: Recognized emotion information

[1339] Step 5: Generate questions and perspectives

[1340] How it works: The server uses a generative AI model (e.g., OpenAI GPT-3) to generate questions to provide appropriate reflections and new perspectives on the user's emotions.

[1341] Input: Recognized emotion information

[1342] Output: Generated questions and perspectives

[1343] Step 6: Sending the generated results

[1344] How it works: The server generates questions and views and sends them to the user's device.

[1345] Input: Generated questions and perspectives

[1346] Output: The generated results sent to the user's device.

[1347] Step 7: Viewing the generation results

[1348] Operation: The device displays the generated results received from the server to the user, allowing the user to reflect on their work or gain new perspectives.

[1349] Input: The generated result sent to the user's device

[1350] Output: Questions and perspectives displayed on the terminal

[1351] In this way, it is possible to analyze the user's speech, recognize their emotions, and provide appropriate points for reflection and new perspectives.

[1352] (Application example 2)

[1353] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1354] In modern society, there is a need to reduce the anxiety and stress felt by users and provide appropriate advice. However, conventional systems have had difficulty accurately recognizing users' emotions and providing appropriate feedback based on those emotions. Another problem is that users lack the means to appropriately reflect on or gain new perspectives on security-related concerns and problems.

[1355] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1356] In this invention, the server includes a means for enabling chat and consultation between humans and AI, a means for encouraging life reflection, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting end-of-life preparations, a means for providing advice that does not violate the Lawyers Act and guidance to web services, and a means for analyzing the user's speech, recognizing emotions, and providing appropriate points of reflection and new perspectives, thereby reducing the anxiety and stress felt by the user and providing appropriate advice.

[1357] "Means that enable casual conversation and consultation" is a function that allows humans and AI to exchange information and opinions through natural conversation.

[1358] "A means to promote life reflection, a change of perspective, and awareness" is a function that helps users reevaluate their past experiences and current situations and gain new perspectives and insights.

[1359] "Legal literacy" refers to features that allow users to deepen their knowledge of the law and improve their understanding of legal issues.

[1360] "Means to support end-of-life preparations" are functions that assist users in making preparations for the end of their lives.

[1361] "Means of providing advice and guidance to web services that do not violate the Lawyers Act" refers to a function that provides advice to users and introduces appropriate web services within the scope of the law.

[1362] "A means of analyzing the user's speech, recognizing their emotions, and providing appropriate points for reflection and new perspectives" is a function that analyzes the content of the user's speech, recognizes their emotions, and then provides the user with appropriate feedback and new perspectives.

[1363] The system for carrying out this invention has the function of analyzing the user's utterances, recognizing their emotions, and providing appropriate points for reflection and new perspectives. A specific embodiment of this system is described below.

[1364] Hardware and software used

[1365] Hardware: Smartphone, microphone

[1366] Software: Python, OpenAI API, SpeechRecognition library, Transformers library

[1367] System configuration

[1368] 1. Speech Recognition: The server converts the user's speech into text using the SpeechRecognition library. When the user speaks into the smartphone's microphone, the voice data is sent to the server.

[1369] 2. Sentiment Analysis: The server uses the sentiment analysis model from the Transformers library to recognize emotions from the user's speech. The text data is input into the sentiment analysis model to identify the user's sentiment.

[1370] 3. Response Generation: The server uses OpenAI's API to generate text that offers appropriate points of reflection or new perspectives based on the user's speech and the recognized emotions. The generated text is provided to the user as feedback.

[1371] Specific examples

[1372] If a user says, "I've been worried about the security of my home lately," the system analyzes the utterance and recognizes that the user is feeling anxious. The system then provides questions such as, "That sounds worrying. Have you had any experience strengthening your security measures before? Is there anything you can learn from that experience?"

[1373] Prompt Sentence Examples

[1374] A user says, "I've been worried about the security of my home lately." They're feeling anxious. Give them some appropriate reflection or fresh perspective.

[1375] In this way, the system can alleviate users' anxiety and provide appropriate advice.

[1376] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1377] Step 1:

[1378] The user speaks into the smartphone's microphone.

[1379] Input: User's voice data

[1380] Output: Audio data is sent to the server

[1381] What happens: The user says, "I've been worried about the security of my home lately."

[1382] Step 2:

[1383] The server uses the SpeechRecognition library to convert the audio data into text.

[1384] Input: User's voice data

[1385] Output: Text data (e.g., "I've been worried about the security of my home lately.")

[1386] Specific operation: The server starts a speech recognition engine, analyzes the voice data, and converts it into text.

[1387] Step 3:

[1388] The server uses sentiment analysis models from the Transformers library to recognize emotions from text data.

[1389] Input: Text data

[1390] Output: Emotion data (e.g., "anxiety")

[1391] Specific operation: The server inputs text data into the sentiment analysis model and obtains sentiment labels.

[1392] Step 4:

[1393] The server uses OpenAI's API to generate text that provides appropriate points of reflection and new perspectives based on text and emotion data.

[1394] Input: Text data, emotion data

[1395] Output: Response text (e.g., "That's concerning. Have you had experience with strengthening security measures before? Is there anything we can learn from that experience?")

[1396] Specific operation: The server inputs a prompt sentence into the generative AI model and generates an appropriate response text.

[1397] Step 5:

[1398] The server sends the generated response text to the user's smartphone.

[1399] Input: Response text

[1400] Output: Response text displayed on the user's smartphone

[1401] Specific operation: The server sends the response text over the network to the user's smartphone and displays it to the user.

[1402] In this way, the system can analyze the user's speech, recognize emotions, and provide appropriate feedback.

[1403] Example 3

[1404] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1405] Conventional end-of-life preparation support systems provide information without considering the user's feelings, making it difficult to provide appropriate support for the user's anxieties and questions. Furthermore, they do not adequately provide information to deepen legal understanding or support for creating an end-of-life note, making it difficult for users to obtain the information and support they need. Furthermore, they do not adequately guide users to advice or web services that do not violate the Attorneys Act, making it difficult for users to obtain professional help.

[1406] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1407] In this invention, the server includes: means for recognizing a user's emotions using an emotion engine; a prompt sentence for instructing the server to generate a question for creating the user's end-of-life note based on the result of the user's emotion recognition; means for generating the question using a generative AI model; means for presenting the generated question to the user and accepting an answer to the question; and means for recording the accepted answer. This enables the server to provide appropriate information and support that takes the user's emotions into consideration, effectively addressing the user's anxieties and questions. Furthermore, the server provides information to deepen legal understanding and supports the creation of an end-of-life note, making it easier for the user to obtain the information and support they need. Furthermore, the server appropriately provides advice and links to web services within the scope of the Attorneys' Act, making it easier for the user to obtain expert help. In addition, in the server, the means for generating questions generates the questions based on the results of recognizing the user's emotions using a prompt sentence that instructs the generation of questions to promote reflection on life, a change of perspective, or awareness as questions for creating the user's ending note, and the generative AI model.

[1408] "Means that enable casual conversations and consultations between humans and AI" refers to technology that enables AI to generate responses to what humans say and engage in dialogue.

[1409] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that supports users in reviewing their past experiences and ways of thinking, and gaining new perspectives and awareness.

[1410] "Means for deepening legal understanding" refers to techniques that allow users to deepen their legal knowledge and understanding by obtaining general information about the law.

[1411] "Means to support end-of-life preparations" are technologies that provide users with the information and support they need when preparing for the end of their life.

[1412] "Means for providing advice and links to web services that do not violate the Attorneys Act" refers to technology that provides general information about the law and recommends consulting with a professional, thereby providing advice that does not violate the Attorneys Act and links to appropriate web services.

[1413] "Means for analyzing human speech using natural language processing technology" refers to technology for acquiring the content of a user's speech as text data and analyzing that content.

[1414] "Means for recognizing human emotions using emotion recognition technology" refers to technology that identifies emotions from the user's speech and facial expressions, and provides appropriate support based on those emotions.

[1415] "Means for providing appropriate information and assistance based on analysis results" refers to technology that provides appropriate information and assistance to users based on analysis results obtained using natural language processing technology and emotion recognition technology.

[1416] A "means for supporting the creation of an ending note" is a technology that provides necessary questions and records the answers when a user creates an ending note.

[1417] "Means for storing data" refers to the technology used to store the user's answers and provided information in a database.

[1418] This invention is a system that uses natural language processing technology and emotion recognition technology to provide appropriate information and support to a user when preparing for an ending. Specific embodiments of this system are described below.

[1419] System configuration

[1420] Hardware

[1421] Server: A server equipped with a high-performance processor and large memory capacity is used to manage the database and perform natural language processing and emotion recognition.

[1422] Device: A device used by a user (smartphone, tablet, PC, etc.) that is capable of voice input and text display.

[1423] software

[1424] Natural language processing technology: Uses Google Cloud Natural Language API and IBM Watson Natural Language Understanding.

[1425] Emotion recognition technology: Uses Microsoft Azure Emotion API and Affectiva emotion recognition technology.

[1426] Speech Recognition Software: Uses Google Speech-to-Text API.

[1427] Database: Use MySQL (registered trademark) or PostgreSQL.

[1428] System Operation

[1429] 1. The user speaks

[1430] The user speaks a question or request to the system, such as "I want to know how to write a will."

[1431] 2. The device converts the speech into text data

[1432] The device converts the user's speech into text data using voice recognition software (Google Speech-to-Text API).

[1433] 3. The server receives the text data

[1434] The terminal transmits the converted text data to the server, which receives the data.

[1435] 4. The server analyzes the text data using natural language processing technology.

[1436] The server analyzes the received text data using Google Cloud Natural Language API and IBM Watson Natural Language Understanding, thereby understanding the content and intent of the text.

[1437] 5. The server recognizes the user's emotions using emotion recognition technology.

[1438] Based on the analysis results, the server uses the Microsoft Azure Emotion API and Affectiva's emotion recognition technology to recognize the user's emotions. For example, if a user says, "I'm thinking about writing a will," the server recognizes that the user is feeling anxious.

[1439] 6. The server provides appropriate information and assistance

[1440] The server then provides appropriate information based on the emotion it recognizes, such as, "You can create a will in several ways, such as a notarized will or a handwritten will. We recommend that you consult a professional for details."

[1441] 7. The server assists in creating the end-of-life note

[1442] To assist users in creating their end-of-life notes, the server generates and provides questions such as, "What would you like to tell your loved ones?" When the user answers, the content is recorded as an end-of-life note. Specifically, the server generates a question based on the user's emotion recognition result using a prompt sentence instructing the server to generate a question for creating the user's ending note and a generative AI model. The server presents the generated question to the user and accepts an answer to the question. At this time, the question may be generated based on the user's emotion recognition result using a prompt sentence instructing the server to generate a question for creating the user's ending note that promotes reflection on life, a change of perspective, or awareness, and a generative AI model. Example prompt sentence: "The user is feeling anxious. Please generate questions to help the user create an end-of-life note that will encourage reflection on life, change of thinking, or awareness."

[1443] 8. The server stores the data

[1444] The server stores the user's answers and provided information in a database (MySQL or PostgreSQL).

[1445] Specific examples

[1446] For example, a user might say, "I want to know how to write a will." The device converts this speech into text data using the Google Speech-to-Text API and sends it to the server. The server receives the text data and analyzes it using the Google Cloud Natural Language API. As a result, it understands that the user wants to know how to write a will.

[1447] Next, the server uses the Microsoft Azure Emotion API to recognize the user's emotions and determines that the user is feeling anxious. The server then provides information such as, "There are several ways to create a will, such as a notarized will or a handwritten will. We recommend that you consult a professional for details."

[1448] Furthermore, to help users create their end-of-life note, the server asks, "What would you like to tell your loved ones?" If the user answers, "I would like to express my gratitude to my family," the server saves the content of the end-of-life note in a MySQL database.

[1449] Example of user input

[1450] I want to know how to create a will

[1451] "I want help writing an ending note."

[1452] "I want to find a will-writing specialist."

[1453] By accepting these user inputs, the server provides appropriate information and support. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1454] Step 1:

[1455] The user speaks

[1456] The user speaks a question or request to the system, such as "I want to know how to write a will." The input is the user's voice, and the output is voice data.

[1457] Step 2:

[1458] The device converts the speech into text data

[1459] The device converts the user's speech into text data using speech recognition software (Google Speech-to-Text API). The input is voice data and the output is text data. Specifically, the device sends voice data to the API and receives the returned text data.

[1460] Step 3:

[1461] The server receives the text data.

[1462] The terminal sends the converted text data to the server. The server receives this data. The input is text data, and the output is text data stored in the server. In concrete terms, the terminal sends the text data to the server using an HTTP request, and the server receives the request.

[1463] Step 4:

[1464] The server analyzes the text data using natural language processing technology.

[1465] The server analyzes the received text data using Google Cloud Natural Language API or IBM Watson Natural Language Understanding. The input is text data, and the output is the analysis results. Specifically, the server sends the text data to the API and receives the analysis results in return.

[1466] Step 5:

[1467] The server recognizes the user's emotions using emotion recognition technology.

[1468] The server uses the analysis results to recognize the user's emotions using the Microsoft Azure Emotion API and Affectiva's emotion recognition technology. The input is the analysis results, and the output is the emotion recognition results. Specifically, the server sends the analysis results to the API and receives the emotion recognition results in return.

[1469] Step 6:

[1470] The server provides appropriate information and assistance

[1471] The server provides appropriate information based on the recognized emotion. For example, it may provide information such as, "You can create a will in several ways, such as a notarized will or a handwritten will. We recommend that you consult a specialist for details." The input is the emotion recognition result, and the output is an informational message. Specifically, the server generates an appropriate message based on the emotion recognition result and sends it to the user.

[1472] Step 7:

[1473] The server assists in creating an end-of-life note.

[1474] To assist in the creation of an Ending Note, the server provides the user with questions such as "What would you like to tell your loved ones?" When the user answers, the content is recorded as an Ending Note. The input is the user's answer, and the output is the text data of the Ending Note. Specifically, the server generates questions, receives the user's answers, and saves them.

[1475] Step 8:

[1476] The server stores the data

[1477] The server stores the user's answers and provided information in a database (MySQL or PostgreSQL). The input is the text data of the ending note and the informational message, and the output is the data stored in the database. Specifically, the server executes an INSERT query on the database and saves the data. The server may further include means for collecting the recorded answers, means for generating the proposed content of the ending preparation using a prompt sentence that instructs the server to propose content for preparing the ending based on the answer collection result and the generative AI model, and means for presenting the proposed content of the ending preparation to the user. Specifically, the server collects the recorded answers, generates the proposed content of the ending preparation based on the answer collection result using a prompt sentence that instructs the server to propose content for preparing the ending based on the answer collection result and the generative AI model, and presents the proposed content of the ending preparation to the user. Example prompt sentence: After collecting the user's answers to the questions for creating an Ending Note, the system accepts the results as input and asks, "Based on these user answers, please suggest the contents of the end-of-life preparations the user should make toward the end of their life."

[1478] (Application example 3)

[1479] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1480] In modern society, it is important to create an end-of-life note and deepen legal understanding, but many people often feel anxious or resistant to these tasks. Also, while there are tools and systems to support the creation of end-of-life notes, few utilize emotion or voice recognition, and support that is sensitive to the user's emotions is lacking. Furthermore, interactive support systems using smart devices are not widely available, so the environment for easy use by users is not yet in place.

[1481] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes means for enabling chat and consultation between humans and AI, means for promoting life reflection, changing perspectives, and awareness, means for deepening legal understanding, means for supporting end-of-life preparations, means for providing advice that does not violate the Attorneys Act and guidance to web services, means for performing emotion recognition, means for performing voice recognition, means for creating an end-of-life note, and means for collecting user responses using a smart device. This enables users to create an end-of-life note and deepen their legal understanding while receiving emotionally sensitive support.

[1482] "Means that enable chatting and consultation between humans and AI" refers to technology that enables AI to generate appropriate responses to human speech and engage in dialogue.

[1483] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that supports users in reviewing their past experiences and ways of thinking, and gaining new perspectives and discoveries.

[1484] "Means for deepening legal understanding" are technologies that provide users with general information about the law and deepen their legal knowledge.

[1485] "Means to support preparation for ending" refers to technology that provides users with the information and support they need when creating their own ending note.

[1486] "Means for providing advice and links to web services that do not violate the Lawyers Act" refers to technology that provides general information about the law and recommends consulting a legal expert.

[1487] "Means for emotion recognition" refers to technology for analyzing and recognizing emotions from a user's speech and behavior.

[1488] "Means for performing speech recognition" refers to technology for converting a user's speech into text.

[1489] "Means for creating an ending note" refers to technology for collecting users' responses and saving them as an ending note.

[1490] "Means for collecting user responses using smart devices" refers to technology that uses devices such as smart glasses or smartphones to interactively collect user responses.

[1491] The system for implementing the present invention uses the following hardware and software.

[1492] Hardware

[1493] Smart Glasses

[1494] microphone

[1495] server

[1496] software

[1497] Python

[1498] SpeechRecognition Library

[1499] Transformers library

[1500] System configuration

[1501] In this system, users wear smart glasses and engage in interactive dialogue to assist in the creation of an end-of-life note. The user's speech is collected through a microphone and sent to a server. The server performs speech recognition and converts it into text data. Furthermore, a generative AI model is used to recognize emotions and provide appropriate support based on the user's emotions.

[1502] Processing flow

[1503] 1. Speech Recognition: When a user answers a question through the smart glasses, the voice data is collected by the microphone. The server converts the voice data into text using the SpeechRecognition library.

[1504] 2. Emotion Recognition: The converted text data is subjected to emotion recognition using the Transformers library, which analyzes and recognizes emotions from user responses.

[1505] 3. Creation of an Ending Note: The user's answers and the emotion recognition results are saved on the server as an Ending Note, allowing the user to create an Ending Note while receiving emotional support.

[1506] Specific examples

[1507] The user puts on the smart glasses and answers questions such as:

[1508] Question: "What would you like to say to your loved one?"

[1509] User Answer: "I want to express my gratitude to my family."

[1510] The emotion recognition model judges this answer as "positive" and saves it in the ending note.

[1511] Prompt Sentence Examples

[1512] "What would you like to say to your loved one?"

[1513] This prompt sentence is input into a generative AI model to collect user responses and perform emotion recognition.

[1514] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1515] Step 1:

[1516] The user wears the smart glasses and answers questions to create an end-of-life note. The user's speech is collected as voice data through a microphone. The input is the user's voice, and the output is voice data.

[1517] Step 2:

[1518] The device sends the collected voice data to the server, which converts the voice data into text data using the SpeechRecognition library. The input is voice data, and the output is text data.

[1519] Step 3:

[1520] The server inputs the converted text data into a generative AI model for emotion recognition. It uses the Transformers library to analyze and recognize emotions from text data. The input is text data, and the output is the emotion recognition results.

[1521] Step 4:

[1522] The server saves the user's answers and the emotion recognition results as an ending note. The input is text data and the emotion recognition results, and the output is the ending note data.

[1523] Step 5:

[1524] The server feeds back the data of the Ending Note to the user, who can check the contents of the Ending Note through smart glasses. The input is the data of the Ending Note, and the output is the user's visual information.

[1525] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1526] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generative AIs. Data generation models 58

[1527] , obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in the data format of voice data, text data, etc. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1528] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[1529] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1530] [Third embodiment]

[1531] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1532] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1533] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure.

[1534] The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1535] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1536] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1537] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1538] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1539] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1540] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1541] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1542] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1543] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1544] "Example 1"

[1545] In one embodiment of the present invention, a means for enabling chatting and consultation with AI uses natural language processing technology to analyze human utterances and generate appropriate responses. Specifically, if a human says, "I'm thinking about writing a will," the AI ​​will generate a response such as, "Wills are an important procedure. What specifically are you considering?"

[1546] "Example 2"

[1547] Furthermore, as a means of encouraging reflection on life, a change of perspective, and awareness, AI can provide points of reflection and new perspectives to human speech. For example, if a human says, "Work hasn't been going well lately," the AI ​​can provide questions such as, "That's tough. Have you had any successful experiences in the past? Is there anything you can learn from those experiences?"

[1548] "Example 3"

[1549] Furthermore, as a means of deepening legal understanding, the AI ​​provides general information about the law. For example, if a human says, "I want to know how to write a will," the AI ​​will provide information such as, "There are several ways to write a will, such as a notarized will or a handwritten will. We recommend that you consult an expert for details."

[1550] "Example 4"

[1551] Additionally, as a means of assisting with end-of-life preparations, AI will assist in the creation of an end-of-life note. Specifically, it will provide questions for each item in the end-of-life note and record the human's answers. For example, it will provide questions such as "What would you like to tell your loved ones?" and save the answers as an end-of-life note.

[1552] "Example 5"

[1553] Finally, as a means of providing advice and guidance to web services that do not violate the Lawyers Act, the AI ​​provides general information about the law, recommends consulting a professional, and provides links to appropriate web services, such as a link to a web service for finding a will-writing professional.

[1554] The processing flow of each embodiment will be described below.

[1555] "Example 1"

[1556] Step 1: The AI ​​analyzes human speech using natural language processing technology.

[1557] Step 2: The AI ​​generates an appropriate response based on the analysis results. For example, if a human says, "I'm thinking about writing a will," the AI ​​will generate a response such as, "Willing is an important procedure. What specifically are you considering?"

[1558] "Example 2"

[1559] Step 1: The AI ​​analyzes human speech using natural language processing technology.

[1560] Step 2: The AI ​​provides points for reflection and new perspectives based on the analysis results. For example, if a human says, "Work hasn't been going well lately," the AI ​​will provide questions such as, "That's tough. Have you had any previous successes? Is there anything you can learn from those experiences?"

[1561] "Example 3"

[1562] Step 1: The AI ​​analyzes human speech using natural language processing technology.

[1563] Step 2: The AI ​​provides general legal information based on the analysis results. For example, if a human says, "I want to know how to write a will," the AI ​​will provide information such as, "There are several ways to write a will, such as a notarized will or a handwritten will. We recommend that you consult a specialist for details."

[1564] "Example 4"

[1565] Step 1: The AI ​​provides questions for each item in the end-of-life note.

[1566] Step 2: The AI ​​records the human's answers and saves them as an end-of-life note. For example, it provides questions such as, "What would you like to tell your loved one?" and saves the answers as an end-of-life note.

[1567] "Example 5"

[1568] Step 1: The AI ​​provides general information about the law and recommends consulting an expert.

[1569] Step 2: The AI ​​provides a link to an appropriate web service, such as a link to a web service for finding a will-writing expert.

[1570] Example 1

[1571] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1572] Conventional AI systems have had difficulty generating appropriate responses when chatting or consulting with users. Furthermore, they lacked the technology to accurately analyze user utterances and generate appropriate prompts, resulting in a decline in the quality of responses. Furthermore, they did not provide sufficient support for preparing the ending or deepening legal understanding.

[1573] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1574] In this invention, the server includes means for analyzing user utterances and generating appropriate responses, means for analyzing utterance data using natural language processing technology, means for inputting prompt sentences into a generative AI model to generate responses, and means for displaying the generated responses to the user, thereby enabling the server to generate high-quality responses in casual conversations and consultations with users.

[1575] "Means enabling chatting and consultation between humans and AI" refers to technology that allows users to have natural conversations with AI, exchanging information and solving problems through chatting and consultation.

[1576] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that helps users reflect on their past experiences and gain new perspectives and ideas.

[1577] "Means for deepening legal understanding" are techniques that allow users to deepen their knowledge of the law and promote their understanding of legal issues.

[1578] "Means to support preparation for ending" are technologies that support users in making preparations for the end of their lives.

[1579] "Means for providing legally compliant advice and guidance to web services" refers to technology that provides users with legally compliant advice and introduces appropriate web services.

[1580] The "means for analyzing user utterances and generating an appropriate response" is a technology for analyzing the content of a user utterance and generating an appropriate response based on that content.

[1581] The "means for analyzing speech data using natural language processing technology" is a technology that uses natural language processing technology to analyze user speech data and extract the intention of the speech and keywords.

[1582] "Means for inputting a prompt sentence into a generative AI model to generate a response" refers to a technology that inputs a prompt sentence into a generative AI model and generates an appropriate response based on that prompt sentence.

[1583] The "means for displaying the generated response to the user" is a technique for transmitting the generated response to the user's terminal and displaying it to the user.

[1584] This invention is a system that allows users to have natural conversations with artificial intelligence, exchanging information and solving problems through casual conversations and consultations. The system includes technology for analyzing user utterances and generating appropriate responses.

[1585] Hardware and software used

[1586] Hardware:

[1587] A server (with a high-performance CPU and sufficient memory)

[1588] software:

[1589] Natural language processing libraries (e.g., spaCy, NLTK)

[1590] Generative AI models (e.g., GPT-4)

[1591] Program processing

[1592] The server receives speech data from the user. Specifically, the user utters "I'm thinking about my will" through a device (such as a smartphone or PC). This speech data is sent from the device to the server.

[1593] The server analyzes the received speech data using a natural language processing library. As a result of the analysis, it extracts the intention of the speech and keywords. Next, it generates a prompt sentence for a generative AI model (such as GPT-4) based on the extracted information. This prompt sentence serves as an instruction for the AI ​​model to generate an appropriate response.

[1594] The generative AI model receives a prompt as input and generates an appropriate response. For example, in response to the utterance "I'm thinking about writing a will," it generates the response "A will is an important procedure. What specifically are you considering?"

[1595] Finally, the server sends the generated response to the user's terminal, where it is displayed to the user.

[1596] Specific examples

[1597] User utterance: "I'm thinking about my will."

[1598] What the device does: Converts speech to text and sends it to the server

[1599] Server analysis: Extract the keyword "will" and the intent "thinking"

[1600] Generate prompt: "The user says they're thinking about a will. Generate an appropriate response about a will."

[1601] The generative AI model responded: "A will is an important procedure. What specifically are you considering?"

[1602] Server Send: Sends the response to the device

[1603] Display terminal: Display the response to the user

[1604] In this way, users can chat and consult with AI.

[1605] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1606] Step 1:

[1607] The user speaks.

[1608] Specific operation: The user uses a device (such as a smartphone or PC) to speak to the system. For example, the user might say, "I'm thinking about my will."

[1609] Input: User's voice data

[1610] Output: Audio data sent to the device

[1611] Step 2:

[1612] The terminal transmits the speech data to the server.

[1613] Specific operation: The device captures the user's speech as audio data and converts it into text data, which is then sent to a server via the Internet.

[1614] Input: User's voice data

[1615] Output: Text data sent to the server

[1616] Step 3:

[1617] The server analyzes the speech data.

[1618] Specific operation: The server analyzes the received text data using a natural language processing library (e.g., spaCy, NLTK). As a result of the analysis, the intention of the utterance and keywords are extracted. For example, the keyword "will" and the intention of "thinking" are extracted.

[1619] Input: Text data

[1620] Output: Extracted intents and keywords

[1621] Step 4:

[1622] The server generates a prompt.

[1623] Specific operation: The server generates a prompt based on the extracted information. This prompt serves as an instruction for the generative AI model to generate an appropriate response. For example, it generates a prompt such as, "The user says they are thinking about a will. Please generate an appropriate response regarding a will."

[1624] Input: Extracted intents and keywords

[1625] Output: prompt statement

[1626] Step 5:

[1627] The server inputs a prompt sentence into the generative AI model.

[1628] Specific operation: The server inputs the generated prompt sentence into a generative AI model (e.g., GPT-4), which generates a response based on the prompt sentence.

[1629] Input: prompt statement

[1630] Output: The prompt sentence that is fed into the generative AI model

[1631] Step 6:

[1632] A generative AI model generates a response.

[1633] Specific behavior: The generative AI model generates an appropriate response based on the prompt sentence, for example, "A will is an important procedure. What specifically are you considering?"

[1634] Input: prompt statement

[1635] Output: The generated response

[1636] Step 7:

[1637] The server sends the generated response to the terminal.

[1638] Specific operation: The server sends the response obtained from the generative AI model to the user's device. The response is sent as text data.

[1639] Input: The generated response

[1640] Output: Text data sent to the terminal

[1641] Step 8:

[1642] The terminal displays the response to the user.

[1643] Specific operation: The terminal displays the received response to the user, who can check the response on the terminal screen.

[1644] Input: Text data sent to the terminal

[1645] Output: The response that is displayed to the user

[1646] (Application example 1)

[1647] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1648] In modern society, individuals face a wide range of problems and worries. In particular, many issues require specialized knowledge, such as life reflection, end-of-life preparations, legal understanding, and even security consultations in everyday life. However, obtaining appropriate advice on these issues is not easy, and consulting with experts takes time and money. Furthermore, there is a demand for advice that does not violate the Lawyers Act, and for people to be directed to appropriate web services. To solve these issues, an efficient and effective system that utilizes AI is needed.

[1649] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1650] In this invention, the server includes a means for enabling chats and consultations between humans and AI, a means for encouraging life reflection, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting preparations for endings, a means for providing advice that does not violate the Lawyers Act and guidance to web services, and a means for consulting AI about security issues. This allows users to efficiently and effectively obtain appropriate advice for a wide range of problems and concerns.

[1651] "Means that enable casual conversation and consultation" refers to a means that uses natural language processing technology to analyze human speech and generate appropriate responses.

[1652] "A means to promote reflection on life, a change of perspective, and awareness" is a means to help users reevaluate their past experiences and thoughts and gain new perspectives and awareness.

[1653] "Means to deepen legal understanding" are means of providing information and explanations to help users understand legal concepts and procedures.

[1654] "Means to support preparation for ending" are means to provide users with the information and guidelines they need when creating their own ending notes.

[1655] "Means of providing advice and directing users to web services that do not violate the Attorneys Act" refers to means of providing information and directing users to appropriate web services when providing legal advice, within the scope of the Attorneys Act.

[1656] "A means for consulting AI about security issues" refers to a means by which users can consult AI about security issues and concerns in their daily lives and receive appropriate advice.

[1657] The system for implementing this invention consists of three main elements: a server, a terminal, and a user. The following explains how each element functions.

[1658] server

[1659] The server is responsible for analyzing the user's speech using a generative AI model and generating an appropriate response. Specifically, the server uses the following software and hardware:

[1660] Software: Python, OpenAI GPT-3 API

[1661] Hardware: A server machine with a powerful processor and sufficient memory

[1662] The server receives the text data sent by the user and inputs it into the generative AI model, which analyzes the prompt and generates an appropriate response. The generated response is then sent back to the user's device.

[1663] Terminal

[1664] The terminal provides the interface through which the user communicates with the server. The terminal uses the following software and hardware:

[1665] Software: Web browser or dedicated mobile application

[1666] Hardware: Smartphone, tablet, or computer

[1667] The user inputs security questions and other inquiries through the terminal. The input text data is sent to the server via the Internet. The response from the server is also displayed to the user through the terminal.

[1668] User

[1669] Users interact with the system using a terminal. They input questions for security consultations, life reflections, or legal understanding. For example:

[1670] Example prompt sentence:

[1671] User: I've been worried about the security of my home lately.

[1672] AI:

[1673] An example of the response generated:

[1674] AI: So you're concerned about home security. What are you specifically concerned about? For example, we can talk about locking doors and windows, installing security cameras, etc.

[1675] In this way, users can efficiently and effectively obtain appropriate advice for a wide range of problems and concerns.

[1676] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1677] Step 1:

[1678] The user uses the terminal to enter security questions and other questions.

[1679] Input: User text input (e.g., "I've been worried about the security of my home lately.")

[1680] Operation: Obtains the user's text data through the device's input interface.

[1681] Output: The user's text data is saved to the device.

[1682] Step 2:

[1683] The terminal transmits the user's text data to the server.

[1684] Input: User's text data

[1685] How it works: The device sends the user's text data to a server via the Internet.

[1686] Output: The user's text data arrives at the server.

[1687] Step 3:

[1688] The server receives the user's text data and generates prompt sentences to input into the generative AI model.

[1689] Input: User's text data

[1690] How it works: The server analyzes the user's text data and generates a prompt appropriate for the generative AI model.

[1691] Output: Prompt text (e.g. "User: I've been worried about the security of my home lately\nAI:")

[1692] Step 4:

[1693] The server uses a generative AI model to generate an appropriate response based on the prompt sentence.

[1694] Input: prompt statement

[1695] How it works: The server calls the OpenAI GPT-3 API, taking the prompt sentence as input and generating an appropriate response.

[1696] Output: The generated response (e.g., "AI: I understand you're concerned about the security of your home. What specifically are you concerned about?")

[1697] Step 5:

[1698] The server sends the generated response to the terminal.

[1699] Input: The generated response

[1700] How it works: The server sends the generated response to the device over the Internet.

[1701] Output: The generated response arrives at the terminal.

[1702] Step 6:

[1703] The terminal displays the generated response to the user.

[1704] Input: The generated response

[1705] Action: The device displays the generated response to the user through the user interface.

[1706] Output: The user sees the generated response.

[1707] Example 2

[1708] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1709] In modern society, people are faced with a variety of problems and worries, and support is needed to solve them. In particular, there is a lack of means to encourage reflection on life, a change of perspective, and awareness. There is also a need for means to deepen legal understanding and support for preparing for the end of life. Furthermore, when providing this support, there is a need to provide advice that does not violate the law and to guide users to web services. To solve these issues, a system is needed that receives user utterances, uses a generative AI model to generate an appropriate response, and provides it to the user.

[1710] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1711] In this invention, the server includes a means for enabling dialogue between humans and AI, a means for encouraging reflection on life, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting preparation for endings, a means for providing legal advice and guidance to web services, a means for receiving user utterances and inputting prompt sentences into a generative AI model to generate responses, and a means for displaying the generated responses to the user, thereby enabling the user to gain new perspectives on the content of their utterances and identify areas for reflection.

[1712] "Means enabling dialogue between humans and artificial intelligence" refers to technology that enables artificial intelligence to understand what humans say and generate appropriate responses.

[1713] "A means to promote reflection on life, a change of perspective, and awareness" is a technology that helps users reexamine their past experiences and ways of thinking and gain new perspectives and insights.

[1714] "Means for deepening legal understanding" refers to techniques that provide information and explanations to help users deepen their knowledge of the law.

[1715] "Means for supporting end-of-life preparations" are technologies that provide support for users to prepare for their own end-of-life.

[1716] "Means for providing legally compliant advice and guidance to web services" refers to techniques for providing advice to users and introducing appropriate web services within the scope of legally compliant advice.

[1717] "Means for receiving user utterances and inputting prompt sentences into a generative AI model to generate a response" refers to a technology that receives the content of a user's utterance as text data, inputs it into a generative AI model, and generates an appropriate response.

[1718] "Means for displaying the generated reaction to the user" refers to technology for displaying the reaction generated by the generative AI model on the user's device.

[1719] This invention is a system that receives a user's utterance, generates an appropriate response using a generative AI model, and provides the response to the user. Specific embodiments of this system will be described below.

[1720] First, the user uses the terminal to input their thoughts or worries by voice or text. For example, consider the case where the user says, "Recently, things haven't been going well at work."

[1721] The server then receives the speech data sent from the user's device. If the received data is audio, the server uses speech recognition software (e.g., a speech recognition API) to convert it into text data. This text data forms the basis of the prompt sentences to be input into the generative AI model.

[1722] The server generates a prompt sentence to be input to the generative AI model based on the converted text data. For example, it generates a prompt sentence such as, "The user says that work hasn't been going well recently. What lessons or new perspectives can you offer?"

[1723] A generative AI model (e.g., a natural language processing model) receives the prompt sent from the server and generates an appropriate response based on it, such as, "That's tough. Have you had any previous successes? Is there anything you can learn from those experiences?"

[1724] The server receives the responses generated by the generative AI model and sends them to the user's device, formatting the data as needed.

[1725] Finally, the device displays the response of the generated AI model received from the server to the user, who can then gain a new perspective on their own utterances or identify areas for improvement.

[1726] This system allows users to gain a new perspective on their own speech, encouraging them to reflect on their lives, change their way of thinking, and become more aware of their surroundings. It also provides a means to deepen legal understanding and support end-of-life preparations, allowing users to receive appropriate support for a variety of problems and concerns.

[1727] As a specific example, if a user says, "Work hasn't been going well lately," the server inputs this utterance as text data into the generative AI model. An example of a prompt would be, "The user says that work hasn't been going well lately. What lessons can you learn from this or a new perspective?" Based on this prompt, the generative AI model generates a response such as, "That's tough. Have you had any previous successes? Is there anything we can learn from those experiences?" The server then sends this response to the user's device, which then displays it to the user.

[1728] In this way, users can receive responses from the generative AI model and gain a new perspective on what they have said.

[1729] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1730] Step 1:

[1731] A user uses a terminal to input their thoughts or worries by voice or text. For example, the user might say, "Work hasn't been going well recently." The input is voice data or text data.

[1732] Step 2:

[1733] The server receives speech data sent from the user's device. If the received data is voice, the server converts it into text data using speech recognition software (e.g., a speech recognition API). The input is voice data, and the output is text data.

[1734] Step 3:

[1735] The server generates a prompt sentence to be input to the generative AI model based on the converted text data. For example, it generates a prompt sentence such as, "The user says that work hasn't been going well recently. What lessons or new perspectives can you offer?" The input is text data, and the output is a prompt sentence.

[1736] Step 4:

[1737] The server inputs the generated prompt sentence into a generative AI model. The generative AI model (e.g., a natural language processing model) generates an appropriate response based on the prompt sentence. The input is the prompt sentence, and the output is the generated response.

[1738] Step 5:

[1739] The server receives the responses generated by the generative AI model and sends them to the user's device, formatting the data as needed. The input is the generated response, and the output is the formatted response.

[1740] Step 6:

[1741] The device receives the generative AI model's responses from the server and displays them to the user. The user can then view the responses to gain new perspectives on their own utterances and identify areas for improvement. The input is the formatted response, and the output is the response displayed to the user.

[1742] (Application example 2)

[1743] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1744] In modern brick-and-mortar stores, it is important for customer service staff to communicate smoothly with customers. However, there is a lack of means to gain appropriate reflection and new perspectives in real time when staff have questions or problems while serving customers. This is an issue that delays staff self-improvement and learning new customer service methods.

[1745] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1746] In this invention, the server includes a means for enabling chats and consultations between humans and AI, a means for encouraging life reflection, a change of perspective, and awareness, a means for deepening legal understanding, a means for supporting end-of-life preparations, a means for providing advice that does not violate the Attorneys Act and guidance to web services, a means used by customer service staff in physical stores through smart glasses, and a means for the AI ​​to provide points for reflection and new perspectives in real time in response to questions or problems that the staff have while serving customers, thereby enabling customer service staff to obtain hints for self-improvement in real time.

[1747] "Means that enable chatting and consultation between humans and AI" refers to technology that enables AI to generate appropriate responses to what humans say and continue the dialogue.

[1748] "A means to promote life reflection, change of perspective, and awareness" is a technology that helps users reevaluate past experiences and current situations and gain new perspectives and insights.

[1749] "Means to deepen legal understanding" refers to techniques that provide information and explanations to help users understand legal concepts and rules.

[1750] "Means to support end-of-life preparation" refers to technology that provides users with the information and support they need to prepare for their own end-of-life.

[1751] "Means of providing advice and guidance to web services that do not violate the Attorneys Act" refers to technology that provides information when providing legal advice within the scope of the Attorneys Act and guides users to appropriate web services.

[1752] "Methods used by customer service staff in brick-and-mortar stores through smart glasses" refers to technology in which customer service staff working in brick-and-mortar stores wear smart glasses and acquire and use information through the glasses.

[1753] "A means for AI to provide points of reflection and new perspectives in real time in response to questions or problems that staff have while serving customers" is a technology in which AI instantly presents appropriate points of reflection and new perspectives in response to questions or problems that staff have while serving customers.

[1754] A system for implementing the present invention includes an application for use by wait staff through smart glasses. A specific embodiment of this system is described below.

[1755] System Configuration

[1756] The system consists of the following major components:

[1757] 1. Smart glasses: devices worn by wait staff that have voice input and display capabilities (e.g., Google Glass).

[1758] 2. Server: Hosts the generative AI model and generates responses to the customer service staff's utterances.

[1759] 3. Generative AI model: Using the OpenAI API, we generate points of reflection and new perspectives on the customer service staff's utterances.

[1760] Program processing

[1761] Hardware and Software

[1762] Smart glasses: Takes voice input and displays information on a display.

[1763] Server: Hosts the generative AI model and converts voice input to text.

[1764] Generative AI model: Uses OpenAI APIs to generate appropriate responses based on text input.

[1765] Data processing and calculation

[1766] 1. Acquiring voice input: The speech of the customer service staff is acquired as voice data through the microphone in the smart glasses.

[1767] 2. Speech recognition: The server converts the voice data into text data.

[1768] 3. Prompt generation: Based on the text data, a prompt is generated to be sent to the generative AI model.

[1769] 4. Response generation: A generative AI model generates a response based on the prompt, including reflections and new perspectives.

[1770] 5. Displaying the response: Display the generated response on the display of the smart glasses.

[1771] Specific examples

[1772] If a customer service staff member says, "Recently, I've been having trouble communicating with customers," the system will operate as follows:

[1773] 1. The smart glasses capture the speech as audio data.

[1774] 2. The server converts the audio data into text data.

[1775] 3. Generate the following prompt based on the text data:

[1776] A user said, "Recently, I've been having trouble communicating with customers." Please provide some reflections or new perspectives.

[1777] 4. The generative AI model generates a response based on the prompt, such as, "That's tough. What are some of the experiences you've had where you successfully communicated with someone before? Is there anything you can learn from that experience?"

[1778] 5. The generated response is displayed on the smart glasses display, allowing the wait staff to see it in real time.

[1779] In this way, customer service staff can get real-time tips for self-improvement.

[1780] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1781] Step 1:

[1782] The smart glasses capture the speech of the customer service staff as voice data.

[1783] Input: Customer service staff's speech (audio)

[1784] Output: Audio data

[1785] Specific operation: The microphone in the smart glasses captures the speech of the customer service staff and saves it as audio data.

[1786] Step 2:

[1787] The server converts the voice data into text data.

[1788] Input: Audio data

[1789] Output: Text data

[1790] What happens: The server uses speech recognition software (e.g., Google Cloud Speech-to-Text API) to convert the voice data into text data.

[1791] Step 3:

[1792] The server generates a prompt based on the text data.

[1793] Input: Text data

[1794] Output: prompt statement

[1795] Specific operation: The server analyzes the text data and generates a prompt to send to the generative AI model. For example, it generates a prompt such as, "The user said, 'Recently, I've been having trouble communicating with customers.' Please provide any points of reflection or new perspectives."

[1796] Step 4:

[1797] The server generates a response using a generative AI model.

[1798] Input: prompt statement

[1799] Output: Response text

[1800] Specific operation: The server calls the OpenAI API, sends a prompt, and generates a response text. The generated response text might be something like, "That's difficult. Have you had any successful communication experiences in the past? Is there anything you can learn from those experiences?"

[1801] Step 5:

[1802] The server sends the generated response text to the smart glasses.

[1803] Input: Response text

[1804] Output: Data sent to smart glasses

[1805] Specific operation: The server converts the response text into a data format for transmission to the smart glasses, and transmits it to the smart glasses through the network.

[1806] Step 6:

[1807] The smart glasses display the response text on the display.

[1808] Input: Data to be sent to smart glasses

[1809] Output: Response text displayed on the display

[1810] How it works: The smart glasses analyze the received data and display a response text on the screen, which the wait staff can view in real time.

[1811] Example 3

[1812] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1813] In modern society, it is important to deepen legal understanding and prepare for the end of life, but there are only a limited number of systems that provide this information appropriately and that allow users to easily access it. There is also a need for advice and guidance to specialists in a manner that does not violate the Lawyers Act. Furthermore, when users create an end-of-life note, they also need a means to pose appropriate questions and record the answers. A comprehensive system is needed to solve these issues.

[1814] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1815] In this invention, the server includes means for enabling dialogue between humans and artificial intelligence, means for promoting life reflection, a change of perspective, and awareness, means for deepening legal understanding, means for supporting preparations for the end of one's life, means for providing advice that does not violate the Attorneys' Act and guidance to online services, means for analyzing user input, means for generating appropriate information based on the analysis results, means for providing the generated information to the user, means for generating questions for each item in the end-of-life note and recording the user's answers, and means for providing links to experts and online services. This allows users to easily obtain legal information, receive support in creating their end-of-life note, and access appropriate experts and online services.

[1816] "Means enabling dialogue between humans and artificial intelligence" refers to the ability for humans to communicate with artificial intelligence in natural language.

[1817] "A means to promote reflection on life, a change of perspective, and awareness" refers to a function that helps users reexamine their past experiences and ways of thinking and gain new perspectives and insights.

[1818] "Means for deepening legal understanding" refers to functions that help users obtain general information about the law and deepen their legal knowledge.

[1819] "Means to support preparation for ending" refers to a function that supports the user in preparing for the end of their life.

[1820] "Means of providing advice or links to online services that do not violate the Lawyers Act" refers to functions that provide general information about the law, recommend consulting a professional, and provide links to appropriate online services.

[1821] "Means for analyzing user input" refers to technology for analyzing text or voice input from a user and understanding its content.

[1822] "Means for generating appropriate information based on the analysis results" refers to technology that generates appropriate responses or information based on the results of analyzing the user's input.

[1823] "Means for providing generated information to a user" refers to a function for displaying or transmitting generated responses or information to a user.

[1824] "Means for generating questions for each item in the ending note and recording the user's answers" refers to the function of generating questions necessary for creating the ending note and recording the user's answers.

[1825] "Means for providing links to experts and online services" refers to a function that provides access links to experts and related online services that users need.

[1826] MODE FOR CARRYING OUT THE INVENTION

[1827] This invention is a system that helps users deepen their legal understanding, assists them in creating an end-of-life note, and provides them with access to appropriate experts and online services. This system operates in cooperation with three parties: a server, a terminal, and a user.

[1828] Generate a program for the system

[1829] The server uses the generative AI model to generate a program to deepen the user's legal understanding. The program provides general information about the law, assists in creating an end-of-life note, and provides advice that does not violate the Attorneys' Act and directs users to appropriate online services.

[1830] Explaining the program's processing in natural language

[1831] The server performs the following process.

[1832] 1. Accepting user input

[1833] The user inputs questions or requests into the system through a terminal, for example, by saying, "I want to know how to write a will."

[1834] 2. Parse the input

[1835] The server analyzes the input received from the user using natural language processing (NLP) techniques, specifically tokenizing the input text and extracting meaning.

[1836] 3. Generate the right information

[1837] The server uses the generative AI model to generate appropriate information based on the analysis results. For example, if a user inputs "I want to know how to write a will," the generative AI model will generate a response such as "There are several ways to write a will, such as a notarized will or a handwritten will. We recommend consulting an expert for details."

[1838] 4. Provide information to users

[1839] The server sends the generated information to the terminal and displays it to the user, who can check the information on the screen of the terminal.

[1840] 5. Support for creating an end-of-life note

[1841] The server generates questions for each item in the Ending Note and provides them to the user. For example, it asks questions such as, "What would you like to tell your loved ones?" and saves the user's answers as the Ending Note.

[1842] 6. Referrals to experts and online services

[1843] The server provides general legal information, recommends consulting a legal professional, and provides links to appropriate online services, such as a link to an online service for finding a will-writing professional.

[1844] Specific examples

[1845] A specific example will be given below in which the user says, "I want to know how to write a will."

[1846] Examples:

[1847] User utterance: "I want to know how to create a will."

[1848] Server response: "A will can be created in several ways, including a notarized will or a handwritten will. We recommend consulting a professional for more information."

[1849] Example prompts to input to a generative AI model:

[1850] "Generate a response when a user says they want to know how to create a will."

[1851] This system allows users to easily obtain legal information, assists in creating an end-of-life note, and provides access to appropriate experts and online services. The flow of the identification process in Example 3 will be described with reference to Figure 15.

[1852] Step 1:

[1853] The user inputs a question or request into the system through the terminal. For example, they might say, "I want to know how to write a will." The terminal then sends this voice data to the server.

[1854] Step 2:

[1855] The server converts the received voice data into text using voice recognition technology. The converted text is "I would like to know how to write a will."

[1856] Step 3:

[1857] The server analyzes the converted text using natural language processing (NLP) techniques, specifically tokenizing the text and extracting meaning. The analysis results indicate that the user is seeking information on how to write a will.

[1858] Step 4:

[1859] The server uses a generative AI model to generate appropriate information based on the analysis results. The prompt text is "Generate a response when a user says they want to know how to create a will," and the generative AI model generates a response such as "A will can be created in several ways, such as a notarized will or a handwritten will. We recommend consulting an expert for details."

[1860] Step 5:

[1861] The server sends the generated response to the terminal. The terminal displays this information to the user. The user confirms the following information on the terminal screen: "A will can be created in several ways, such as a notarized will or a handwritten will. We recommend that you consult a professional for details."

[1862] Step 6:

[1863] The server generates questions for each item in the end-of-life note and sends them to the terminal. For example, it generates a question such as, "What would you like to tell your loved ones?" In response to this question, the user might enter, "I would like to express my gratitude to my family." The terminal then sends this answer to the server.

[1864] Step 7:

[1865] The server saves the user's answers as an ending note, which the user can review later.

[1866] Step 8:

[1867] The server provides general legal information and recommends consulting a legal expert. It also generates a link to an appropriate online service and sends it to the terminal. For example, it provides a link to an online service for finding a legal expert. The user clicks the link to access the online service for finding a legal expert.

[1868] (Application example 3)

[1869] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1870] In modern society, it is important to obtain legal information quickly and accurately, but consulting with an expert takes time and money. There is also a lack of means to support end-of-life preparations, such as creating an end-of-life note or preparing a will. Furthermore, when providing this information, it is necessary to ensure that it does not violate the Attorneys Act. To solve these issues, a system is needed that provides legal information in real time using smart devices and supports the creation of an end-of-life note.

[1871] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1872] In this invention, the server includes means for enabling chat and consultation between humans and AI, means for promoting life reflection, mindset change, and awareness, means for deepening legal understanding, means for supporting preparations for the end of life, means for providing advice that does not violate the Attorneys Act and links to web services, means for providing legal information in real time using a smart device, means for providing questions to support the creation of an end-of-life note and recording the answers, and means for acquiring legal information using a generative AI model.This enables users to quickly and accurately obtain legal information through their smart devices and efficiently create an end-of-life note.

[1873] "Means that enable casual conversation and consultation" is a function that allows humans and AI to exchange information and opinions through natural conversation.

[1874] "A means to promote reflection on life, a change of perspective, and awareness" is a function that helps users reflect on their past experiences and gain new perspectives and insights.

[1875] "Legal literacy" is a feature that provides general legal information to help users deepen their legal knowledge.

[1876] "Means to support end-of-life preparations" is a function that assists users in creating an end-of-life note and preparing a will in order to prepare for the end of their lives.

[1877] "Means of providing advice and links to web services that do not violate the Lawyers Act" refers to a function that provides general information about the law and recommends consulting a specialist if necessary.

[1878] "Means for providing legal information in real time using smart devices" refers to a function that provides users with instant legal information using devices such as smart glasses or smartphones.

[1879] "Means for providing questions to assist in the creation of an Ending Note and recording the answers" is a function that presents the user with questions regarding each item in the Ending Note and records the answers.

[1880] "Means for obtaining legal information using a generative AI model" refers to a function that uses a generative AI model to generate and provide legal information in response to a user's question.

[1881] The system for implementing this invention uses a smart device (e.g., smart glasses or a smartphone) to provide users with real-time legal information and assist them in creating an end-of-life note. Specific embodiments of this system are described below.

[1882] System configuration

[1883] The system consists of the following main components:

[1884] 1. Smart Device: A device worn or used by the user to display and input information.

[1885] 2. Server: Generates legal information using generative AI models and sends it to smart devices.

[1886] 3. Generative AI model: An AI model for generating legal information in response to a user question.

[1887] Program processing

[1888] The server receives input from the user and uses a generative AI model to generate appropriate legal information. The generated information is sent to the user's smart device and displayed. To assist in the creation of the end-of-life note, the server also provides a series of questions and records the user's answers.

[1889] Hardware and software used

[1890] Smart devices: smart glasses, smartphones

[1891] Server: Cloud server or on-premise server

[1892] Generative AI model: Uses OpenAI API

[1893] Data processing and calculation

[1894] The server receives input data from the user and sends it to the generative AI model as a prompt. The generative AI model generates legal information based on the prompt and sends it back to the server. The server then sends the generated information to the smart device and displays it to the user. When creating the ending note, the server also records and saves the user's answers in JSON format.

[1895] Specific examples

[1896] The user puts on the smart glasses and launches the application. They select "Get legal information" from the menu and enter "I want to know how to write a will." The server receives this input and sends the following prompt to the generative AI model:

[1897] Example prompt sentence:

[1898] Please provide general legal information: I want to know how to make a will.

[1899] Based on this prompt, the generative AI model generates information on how to write a will and sends it back to the server, which then sends this information to the smart glasses and displays it to the user.

[1900] If a user wants to create an end-of-life note, they select "Create an end-of-life note" from the menu and answer a series of questions provided by the server. For example, when a user answers the question "What would you like to tell your loved one?", the answers are recorded by the server and can be viewed or edited later.

[1901] In this way, users can quickly and accurately obtain legal information through their smart devices and efficiently create their end-of-life notes.

[1902] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1903] Step 1:

[1904] The user starts the smart device and selects an application.

[1905] Input: User actions (launching and selecting applications)

[1906] Output: The application's main menu is displayed.

[1907] Specific operation: The user operates smart glasses or a smartphone to launch the legal consultation support application, and the main menu is displayed on the device screen.

[1908] Step 2:

[1909] The user selects "Get legal information" from the menu and enters the information they want to know.

[1910] Input: User's choice ("Get legal information") and input (information they want to know)

[1911] Output: User input is sent to the server

[1912] Specific operation: The...

Claims

1. A means for recognizing a user's emotion using an emotion engine; A means for generating a question for creating the user's ending note based on the result of the recognition of the user's emotion, using a prompt sentence that instructs the generation of the question using a generative AI model; means for presenting the generated question to the user and accepting an answer to the question; means for recording said received responses; A system including:

2. means for collecting said recorded responses; A means for generating a proposed content of the ending preparation using a prompt sentence that instructs the user to propose the content of the ending preparation based on the collected answer and the generation AI model; a means for presenting the ending preparation proposal content to the user; The system of claim 1 further comprising:

3. The system described in claim 1, wherein the question generating means generates the question using a prompt sentence that instructs the system to generate questions to promote reflection on the user's life, a change of thinking, or awareness as questions for creating the user's ending note based on the results of recognizing the user's emotions, and the generative AI model.

Images