System

Abstract

To provide a system.SOLUTION: A system includes: means for acquiring voice data captured from user voice; means for converting the acquired voice data to text data; means for analyzing the text data using a natural language processing technique and extracting the intention or feeling of the user; means for generating a response based on the principles of cognitive behavioral therapy on the basis of the extracted intention or feeling of the user; and means for providing the user with the response through voice.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, there is a demand for methods to deal with stress and mental health issues. However, there are barriers to receiving professional counseling, such as time, cost, and access to specialists. Furthermore, while it is important to record and reflect on daily emotions and behaviors from the perspective of self-management, doing so consistently is not easy. [Means for solving the problem]

[0005] This invention provides a voice dialogue system using AI. This system listens to users' complaints and provides counseling services similar to cognitive behavioral therapy in a natural, non-preachy dialogue. This helps prevent depression and previous low moods and guides users to live better lives. Furthermore, the system can record users' actions and thoughts during the dialogue, which can be reviewed at a later date. This allows users to easily manage themselves. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] One embodiment of the present invention provides a voice dialogue system using AI. This system accepts voice input from a user and uses natural language processing technology to understand the content. It then generates an appropriate response based on the principles of cognitive behavioral therapy and provides it to the user as voice output. The purpose of this dialogue is to deepen understanding of the user's problems and concerns and to provide appropriate advice and guidance.

[0029] "Example 2"

[0030] Furthermore, this system has the function of creating a record of the user's actions and thoughts. Specifically, when the user describes their actions or thoughts while interacting with the system, the system records them and saves them for later reference. For example, if a user says, "I've been feeling depressed since this morning and haven't been able to get anything done," the system records that information and provides it as reference information for the user to use later when reflecting on their mood and actions that day.

[0031] "Example 3"

[0032] This system helps users understand their own mental state and guides them in taking concrete actions to improve it. For example, if a user says, "I feel like nothing I do goes well these days," the system will explore the underlying thought patterns and provide advice based on the principles of cognitive behavioral therapy. This will encourage users to reevaluate their own thought patterns and take more constructive action.

[0033] The processing flow of each embodiment will be described below.

[0034] "Example 1"

[0035] Step 1: The system accepts voice input from the user, which includes the user's emotions, thoughts, and actions.

[0036] Step 2: The system uses natural language processing technology to understand the voice input, extracting the user's emotions, thought patterns, and behavioral tendencies.

[0037] Step 3: The system generates an appropriate response based on the principles of cognitive behavioral therapy, which aims to deepen understanding of the user's problems and concerns and provide appropriate advice and guidance.

[0038] Step 4: The generated response is provided to the user as a voice output, which can provide the user with a new perspective or solution to their problem or concern.

[0039] "Example 2"

[0040] Step 1: The user describes their actions and thoughts while interacting with the system.

[0041] Step 2: The system analyzes the user's statements using natural language processing technology and creates a record of their actions and thoughts.

[0042] Step 3: The created records are saved in the system and can be referenced later by the user, allowing them to reflect on their own behavioral and thought patterns and deepen their self-understanding.

[0043] "Example 3"

[0044] Step 1: The user describes their problem or concern to the system.

[0045] Step 2: The system analyzes the user's statements using natural language processing technology and explores the thought patterns behind them.

[0046] Step 3: The system generates and provides advice based on principles of cognitive behavioral therapy to the user, encouraging them to reevaluate their thought patterns and adopt more constructive behaviors.

[0047] Example 1

[0048] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0049] Conventional counseling systems often lack an environment where users can feel free to talk about their complaints and worries, and it is difficult to have natural conversations without sounding preachy. Furthermore, systems that allow users to record their behavior and thoughts are limited, and lack the functionality to review them later. This means that users are not provided with sufficient support to prevent depression and lead better lives.

[0050] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0051] In this invention, the server includes means for accepting voice input and converting it into text data using voice recognition technology, means for analyzing the text data using natural language processing technology and generating an appropriate response, and means for converting the generated response into voice data and providing it as a voice output. This allows users to freely talk about their complaints and worries, and enables the provision of counseling services based on cognitive behavioral therapy through natural dialogue that is not preachy. Furthermore, the server can keep records of users' actions and thoughts, which can be reviewed later, providing sufficient support to prevent depression and lead a better life.

[0052] "Voice interaction" means that the user interacts with the system through voice.

[0053] "Artificial intelligence" is a technology that allows computers to mimic human intelligence and learn, reason, and self-correct.

[0054] "Natural language processing technology" is a technology that allows computers to understand and generate human language.

[0055] Cognitive behavioral therapy is a form of psychotherapy that improves emotional and behavioral problems by changing thoughts and behaviors.

[0056] "Counseling services" are services that provide advice and support to users regarding their worries and problems.

[0057] "Voice input" refers to a user inputting voice into the system through a microphone.

[0058] "Speech recognition technology" is a technology that converts voice into text data.

[0059] "Text data" is character string data converted using voice recognition technology.

[0060] "Response generation" is the process of generating an appropriate reply based on the analyzed text data.

[0061] "Audio data" refers to data obtained by converting text data into an audio signal.

[0062] "Audio output" refers to playing the generated audio data through a speaker or the like.

[0063] "Behavior record" is data that records the user's behavior.

[0064] "Thought records" are data that record the user's thoughts.

[0065] "Analysis" is the process of understanding text data and extracting meaning.

[0066] This invention is a system that provides counseling services based on cognitive behavioral therapy by listening to users' complaints and worries in a voice dialogue format, while engaging in natural dialogue with artificial intelligence to avoid being preachy. The system aims to prevent users from becoming depressed and to provide support for them to live better lives.

[0067] System configuration

[0068] Hardware

[0069] Device: A device with a microphone and speaker (e.g., smartphone, tablet, computer)

[0070] Server: a computer system with high-performance computing power

[0071] software

[0072] Speech recognition technology: Software that converts voice data into text data (e.g., Google® Cloud Speech-to-Text API)

[0073] Natural language processing technology: Software that analyzes text data and generates appropriate responses (e.g., OpenAI's GPT-4)

[0074] Speech synthesis technology: Software that converts text data into voice data (e.g., Google Cloud Text-to-Speech API)

[0075] System Operation

[0076] Accepting voice input

[0077] The user speaks into the device's microphone. For example, they might say, "I've been feeling a lot of stress lately." The device captures this speech as digital audio data.

[0078] Converting audio data to text

[0079] The device sends the captured voice data to a server, which uses voice recognition technology to convert the voice data into text data. During this conversion process, the voice signal is analyzed and a corresponding string of characters is generated.

[0080] Text data analysis

[0081] The server receives the converted text data and analyzes it using natural language processing technology. This analysis uses a generative AI model. The server extracts and understands the user's intentions and emotions from the text data.

[0082] Generating a response

[0083] Based on the analysis results, the server generates appropriate responses based on the principles of cognitive behavioral therapy using a pre-trained generative AI model. The generated responses are stored on the server as text data.

[0084] Response transcription

[0085] The server converts the generated text data into voice data using speech synthesis technology, in which the text data is converted into voice signals and generated as natural-sounding speech.

[0086] Audio Output

[0087] The server transmits the generated voice data to the terminal, which plays the voice data through a speaker and provides a response to the user.

[0088] Specific examples

[0089] As a concrete example, consider the case where a user voice-inputs, "I've been feeling a lot of stress lately, and it's bothering me." This voice input is captured by the device via a microphone and sent to the server. The server then uses voice recognition technology to convert it into text data, "I've been feeling a lot of stress lately, and it's bothering me."

[0090] The server then analyzes this text data using natural language processing technology to understand the user's intention regarding stress, and generates a response based on the principles of cognitive behavioral therapy, such as, "To reduce stress, it is important to first recognize and accept your own emotions. Specifically, keeping a diary and setting aside time to relax are effective."

[0091] The generated response is converted into voice data using voice synthesis technology and provided to the user through the device's speaker.

[0092] An example of a prompt might be:

[0093] User: "I've been feeling a lot of stress lately."

[0094] Sarver: "The key to reducing stress is to first recognize and accept your emotions. Specifically, journaling and setting aside time to relax can be effective."

[0095] In this way, the system can better understand the user's problems and concerns and provide appropriate advice and guidance.

[0096] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0097] Step 1:

[0098] The user speaks into the microphone of the device. For example, they might say, "I've been feeling a lot of stress lately." The device captures this speech as digital audio data. The input is the user's voice, and the output is digital audio data.

[0099] Step 2:

[0100] The device sends the captured voice data to a server, which uses voice recognition technology to convert the voice data into text data. During this conversion process, the voice signal is analyzed and a corresponding string of characters is generated. The input is digital voice data, and the output is text data.

[0101] Step 3:

[0102] The server receives the converted text data and analyzes it using natural language processing technology. A generative AI model is used for this analysis. The server extracts and understands the user's intentions and emotions from the text data. The input is the text data, and the output is the analysis results.

[0103] Step 4:

[0104] The server generates an appropriate response based on the principles of cognitive behavioral therapy based on the analysis results. A pre-trained generative AI model is used to generate this response. The generated response is saved as text data on the server. The input is the analysis results, and the output is the text data of the response.

[0105] Step 5:

[0106] The server converts the generated text data into voice data using speech synthesis technology. In this conversion process, the text data is converted into voice signals and generated as natural-sounding speech. The input is the response text data, and the output is voice data.

[0107] Step 6:

[0108] The server transmits the generated voice data to the terminal, which plays the voice data through a speaker and provides a response to the user. The input is the voice data, and the output is a voice response provided to the user.

[0109] In this way, the system can better understand the user's problems and concerns and provide appropriate advice and guidance.

[0110] (Application example 1)

[0111] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0112] In modern society, users experience various stresses and anxieties in their daily lives. In particular, depression, low mood, and security-related anxieties are on the rise, and appropriate support for these issues is needed. However, conventional counseling services and security advice require users to consult with experts directly, which places time and place restrictions on the users. There is also psychological resistance to consulting with experts. To solve these issues, a system that users can easily access is needed.

[0113] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0114] In this invention, the server includes: means for listening to the user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy in a natural dialogue with AI that does not sound preachy; means for preventing depression and previous low moods and guiding the user to live a better life; means for recording the user's actions and thoughts during the dialogue and allowing them to be reviewed at a later date; means for providing appropriate advice and guidance for security concerns and questions; means for converting voice input into text and generating an appropriate response using a generative AI model; and means for providing the generated text response as voice output. This allows users to easily receive counseling services and security advice.

[0115] "Voice interaction" means that the user interacts with the system through voice.

[0116] "Complaints, etc." refers to statements made by users regarding dissatisfaction or stress they feel in their daily lives.

[0117] "Avoiding preaching" means avoiding instructing or criticizing users and maintaining a natural dialogue.

[0118] "AI" refers to artificial intelligence technologies, specifically including natural language processing and generative AI models.

[0119] "Natural dialogue" is a dialogue format designed to allow users to converse with the system in a natural way.

[0120] "Cognitive behavioral therapy" is a type of psychotherapy that aims to improve a client's thoughts and behaviors.

[0121] "Counseling services" are services that provide support and advice to users regarding psychological problems and worries.

[0122] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[0123] "Mood depression" refers to a temporary state of depression or lethargy experienced by users.

[0124] "Behavior records" are data that record the user's daily behavior.

[0125] "Thought records" are data that record the user's thoughts and feelings.

[0126] "Security concerns" refers to concerns users have about the safety of their information and privacy.

[0127] "Advice and Guidance" means advice or guidance provided to a User.

[0128] "Voice input" refers to a user providing information to a system by voice via a microphone.

[0129] "Convert to text" is the process of converting audio data into text data.

[0130] A "generative AI model" is an artificial intelligence model that generates appropriate responses based on input data.

[0131] A "text response" is a response of text data generated by a generative AI model.

[0132] "Voice output" is the process of converting text data into speech and providing it to the user.

[0133] The following system configuration will be described as an embodiment of the present invention.

[0134] System Configuration

[0135] The system listens to users' complaints and concerns in a voice dialogue format, providing counseling services similar to cognitive behavioral therapy through natural dialogue with AI that avoids being preachy. It also offers ways to prevent depression and low mood and guide users toward a better life. It also includes a function that allows users to record their actions and thoughts during the dialogue, allowing them to review them later. It also has a function that provides appropriate advice and guidance for security-related concerns and questions.

[0136] Hardware and software used

[0137] Hardware: Smartphone (microphone, speaker)

[0138] software:

[0139] speech_recognition library: Used to convert voice input to text.

[0140] Transformers library: Uses generative AI models (e.g., GPT-3®) to generate appropriate responses.

[0141] Data processing and calculation

[0142] 1. Acquiring voice input: The user provides information by voice through the smartphone microphone, and the server captures this voice data.

[0143] 2. Speech recognition: The server uses the speech_recognition library to convert the voice data into text.

[0144] 3. Natural Language Processing: The server uses a generative AI model (e.g., GPT-3) to generate an appropriate response based on the user's input.

[0145] 4. Audio output: The server provides the generated text response as audio output through the smartphone's speaker.

[0146] Specific examples

[0147] If a user asks, "I think I received a phishing email. What should I do?", the server inputs the following prompt into the generative AI model:

[0148] Prompt Sentence Examples

[0149] A user asked a security question: I think I received a phishing email. What should I do?

[0150] AI Assistant: Do not click on the link in that email. Check the sender's address and contact official support.

[0151] The generative AI model generates an appropriate response based on the prompt, and the server provides the response as voice output to the user, allowing users to easily receive counseling services and security advice.

[0152] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0153] Step 1:

[0154] The user provides information by voice through the smartphone microphone. The server captures this voice data. The input is the user's voice data, and the output is the captured voice data.

[0155] Step 2:

[0156] The server uses the speech_recognition library to convert the captured voice data into text. The input is voice data and the output is text data. In this step, speech recognition technology is used to convert the voice data into text data.

[0157] Step 3:

[0158] The server uses a generative AI model (e.g., GPT-3) to generate an appropriate response based on the text data. The input is the user's text data, and the output is the generated text response. In this step, the generative AI model generates an appropriate response based on the prompt sentence.

[0159] Step 4:

[0160] The server provides the generated text response as a voice output through the smartphone speaker. The input is the generated text response and the output is voice data. In this step, the text data is converted into voice and provided to the user.

[0161] Step 5:

[0162] The server records the user's actions and thoughts during the dialogue. The input is the user's text data and generated text responses, and the output is the action record and thought record data. In this step, the dialogue content is recorded so that it can be reviewed at a later date.

[0163] Step 6:

[0164] The server provides appropriate advice and guidance for security concerns and questions. The input is the user's security question, and the output is the generated security advice. In this step, a generative AI model is used to generate an appropriate security response.

[0165] Example 2

[0166] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0167] In modern society, many people suffer from stress and depression. Depression and its precursor, low mood, are particularly significant factors that significantly reduce quality of life. Conventional counseling services primarily involve face-to-face sessions with a specialist, but are often limited by time and location, making them difficult for users to access. Furthermore, systems for efficiently managing and later referencing users' activity and thought records have yet to be fully developed. To address these issues, a system is needed that can provide counseling services through natural, non-preachy dialogue while listening to users' complaints in a voice-based dialogue format, and that can also efficiently manage and reference users' activity and thought records.

[0168] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0169] In this invention, the server includes: means for listening to a user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with an AI that avoids being preachy; means for preventing depression and guiding the user to live a better life; means for keeping a record of the user's actions and thoughts during the dialogue and allowing them to review them at a later date; means for a terminal to convert speech into text when the user speaks to the system and send the text to a generative AI model; means for the generative AI model to analyze the text and the server to store the analysis results in a database; and means for the server to retrieve the records from the database and display them on the terminal when the user wants to view the records. This allows users to easily receive counseling services regardless of time or place, and also enables them to efficiently manage and view their own action and thought records.

[0170] "Voice interaction" refers to a format in which a user interacts with a system using voice.

[0171] "Complaints, etc." refers to the dissatisfaction, stress, worries, etc. that users experience in their daily lives.

[0172] "Artificial intelligence" is a technology that allows computers to act in a way that mimics human intelligence.

[0173] "Natural dialogue" is a dialogue format designed to allow users to converse with the system in a natural way.

[0174] "Cognitive behavioral therapy" is a form of psychotherapy that aims to improve mood and behavior by changing the user's cognition and behavior.

[0175] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[0176] "Mood depression" refers to a temporary state of low emotion or depression experienced by a user.

[0177] "Behavior records" are data that record the user's daily behavior.

[0178] "Thought records" are data that record the user's thoughts and feelings.

[0179] A "terminal" is a device (e.g., smartphone, PC) that a user uses to interact with the system.

[0180] "Speech-to-text" is the process of converting audio data into text using speech recognition technology.

[0181] A "generative AI model" is a model that uses artificial intelligence to analyze text data and extract meaning.

[0182] "Analysis results" are information obtained by the generative AI model analyzing text data.

[0183] A "database" is a system for efficiently storing and managing data.

[0184] "Referring to records" refers to the act of checking stored data at a later date.

[0185] This invention is a system that listens to users' complaints and other issues in a voice dialogue format, provides counseling services such as cognitive behavioral therapy through natural dialogue with artificial intelligence that avoids being preachy, and can also efficiently manage and refer to users' behavioral and thought records.

[0186] Hardware and software used

[0187] This system is realized using the following hardware and software.

[0188] Hardware: Servers (e.g., cloud computing services), devices (e.g., smartphones, PCs)

[0189] Software: Generative AI models (e.g., natural language processing models), databases (e.g., relational database management systems)

[0190] Data processing and calculation

[0191] Voice Recognition

[0192] When a user speaks to the system through the device, the device uses voice recognition software to convert the speech into text, for example by using the Google Speech-to-Text API.

[0193] Text analytics

[0194] The converted text data is sent to a generative AI model. The generative AI model (e.g., a natural language processing model) analyzes the text data and extracts the user's actions and thoughts. For example, from the text "I've been feeling depressed since this morning and I haven't been able to get anything done," the information "I've been feeling depressed" and "I haven't been able to get anything done" can be extracted.

[0195] Data storage

[0196] The server receives the analysis results sent from the generative AI model and stores them in a database. The stored data includes the user ID, date and time, behavioral records, and thought records. A relational database management system (e.g., MySQL (registered trademark)) is used as the database.

[0197] Data Reference

[0198] When a user wants to refer to the record of their actions or thoughts at a later date, they access the system using a terminal. The server retrieves the relevant record from the database and displays it on the terminal. For example, if a user requests "Show me yesterday's record," the server retrieves yesterday's record from the database and displays it on the terminal.

[0199] Specific examples

[0200] scenario:

[0201] A user talks to the system using a smartphone, stating, "I've been feeling depressed since this morning and haven't been able to get anything done."

[0202] Example prompt sentence:

[0203] "I've been feeling down since this morning and haven't been able to get anything done. Please record this information."

[0204] In this way, the system efficiently manages the user's records of actions and thoughts and makes them available for later reference.

[0205] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0206] Step 1:

[0207] The user talks to the system.

[0208] Specific action: The user speaks into the smartphone microphone, "I've been feeling depressed since this morning and haven't been able to get anything done."

[0209] Input: User's voice data.

[0210] Output: Audio data is input to the device.

[0211] Step 2:

[0212] The device converts the speech to text.

[0213] What happens: Your device calls speech recognition software (e.g., Google Speech-to-Text API) and converts your speech into text, such as "I've been feeling depressed since this morning and haven't been able to get anything done."

[0214] Input: Audio data.

[0215] Output: Text data.

[0216] Step 3:

[0217] The device sends the text to a generative AI model.

[0218] What it does: The device sends the converted text over the internet to a generative AI model (e.g., a natural language processing model).

[0219] Input: Text data.

[0220] Output: The text data sent to the generative AI model.

[0221] Step 4:

[0222] A generative AI model analyzes the text.

[0223] What it does: The generative AI model analyzes the text and extracts information such as "I feel depressed" and "I couldn't get anything done."

[0224] Input: Text data.

[0225] Output: Analysis results (behavioral record, thought record).

[0226] Step 5:

[0227] The server stores the analysis results in a database.

[0228] Specific operation: The server receives the analysis results and stores the user ID, date and time, behavioral record, and thought record in a database (e.g., a relational database management system).

[0229] Input: Analysis results (action log, thought log).

[0230] Output: Records stored in a database.

[0231] Step 6:

[0232] A user views a record.

[0233] Specific operation: When a user requests "Show me yesterday's records" on their smartphone, the server retrieves yesterday's records from the database and displays them on the smartphone.

[0234] Input: The user request.

[0235] Output: The transcript displayed on the terminal.

[0236] (Application example 2)

[0237] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0238] In modern society, there is a demand for counseling services to help users maintain their mental health. However, conventional counseling services make it difficult for users to record their own actions and thoughts and review them later. They also lack a means to record security-related actions and thoughts so that they can be referenced later. This makes it difficult for users to receive appropriate feedback to improve their mental health and security awareness.

[0239] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for providing counseling services such as cognitive behavioral therapy through a natural dialogue with an AI while listening to the user's complaints in a voice dialogue format so as not to sound preachy; a means for preventing depression and previous low moods and guiding the user to live a better life; a means for recording the user's actions and thoughts during the dialogue so that they can be reviewed at a later date; and a means for recording security-related actions and thoughts and saving them for future reference. This allows the user to receive appropriate feedback to maintain their mental health and improve their security awareness.

[0240] "Voice interaction" means that the user interacts with the system through voice.

[0241] "Complaints, etc." refers to statements made by users regarding dissatisfaction or stress they feel in their daily lives.

[0242] "Not preachy" means avoiding a pressured or instructional tone that users may feel while interacting with the system.

[0243] "AI" is an abbreviation for artificial intelligence, and refers to technology that allows machines to act in a way that mimics human intelligence.

[0244] "Natural dialogue" refers to a dialogue format that allows users to feel as if they are having a conversation with a system.

[0245] "Cognitive behavioral therapy" is a type of psychotherapy that improves mental health by improving the user's cognition and behavior.

[0246] "Counselling services" are services that provide consultation and advice to support the mental health of users.

[0247] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[0248] "Mood depression" refers to a temporary state of mental depression experienced by the user.

[0249] "Behavior record" refers to recording specific actions taken by a user.

[0250] "Thought recording" refers to recording what the user thinks and feels.

[0251] "Looking back" refers to revisiting past actions and thoughts.

[0252] "Security-related actions and thoughts" refer to the actions and thoughts that users take regarding their own safety and information protection.

[0253] "Storing" refers to storing recorded information for future reference.

[0254] The following system configuration is used as an embodiment of this invention. The system provides a counseling service similar to cognitive behavioral therapy by listening to the user's complaints in a voice dialogue format and engaging in natural dialogue with AI to avoid being preachy. The system also has a function to record the user's actions and thoughts and allow them to be reviewed at a later date. It also includes a function to record security-related actions and thoughts and save them for future reference.

[0255] System Program

[0256] The system includes the following programs:

[0257] 1. Voice interaction:

[0258] The server uses speech recognition software (e.g., Google Speech-to-Text API) to convert the user's speech into text, which is then analyzed using natural language processing techniques (e.g., OpenAI GPT-3) to generate an appropriate response.

[0259] 2. Providing counseling services:

[0260] The server converts the generated response into speech using speech synthesis software (e.g., Google Text-to-Speech API) and provides it to the user, allowing the user to receive counseling through natural dialogue.

[0261] 3. Keeping records of actions and thoughts:

[0262] The server records the user's actions and thoughts in text format and stores them in a database (e.g., MySQL). The stored data can be accessed by the user at a later date.

[0263] 4. Security-related records:

[0264] The server identifies the security-related actions and thoughts expressed by the user and stores them in a database, allowing users to refer to these records later to improve their security awareness.

[0265] Processing Description

[0266] The server uses speech recognition software to convert the user's speech into text and analyzes it using natural language processing technology. Based on the analysis results, it generates an appropriate response and converts it into speech using speech synthesis software. The user's actions and thoughts are recorded in text format and saved in a database, allowing the user to refer to these records at a later date.

[0267] Specific examples

[0268] For example, if a user says, "I upgraded my home security system today," that information is converted into text through speech recognition software and analyzed using natural language processing technology. The analysis results are stored in a database, and the user can refer to the record at a later date.

[0269] Prompt Sentence Examples

[0270] If you say, "Today I upgraded my home security system," record that information and save it for future reference.

[0271] In this way, a system is realized that provides appropriate feedback to maintain users' mental health and improve their security awareness.

[0272] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0273] Step 1:

[0274] The server uses speech recognition software (e.g., Google Speech-to-Text API) to convert the user's speech into text. The input is the user's voice, and the output is text data. For example, when the user says, "Today I upgraded my home security system," the speech is converted into text.

[0275] Step 2:

[0276] The server analyzes the converted text data using natural language processing technology (e.g., OpenAI GPT-3). The input is the text data obtained in step 1, and the output is an appropriate response as a result of the analysis. Specifically, the text "I upgraded my home security system today" is analyzed, and an appropriate response is generated.

[0277] Step 3:

[0278] The server converts the generated response into speech using speech synthesis software (e.g., Google Text-to-Speech API) and provides it to the user. The input is the response text obtained in step 2, and the output is audio data. Specifically, the generated response is converted into speech and played back to the user.

[0279] Step 4:

[0280] The server records the user's actions and thoughts in text format and stores them in a database (e.g., MySQL). The input is the text data obtained in step 1, and the output is the record stored in the database. Specifically, the text "I upgraded my home security system today" is stored in the database.

[0281] Step 5:

[0282] The server identifies the security-related actions and thoughts stated by the user and stores them in a database. The input is the text data obtained in step 1, and the output is stored in the database as a security-related record. Specifically, the part "I upgraded my security system" is identified and stored as a security-related record.

[0283] Step 6:

[0284] The user can access the database at a later date and view the saved records of their actions and thoughts. The input is a request to access the database, and the output is a display of the saved records. Specifically, the user searches for past records through the application and checks the displayed records.

[0285] In this way, a system is realized that provides appropriate feedback to maintain users' mental health and improve their security awareness.

[0286] Example 3

[0287] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0288] In modern society, many people suffer from stress and depression. Traditional counseling services are primarily conducted through face-to-face sessions, which are constrained by time and location. Furthermore, few systems allow users to record their thoughts and actions and reflect on them later. Furthermore, there is a lack of ways to provide advice through natural conversations without coming across as preachy. To address these issues, a system that provides more flexible and effective counseling services is needed.

[0289] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0290] In this invention, the server includes a means for a user to input, a means for the terminal to send the input to the server, a means for the server to analyze the input, a means for the server to send a prompt to the generative AI model, a means for the generative AI model to generate advice, and a means for the server to receive and provide the advice to the user. This allows the user to receive advice based on cognitive behavioral therapy through natural dialogue without being restricted by time or place. In addition, the user can keep a record of their actions and thoughts, which can be reviewed at a later date, promoting self-understanding and behavioral improvement.

[0291] "Voice interaction" means that the user interacts with the system through voice.

[0292] "Artificial intelligence" is a technology that allows computers to imitate human intelligence and perform learning and reasoning.

[0293] "Natural dialogue" is a dialogue format designed to allow users to converse with the system in a natural way.

[0294] Cognitive behavioral therapy is a form of psychotherapy that aims to improve emotions and behavior by changing the client's thought patterns and behavior.

[0295] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[0296] "Mood depression" is a temporary state of low emotion or depression experienced by a user.

[0297] "Behavior records" are data that users use to record their daily activities.

[0298] "Thought records" are data that users use to record their thoughts and feelings.

[0299] A "prompt sentence" is an input sentence that gives specific instructions or questions to a generative AI model.

[0300] A "generative AI model" is an artificial intelligence model that generates new information or advice based on input data.

[0301] A "server" is a computer system that processes and stores data on a network.

[0302] A "terminal" is a device that is directly operated by a user.

[0303] "Analysis" is the process of understanding input data and extracting meaning from it.

[0304] "Advice" is specific instructions or advice provided to a user.

[0305] This invention is a system that provides support for helping users understand their own mental state and derive specific actions to improve it. This system includes a means for a user to provide input, a means for a terminal to send the input to a server, a means for the server to analyze the input, a means for the server to send a prompt sentence to a generative AI model, a means for the generative AI model to generate advice, and a means for the server to receive the advice and provide it to the user.

[0306] Hardware and software used

[0307] Hardware

[0308] Terminal: A device that is directly operated by the user, such as a smartphone, tablet, or PC.

[0309] Server: A computer system that processes and stores data over a network.

[0310] software

[0311] Natural language processing engine: Software for analyzing input text data, such as SpaCy or NLTK.

[0312] Generative AI models: Artificial intelligence models that generate new information or advice based on input data, such as OpenAI's GPT-3.

[0313] Data processing and calculation

[0314] A means for users to provide input

[0315] The user opens an application on their smartphone or computer and types, "Lately, I feel like nothing I do goes right" into the text box.

[0316] A means by which a device sends input to a server

[0317] The terminal sends the text data entered by the user to the server using the HTTPS protocol. After the transmission is complete, the terminal waits for a response from the server.

[0318] How the server parses the input

[0319] The server analyzes the received text data using a natural language processing engine (e.g., SpaCy or NLTK). As a result of the analysis, the user's emotions and thought patterns are identified.

[0320] A means for the server to send prompts to the generative AI model

[0321] The server generates a prompt to send to the generative AI model based on the analysis results. For example, it generates a prompt such as, "The user has said, 'Recently, I feel like nothing I do goes well.' Please identify the thought pattern behind this and provide advice based on the principles of cognitive behavioral therapy."

[0322] How generative AI models generate advice

[0323] The generative AI model generates advice based on prompts received from the server, and leverages past data and learned knowledge to provide advice based on the principles of cognitive behavioral therapy.

[0324] A means by which the server receives and provides advice to the user

[0325] The server provides the user with advice received from the generative AI model. Specifically, the server displays the advice to the user through the device interface. For example, the server displays advice such as, "Reflect specifically on recent events and consider what thoughts are causing those emotions."

[0326] Examples of specific examples and prompts

[0327] As a concrete example, consider the case where a user inputs "I feel like nothing I do goes right these days." In this case, the server sends the following prompt to the generative AI model:

[0328] "A client says, 'Lately, I feel like nothing I do seems to work.' Identify the thought patterns behind this and offer advice based on the principles of cognitive behavioral therapy."

[0329] The generative AI model analyzes this prompt and returns the following advice:

[0330] "Think specifically about recent events and consider what thoughts are triggering those feelings."

[0331] "Evaluate whether your thinking is realistic and look for ways to develop a more realistic perspective."

[0332] In this way, the server provides the user with advice that encourages specific actions. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0333] Step 1:

[0334] The user provides input

[0335] A user opens an application on a smartphone or PC and enters "Recently, I feel like nothing I do goes well" into the text box. The input data is in text format and expresses the user's state of mind and worries.

[0336] Step 2:

[0337] The device sends input to the server

[0338] The terminal sends the text data entered by the user to the server using the HTTPS protocol. The input data is encrypted and sent to the server over a secure communication channel. Once the transmission is complete, the terminal waits for a response from the server.

[0339] Step 3:

[0340] The server parses the input

[0341] The server analyzes the received text data using a natural language processing engine (e.g., SpaCy or NLTK). The input data is in text format, and the analysis results identify the user's emotions and thought patterns. Specifically, the server tokenizes the text data and performs sentiment analysis and keyword extraction.

[0342] Step 4:

[0343] The server sends a prompt to the generative AI model

[0344] The server generates a prompt to be sent to the generative AI model based on the analysis results. The prompt is in text format and includes the user's input and the analysis results. For example, a prompt might be generated such as, "The user says, 'Recently, I feel like nothing I do goes well.' Please identify the thought pattern behind this and provide advice based on the principles of cognitive behavioral therapy."

[0345] Step 5:

[0346] Generative AI models generate advice

[0347] The generative AI model generates advice based on prompts received from the server. The input data is in the form of prompts, and the output data is in the form of advice text. The generative AI model utilizes past data and learned knowledge to provide advice based on the principles of cognitive behavioral therapy.

[0348] Step 6:

[0349] The server receives the advice and provides it to the user.

[0350] The server provides the user with the advice received from the generative AI model. The input data is the text format of the advice from the generative AI model, and the output data is the text format of the advice to be displayed to the user. Specifically, the advice is displayed to the user through the device interface. For example, the advice displayed is, "Reflect specifically on recent events and consider what thoughts are causing those emotions."

[0351] (Application example 3)

[0352] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0353] In modern society, the number of people experiencing stress and anxiety is increasing, and appropriate measures to address this are needed. However, traditional counseling services are primarily face-to-face sessions, which are limited by time and location. In addition, there is a lack of support for users to accurately understand their own mental state and take appropriate action. Furthermore, occupations such as security guards and security officers often experience stress during long shifts, and a prompt response to this is required.

[0354] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes: a means for listening to the user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with AI without being preachy; a means for preventing depression and previous low moods and guiding the user to live a better life; a means for recording the user's actions and thoughts during the dialogue and reviewing them at a later date; a means for monitoring the user's mental state and providing appropriate advice when stress or anxiety increases; and a means for generating prompt sentences using a generative AI model and providing advice based on the principles of cognitive behavioral therapy. This allows users to accurately understand their mental state and receive support for taking appropriate actions. Furthermore, occupations such as security guards and security guards can quickly manage stress.

[0355] "Voice interaction format" refers to a format in which a user and a system interact through voice.

[0356] "Complaining" is the verbal expression of dissatisfaction and stress that users feel in their daily lives or at work.

[0357] "Artificial intelligence" is a technology that allows computer systems to mimic human intelligence and have capabilities such as learning, reasoning, and recognition.

[0358] "Natural dialogue" means that the user and the system communicate smoothly, like a conversation between humans.

[0359] Cognitive behavioral therapy is a form of psychotherapy that involves reevaluating clients' thought patterns and behaviors and encouraging more constructive behavior.

[0360] "Counseling services" are services that provide support to help users understand and improve their mental state.

[0361] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[0362] "Depression" refers to temporary feelings of sadness or lethargy experienced by users.

[0363] "Behavioral records" refer to recording the user's activities in their daily life and work.

[0364] "Thought recording" is the act of recording what the user thinks and feels.

[0365] "Monitoring" means continuously observing the user's mental state and detecting any changes.

[0366] "Stress" refers to the mental or physical tension or strain felt by users.

[0367] "Anxiety" refers to the vague worries and fears that users feel.

[0368] "Advice" is specific instructions or suggestions for users to take better action.

[0369] A "generative AI model" is a model that uses artificial intelligence to generate text or data for a specific purpose.

[0370] A "prompt" is an instruction or question that is input into a generative AI model.

[0371] The system for implementing this invention provides a counseling service similar to cognitive behavioral therapy by listening to the user's complaints in a voice dialogue format, while engaging in natural dialogue with artificial intelligence to avoid becoming preachy. The system has the function of monitoring the user's mental state and providing appropriate advice when stress or anxiety increases.

[0372] Hardware and software used

[0373] Hardware

[0374] Smartphone

[0375] server

[0376] software

[0377] Python

[0378] OpenAI API

[0379] Data processing and calculation

[0380] server

[0381] The server receives voice input from the user and converts it into text data. It then uses a generative AI model to generate prompts and advice based on the principles of cognitive behavioral therapy. The advice is then converted back into voice data and provided to the user.

[0382] Device (smartphone)

[0383] The smartphone receives the user's voice input, sends it to the server, and also has the function of playing back the advice returned by the server.

[0384] Specific examples

[0385] For example, if a security guard types "I feel like nothing I do seems to work out well lately," the smartphone sends this voice data to the server, which converts it into text data and generates a prompt like this:

[0386] Prompt Sentence Examples

[0387] "If a user says, 'I feel like nothing I do seems to work lately,' offer advice based on principles of cognitive behavioral therapy."

[0388] The generative AI model generates advice based on this prompt, and the server converts the advice into voice data and sends it to the smartphone, which then plays the voice data and provides the advice to the user.

[0389] In this way, users can accurately understand their own mental state and receive support to take appropriate action. It also enables occupations such as security guards and security officers to quickly manage stress.

[0390] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0391] Step 1:

[0392] The user inputs voice data into the smartphone. For example, they might say, "Recently, I feel like nothing I do goes right." This voice data is input into the smartphone.

[0393] Step 2:

[0394] Smartphones convert input voice data into text data using voice recognition software. The input is voice data and the output is text data.

[0395] Step 3:

[0396] The smartphone sends the converted text data to the server. The input is text data, and the output is data transmission to the server.

[0397] Step 4:

[0398] The server generates a prompt sentence based on the received text data. For example, it generates a prompt sentence such as, "If the user says, 'I feel like nothing I do recently goes well,' please provide some advice based on the principles of cognitive behavioral therapy." The input is text data, and the output is a prompt sentence.

[0399] Step 5:

[0400] The server inputs the generated prompt sentence into the generative AI model to generate advice. The input is the prompt sentence, and the output is the text data of the advice.

[0401] Step 6:

[0402] The server converts the generated advice text data into voice data using voice synthesis software. The input is the advice text data, and the output is voice data.

[0403] Step 7:

[0404] The server then sends the converted voice data to the smartphone. The input is the voice data, and the output is data transmission to the smartphone.

[0405] Step 8:

[0406] The smartphone plays back the received voice data and provides advice to the user. The input is the voice data, and the output is the voice playback.

[0407] In this way, users can accurately understand their own emotional state and receive assistance in taking appropriate actions.

[0408] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0409] "Example 1"

[0410] One embodiment of the present invention is a system incorporating an emotion engine. This system includes an emotion engine that analyzes emotions from a user's voice input. Specifically, the system infers the user's emotional state from the words, tone of voice, speaking rate, and other factors used by the user during a dialogue with the system. This emotion engine is used in combination with AI-based natural language processing technology to generate an appropriate response based on the user's emotional state.

[0411] "Example 2"

[0412] The emotion engine also has the ability to track changes in a user's emotions. Specifically, it records emotional information obtained through conversations with the user over time and analyzes these changes. This makes it possible to understand the user's emotional patterns, such as what emotions the user tends to show when discussing a particular topic or at a particular time of day. This information can be used to optimize counseling services such as cognitive behavioral therapy.

[0413] "Example 3"

[0414] Furthermore, the emotion engine has the ability to adjust how it provides counseling services depending on the user's emotional state. Specifically, if the user is showing strong emotions such as anger or sadness, the system will prioritize providing advice to calm those emotions. On the other hand, if the user is in a calm emotional state, the system will provide questions and tasks to encourage deeper self-understanding. This allows the system to provide optimal counseling services according to the user's emotional state.

[0415] The processing flow of each embodiment will be described below.

[0416] "Example 1"

[0417] Step 1: The user initiates an interaction with the system.

[0418] Step 2: The emotion engine receives the user's voice input.

[0419] Step 3: The emotion engine analyzes the emotion from the user's voice, taking into account word choice, tone of voice, speaking rate, etc.

[0420] Step 4: The analysis results are combined with AI-based natural language processing technology to generate an appropriate response based on the user's emotional state.

[0421] "Example 2"

[0422] Step 1: Record the emotional information obtained through the interaction with the user over time.

[0423] Step 2: Analyze changes in the recorded emotional information.

[0424] Step 3: Based on the analysis results, understand the emotional patterns of users.

[0425] Step 4: Use identified emotional patterns to optimize counseling services, such as cognitive behavioral therapy.

[0426] "Example 3"

[0427] Step 1: The emotion engine analyzes the user's emotional state.

[0428] Step 2: Adjust how counseling services are delivered based on the analysis results.

[0429] Step 3: If the user is showing strong emotions such as anger or sadness, the system will prioritize providing advice to calm those emotions.

[0430] Step 4: If the user is in a calm emotional state, the system provides questions and challenges to encourage deeper self-understanding.

[0431] Example 1

[0432] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0433] In modern society, the number of people suffering from mood disorders and stress is increasing, creating a demand for effective counseling services to resolve these issues. However, traditional counseling services are often conducted face-to-face, making them difficult for users to access. Furthermore, it is difficult to provide appropriate responses based on the user's emotional state, and these services may not be effective enough in improving the user's mood. Furthermore, there is a lack of means to automatically record the user's behavior and thoughts, making it difficult to review them later. To address these issues, a system is needed that is easily accessible to users, provides appropriate responses based on their emotional state, and automatically records behavior and thoughts.

[0434] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0435] In this invention, the server includes means for receiving a user's voice input and understanding the content of the input using natural language processing technology, means for analyzing emotions from the user's voice input and generating an appropriate response according to the user's emotional state, and means for providing the generated response to the user as a voice output, thereby enabling the user to easily access the server, provide an appropriate response according to the user's emotional state, and automatically keep a record of their actions and thoughts.

[0436] "Voice interaction" means that the user interacts with the system through voice.

[0437] "Artificial intelligence" is a technology that allows computers to act in a way that mimics human intelligence.

[0438] "Natural language processing technology" is a technology that allows computers to understand, analyze, and generate human language.

[0439] Cognitive behavioral therapy is a form of psychotherapy that addresses mental problems by working on both cognition and behavior.

[0440] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[0441] "Mood disorders" are mental illnesses whose main symptom is mood abnormalities, such as depression and bipolar disorder.

[0442] "Behavior recording" refers to recording the user's behavior.

[0443] "Thought recording" means recording the user's thoughts.

[0444] "Emotion analysis" refers to analyzing a user's emotional state.

[0445] "Response generation" refers to generating an appropriate response to a user's input.

[0446] "Audio output" means outputting the generated response as audio.

[0447] MODE FOR CARRYING OUT THE INVENTION

[0448] This invention is a voice dialogue system using artificial intelligence (AI). It accepts voice input from a user and understands the content using natural language processing technology. Furthermore, it aims to generate appropriate responses based on the principles of cognitive behavioral therapy and provide them to the user as voice output. It also incorporates an emotion engine that analyzes emotions from the user's voice input and generates responses according to their emotional state.

[0449] Hardware and software used

[0450] Devices: microphone, speaker

[0451] Server: Speech recognition software (e.g., Google Speech-to-Text API), natural language processing libraries (e.g., spaCy, NLTK), sentiment analysis engines (e.g., IBM Watson® Tone Analyzer), response generation models (e.g., GPT-3), speech synthesis software (e.g., Google Text-to-Speech API)

[0452] Program processing flow

[0453] 1. Accepting voice input

[0454] The device receives voice input from the user through a microphone. When the user says, "I've been feeling a lot of stress lately," the device's microphone captures the voice.

[0455] 2. Converting voice data to text

[0456] The server uses voice recognition software to convert the voice data sent from the device into text data. The server analyzes the voice data and generates the text, "I'm having trouble with a lot of stress these days."

[0457] 3. Content understanding using natural language processing

[0458] The server uses a natural language processing library to analyze the content of the text data and understand the user's intent. The server extracts the keyword "stress" and recognizes that the user is feeling stressed.

[0459] 4. Emotion analysis

[0460] The server uses an emotion analysis engine to analyze the user's emotional state from the text data. If the server determines that the user is feeling "stressed" from their comments, it records the user's emotional state as "stress."

[0461] 5. Response Generation

[0462] The server generates an appropriate response based on the principles of cognitive behavioral therapy, taking into account the user's intentions and emotional state. Using a generative AI model, the server generates a response such as, "Please tell me more about what is causing you stress."

[0463] 6. Generating Audio Output

[0464] The server generates a response that is converted into audio data using speech synthesis software. The server converts the text response into audio data and generates an audio file.

[0465] 7. Providing Audio Output

[0466] The device provides the voice data sent from the server to the user through the speaker, and the device uses the speaker to play back the voice message, "Please tell us more about what causes you stress."

[0467] Specific examples

[0468] The user speaks, "I've been feeling a lot of stress lately."

[0469] The device captures the audio with a microphone and sends it to the server.

[0470] The server uses speech recognition software to convert the speech to text.

[0471] The server analyzes the text using a natural language processing library and understands that the user is feeling stressed.

[0472] The server performs emotion analysis using an emotion analysis engine and determines that the user is feeling stressed.

[0473] The server uses a generative AI model to generate a response such as, "Please tell me more about what causes you stress."

[0474] The server converts the response into speech using speech synthesis software.

[0475] The terminal provides the generated audio to the user through a speaker.

[0476] Example prompt sentence:

[0477] User: I've been feeling a lot of stress lately.

[0478] System: Can you tell us a bit more about what causes you stress?

[0479] In this way, the system analyzes the user's voice input and generates and provides an appropriate response.

[0480] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0481] Step 1:

[0482] Accepting voice input

[0483] The device accepts voice input from the user through a microphone.

[0484] Input: User speech (e.g., "I've been feeling stressed lately.")

[0485] Specific operation: The user's voice is captured by the microphone and saved as audio data on the device.

[0486] Output: Audio data

[0487] Step 2:

[0488] Converting audio data to text

[0489] The server uses voice recognition software to convert the voice data sent from the terminal into text data.

[0490] Input: Audio data

[0491] Specific operation: The server calls voice recognition software (e.g., voice recognition API) and converts the voice data into text data.

[0492] Output: Text data (e.g., "I've been feeling stressed lately.")

[0493] Step 3:

[0494] Content understanding through natural language processing

[0495] The server uses a natural language processing library to analyze the content of the text data and understand the user's intent.

[0496] Input: Text data

[0497] Specific behavior: The server uses a natural language processing library (e.g., a natural language processing library) to extract keywords and context from the text data and analyze the user's intent.

[0498] Output: User intent (e.g., feeling stressed)

[0499] Step 4:

[0500] Emotion analysis

[0501] The server uses an emotion analysis engine to analyze the user's emotional state from the text data.

[0502] Input: Text data

[0503] Specific operation: The server uses a sentiment analysis engine (e.g., sentiment analysis API) to infer the emotional state from the text data.

[0504] Output: Emotional state (e.g., stress)

[0505] Step 5:

[0506] Response Generation

[0507] The server generates appropriate responses based on the principles of cognitive behavioral therapy according to the user's intentions and emotional state.

[0508] Input: User intent, emotional state

[0509] What it does: The server uses a generative AI model (e.g., a response generation model) to generate a response based on the user's intent and emotional state.

[0510] Output: Response text (e.g., "Tell me more about what makes you stressed.")

[0511] Step 6:

[0512] Generate audio output

[0513] The server-generated response is converted into voice data using speech synthesis software.

[0514] Input: Response text

[0515] What happens: The server uses speech synthesis software (e.g., a speech synthesis API) to convert the response text into audio data.

[0516] Output: Response audio data

[0517] Step 7:

[0518] Providing audio output

[0519] The terminal provides the user with the audio data sent from the server through the speaker.

[0520] Input: Response audio data

[0521] Specific operation: The device uses the speaker to play back the response audio data.

[0522] Output: The audio response the user hears (e.g., "Tell me more about what makes you stressed.")

[0523] (Application example 1)

[0524] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0525] Conventional counseling systems have difficulty accurately grasping the user's emotional state, making it difficult to provide an appropriate response. Furthermore, there has been a lack of systems that can efficiently manage the user's behavioral and thought records and allow for later review. Furthermore, security services require rapid on-site response, but there has been no advanced dialogue system that includes emotion analysis.

[0526] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes: a means for listening to the user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with AI without being preachy; a means for preventing depression and previous low moods and guiding the user to a better life; a means for recording the user's behavior and thoughts during the dialogue and reviewing them at a later date; an emotion analysis means for analyzing the user's voice input and estimating their emotional state; a means for generating appropriate responses based on the emotional state and providing them as voice output; and a means for recording the conversation content and emotion analysis results in a database for later analysis. This makes it possible to accurately grasp the user's emotional state and provide appropriate responses. Furthermore, the ability to efficiently manage behavior and thought records and review them at a later date enables prompt and appropriate responses in security services.

[0527] "Voice interaction" means that the user interacts with the system through voice.

[0528] "Complaints, etc." are statements that contain negative emotions such as dissatisfaction or worries that users have.

[0529] "Avoiding preaching" means not giving the impression of instructing users in a condescending manner.

[0530] "AI" is an abbreviation for artificial intelligence, a technology that allows machines to imitate human intelligence and learn and reason.

[0531] "Natural dialogue" means that users can converse with the system without feeling uncomfortable.

[0532] Cognitive behavioral therapy is a treatment that solves psychological problems by changing the client's thoughts and behavior.

[0533] "Counseling services" are services that provide advice and support to users regarding psychological problems and worries.

[0534] "Depression" is a mental illness characterized by persistently depressed mood and loss of interest.

[0535] "Depressed mood" refers to a temporary feeling of gloom or lack of motivation.

[0536] "Behavior recording" refers to recording the user's behavior.

[0537] "Thought recording" means recording the user's thoughts and feelings.

[0538] "Emotion analysis means" is a technology for estimating the emotional state of a user from their voice input.

[0539] "Appropriate response" means generating an appropriate reply according to the user's situation and emotions.

[0540] "Audio output" means that the system provides information by voice.

[0541] A "database" is a system for systematically organizing and storing information.

[0542] A "means for enabling later analysis" is a method for later analysis of the recorded data.

[0543] The system for implementing this invention listens to users' complaints and other concerns in a voice dialogue format, while engaging in natural dialogue with AI in a way that is not preachy. The system provides counseling services based on the principles of cognitive behavioral therapy, helping users to prevent depression and lead better lives. It also allows users to keep records of their actions and thoughts during the dialogue, which can be reviewed at a later date.

[0544] Hardware and software used

[0545] Hardware:

[0546] Smartphone

[0547] Smart Glasses

[0548] microphone

[0549] software:

[0550] Natural language processing libraries (e.g. spaCy, NLTK)

[0551] Sentiment analysis engine (e.g. IBM Watson Tone Analyzer)

[0552] Speech recognition engine (e.g. Google Speech-to-Text)

[0553] Data processing and calculation

[0554] Acquiring voice input:

[0555] The device (smartphone or smart glasses) captures the user's voice data through a microphone, which is then converted into text data using a voice recognition engine.

[0556] Natural Language Processing:

[0557] The server analyzes the acquired text data using a natural language processing library to understand the content of the conversation, thereby understanding the user's intentions and situation.

[0558] Emotion analysis:

[0559] The server inputs the text data into an emotion analysis engine to estimate the user's emotional state. The emotion analysis engine analyzes emotions such as anger, anxiety, and tension in real time based on the user's tone of voice and speaking speed.

[0560] Response generation:

[0561] The server generates appropriate responses based on the principles of cognitive behavioral therapy and provides them to the device as voice output, allowing the user to receive appropriate advice and guidance.

[0562] Data recording and analysis:

[0563] The server records the conversation content and emotion analysis results in a database for later analysis, allowing users to efficiently manage their behavioral and thought records and review them at a later date.

[0564] Examples of specific examples and prompts

[0565] For example, if a security guard is talking to a suspicious person, the following prompt sentence can be input into the generative AI model:

[0566] Example prompt sentence:

[0567] Voice input: 'I don't need to explain what I'm doing here.'

[0568] Analysis result: 'Anger'

[0569] Response Generation: 'Please stay calm. We just want to check in. Let us know if we can help you with anything.'

[0570] Based on this prompt, the AI ​​model generates an appropriate response and provides it to the security guard as a voice output, enabling a quick and appropriate response on the scene.

[0571] The above is an embodiment of the present invention.

[0572] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0573] Step 1:

[0574] The device acquires the user's voice data through a microphone. The input is the user's voice and the output is voice data. Specifically, the device's microphone captures the voice and stores it as digital voice data.

[0575] Step 2:

[0576] The device sends the acquired voice data to a voice recognition engine, which converts it into text data. The input is voice data, and the output is text data. Specifically, the voice recognition engine (e.g., Google Speech-to-Text) analyzes the voice data and generates corresponding text.

[0577] Step 3:

[0578] The server inputs the text data into a natural language processing library and analyzes the conversation. The input is text data, and the output is the analysis results. Specifically, the natural language processing library (e.g., spaCy, NLTK) analyzes the text data and understands the user's intent and situation.

[0579] Step 4:

[0580] The server inputs the analysis results into an emotion analysis engine to estimate the user's emotional state. The input is the analysis results, and the output is the emotional state. Specifically, the emotion analysis engine (e.g., IBM Watson Tone Analyzer) estimates the emotional state based on the analysis results.

[0581] Step 5:

[0582] The server generates an appropriate response based on the emotional state. The input is the emotional state, and the output is the response text. Specifically, the generative AI model takes the emotional state into account and generates a response based on the principles of cognitive behavioral therapy.

[0583] Step 6:

[0584] The server inputs the generated response text into a speech synthesis engine to generate a voice output. The input is the response text, and the output is voice data. Specifically, the speech synthesis engine converts the text into voice and generates the voice data.

[0585] Step 7:

[0586] The terminal plays the generated voice data to the user. The input is voice data, and the output is voice output to the user. Specifically, the terminal's speaker plays the voice data and provides it to the user.

[0587] Step 8:

[0588] The server records the conversation content and the emotion analysis results in a database. The input is the conversation content and the emotion analysis results, and the output is the recording in the database. Specifically, the server saves the information in the database so that it can be analyzed later.

[0589] Example 2

[0590] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0591] Conventional counseling systems have difficulty effectively recording and analyzing changes in users' emotions and behavior, resulting in insufficient information for users to reflect on their own condition. Furthermore, they are unable to track changes in users' emotions over time and understand their patterns, making it difficult to optimize individual counseling services. Furthermore, there is a lack of a way to naturally analyze users' comments and automatically save records of their behavior and thoughts.

[0592] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0593] In this invention, the server includes: means for listening to a user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with AI so as not to be preachy; means for preventing depression and guiding the user to live a better life; means for recording the user's actions and thoughts during the dialogue and allowing them to be reviewed at a later date; means for recording changes in the user's emotions over time and analyzing those changes; means for analyzing the user's comments using a generative AI model and saving the records of actions and thoughts in a database; means for extracting emotional information from the user's comments using an emotion engine and recording it over time; and means for analyzing the recorded emotional information and understanding the user's emotional patterns. This makes it possible to effectively record and analyze changes in the user's emotions and behavior, thereby optimizing individual counseling services.

[0594] "Voice interaction" refers to a format in which a user interacts with a system using voice.

[0595] "Artificial intelligence" is a technology that allows computers to imitate human intelligence and have functions such as learning, reasoning, and recognition.

[0596] "Natural dialogue" is a form of dialogue in which users and systems can communicate smoothly, as if they were having a conversation between humans.

[0597] Cognitive behavioral therapy is a form of psychotherapy that aims to solve mental problems by changing the client's cognition and behavior.

[0598] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[0599] "Behavior record" refers to recording information about a user's behavior.

[0600] "Thought recording" refers to recording information about a user's thoughts.

[0601] "Emotional changes" refers to how a user's emotions change over time.

[0602] A "generative AI model" is a model that artificial intelligence uses to analyze user utterances.

[0603] A "database" is a system that stores information systematically and allows it to be searched and updated as needed.

[0604] An "emotion engine" is a technology for extracting emotional information from users' comments.

[0605] "Emotional patterns" are trends that indicate how a user's emotions change under specific conditions or at specific times.

[0606] This invention is a system that creates a record of a user's behavior and thoughts and tracks changes in their emotions. The system listens to the user's complaints in a voice dialogue format, and provides counseling services similar to cognitive behavioral therapy through natural dialogue with artificial intelligence that avoids being preachy. Furthermore, by recording and analyzing changes in the user's emotions over time, it is possible to understand what emotions the user tends to show when discussing specific topics or at specific times of the day.

[0607] Hardware and software used

[0608] Hardware: Servers, terminals (PCs, smartphones)

[0609] Software: Generative AI models (e.g., GPT-4), database management systems (e.g., MySQL), sentiment analysis engines (e.g., IBM Watson)

[0610] Specific operation of the system

[0611] 1. The user initiates an interaction with the system

[0612] A user accesses the system using a terminal and starts a dialogue. For example, the user opens the app on their smartphone and says, "I've been feeling depressed since this morning and haven't been able to get anything done."

[0613] 2. The server records the conversation

[0614] The server analyzes the dialogue received from the user using a generative AI model (e.g., GPT-4) and stores the dialogue in a database as a record of the user's actions and thoughts. For example, a statement such as "I've been feeling depressed since this morning, and I haven't been able to get anything done" is stored as is.

[0615] 3. The server analyzes the emotional information

[0616] The server uses an emotion engine (e.g., IBM Watson) to extract emotional information from the user's speech and records it over time. For example, it analyzes the emotion "I feel depressed" and stores the results in a database.

[0617] 4. The server analyzes changes in emotions

[0618] The server analyzes the recorded emotional information and identifies patterns of the user's emotions. For example, it may discover that the user tends to feel depressed when the topic of "work" is mentioned.

[0619] 5. User views the record

[0620] Users can access the system at a later date to view their own behavior, thoughts, and emotional changes. For example, if a user types into the system, "Show me my mood record from last week," the server will display the relevant record.

[0621] Examples of specific examples and prompts

[0622] Examples:

[0623] A user states to the system, "I was stressed at work today."

[0624] The server records the comments, and the emotion engine analyzes the "stress" and stores it in a database.

[0625] Later, when the user asks the system, "What was my stress level last week?" the server will display the relevant records.

[0626] Example prompt sentence:

[0627] "Tell me how you felt today."

[0628] "Please tell me about any recent changes in your mood."

[0629] "Tell me how your emotions change when you come across a particular topic."

[0630] In this way, the system records and analyzes changes in the user's behavior, thoughts, and emotions, providing reference information for the user to reflect on their own condition.

[0631] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0632] Step 1:

[0633] The user initiates an interaction with the system.

[0634] Specific operation: The user accesses the system using a terminal (PC or smartphone) and begins a dialogue.

[0635] Input: A user types into their terminal, "I've been feeling depressed since this morning and haven't been able to get anything done."

[0636] Output: The user's utterances are sent from the device to the server.

[0637] Step 2:

[0638] The server records the conversation.

[0639] Specific operation: The server analyzes the dialogue received from the user using a generative AI model (e.g., GPT-4) and stores it in a database as a record of actions and thoughts.

[0640] Input: User says, "I've been feeling depressed since this morning and haven't been able to get anything done."

[0641] Data processing: A generative AI model analyzes speech and structures it into a record of actions and thoughts.

[0642] Output: Structured data stored in a database.

[0643] Step 3:

[0644] The server analyzes the emotional information.

[0645] Specific operation: The server uses an emotion engine (e.g., IBM Watson) to extract emotional information from the user's utterances and records it over time.

[0646] Input: User says, "I've been feeling depressed since this morning and haven't been able to get anything done."

[0647] Data calculation: The emotion engine analyzes the statement and extracts the emotional information, such as "I feel depressed."

[0648] Output: Emotion information stored in the database in the format "October 1, 2023 10:00 - Feeling depressed".

[0649] Step 4:

[0650] The server analyzes changes in emotions.

[0651] Specific operation: The server analyzes the recorded emotional information and understands the user's emotional patterns.

[0652] Input: Past emotion information stored in a database.

[0653] Data calculation: The server analyzes changes in emotions for specific topics and time periods based on past emotion data.

[0654] Output: The analysis result is saved as "Users tend to feel depressed when talking about work."

[0655] Step 5:

[0656] A user views a record.

[0657] Specific actions: Users can access the system at a later date to view records of their own actions, thoughts, and emotional changes.

[0658] Input: A user types into their device, "Show me last week's mood log."

[0659] Data processing: The server retrieves the relevant records from the database.

[0660] Output: The user's device will display the following entry: "October 1, 2023, 10:00 - Feeling depressed".

[0661] (Application example 2)

[0662] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0663] Maintaining users' mental health is an important issue in modern society. However, conventional counseling services have difficulty tracking users' emotional changes in real time and providing appropriate responses. They also lack the means to detect security risks early on. This makes it difficult to effectively support users' mental health.

[0664] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0665] In this invention, the server includes means for providing counseling services such as cognitive behavioral therapy in a natural dialogue with artificial intelligence while listening to the user's complaints in a voice dialogue format so as not to sound preachy, means for preventing depression and previous low moods and guiding the user to live a better life, means for recording the user's actions and thoughts during the dialogue so that they can be reviewed at a later date, means for tracking changes in the user's emotions, recording emotional information over time and analyzing these changes, and means for analyzing emotional changes to detect security risks at an early stage.This makes it possible to effectively support the user's mental health and detect security risks at an early stage.

[0666] "Voice dialogue format" refers to a format in which a user and a system communicate using voice.

[0667] "Artificial intelligence" is the technology that enables computer systems to learn, reason, and self-correct by imitating human intelligence.

[0668] "Natural dialogue" is a form of dialogue in which users and systems can communicate smoothly, as if they were having a conversation between humans.

[0669] Cognitive behavioral therapy is a form of psychotherapy that solves mental problems by changing the client's cognition and behavior.

[0670] "Counseling services" are services that provide support to users to resolve their mental problems and worries.

[0671] "Depression" is a mental illness characterized by persistent sadness and loss of interest.

[0672] "Depression" is a temporary state of sadness or lethargy experienced by a user.

[0673] "Behavior record" means recording the actions taken by a user.

[0674] "Thought recording" is the act of recording what the user thinks and feels.

[0675] "Changes in emotions" refers to changes in a user's emotions over time.

[0676] "Tracking" means the continuous tracking and recording of specific information.

[0677] "Emotion information" is data related to the user's emotions.

[0678] A "security risk" is a potential threat or danger to a system or data.

[0679] "Early detection" means finding problems before they occur.

[0680] The system for implementing this invention provides a counseling service similar to cognitive behavioral therapy, listening to users' complaints and complaints in a voice dialogue format while engaging in natural dialogue with artificial intelligence to avoid being preachy. The system can record users' actions and thoughts, allowing them to review them at a later date. It also tracks changes in users' emotions, records emotional information over time, and analyzes these changes to enable early detection of security risks.

[0681] Hardware and software used

[0682] Hardware: Smartphone

[0683] Software: Python, JSON library

[0684] Data processing and calculation

[0685] server

[0686] The server listens to users' complaints and other concerns in a voice dialogue format and uses artificial intelligence to engage in natural conversation. The user's actions and thoughts are recorded with a timestamp and saved for future reference. It also uses an emotion engine to track changes in the user's emotions and records the emotional information over time. This allows for analysis of emotional changes and early detection of security risks.

[0687] Terminal

[0688] The device (smartphone) transmits information obtained through dialogue with the user to a server. The device converts voice input into text and saves it as a record of actions and thoughts. It also obtains emotional information using an emotion engine and transmits it to the server.

[0689] User

[0690] Users interact with the system via their smartphones. For example, if a user says, "I've been feeling depressed since this morning and haven't been able to get anything done," this information is recorded along with a timestamp. At the same time, the emotion of "sadness" is also recorded. This information can be used as reference when the user later reflects on their mood and actions that day.

[0691] Specific examples

[0692] For example, if a user says, "I've been feeling depressed since this morning and haven't been able to get anything done," that information is recorded along with a timestamp. At the same time, the emotion of "sadness" is also recorded. This information can be used as reference when the user later looks back on their mood and actions that day.

[0693] Prompt Sentence Examples

[0694] "I've been feeling down since this morning and haven't been able to get anything done."

[0695] In this way, the system can effectively support users' mental health and detect security risks early.

[0696] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0697] Step 1:

[0698] The user starts a conversation with the system via their smartphone. The user says, "I've been feeling depressed since this morning and haven't been able to get anything done." The input is the user's voice, and the output is voice data.

[0699] Step 2:

[0700] The device converts voice input to text. It uses speech recognition software to convert the voice data to text. The input is voice data and the output is text data.

[0701] Step 3:

[0702] The terminal sends text data to the server. The text data is sent to the server using network communication. The input is text data, and the output is data sent to the server.

[0703] Step 4:

[0704] The server receives the text data and stores it as a record of actions and thoughts. The text data is stored in a database along with a timestamp. The input is text data, and the output is a record in the database.

[0705] Step 5:

[0706] The server uses an emotion engine to extract emotional information from text data. It uses natural language processing technology to extract the emotion "sad" from the text data. The input is text data, and the output is emotional information.

[0707] Step 6:

[0708] The server records the emotion information with a timestamp and saves it in a database. The input is emotion information, and the output is a record in the database.

[0709] Step 7:

[0710] The server analyzes changes in emotional information and tracks them by comparing them with past emotional information. The input is past emotional information and current emotional information, and the output is the analysis result of the emotional changes.

[0711] Step 8:

[0712] The server evaluates security risks based on changes in emotions. It detects sudden changes in emotions and specific patterns to provide early warning of security risks. The input is the analysis result of emotional changes, and the output is the security risk assessment result.

[0713] Step 9:

[0714] The server transmits the security risk assessment results to the terminal. The assessment results are transmitted to the terminal using network communication. The input is the security risk assessment results, and the output is data transmission to the terminal.

[0715] Step 10:

[0716] The terminal notifies the user of the security risk evaluation results. It uses the notification function to display a warning message to the user. The input is the security risk evaluation results, and the output is a notification to the user.

[0717] Example 3

[0718] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0719] Conventional counseling systems have had difficulty providing appropriate advice and counseling services tailored to the user's emotional state. Furthermore, they lacked the means to effectively analyze the user's input data and generate specific advice based on the principles of cognitive behavioral therapy. This has resulted in insufficient support for users to understand their own mental state and derive specific actions to improve it.

[0720] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0721] In this invention, the server includes means for receiving user input, means for analyzing the input data, means for generating advice based on the principles of cognitive behavioral therapy, means for evaluating the emotional state of the user, means for providing counseling services according to the emotional state, and means for displaying the generated advice and questions, thereby making it possible to understand the user's mental state and provide appropriate advice and counseling.

[0722] "Means for receiving user input" refers to a function that allows a user to input data such as text or voice via a terminal and send that data to a server.

[0723] The "means for analyzing input data" is a function for analyzing the input data received by the server from the user and understanding its contents.

[0724] The "means for generating advice based on the principles of cognitive behavioral therapy" is a function for generating specific advice for the user in accordance with the principles of cognitive behavioral therapy based on the analyzed data.

[0725] The "means for evaluating the emotional state of the user" is a function for evaluating the emotional state from the data input by the user and determining a response according to that emotion.

[0726] The "means for providing counseling services according to emotional state" is a function for providing optimal counseling services and advice based on the assessed emotional state.

[0727] The "means for displaying the generated advice or question" is a function for displaying the advice or question generated by the server on the user's terminal.

[0728] This invention is a system that helps users understand their own mental state and derives specific actions to improve it. This system is realized using hardware and software such as a server, terminals, a generative AI model, an emotion engine, and a database management system.

[0729] Hardware and software used

[0730] Hardware: Servers, terminals (PCs, smartphones)

[0731] Software: Generative AI models (e.g., GPT-4), emotion engines, database management systems (e.g., MySQL)

[0732] Specific operation of the system

[0733] 1. Receive user input:

[0734] A user uses a terminal to provide text input to the system.

[0735] For example, the user may input, "Recently, I feel like nothing I do goes right."

[0736] The terminal transmits this input data to the server.

[0737] 2. Analysis of input data:

[0738] The server passes the received user input data to a generative AI model (e.g., GPT-4).

[0739] The generative AI model analyzes what the user says and identifies the thought patterns behind it.

[0740] For example, the generative AI model recognizes a user's negative thought patterns from the phrase "it's not working."

[0741] 3. Generating Advice:

[0742] The server generates advice based on the analysis results obtained from the generative AI model, based on the principles of cognitive behavioral therapy.

[0743] For example, create specific advice such as, "It's important to reflect on your own successes and focus on the positive aspects."

[0744] The server stores this advice in a database.

[0745] 4. Emotional state assessment:

[0746] The server uses an emotion engine to assess the user's emotional state from the input data.

[0747] For example, strong emotions such as "anger" or "sadness" can be detected from user input.

[0748] The emotion engine identifies appropriate responses to these emotions.

[0749] 5. Providing counseling services:

[0750] The server provides optimal counseling services according to the user's emotional state.

[0751] For example, if the user is showing signs of anger, the server will prioritize providing advice such as "Take a deep breath and take some time to relax."

[0752] On the other hand, if the user is in a calm emotional state, the server will ask questions that encourage deeper self-understanding, such as, "What recent events have made the biggest impression on you?"

[0753] 6. Displaying the results:

[0754] The server sends the generated advice and questions to the terminal.

[0755] The terminal displays this information to the user.

[0756] For example, the user's screen might display the message, "It's important to reflect on your own successes and focus on the positive aspects."

[0757] Examples and prompts

[0758] Examples:

[0759] The user types, "Lately, nothing seems to work."

[0760] The system offers the advice, "It's important to reflect on your own successes and focus on the positive aspects."

[0761] The emotion engine assesses the user's emotional state and provides appropriate counseling services.

[0762] Example prompt sentence:

[0763] "Lately, nothing I do seems to work. What should I do?"

[0764] "What recent event has particularly impressed you?"

[0765] In this way, the system can understand the user's mental state and provide appropriate advice and counseling. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0766] Step 1:

[0767] Accepting user input

[0768] Specific behavior:

[0769] A user uses a terminal to provide text input to the system.

[0770] For example, the user may input, "Recently, I feel like nothing I do goes right."

[0771] Input: User text input

[0772] Output: Sending input data from the terminal to the server

[0773] Step 2:

[0774] Analyzing input data

[0775] Specific behavior:

[0776] The server passes the received user input data to a generative AI model (e.g., GPT-4).

[0777] The generative AI model analyzes what the user says and identifies the thought patterns behind it.

[0778] Input: User-entered data

[0779] Output: Analysis results (identification of thought patterns)

[0780] Step 3:

[0781] Generating Advice

[0782] Specific behavior:

[0783] The server generates advice based on the analysis results obtained from the generative AI model, based on the principles of cognitive behavioral therapy.

[0784] For example, create specific advice such as, "It's important to reflect on your own successes and focus on the positive aspects."

[0785] Input: Analysis results

[0786] Output: The generated advice

[0787] Step 4:

[0788] Emotional state assessment

[0789] Specific behavior:

[0790] The server uses an emotion engine to assess the user's emotional state from the input data.

[0791] For example, strong emotions such as "anger" or "sadness" can be detected from user input.

[0792] Input: User-entered data

[0793] Output: Emotional state assessment result

[0794] Step 5:

[0795] Providing counseling services

[0796] Specific behavior:

[0797] The server provides optimal counseling services according to the user's emotional state.

[0798] For example, if the user is showing signs of anger, the server will prioritize providing advice such as "Take a deep breath and take some time to relax."

[0799] Input: Emotional state assessment result

[0800] Output: Counseling services provided

[0801] Step 6:

[0802] Displaying the results

[0803] Specific behavior:

[0804] The server sends the generated advice and questions to the terminal.

[0805] The terminal displays this information to the user.

[0806] For example, the user's screen might display the message, "It's important to reflect on your own successes and focus on the positive aspects."

[0807] Input: Generated advice or question

[0808] Output: The results displayed on the user's terminal

[0809] (Application example 3)

[0810] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0811] In modern society, there is a demand for systems that can grasp users' emotional states in real time and provide appropriate advice and product suggestions. However, conventional systems have difficulty responding flexibly to users' emotional states, and have had issues with not being able to respond appropriately, particularly when users show strong emotions or are in a calm state. In addition, it is not possible to record users' actions or thoughts, making it impossible to review them later, making it difficult to provide continuous support.

[0812] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes: a means for listening to the user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with AI so as not to be preachy; a means for preventing depression and previous low moods and guiding the user to live a better life; a means for recording the user's actions and thoughts during the dialogue and reviewing them at a later date; a means for understanding the user's mental state in real time and providing appropriate advice and product suggestions; a means for providing advice to calm the user when the user shows strong emotions; and a means for providing questions and tasks to deepen the user's self-understanding when the user is calm and suggesting products based on the results. This enables flexible responses according to the user's mental state and provides continuous support.

[0813] "Voice dialogue format" refers to a format in which a user and a system communicate using voice.

[0814] "Complaints, etc." are statements that contain negative emotions such as dissatisfaction or worries that users feel in their daily lives.

[0815] "Avoiding preaching" means not giving the impression of instructing users in a condescending manner.

[0816] "AI" is an abbreviation for artificial intelligence, a technology that allows computers to act in a way that mimics human intelligence.

[0817] "Natural dialogue" means that the user and the system communicate smoothly, like a conversation between humans.

[0818] Cognitive behavioral therapy is a type of psychotherapy that encourages clients to reevaluate their thought patterns and engage in constructive behavior.

[0819] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[0820] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[0821] "Mood depression" refers to a temporary negative emotion or low mood experienced by a user.

[0822] "Behavior record" means recording the actions taken by a user.

[0823] "Thought recording" is the act of recording what the user thinks and feels.

[0824] "Real-time" means that information entered by a user is processed immediately.

[0825] "Advice" means advice or suggestions provided to a user.

[0826] "Product suggestion" refers to recommending appropriate products based on the user's needs and condition.

[0827] "Strong emotions" are strong emotions such as anger or sadness felt by the user.

[0828] "Calming advice" is advice to help users calm their strong emotions.

[0829] "Self-understanding" means that users gain a deep understanding of their own emotions and thoughts.

[0830] "Questioning" means asking questions that make users think.

[0831] "Issues" are problems or challenges that users must address.

[0832] The system for implementing this invention is configured as follows: First, the server listens to the user's complaints in a voice dialogue format, while engaging in a natural dialogue with the AI ​​without sounding preachy. This provides a counseling service similar to cognitive behavioral therapy. The server uses an emotion engine to grasp the user's mental state in real time and provide appropriate advice and product suggestions.

[0833] Hardware and software used

[0834] Hardware: Smartphone

[0835] Software: Python, sentiment analysis library (e.g. TextBlob, NLTK)

[0836] Data processing and calculation

[0837] 1. Getting user input: A smartphone application gets input from the user. For example, the user might type, "Lately, I feel like nothing I do is going right."

[0838] 2. Sentiment Analysis: The emotion engine analyzes the user's input and identifies their current emotional state. For example, the user may type "sad."

[0839] 3. Providing advice: Providing advice based on the emotional state. For example, "Take a short break to refresh yourself."

[0840] 4. Product proposal: When the user is in a calm state, we provide questions and tasks to deepen self-understanding, and then make product proposals based on those questions and tasks.

[0841] Specific examples

[0842] Example 1: Sentiment analysis and advice provision

[0843] If a user types, "I feel like nothing I do goes right these days," the emotion engine will interpret this as "sad" and offer the advice, "Take a break and refresh yourself."

[0844] Example 2: Product proposal

[0845] If a user types "I'm feeling good today," the emotion engine will interpret this as "happy" and suggest products based on the user's interests along with the advice "Keep it up!"

[0846] Prompt Sentence Examples

[0847] "Tell me how you're feeling right now: Lately, it feels like nothing I do is going right."

[0848] "Tell me how you feel right now: I feel good today."

[0849] In this way, a system can be realized that can respond flexibly to the user's mental state and provide continuous support.

[0850] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0851] Step 1:

[0852] The user launches the smartphone application and inputs their current feelings. The input text is sent to the server, which then uses the input data to analyze the user's emotional state.

[0853] Step 2:

[0854] The server analyzes the received user input data using a sentiment analysis library (e.g., TextBlob, NLTK). Specifically, emotions are extracted from the input text and classified as "happy," "sad," "angry," or "calm." For example, an input such as "I feel like nothing I do these days goes well" would be classified as "sad."

[0855] Step 3:

[0856] The server uses an emotion engine to generate advice based on the analysis results. Advice according to the emotional state is retrieved from the database and provided to the user. For example, if the emotional state is classified as "sad," the advice generated is "Take a short break and refresh yourself."

[0857] Step 4:

[0858] The server records the user's emotional state and advice, allowing the user to later reflect on their own emotional state and the advice they received. The recorded data is saved as a record of the user's actions and thoughts.

[0859] Step 5:

[0860] If a user expresses strong emotions, the server will prioritize providing advice to calm them down. For example, if the user is classified as "angry," the server will provide advice such as "Take a deep breath and stay calm."

[0861] Step 6:

[0862] If the user is in a calm state, the server will provide questions and challenges to deepen self-understanding. For example, if the user is classified as "calm," the server will suggest related products along with advice such as "Try something new."

[0863] Step 7:

[0864] The server then makes appropriate product suggestions based on the user's input data and the results of emotion analysis. For example, if the emotion is classified as "happy," the server will suggest products based on the user's interests along with the advice, "Keep it up!"

[0865] Step 8:

[0866] The user can review the advice and product suggestions provided and take action if necessary. The user's feedback is sent to the server and reflected in future advice and suggestions.

[0867] In this way, a system can be realized that can respond flexibly to the user's mental state and provide continuous support.

[0868] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0869] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0870] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[0871] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0872] [Second embodiment]

[0873] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0874] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0875] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0876] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0877] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0878] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0879] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0880] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0881] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0882] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0883] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0884] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0885] "Example 1"

[0886] One embodiment of the present invention provides a voice dialogue system using AI. This system accepts voice input from a user and uses natural language processing technology to understand the content. It then generates an appropriate response based on the principles of cognitive behavioral therapy and provides it to the user as voice output. The purpose of this dialogue is to deepen understanding of the user's problems and concerns and to provide appropriate advice and guidance.

[0887] "Example 2"

[0888] Furthermore, this system has the function of creating a record of the user's actions and thoughts. Specifically, when the user describes their actions or thoughts while interacting with the system, the system records them and saves them for later reference. For example, if a user says, "I've been feeling depressed since this morning and haven't been able to get anything done," the system records that information and provides it as reference information for the user to use later when reflecting on their mood and actions that day.

[0889] "Example 3"

[0890] This system helps users understand their own mental state and guides them in taking concrete actions to improve it. For example, if a user says, "I feel like nothing I do goes well these days," the system will explore the underlying thought patterns and provide advice based on the principles of cognitive behavioral therapy. This will encourage users to reevaluate their own thought patterns and take more constructive action.

[0891] The processing flow of each embodiment will be described below.

[0892] "Example 1"

[0893] Step 1: The system accepts voice input from the user, which includes the user's emotions, thoughts, and actions.

[0894] Step 2: The system uses natural language processing technology to understand the voice input, extracting the user's emotions, thought patterns, and behavioral tendencies.

[0895] Step 3: The system generates an appropriate response based on the principles of cognitive behavioral therapy, which aims to deepen understanding of the user's problems and concerns and provide appropriate advice and guidance.

[0896] Step 4: The generated response is provided to the user as a voice output, which can provide the user with a new perspective or solution to their problem or concern.

[0897] "Example 2"

[0898] Step 1: The user describes their actions and thoughts while interacting with the system.

[0899] Step 2: The system analyzes the user's statements using natural language processing technology and creates a record of their actions and thoughts.

[0900] Step 3: The created records are saved in the system and can be referenced later by the user, allowing them to reflect on their own behavioral and thought patterns and deepen their self-understanding.

[0901] "Example 3"

[0902] Step 1: The user describes their problem or concern to the system.

[0903] Step 2: The system analyzes the user's statements using natural language processing technology and explores the thought patterns behind them.

[0904] Step 3: The system generates and provides advice based on principles of cognitive behavioral therapy to the user, encouraging them to reevaluate their thought patterns and adopt more constructive behaviors.

[0905] Example 1

[0906] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0907] Conventional counseling systems often lack an environment where users can feel free to talk about their complaints and worries, and it is difficult to have natural conversations without sounding preachy. Furthermore, systems that allow users to record their behavior and thoughts are limited, and lack the functionality to review them later. This means that users are not provided with sufficient support to prevent depression and lead better lives.

[0908] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0909] In this invention, the server includes means for accepting voice input and converting it into text data using voice recognition technology, means for analyzing the text data using natural language processing technology and generating an appropriate response, and means for converting the generated response into voice data and providing it as a voice output. This allows users to freely talk about their complaints and worries, and enables the provision of counseling services based on cognitive behavioral therapy through natural dialogue that is not preachy. Furthermore, the server can keep records of users' actions and thoughts, which can be reviewed later, providing sufficient support to prevent depression and lead a better life.

[0910] "Voice interaction" means that the user interacts with the system through voice.

[0911] "Artificial intelligence" is a technology that allows computers to mimic human intelligence and learn, reason, and self-correct.

[0912] "Natural language processing technology" is a technology that allows computers to understand and generate human language.

[0913] Cognitive behavioral therapy is a form of psychotherapy that improves emotional and behavioral problems by changing thoughts and behaviors.

[0914] "Counseling services" are services that provide advice and support to users regarding their worries and problems.

[0915] "Voice input" refers to a user inputting voice into the system through a microphone.

[0916] "Speech recognition technology" is a technology that converts voice into text data.

[0917] "Text data" is character string data converted using voice recognition technology.

[0918] "Response generation" is the process of generating an appropriate reply based on the analyzed text data.

[0919] "Audio data" refers to data obtained by converting text data into an audio signal.

[0920] "Audio output" refers to playing the generated audio data through a speaker or the like.

[0921] "Behavior record" is data that records the user's behavior.

[0922] "Thought records" are data that record the user's thoughts.

[0923] "Analysis" is the process of understanding text data and extracting meaning.

[0924] This invention is a system that provides counseling services based on cognitive behavioral therapy by listening to users' complaints and worries in a voice dialogue format, while engaging in natural dialogue with artificial intelligence to avoid being preachy. The system aims to prevent users from becoming depressed and to provide support for them to live better lives.

[0925] System configuration

[0926] Hardware

[0927] Device: A device with a microphone and speaker (e.g., smartphone, tablet, computer)

[0928] Server: a computer system with high-performance computing power

[0929] software

[0930] Speech recognition technology: Software that converts voice data into text data (e.g., Google Cloud Speech-to-Text API)

[0931] Natural language processing technology: Software that analyzes text data and generates appropriate responses (e.g., OpenAI's GPT-4)

[0932] Speech synthesis technology: Software that converts text data into voice data (e.g., Google Cloud Text-to-Speech API)

[0933] System Operation

[0934] Accepting voice input

[0935] The user speaks into the device's microphone. For example, they might say, "I've been feeling a lot of stress lately." The device captures this speech as digital audio data.

[0936] Converting audio data to text

[0937] The device sends the captured voice data to a server, which uses voice recognition technology to convert the voice data into text data. During this conversion process, the voice signal is analyzed and a corresponding string of characters is generated.

[0938] Text data analysis

[0939] The server receives the converted text data and analyzes it using natural language processing technology. This analysis uses a generative AI model. The server extracts and understands the user's intentions and emotions from the text data.

[0940] Generating a response

[0941] Based on the analysis results, the server generates appropriate responses based on the principles of cognitive behavioral therapy using a pre-trained generative AI model. The generated responses are stored on the server as text data.

[0942] Response transcription

[0943] The server converts the generated text data into voice data using speech synthesis technology, in which the text data is converted into voice signals and generated as natural-sounding speech.

[0944] Audio Output

[0945] The server transmits the generated voice data to the terminal, which plays the voice data through a speaker and provides a response to the user.

[0946] Specific examples

[0947] As a concrete example, consider the case where a user voice-inputs, "I've been feeling very stressed lately." This voice input is captured by the device via a microphone and sent to the server. The server then uses voice recognition technology to convert it into text data such as, "I've been feeling very stressed lately."

[0948] The server then analyzes this text data using natural language processing technology to understand the user's intention regarding stress, and generates a response based on the principles of cognitive behavioral therapy, such as, "To reduce stress, it is important to first recognize and accept your own emotions. Specifically, keeping a diary and setting aside time to relax are effective."

[0949] The generated response is converted into voice data using voice synthesis technology and provided to the user through the device's speaker.

[0950] An example of a prompt might be:

[0951] User: "I've been feeling a lot of stress lately."

[0952] Sarver: "The key to reducing stress is to first recognize and accept your emotions. Specifically, journaling and setting aside time to relax can be effective."

[0953] In this way, the system can better understand the user's problems and concerns and provide appropriate advice and guidance.

[0954] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0955] Step 1:

[0956] The user speaks into the microphone of the device. For example, they might say, "I've been feeling a lot of stress lately." The device captures this speech as digital audio data. The input is the user's voice, and the output is digital audio data.

[0957] Step 2:

[0958] The device sends the captured voice data to a server, which uses voice recognition technology to convert the voice data into text data. During this conversion process, the voice signal is analyzed and a corresponding string of characters is generated. The input is digital voice data, and the output is text data.

[0959] Step 3:

[0960] The server receives the converted text data and analyzes it using natural language processing technology. A generative AI model is used for this analysis. The server extracts and understands the user's intentions and emotions from the text data. The input is the text data, and the output is the analysis results.

[0961] Step 4:

[0962] The server generates an appropriate response based on the principles of cognitive behavioral therapy based on the analysis results. A pre-trained generative AI model is used to generate this response. The generated response is saved as text data on the server. The input is the analysis results, and the output is the text data of the response.

[0963] Step 5:

[0964] The server converts the generated text data into voice data using speech synthesis technology. In this conversion process, the text data is converted into voice signals and generated as natural-sounding speech. The input is the response text data, and the output is voice data.

[0965] Step 6:

[0966] The server transmits the generated voice data to the terminal, which plays the voice data through a speaker and provides a response to the user. The input is the voice data, and the output is a voice response provided to the user.

[0967] In this way, the system can better understand the user's problems and concerns and provide appropriate advice and guidance.

[0968] (Application example 1)

[0969] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0970] In modern society, users experience various stresses and anxieties in their daily lives. In particular, depression, low mood, and security-related anxieties are on the rise, and appropriate support for these issues is needed. However, conventional counseling services and security advice require users to consult with experts directly, which places time and place restrictions on the users. There is also psychological resistance to consulting with experts. To solve these issues, a system that users can easily access is needed.

[0971] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0972] In this invention, the server includes: means for listening to the user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy in a natural dialogue with AI that does not sound preachy; means for preventing depression and previous low moods and guiding the user to live a better life; means for recording the user's actions and thoughts during the dialogue and allowing them to be reviewed at a later date; means for providing appropriate advice and guidance for security concerns and questions; means for converting voice input into text and generating an appropriate response using a generative AI model; and means for providing the generated text response as voice output. This allows users to easily receive counseling services and security advice.

[0973] "Voice interaction" means that the user interacts with the system through voice.

[0974] "Complaints, etc." refers to statements made by users regarding dissatisfaction or stress they feel in their daily lives.

[0975] "Avoiding preaching" means avoiding instructing or criticizing users and maintaining a natural dialogue.

[0976] "AI" refers to artificial intelligence technologies, specifically including natural language processing and generative AI models.

[0977] "Natural dialogue" is a dialogue format designed to allow users to converse with the system in a natural way.

[0978] "Cognitive behavioral therapy" is a type of psychotherapy that aims to improve a client's thoughts and behaviors.

[0979] "Counseling services" are services that provide support and advice to users regarding psychological problems and worries.

[0980] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[0981] "Mood depression" refers to a temporary state of depression or lethargy experienced by users.

[0982] "Behavior records" are data that record the user's daily behavior.

[0983] "Thought records" are data that record the user's thoughts and feelings.

[0984] "Security concerns" refers to concerns users have about the safety of their information and privacy.

[0985] "Advice and Guidance" means advice or guidance provided to a User.

[0986] "Voice input" refers to a user providing information to a system by voice via a microphone.

[0987] "Convert to text" is the process of converting audio data into text data.

[0988] A "generative AI model" is an artificial intelligence model that generates appropriate responses based on input data.

[0989] A "text response" is a response of text data generated by a generative AI model.

[0990] "Voice output" is the process of converting text data into speech and providing it to the user.

[0991] The following system configuration will be described as an embodiment of the present invention.

[0992] System Configuration

[0993] The system listens to users' complaints and concerns in a voice dialogue format, providing counseling services similar to cognitive behavioral therapy through natural dialogue with AI that avoids being preachy. It also offers ways to prevent depression and low mood and guide users toward a better life. It also includes a function that allows users to record their actions and thoughts during the dialogue, allowing them to review them later. It also has a function that provides appropriate advice and guidance for security-related concerns and questions.

[0994] Hardware and software used

[0995] Hardware: Smartphone (microphone, speaker)

[0996] software:

[0997] speech_recognition library: Used to convert voice input to text.

[0998] Transformers library: Uses generative AI models (e.g., GPT-3) to generate appropriate responses.

[0999] Data processing and calculation

[1000] 1. Acquiring voice input: The user provides information by voice through the smartphone microphone, and the server captures this voice data.

[1001] 2. Speech recognition: The server uses the speech_recognition library to convert the voice data into text.

[1002] 3. Natural Language Processing: The server uses a generative AI model (e.g., GPT-3) to generate an appropriate response based on the user's input.

[1003] 4. Audio output: The server provides the generated text response as audio output through the smartphone's speaker.

[1004] Specific examples

[1005] If a user asks, "I think I received a phishing email. What should I do?", the server inputs the following prompt into the generative AI model:

[1006] Prompt Sentence Examples

[1007] A user asked a security question: I think I received a phishing email. What should I do?

[1008] AI Assistant: Do not click on the link in that email. Check the sender's address and contact official support.

[1009] The generative AI model generates an appropriate response based on the prompt, and the server provides the response as voice output to the user, allowing users to easily receive counseling services and security advice.

[1010] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1011] Step 1:

[1012] The user provides information by voice through the smartphone microphone. The server captures this voice data. The input is the user's voice data, and the output is the captured voice data.

[1013] Step 2:

[1014] The server uses the speech_recognition library to convert the captured voice data into text. The input is voice data and the output is text data. In this step, speech recognition technology is used to convert the voice data into text data.

[1015] Step 3:

[1016] The server uses a generative AI model (e.g., GPT-3) to generate an appropriate response based on the text data. The input is the user's text data, and the output is the generated text response. In this step, the generative AI model generates an appropriate response based on the prompt sentence.

[1017] Step 4:

[1018] The server provides the generated text response as a voice output through the smartphone speaker. The input is the generated text response and the output is voice data. In this step, the text data is converted into voice and provided to the user.

[1019] Step 5:

[1020] The server records the user's actions and thoughts during the dialogue. The input is the user's text data and generated text responses, and the output is the action record and thought record data. In this step, the dialogue content is recorded so that it can be reviewed at a later date.

[1021] Step 6:

[1022] The server provides appropriate advice and guidance for security concerns and questions. The input is the user's security question, and the output is the generated security advice. In this step, a generative AI model is used to generate an appropriate security response.

[1023] Example 2

[1024] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1025] In modern society, many people suffer from stress and depression. Depression and its precursor, low mood, are particularly significant factors that significantly reduce quality of life. Conventional counseling services primarily involve face-to-face sessions with a specialist, but are often limited by time and location, making them difficult for users to access. Furthermore, systems for efficiently managing and later referencing users' activity and thought records have yet to be fully developed. To address these issues, a system is needed that can provide counseling services through natural, non-preachy dialogue while listening to users' complaints in a voice-based dialogue format, and that can also efficiently manage and reference users' activity and thought records.

[1026] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1027] In this invention, the server includes: means for listening to a user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with an AI that avoids being preachy; means for preventing depression and guiding the user to live a better life; means for keeping a record of the user's actions and thoughts during the dialogue and allowing them to review them at a later date; means for a terminal to convert speech into text when the user speaks to the system and send the text to a generative AI model; means for the generative AI model to analyze the text and the server to store the analysis results in a database; and means for the server to retrieve the records from the database and display them on the terminal when the user wants to view the records. This allows users to easily receive counseling services regardless of time or place, and also enables them to efficiently manage and view their own action and thought records.

[1028] "Voice interaction" refers to a format in which a user interacts with a system using voice.

[1029] "Complaints, etc." refers to the dissatisfaction, stress, worries, etc. that users experience in their daily lives.

[1030] "Artificial intelligence" is a technology that allows computers to act in a way that mimics human intelligence.

[1031] "Natural dialogue" is a dialogue format designed to allow users to converse with the system in a natural way.

[1032] "Cognitive behavioral therapy" is a form of psychotherapy that aims to improve mood and behavior by changing the user's cognition and behavior.

[1033] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[1034] "Mood depression" refers to a temporary state of low emotion or depression experienced by a user.

[1035] "Behavior records" are data that record the user's daily behavior.

[1036] "Thought records" are data that record the user's thoughts and feelings.

[1037] A "terminal" is a device (e.g., smartphone, PC) that a user uses to interact with the system.

[1038] "Speech-to-text" is the process of converting audio data into text using speech recognition technology.

[1039] A "generative AI model" is a model that uses artificial intelligence to analyze text data and extract meaning.

[1040] "Analysis results" are information obtained by the generative AI model analyzing text data.

[1041] A "database" is a system for efficiently storing and managing data.

[1042] "Referring to records" refers to the act of checking stored data at a later date.

[1043] This invention is a system that listens to users' complaints and other issues in a voice dialogue format, provides counseling services such as cognitive behavioral therapy through natural dialogue with artificial intelligence that avoids being preachy, and can also efficiently manage and refer to users' behavioral and thought records.

[1044] Hardware and software used

[1045] This system is realized using the following hardware and software.

[1046] Hardware: Servers (e.g., cloud computing services), devices (e.g., smartphones, PCs)

[1047] Software: Generative AI models (e.g., natural language processing models), databases (e.g., relational database management systems)

[1048] Data processing and calculation

[1049] Voice Recognition

[1050] When a user speaks to the system through the device, the device uses voice recognition software to convert the speech into text, for example by using the Google Speech-to-Text API.

[1051] Text analytics

[1052] The converted text data is sent to a generative AI model. The generative AI model (e.g., a natural language processing model) analyzes the text data and extracts the user's actions and thoughts. For example, from the text "I've been feeling depressed since this morning and I haven't been able to get anything done," the information "I've been feeling depressed" and "I haven't been able to get anything done" can be extracted.

[1053] Data storage

[1054] The server receives the analysis results sent from the generative AI model and stores them in a database. The stored data includes the user ID, date and time, behavioral records, and thought records. A relational database management system (e.g., MySQL) is used as the database.

[1055] Data Reference

[1056] When a user wants to refer to the record of their actions or thoughts at a later date, they access the system using a terminal. The server retrieves the relevant record from the database and displays it on the terminal. For example, if a user requests "Show me yesterday's record," the server retrieves yesterday's record from the database and displays it on the terminal.

[1057] Specific examples

[1058] scenario:

[1059] A user talks to the system using a smartphone, stating, "I've been feeling depressed since this morning and haven't been able to get anything done."

[1060] Example prompt sentence:

[1061] "I've been feeling down since this morning and haven't been able to get anything done. Please record this information."

[1062] In this way, the system efficiently manages the user's records of actions and thoughts and makes them available for later reference.

[1063] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1064] Step 1:

[1065] The user talks to the system.

[1066] Specific action: The user speaks into the smartphone microphone, "I've been feeling depressed since this morning and haven't been able to get anything done."

[1067] Input: User's voice data.

[1068] Output: Audio data is input to the device.

[1069] Step 2:

[1070] The device converts the speech to text.

[1071] What happens: Your device calls speech recognition software (e.g., Google Speech-to-Text API) and converts your speech into text, such as "I've been feeling depressed since this morning and haven't been able to get anything done."

[1072] Input: Audio data.

[1073] Output: Text data.

[1074] Step 3:

[1075] The device sends the text to a generative AI model.

[1076] What it does: The device sends the converted text over the internet to a generative AI model (e.g., a natural language processing model).

[1077] Input: Text data.

[1078] Output: The text data sent to the generative AI model.

[1079] Step 4:

[1080] A generative AI model analyzes the text.

[1081] What it does: The generative AI model analyzes the text and extracts information such as "I feel depressed" and "I couldn't get anything done."

[1082] Input: Text data.

[1083] Output: Analysis results (behavioral record, thought record).

[1084] Step 5:

[1085] The server stores the analysis results in a database.

[1086] Specific operation: The server receives the analysis results and stores the user ID, date and time, behavioral record, and thought record in a database (e.g., a relational database management system).

[1087] Input: Analysis results (action log, thought log).

[1088] Output: Records stored in a database.

[1089] Step 6:

[1090] A user views a record.

[1091] Specific operation: When a user requests "Show me yesterday's records" on their smartphone, the server retrieves yesterday's records from the database and displays them on the smartphone.

[1092] Input: The user request.

[1093] Output: The transcript displayed on the terminal.

[1094] (Application example 2)

[1095] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1096] In modern society, there is a demand for counseling services to help users maintain their mental health. However, conventional counseling services make it difficult for users to record their own actions and thoughts and review them later. They also lack a means to record security-related actions and thoughts so that they can be referenced later. This makes it difficult for users to receive appropriate feedback to improve their mental health and security awareness.

[1097] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for providing counseling services such as cognitive behavioral therapy through a natural dialogue with an AI while listening to the user's complaints in a voice dialogue format so as not to sound preachy; a means for preventing depression and previous low moods and guiding the user to live a better life; a means for recording the user's actions and thoughts during the dialogue so that they can be reviewed at a later date; and a means for recording security-related actions and thoughts and saving them for future reference. This allows the user to receive appropriate feedback to maintain their mental health and improve their security awareness.

[1098] "Voice interaction" means that the user interacts with the system through voice.

[1099] "Complaints, etc." refers to statements made by users regarding dissatisfaction or stress they feel in their daily lives.

[1100] "Not preachy" means avoiding a pressured or instructional tone that users may feel while interacting with the system.

[1101] "AI" is an abbreviation for artificial intelligence, and refers to technology that allows machines to act in a way that mimics human intelligence.

[1102] "Natural dialogue" refers to a dialogue format that allows users to feel as if they are having a conversation with a system.

[1103] "Cognitive behavioral therapy" is a type of psychotherapy that improves mental health by improving the user's cognition and behavior.

[1104] "Counselling services" are services that provide consultation and advice to support the mental health of users.

[1105] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[1106] "Mood depression" refers to a temporary state of mental depression experienced by the user.

[1107] "Behavior record" refers to recording specific actions taken by a user.

[1108] "Thought recording" refers to recording what the user thinks and feels.

[1109] "Looking back" refers to revisiting past actions and thoughts.

[1110] "Security-related actions and thoughts" refer to the actions and thoughts that users take regarding their own safety and information protection.

[1111] "Storing" refers to storing recorded information for future reference.

[1112] The following system configuration is used as an embodiment of this invention. The system provides a counseling service similar to cognitive behavioral therapy by listening to the user's complaints in a voice dialogue format and engaging in natural dialogue with AI to avoid being preachy. The system also has a function to record the user's actions and thoughts and allow them to be reviewed at a later date. It also includes a function to record security-related actions and thoughts and save them for future reference.

[1113] System Program

[1114] The system includes the following programs:

[1115] 1. Voice interaction:

[1116] The server uses speech recognition software (e.g., Google Speech-to-Text API) to convert the user's speech into text, which is then analyzed using natural language processing techniques (e.g., OpenAI GPT-3) to generate an appropriate response.

[1117] 2. Providing counseling services:

[1118] The server converts the generated response into speech using speech synthesis software (e.g., Google Text-to-Speech API) and provides it to the user, allowing the user to receive counseling through natural dialogue.

[1119] 3. Keeping records of actions and thoughts:

[1120] The server records the user's actions and thoughts in text format and stores them in a database (e.g., MySQL). The stored data can be accessed by the user at a later date.

[1121] 4. Security-related records:

[1122] The server identifies the security-related actions and thoughts expressed by the user and stores them in a database, allowing users to refer to these records later to improve their security awareness.

[1123] Processing Description

[1124] The server uses speech recognition software to convert the user's speech into text and analyzes it using natural language processing technology. Based on the analysis results, it generates an appropriate response and converts it into speech using speech synthesis software. The user's actions and thoughts are recorded in text format and saved in a database, allowing the user to refer to these records at a later date.

[1125] Specific examples

[1126] For example, if a user says, "I upgraded my home security system today," that information is converted into text through speech recognition software and analyzed using natural language processing technology. The analysis results are stored in a database, and the user can refer to the record at a later date.

[1127] Prompt Sentence Examples

[1128] If you say, "Today I upgraded my home security system," record that information and save it for future reference.

[1129] In this way, a system is realized that provides appropriate feedback to maintain users' mental health and improve their security awareness.

[1130] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1131] Step 1:

[1132] The server uses speech recognition software (e.g., Google Speech-to-Text API) to convert the user's speech into text. The input is the user's voice, and the output is text data. For example, when the user says, "Today I upgraded my home security system," the speech is converted into text.

[1133] Step 2:

[1134] The server analyzes the converted text data using natural language processing technology (e.g., OpenAI GPT-3). The input is the text data obtained in step 1, and the output is an appropriate response as a result of the analysis. Specifically, the text "I upgraded my home security system today" is analyzed, and an appropriate response is generated.

[1135] Step 3:

[1136] The server converts the generated response into speech using speech synthesis software (e.g., Google Text-to-Speech API) and provides it to the user. The input is the response text obtained in step 2, and the output is audio data. Specifically, the generated response is converted into speech and played back to the user.

[1137] Step 4:

[1138] The server records the user's actions and thoughts in text format and stores them in a database (e.g., MySQL). The input is the text data obtained in step 1, and the output is the record stored in the database. Specifically, the text "I upgraded my home security system today" is stored in the database.

[1139] Step 5:

[1140] The server identifies the security-related actions and thoughts stated by the user and stores them in a database. The input is the text data obtained in step 1, and the output is stored in the database as a security-related record. Specifically, the part "I upgraded my security system" is identified and stored as a security-related record.

[1141] Step 6:

[1142] The user can access the database at a later date to view the saved records of their actions and thoughts. The input is a request to access the database, and the output is a display of the saved records. Specifically, the user searches for past records through the application and checks the displayed records.

[1143] In this way, a system is realized that provides appropriate feedback to maintain users' mental health and improve their security awareness.

[1144] Example 3

[1145] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1146] In modern society, many people suffer from stress and depression. Traditional counseling services are primarily conducted through face-to-face sessions, which are constrained by time and location. Furthermore, few systems allow users to record their thoughts and actions and reflect on them later. Furthermore, there is a lack of ways to provide advice through natural conversations without coming across as preachy. To address these issues, a system that provides more flexible and effective counseling services is needed.

[1147] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1148] In this invention, the server includes a means for a user to input, a means for the terminal to send the input to the server, a means for the server to analyze the input, a means for the server to send a prompt to the generative AI model, a means for the generative AI model to generate advice, and a means for the server to receive and provide the advice to the user. This allows the user to receive advice based on cognitive behavioral therapy through natural dialogue without being restricted by time or place. In addition, the user can keep a record of their actions and thoughts, which can be reviewed at a later date, promoting self-understanding and behavioral improvement.

[1149] "Voice interaction" means that the user interacts with the system through voice.

[1150] "Artificial intelligence" is a technology that allows computers to imitate human intelligence and perform learning and reasoning.

[1151] "Natural dialogue" is a dialogue format designed to allow users to converse with the system in a natural way.

[1152] Cognitive behavioral therapy is a form of psychotherapy that aims to improve emotions and behavior by changing the client's thought patterns and behavior.

[1153] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[1154] "Mood depression" is a temporary state of low emotion or depression experienced by a user.

[1155] "Behavior records" are data that users use to record their daily activities.

[1156] "Thought records" are data that users use to record their thoughts and feelings.

[1157] A "prompt sentence" is an input sentence that gives specific instructions or questions to a generative AI model.

[1158] A "generative AI model" is an artificial intelligence model that generates new information or advice based on input data.

[1159] A "server" is a computer system that processes and stores data on a network.

[1160] A "terminal" is a device that is directly operated by a user.

[1161] "Analysis" is the process of understanding input data and extracting meaning from it.

[1162] "Advice" is specific instructions or advice provided to a user.

[1163] This invention is a system that provides support for helping users understand their own mental state and derive specific actions to improve it. This system includes a means for a user to provide input, a means for a terminal to send the input to a server, a means for the server to analyze the input, a means for the server to send a prompt sentence to a generative AI model, a means for the generative AI model to generate advice, and a means for the server to receive the advice and provide it to the user.

[1164] Hardware and software used

[1165] Hardware

[1166] Terminal: A device that is directly operated by the user, such as a smartphone, tablet, or PC.

[1167] Server: A computer system that processes and stores data over a network.

[1168] software

[1169] Natural language processing engine: Software for analyzing input text data, such as SpaCy or NLTK.

[1170] Generative AI models: Artificial intelligence models that generate new information or advice based on input data, such as OpenAI's GPT-3.

[1171] Data processing and calculation

[1172] A means for users to provide input

[1173] The user opens an application on their smartphone or computer and types, "Lately, I feel like nothing I do goes right" into the text box.

[1174] A means by which a device sends input to a server

[1175] The terminal sends the text data entered by the user to the server using the HTTPS protocol. After the transmission is complete, the terminal waits for a response from the server.

[1176] How the server parses the input

[1177] The server analyzes the received text data using a natural language processing engine (e.g., SpaCy or NLTK). As a result of the analysis, the user's emotions and thought patterns are identified.

[1178] A means for the server to send prompts to the generative AI model

[1179] The server generates a prompt to send to the generative AI model based on the analysis results. For example, it generates a prompt such as, "The user has said, 'Recently, I feel like nothing I do goes well.' Please identify the thought pattern behind this and provide advice based on the principles of cognitive behavioral therapy."

[1180] How generative AI models generate advice

[1181] The generative AI model generates advice based on prompts received from the server, and leverages past data and learned knowledge to provide advice based on the principles of cognitive behavioral therapy.

[1182] A means by which the server receives and provides advice to the user

[1183] The server provides the user with advice received from the generative AI model. Specifically, the server displays the advice to the user through the device interface. For example, the server displays advice such as, "Reflect specifically on recent events and consider what thoughts are causing those emotions."

[1184] Examples of specific examples and prompts

[1185] As a concrete example, consider the case where a user inputs "I feel like nothing I do goes right these days." In this case, the server sends the following prompt to the generative AI model:

[1186] "A client says, 'Lately, I feel like nothing I do seems to work.' Identify the thought patterns behind this and offer advice based on the principles of cognitive behavioral therapy."

[1187] The generative AI model analyzes this prompt and returns the following advice:

[1188] "Think specifically about recent events and consider what thoughts are triggering those feelings."

[1189] "Evaluate whether your thinking is realistic and look for ways to develop a more realistic perspective."

[1190] In this way, the server provides the user with advice that encourages specific actions. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1191] Step 1:

[1192] The user provides input

[1193] A user opens an application on a smartphone or PC and enters "Recently, I feel like nothing I do goes well" into the text box. The input data is in text format and expresses the user's state of mind and worries.

[1194] Step 2:

[1195] The device sends input to the server

[1196] The terminal sends the text data entered by the user to the server using the HTTPS protocol. The input data is encrypted and sent to the server over a secure communication channel. Once the transmission is complete, the terminal waits for a response from the server.

[1197] Step 3:

[1198] The server parses the input

[1199] The server analyzes the received text data using a natural language processing engine (e.g., SpaCy or NLTK). The input data is in text format, and the analysis results identify the user's emotions and thought patterns. Specifically, the server tokenizes the text data and performs sentiment analysis and keyword extraction.

[1200] Step 4:

[1201] The server sends a prompt to the generative AI model

[1202] The server generates a prompt to be sent to the generative AI model based on the analysis results. The prompt is in text format and includes the user's input and the analysis results. For example, a prompt might be generated such as, "The user says, 'Recently, I feel like nothing I do goes well.' Please identify the thought pattern behind this and provide advice based on the principles of cognitive behavioral therapy."

[1203] Step 5:

[1204] Generative AI models generate advice

[1205] The generative AI model generates advice based on prompts received from the server. The input data is in the form of prompts, and the output data is in the form of advice text. The generative AI model utilizes past data and learned knowledge to provide advice based on the principles of cognitive behavioral therapy.

[1206] Step 6:

[1207] The server receives the advice and provides it to the user.

[1208] The server provides the user with the advice received from the generative AI model. The input data is the text format of the advice from the generative AI model, and the output data is the text format of the advice to be displayed to the user. Specifically, the advice is displayed to the user through the device interface. For example, the advice displayed is, "Reflect specifically on recent events and consider what thoughts are causing those emotions."

[1209] (Application example 3)

[1210] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1211] In modern society, the number of people experiencing stress and anxiety is increasing, and appropriate measures to address this are needed. However, traditional counseling services are primarily face-to-face sessions, which are limited by time and location. In addition, there is a lack of support for users to accurately understand their own mental state and take appropriate action. Furthermore, occupations such as security guards and security officers often experience stress during long shifts, and a prompt response to this is required.

[1212] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes: a means for listening to the user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with AI without being preachy; a means for preventing depression and previous low moods and guiding the user to live a better life; a means for recording the user's actions and thoughts during the dialogue and reviewing them at a later date; a means for monitoring the user's mental state and providing appropriate advice when stress or anxiety increases; and a means for generating prompt sentences using a generative AI model and providing advice based on the principles of cognitive behavioral therapy. This allows users to accurately understand their mental state and receive support for taking appropriate actions. Furthermore, occupations such as security guards and security guards can quickly manage stress.

[1213] "Voice interaction format" refers to a format in which a user and a system interact through voice.

[1214] "Complaining" is the verbal expression of dissatisfaction and stress that users feel in their daily lives or at work.

[1215] "Artificial intelligence" is a technology that allows computer systems to mimic human intelligence and have capabilities such as learning, reasoning, and recognition.

[1216] "Natural dialogue" means that the user and the system communicate smoothly, like a conversation between humans.

[1217] Cognitive behavioral therapy is a form of psychotherapy that involves reevaluating clients' thought patterns and behaviors and encouraging more constructive behavior.

[1218] "Counseling services" are services that provide support to help users understand and improve their mental state.

[1219] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[1220] "Depression" refers to temporary feelings of sadness or lethargy experienced by users.

[1221] "Behavioral records" refer to recording the user's activities in their daily life and work.

[1222] "Thought recording" is the act of recording what the user thinks and feels.

[1223] "Monitoring" means continuously observing the user's mental state and detecting any changes.

[1224] "Stress" refers to the mental or physical tension or strain felt by users.

[1225] "Anxiety" refers to the vague worries and fears that users feel.

[1226] "Advice" is specific instructions or suggestions for users to take better action.

[1227] A "generative AI model" is a model that uses artificial intelligence to generate text or data for a specific purpose.

[1228] A "prompt" is an instruction or question that is input into a generative AI model.

[1229] The system for implementing this invention provides a counseling service similar to cognitive behavioral therapy by listening to the user's complaints in a voice dialogue format, while engaging in natural dialogue with artificial intelligence to avoid becoming preachy. The system has the function of monitoring the user's mental state and providing appropriate advice when stress or anxiety increases.

[1230] Hardware and software used

[1231] Hardware

[1232] Smartphone

[1233] server

[1234] software

[1235] Python

[1236] OpenAI API

[1237] Data processing and calculation

[1238] server

[1239] The server receives voice input from the user and converts it into text data. It then uses a generative AI model to generate prompts and advice based on the principles of cognitive behavioral therapy. The advice is then converted back into voice data and provided to the user.

[1240] Device (smartphone)

[1241] The smartphone receives the user's voice input, sends it to the server, and also has the function of playing back the advice returned by the server.

[1242] Specific examples

[1243] For example, if a security guard types "I feel like nothing I do seems to work out well lately," the smartphone sends this voice data to the server, which converts it into text data and generates a prompt like this:

[1244] Prompt Sentence Examples

[1245] "If a user says, 'I feel like nothing I do seems to work lately,' offer advice based on principles of cognitive behavioral therapy."

[1246] The generative AI model generates advice based on this prompt, and the server converts the advice into voice data and sends it to the smartphone, which then plays the voice data and provides the advice to the user.

[1247] In this way, users can accurately understand their own mental state and receive support to take appropriate action. It also enables occupations such as security guards and security officers to quickly manage stress.

[1248] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1249] Step 1:

[1250] The user inputs voice data into the smartphone. For example, they might say, "Recently, I feel like nothing I do goes right." This voice data is input into the smartphone.

[1251] Step 2:

[1252] Smartphones convert input voice data into text data using voice recognition software. The input is voice data and the output is text data.

[1253] Step 3:

[1254] The smartphone sends the converted text data to the server. The input is text data, and the output is data transmission to the server.

[1255] Step 4:

[1256] The server generates a prompt sentence based on the received text data. For example, it generates a prompt sentence such as, "If the user says, 'I feel like nothing I do recently goes well,' please provide some advice based on the principles of cognitive behavioral therapy." The input is text data, and the output is a prompt sentence.

[1257] Step 5:

[1258] The server inputs the generated prompt sentence into the generative AI model to generate advice. The input is the prompt sentence, and the output is the text data of the advice.

[1259] Step 6:

[1260] The server converts the generated advice text data into voice data using voice synthesis software. The input is the advice text data, and the output is voice data.

[1261] Step 7:

[1262] The server then sends the converted voice data to the smartphone. The input is the voice data, and the output is data transmission to the smartphone.

[1263] Step 8:

[1264] The smartphone plays back the received voice data and provides advice to the user. The input is the voice data, and the output is the voice playback.

[1265] In this way, users can accurately understand their own emotional state and receive assistance in taking appropriate actions.

[1266] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1267] "Example 1"

[1268] One embodiment of the present invention is a system incorporating an emotion engine. This system includes an emotion engine that analyzes emotions from a user's voice input. Specifically, the system infers the user's emotional state from the words, tone of voice, speaking rate, and other factors used by the user during a dialogue with the system. This emotion engine is used in combination with AI-based natural language processing technology to generate an appropriate response based on the user's emotional state.

[1269] "Example 2"

[1270] The emotion engine also has the ability to track changes in a user's emotions. Specifically, it records emotional information obtained through conversations with the user over time and analyzes these changes. This makes it possible to understand the user's emotional patterns, such as what emotions the user tends to show when discussing a particular topic or at a particular time of day. This information can be used to optimize counseling services such as cognitive behavioral therapy.

[1271] "Example 3"

[1272] Furthermore, the emotion engine has the ability to adjust how it provides counseling services depending on the user's emotional state. Specifically, if the user is showing strong emotions such as anger or sadness, the system will prioritize providing advice to calm those emotions. On the other hand, if the user is in a calm emotional state, the system will provide questions and tasks to encourage deeper self-understanding. This allows the system to provide optimal counseling services according to the user's emotional state.

[1273] The processing flow of each embodiment will be described below.

[1274] "Example 1"

[1275] Step 1: The user initiates an interaction with the system.

[1276] Step 2: The emotion engine receives the user's voice input.

[1277] Step 3: The emotion engine analyzes the emotion from the user's voice, taking into account word choice, tone of voice, speaking rate, etc.

[1278] Step 4: The analysis results are combined with AI-based natural language processing technology to generate an appropriate response based on the user's emotional state.

[1279] "Example 2"

[1280] Step 1: Record the emotional information obtained through the interaction with the user over time.

[1281] Step 2: Analyze changes in the recorded emotional information.

[1282] Step 3: Based on the analysis results, understand the emotional patterns of users.

[1283] Step 4: Use identified emotional patterns to optimize counseling services, such as cognitive behavioral therapy.

[1284] "Example 3"

[1285] Step 1: The emotion engine analyzes the user's emotional state.

[1286] Step 2: Adjust how counseling services are delivered based on the analysis results.

[1287] Step 3: If the user is showing strong emotions such as anger or sadness, the system will prioritize providing advice to calm those emotions.

[1288] Step 4: If the user is in a calm emotional state, the system provides questions and challenges to encourage deeper self-understanding.

[1289] Example 1

[1290] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1291] In modern society, the number of people suffering from mood disorders and stress is increasing, creating a demand for effective counseling services to resolve these issues. However, traditional counseling services are often conducted face-to-face, making them difficult for users to access. Furthermore, it is difficult to provide appropriate responses based on the user's emotional state, and these services may not be effective enough in improving the user's mood. Furthermore, there is a lack of means to automatically record the user's behavior and thoughts, making it difficult to review them later. To address these issues, a system is needed that is easily accessible to users, provides appropriate responses based on their emotional state, and automatically records behavior and thoughts.

[1292] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1293] In this invention, the server includes means for receiving a user's voice input and understanding the content of the input using natural language processing technology, means for analyzing emotions from the user's voice input and generating an appropriate response according to the user's emotional state, and means for providing the generated response to the user as a voice output, thereby enabling the user to easily access the server, provide an appropriate response according to the user's emotional state, and automatically keep a record of their actions and thoughts.

[1294] "Voice interaction" means that the user interacts with the system through voice.

[1295] "Artificial intelligence" is a technology that allows computers to act in a way that mimics human intelligence.

[1296] "Natural language processing technology" is a technology that allows computers to understand, analyze, and generate human language.

[1297] Cognitive behavioral therapy is a form of psychotherapy that addresses mental problems by working on both cognition and behavior.

[1298] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[1299] "Mood disorders" are mental illnesses whose main symptom is mood abnormalities, such as depression and bipolar disorder.

[1300] "Behavior recording" refers to recording the user's behavior.

[1301] "Thought recording" means recording the user's thoughts.

[1302] "Emotion analysis" refers to analyzing a user's emotional state.

[1303] "Response generation" refers to generating an appropriate response to a user's input.

[1304] "Audio output" means outputting the generated response as audio.

[1305] MODE FOR CARRYING OUT THE INVENTION

[1306] This invention is a voice dialogue system using artificial intelligence (AI). It accepts voice input from a user and understands the content using natural language processing technology. Furthermore, it aims to generate appropriate responses based on the principles of cognitive behavioral therapy and provide them to the user as voice output. It also incorporates an emotion engine that analyzes emotions from the user's voice input and generates responses according to their emotional state.

[1307] Hardware and software used

[1308] Devices: microphone, speaker

[1309] Server: Speech recognition software (e.g., Google Speech-to-Text API), natural language processing libraries (e.g., spaCy, NLTK), sentiment analysis engines (e.g., IBM Watson Tone Analyzer), response generation models (e.g., GPT-3), speech synthesis software (e.g., Google Text-to-Speech API)

[1310] Program processing flow

[1311] 1. Accepting voice input

[1312] The device receives voice input from the user through a microphone. When the user says, "I've been feeling a lot of stress lately," the device's microphone captures the voice.

[1313] 2. Converting voice data to text

[1314] The server uses voice recognition software to convert the voice data sent from the device into text data. The server analyzes the voice data and generates the text, "I'm having trouble with a lot of stress these days."

[1315] 3. Content understanding using natural language processing

[1316] The server uses a natural language processing library to analyze the content of the text data and understand the user's intent. The server extracts the keyword "stress" and recognizes that the user is feeling stressed.

[1317] 4. Emotion analysis

[1318] The server uses an emotion analysis engine to analyze the user's emotional state from the text data. If the server determines that the user is feeling "stressed" from their comments, it records the user's emotional state as "stress."

[1319] 5. Response Generation

[1320] The server generates an appropriate response based on the principles of cognitive behavioral therapy, taking into account the user's intentions and emotional state. Using a generative AI model, the server generates a response such as, "Please tell me more about what is causing you stress."

[1321] 6. Generating Audio Output

[1322] The server generates a response that is converted into audio data using speech synthesis software. The server converts the text response into audio data and generates an audio file.

[1323] 7. Providing Audio Output

[1324] The device provides the voice data sent from the server to the user through the speaker, and the device uses the speaker to play back the voice message, "Please tell us more about what causes you stress."

[1325] Specific examples

[1326] The user speaks, "I've been feeling a lot of stress lately."

[1327] The device captures the audio with a microphone and sends it to the server.

[1328] The server uses speech recognition software to convert the speech to text.

[1329] The server analyzes the text using a natural language processing library and understands that the user is feeling stressed.

[1330] The server performs emotion analysis using an emotion analysis engine and determines that the user is feeling stressed.

[1331] The server uses a generative AI model to generate a response such as, "Please tell me more about what causes you stress."

[1332] The server converts the response into speech using speech synthesis software.

[1333] The terminal provides the generated audio to the user through a speaker.

[1334] Example prompt sentence:

[1335] User: I've been feeling a lot of stress lately.

[1336] System: Can you tell us a bit more about what causes you stress?

[1337] In this way, the system analyzes the user's voice input and generates and provides an appropriate response.

[1338] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1339] Step 1:

[1340] Accepting voice input

[1341] The device accepts voice input from the user through a microphone.

[1342] Input: User speech (e.g., "I've been feeling stressed lately.")

[1343] Specific operation: The user's voice is captured by the microphone and saved as audio data on the device.

[1344] Output: Audio data

[1345] Step 2:

[1346] Converting audio data to text

[1347] The server uses voice recognition software to convert the voice data sent from the terminal into text data.

[1348] Input: Audio data

[1349] Specific operation: The server calls voice recognition software (e.g., voice recognition API) and converts the voice data into text data.

[1350] Output: Text data (e.g., "I've been feeling stressed lately.")

[1351] Step 3:

[1352] Content understanding through natural language processing

[1353] The server uses a natural language processing library to analyze the content of the text data and understand the user's intent.

[1354] Input: Text data

[1355] Specific behavior: The server uses a natural language processing library (e.g., a natural language processing library) to extract keywords and context from the text data and analyze the user's intent.

[1356] Output: User intent (e.g., feeling stressed)

[1357] Step 4:

[1358] Emotion analysis

[1359] The server uses an emotion analysis engine to analyze the user's emotional state from the text data.

[1360] Input: Text data

[1361] Specific operation: The server uses a sentiment analysis engine (e.g., sentiment analysis API) to infer the emotional state from the text data.

[1362] Output: Emotional state (e.g., stress)

[1363] Step 5:

[1364] Response Generation

[1365] The server generates appropriate responses based on the principles of cognitive behavioral therapy according to the user's intentions and emotional state.

[1366] Input: User intent, emotional state

[1367] What it does: The server uses a generative AI model (e.g., a response generation model) to generate a response based on the user's intent and emotional state.

[1368] Output: Response text (e.g., "Tell me more about what makes you stressed.")

[1369] Step 6:

[1370] Generate audio output

[1371] The server-generated response is converted into voice data using speech synthesis software.

[1372] Input: Response text

[1373] What happens: The server uses speech synthesis software (e.g., a speech synthesis API) to convert the response text into audio data.

[1374] Output: Response audio data

[1375] Step 7:

[1376] Providing audio output

[1377] The terminal provides the user with the audio data sent from the server through the speaker.

[1378] Input: Response audio data

[1379] Specific operation: The device uses the speaker to play back the response audio data.

[1380] Output: The audio response the user hears (e.g., "Tell me more about what makes you stressed.")

[1381] (Application example 1)

[1382] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1383] Conventional counseling systems have difficulty accurately grasping the user's emotional state, making it difficult to provide an appropriate response. Furthermore, there has been a lack of systems that can efficiently manage the user's behavioral and thought records and allow for later review. Furthermore, security services require rapid on-site response, but there has been no advanced dialogue system that includes emotion analysis.

[1384] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes: a means for listening to the user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with AI without being preachy; a means for preventing depression and previous low moods and guiding the user to a better life; a means for recording the user's behavior and thoughts during the dialogue and reviewing them at a later date; an emotion analysis means for analyzing the user's voice input and estimating their emotional state; a means for generating appropriate responses based on the emotional state and providing them as voice output; and a means for recording the conversation content and emotion analysis results in a database for later analysis. This makes it possible to accurately grasp the user's emotional state and provide appropriate responses. Furthermore, the ability to efficiently manage behavior and thought records and review them at a later date enables prompt and appropriate responses in security services.

[1385] "Voice interaction" means that the user interacts with the system through voice.

[1386] "Complaints, etc." are statements that contain negative emotions such as dissatisfaction or worries that users have.

[1387] "Avoiding preaching" means not giving the impression of instructing users in a condescending manner.

[1388] "AI" is an abbreviation for artificial intelligence, a technology that allows machines to imitate human intelligence and learn and reason.

[1389] "Natural dialogue" means that users can converse with the system without feeling uncomfortable.

[1390] Cognitive behavioral therapy is a treatment that solves psychological problems by changing the client's thoughts and behavior.

[1391] "Counseling services" are services that provide advice and support to users regarding psychological problems and worries.

[1392] "Depression" is a mental illness characterized by persistently depressed mood and loss of interest.

[1393] "Depressed mood" refers to a temporary feeling of gloom or lack of motivation.

[1394] "Behavior recording" refers to recording the user's behavior.

[1395] "Thought recording" means recording the user's thoughts and feelings.

[1396] "Emotion analysis means" is a technology for estimating the emotional state of a user from their voice input.

[1397] "Appropriate response" means generating an appropriate reply according to the user's situation and emotions.

[1398] "Audio output" means that the system provides information by voice.

[1399] A "database" is a system for systematically organizing and storing information.

[1400] A "means for enabling later analysis" is a method for later analysis of the recorded data.

[1401] The system for implementing this invention listens to users' complaints and other concerns in a voice dialogue format, while engaging in natural dialogue with AI in a way that is not preachy. The system provides counseling services based on the principles of cognitive behavioral therapy, helping users to prevent depression and lead better lives. It also allows users to keep records of their actions and thoughts during the dialogue, which can be reviewed at a later date.

[1402] Hardware and software used

[1403] Hardware:

[1404] Smartphone

[1405] Smart Glasses

[1406] microphone

[1407] software:

[1408] Natural language processing libraries (e.g. spaCy, NLTK)

[1409] Sentiment analysis engine (e.g. IBM Watson Tone Analyzer)

[1410] Speech recognition engine (e.g. Google Speech-to-Text)

[1411] Data processing and calculation

[1412] Acquiring voice input:

[1413] The device (smartphone or smart glasses) captures the user's voice data through a microphone, which is then converted into text data using a voice recognition engine.

[1414] Natural Language Processing:

[1415] The server analyzes the acquired text data using a natural language processing library to understand the content of the conversation, thereby understanding the user's intentions and situation.

[1416] Emotion analysis:

[1417] The server inputs the text data into an emotion analysis engine to estimate the user's emotional state. The emotion analysis engine analyzes emotions such as anger, anxiety, and tension in real time based on the user's tone of voice and speaking speed.

[1418] Response generation:

[1419] The server generates appropriate responses based on the principles of cognitive behavioral therapy and provides them to the device as voice output, allowing the user to receive appropriate advice and guidance.

[1420] Data recording and analysis:

[1421] The server records the conversation content and emotion analysis results in a database for later analysis, allowing users to efficiently manage their behavioral and thought records and review them at a later date.

[1422] Examples of specific examples and prompts

[1423] For example, if a security guard is talking to a suspicious person, the following prompt sentence can be input into the generative AI model:

[1424] Example prompt sentence:

[1425] Voice input: 'I don't need to explain what I'm doing here.'

[1426] Analysis result: 'Anger'

[1427] Response Generation: 'Please stay calm. We just want to check in. Let us know if we can help you with anything.'

[1428] Based on this prompt, the AI ​​model generates an appropriate response and provides it to the security guard as a voice output, enabling a quick and appropriate response on the scene.

[1429] The above is an embodiment of the present invention.

[1430] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1431] Step 1:

[1432] The device acquires the user's voice data through a microphone. The input is the user's voice and the output is voice data. Specifically, the device's microphone captures the voice and stores it as digital voice data.

[1433] Step 2:

[1434] The device sends the acquired voice data to a voice recognition engine, which converts it into text data. The input is voice data, and the output is text data. Specifically, the voice recognition engine (e.g., Google Speech-to-Text) analyzes the voice data and generates corresponding text.

[1435] Step 3:

[1436] The server inputs the text data into a natural language processing library and analyzes the conversation. The input is text data, and the output is the analysis results. Specifically, the natural language processing library (e.g., spaCy, NLTK) analyzes the text data and understands the user's intent and situation.

[1437] Step 4:

[1438] The server inputs the analysis results into an emotion analysis engine to estimate the user's emotional state. The input is the analysis results, and the output is the emotional state. Specifically, the emotion analysis engine (e.g., IBM Watson Tone Analyzer) estimates the emotional state based on the analysis results.

[1439] Step 5:

[1440] The server generates an appropriate response based on the emotional state. The input is the emotional state, and the output is the response text. Specifically, the generative AI model takes the emotional state into account and generates a response based on the principles of cognitive behavioral therapy.

[1441] Step 6:

[1442] The server inputs the generated response text into a speech synthesis engine to generate a voice output. The input is the response text, and the output is voice data. Specifically, the speech synthesis engine converts the text into voice and generates the voice data.

[1443] Step 7:

[1444] The terminal plays the generated voice data to the user. The input is voice data, and the output is voice output to the user. Specifically, the terminal's speaker plays the voice data and provides it to the user.

[1445] Step 8:

[1446] The server records the conversation content and the emotion analysis results in a database. The input is the conversation content and the emotion analysis results, and the output is the recording in the database. Specifically, the server saves the information in the database so that it can be analyzed later.

[1447] Example 2

[1448] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1449] Conventional counseling systems have difficulty effectively recording and analyzing changes in users' emotions and behavior, resulting in insufficient information for users to reflect on their own condition. Furthermore, they are unable to track changes in users' emotions over time and understand their patterns, making it difficult to optimize individual counseling services. Furthermore, there is a lack of a way to naturally analyze users' comments and automatically save records of their behavior and thoughts.

[1450] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1451] In this invention, the server includes: means for listening to a user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with AI so as not to be preachy; means for preventing depression and guiding the user to live a better life; means for recording the user's actions and thoughts during the dialogue and allowing them to be reviewed at a later date; means for recording changes in the user's emotions over time and analyzing those changes; means for analyzing the user's comments using a generative AI model and saving the records of actions and thoughts in a database; means for extracting emotional information from the user's comments using an emotion engine and recording it over time; and means for analyzing the recorded emotional information and understanding the user's emotional patterns. This makes it possible to effectively record and analyze changes in the user's emotions and behavior, thereby optimizing individual counseling services.

[1452] "Voice interaction" refers to a format in which a user interacts with a system using voice.

[1453] "Artificial intelligence" is a technology that allows computers to imitate human intelligence and have functions such as learning, reasoning, and recognition.

[1454] "Natural dialogue" is a form of dialogue in which users and systems can communicate smoothly, as if they were having a conversation between humans.

[1455] Cognitive behavioral therapy is a form of psychotherapy that aims to solve mental problems by changing the client's cognition and behavior.

[1456] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[1457] "Behavior record" refers to recording information about a user's behavior.

[1458] "Thought recording" refers to recording information about a user's thoughts.

[1459] "Emotional changes" refers to how a user's emotions change over time.

[1460] A "generative AI model" is a model that artificial intelligence uses to analyze user utterances.

[1461] A "database" is a system that stores information systematically and allows it to be searched and updated as needed.

[1462] An "emotion engine" is a technology for extracting emotional information from users' comments.

[1463] "Emotional patterns" are trends that indicate how a user's emotions change under specific conditions or at specific times.

[1464] This invention is a system that creates a record of a user's behavior and thoughts and tracks changes in their emotions. The system listens to the user's complaints in a voice dialogue format, and provides counseling services similar to cognitive behavioral therapy through natural dialogue with artificial intelligence that avoids being preachy. Furthermore, by recording and analyzing changes in the user's emotions over time, it is possible to understand what emotions the user tends to show when discussing specific topics or at specific times of the day.

[1465] Hardware and software used

[1466] Hardware: Servers, terminals (PCs, smartphones)

[1467] Software: Generative AI models (e.g., GPT-4), database management systems (e.g., MySQL), sentiment analysis engines (e.g., IBM Watson)

[1468] Specific operation of the system

[1469] 1. The user initiates an interaction with the system

[1470] A user accesses the system using a terminal and starts a dialogue. For example, the user opens the app on their smartphone and says, "I've been feeling depressed since this morning and haven't been able to get anything done."

[1471] 2. The server records the conversation

[1472] The server analyzes the dialogue received from the user using a generative AI model (e.g., GPT-4) and stores the dialogue in a database as a record of the user's actions and thoughts. For example, a statement such as "I've been feeling depressed since this morning, and I haven't been able to get anything done" is stored as is.

[1473] 3. The server analyzes the emotional information

[1474] The server uses an emotion engine (e.g., IBM Watson) to extract emotional information from the user's speech and records it over time. For example, it analyzes the emotion "I feel depressed" and stores the results in a database.

[1475] 4. The server analyzes changes in emotions

[1476] The server analyzes the recorded emotional information and identifies patterns of the user's emotions. For example, it may discover that the user tends to feel depressed when the topic of "work" is mentioned.

[1477] 5. User views the record

[1478] Users can access the system at a later date to view their own behavior, thoughts, and emotional changes. For example, if a user types into the system, "Show me my mood record from last week," the server will display the relevant record.

[1479] Examples of specific examples and prompts

[1480] Examples:

[1481] A user states to the system, "I was stressed at work today."

[1482] The server records the comments, and the emotion engine analyzes the "stress" and stores it in a database.

[1483] Later, when the user asks the system, "What was my stress level last week?" the server will display the relevant records.

[1484] Example prompt sentence:

[1485] "Tell me how you felt today."

[1486] "Please tell me about any recent changes in your mood."

[1487] "Tell me how your emotions change when you come across a particular topic."

[1488] In this way, the system records and analyzes changes in the user's behavior, thoughts, and emotions, providing reference information for the user to reflect on their own condition.

[1489] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1490] Step 1:

[1491] The user initiates an interaction with the system.

[1492] Specific operation: The user accesses the system using a terminal (PC or smartphone) and begins a dialogue.

[1493] Input: A user types into their terminal, "I've been feeling depressed since this morning and haven't been able to get anything done."

[1494] Output: The user's utterances are sent from the device to the server.

[1495] Step 2:

[1496] The server records the conversation.

[1497] Specific operation: The server analyzes the dialogue received from the user using a generative AI model (e.g., GPT-4) and stores it in a database as a record of actions and thoughts.

[1498] Input: User says, "I've been feeling depressed since this morning and haven't been able to get anything done."

[1499] Data processing: A generative AI model analyzes speech and structures it into a record of actions and thoughts.

[1500] Output: Structured data stored in a database.

[1501] Step 3:

[1502] The server analyzes the emotional information.

[1503] Specific operation: The server uses an emotion engine (e.g., IBM Watson) to extract emotional information from the user's utterances and records it over time.

[1504] Input: User says, "I've been feeling depressed since this morning and haven't been able to get anything done."

[1505] Data calculation: The emotion engine analyzes the statement and extracts the emotional information, such as "I feel depressed."

[1506] Output: Emotion information stored in the database in the format "October 1, 2023 10:00 - Feeling depressed".

[1507] Step 4:

[1508] The server analyzes changes in emotions.

[1509] Specific operation: The server analyzes the recorded emotional information and understands the user's emotional patterns.

[1510] Input: Past emotion information stored in a database.

[1511] Data calculation: The server analyzes changes in emotions for specific topics and time periods based on past emotion data.

[1512] Output: The analysis result is saved as "Users tend to feel depressed when talking about work."

[1513] Step 5:

[1514] A user views a record.

[1515] Specific actions: Users can access the system at a later date to view records of their own actions, thoughts, and emotional changes.

[1516] Input: A user types into their device, "Show me last week's mood log."

[1517] Data processing: The server retrieves the relevant records from the database.

[1518] Output: The user's device will display the following entry: "October 1, 2023, 10:00 - Feeling depressed".

[1519] (Application example 2)

[1520] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1521] Maintaining users' mental health is an important issue in modern society. However, conventional counseling services have difficulty tracking users' emotional changes in real time and providing appropriate responses. They also lack the means to detect security risks early on. This makes it difficult to effectively support users' mental health.

[1522] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1523] In this invention, the server includes means for providing counseling services such as cognitive behavioral therapy in a natural dialogue with artificial intelligence while listening to the user's complaints in a voice dialogue format so as not to sound preachy, means for preventing depression and previous low moods and guiding the user to live a better life, means for recording the user's actions and thoughts during the dialogue so that they can be reviewed at a later date, means for tracking changes in the user's emotions, recording emotional information over time and analyzing these changes, and means for analyzing emotional changes to detect security risks at an early stage.This makes it possible to effectively support the user's mental health and detect security risks at an early stage.

[1524] "Voice dialogue format" refers to a format in which a user and a system communicate using voice.

[1525] "Artificial intelligence" is the technology that enables computer systems to learn, reason, and self-correct by imitating human intelligence.

[1526] "Natural dialogue" is a form of dialogue in which users and systems can communicate smoothly, as if they were having a conversation between humans.

[1527] Cognitive behavioral therapy is a form of psychotherapy that solves mental problems by changing the client's cognition and behavior.

[1528] "Counseling services" are services that provide support to users to resolve their mental problems and worries.

[1529] "Depression" is a mental illness characterized by persistent sadness and loss of interest.

[1530] "Depression" is a temporary state of sadness or lethargy experienced by a user.

[1531] "Behavior record" means recording the actions taken by a user.

[1532] "Thought recording" is the act of recording what the user thinks and feels.

[1533] "Changes in emotions" refers to changes in a user's emotions over time.

[1534] "Tracking" means the continuous tracking and recording of specific information.

[1535] "Emotion information" is data related to the user's emotions.

[1536] A "security risk" is a potential threat or danger to a system or data.

[1537] "Early detection" means finding problems before they occur.

[1538] The system for implementing this invention provides a counseling service similar to cognitive behavioral therapy, listening to users' complaints and complaints in a voice dialogue format while engaging in natural dialogue with artificial intelligence to avoid being preachy. The system can record users' actions and thoughts, allowing them to review them at a later date. It also tracks changes in users' emotions, records emotional information over time, and analyzes these changes to enable early detection of security risks.

[1539] Hardware and software used

[1540] Hardware: Smartphone

[1541] Software: Python, JSON library

[1542] Data processing and calculation

[1543] server

[1544] The server listens to users' complaints and other concerns in a voice dialogue format and uses artificial intelligence to engage in natural conversation. The user's actions and thoughts are recorded with a timestamp and saved for future reference. It also uses an emotion engine to track changes in the user's emotions and records the emotional information over time. This allows for analysis of emotional changes and early detection of security risks.

[1545] Terminal

[1546] The device (smartphone) transmits information obtained through dialogue with the user to a server. The device converts voice input into text and saves it as a record of actions and thoughts. It also obtains emotional information using an emotion engine and transmits it to the server.

[1547] User

[1548] Users interact with the system via their smartphones. For example, if a user says, "I've been feeling depressed since this morning and haven't been able to get anything done," this information is recorded along with a timestamp. At the same time, the emotion of "sadness" is also recorded. This information can be used as reference when the user later reflects on their mood and actions that day.

[1549] Specific examples

[1550] For example, if a user says, "I've been feeling depressed since this morning and haven't been able to get anything done," that information is recorded along with a timestamp. At the same time, the emotion of "sadness" is also recorded. This information can be used as reference when the user later looks back on their mood and actions that day.

[1551] Prompt Sentence Examples

[1552] "I've been feeling down since this morning and haven't been able to get anything done."

[1553] In this way, the system can effectively support users' mental health and detect security risks early.

[1554] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1555] Step 1:

[1556] The user starts a conversation with the system via their smartphone. The user says, "I've been feeling depressed since this morning and haven't been able to get anything done." The input is the user's voice, and the output is voice data.

[1557] Step 2:

[1558] The device converts voice input to text. It uses speech recognition software to convert the voice data to text. The input is voice data and the output is text data.

[1559] Step 3:

[1560] The terminal sends text data to the server. The text data is sent to the server using network communication. The input is text data, and the output is data sent to the server.

[1561] Step 4:

[1562] The server receives the text data and stores it as a record of actions and thoughts. The text data is stored in a database along with a timestamp. The input is text data, and the output is a record in the database.

[1563] Step 5:

[1564] The server uses an emotion engine to extract emotional information from text data. It uses natural language processing technology to extract the emotion "sad" from the text data. The input is text data, and the output is emotional information.

[1565] Step 6:

[1566] The server records the emotion information with a timestamp and saves it in a database. The input is emotion information, and the output is a record in the database.

[1567] Step 7:

[1568] The server analyzes changes in emotional information and tracks them by comparing them with past emotional information. The input is past emotional information and current emotional information, and the output is the analysis result of the emotional changes.

[1569] Step 8:

[1570] The server evaluates security risks based on changes in emotions. It detects sudden changes in emotions and specific patterns to provide early warning of security risks. The input is the analysis result of emotional changes, and the output is the security risk assessment result.

[1571] Step 9:

[1572] The server transmits the security risk assessment results to the terminal. The assessment results are transmitted to the terminal using network communication. The input is the security risk assessment results, and the output is data transmission to the terminal.

[1573] Step 10:

[1574] The terminal notifies the user of the security risk evaluation results. It uses the notification function to display a warning message to the user. The input is the security risk evaluation results, and the output is a notification to the user.

[1575] Example 3

[1576] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1577] Conventional counseling systems have had difficulty providing appropriate advice and counseling services tailored to the user's emotional state. Furthermore, they lacked the means to effectively analyze the user's input data and generate specific advice based on the principles of cognitive behavioral therapy. This has resulted in insufficient support for users to understand their own mental state and derive specific actions to improve it.

[1578] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1579] In this invention, the server includes means for receiving user input, means for analyzing the input data, means for generating advice based on the principles of cognitive behavioral therapy, means for evaluating the emotional state of the user, means for providing counseling services according to the emotional state, and means for displaying the generated advice and questions, thereby making it possible to understand the user's mental state and provide appropriate advice and counseling.

[1580] "Means for receiving user input" refers to a function that allows a user to input data such as text or voice via a terminal and send that data to a server.

[1581] The "means for analyzing input data" is a function for analyzing the input data received by the server from the user and understanding its contents.

[1582] The "means for generating advice based on the principles of cognitive behavioral therapy" is a function for generating specific advice for the user in accordance with the principles of cognitive behavioral therapy based on the analyzed data.

[1583] The "means for evaluating the emotional state of the user" is a function for evaluating the emotional state from the data input by the user and determining a response according to that emotion.

[1584] The "means for providing counseling services according to emotional state" is a function for providing optimal counseling services and advice based on the assessed emotional state.

[1585] The "means for displaying the generated advice or question" is a function for displaying the advice or question generated by the server on the user's terminal.

[1586] This invention is a system that helps users understand their own mental state and derives specific actions to improve it. This system is realized using hardware and software such as a server, terminals, a generative AI model, an emotion engine, and a database management system.

[1587] Hardware and software used

[1588] Hardware: Servers, terminals (PCs, smartphones)

[1589] Software: Generative AI models (e.g., GPT-4), emotion engines, database management systems (e.g., MySQL)

[1590] Specific operation of the system

[1591] 1. Receive user input:

[1592] A user uses a terminal to provide text input to the system.

[1593] For example, the user may input, "Recently, I feel like nothing I do goes right."

[1594] The terminal transmits this input data to the server.

[1595] 2. Analysis of input data:

[1596] The server passes the received user input data to a generative AI model (e.g., GPT-4).

[1597] The generative AI model analyzes what the user says and identifies the thought patterns behind it.

[1598] For example, the generative AI model recognizes a user's negative thought patterns from the phrase "it's not working."

[1599] 3. Generating Advice:

[1600] The server generates advice based on the analysis results obtained from the generative AI model, based on the principles of cognitive behavioral therapy.

[1601] For example, create specific advice such as, "It's important to reflect on your own successes and focus on the positive aspects."

[1602] The server stores this advice in a database.

[1603] 4. Emotional state assessment:

[1604] The server uses an emotion engine to assess the user's emotional state from the input data.

[1605] For example, strong emotions such as "anger" or "sadness" can be detected from user input.

[1606] The emotion engine identifies appropriate responses to these emotions.

[1607] 5. Providing counseling services:

[1608] The server provides optimal counseling services according to the user's emotional state.

[1609] For example, if the user is showing signs of anger, the server will prioritize providing advice such as "Take a deep breath and take some time to relax."

[1610] On the other hand, if the user is in a calm emotional state, the server will ask questions that encourage deeper self-understanding, such as, "What recent events have made the biggest impression on you?"

[1611] 6. Displaying the results:

[1612] The server sends the generated advice and questions to the terminal.

[1613] The terminal displays this information to the user.

[1614] For example, the user's screen might display the message, "It's important to reflect on your own successes and focus on the positive aspects."

[1615] Examples and prompts

[1616] Examples:

[1617] The user types, "Lately, nothing seems to work."

[1618] The system offers the advice, "It's important to reflect on your own successes and focus on the positive aspects."

[1619] The emotion engine assesses the user's emotional state and provides appropriate counseling services.

[1620] Example prompt sentence:

[1621] "Lately, nothing I do seems to work. What should I do?"

[1622] "What recent event has particularly impressed you?"

[1623] In this way, the system can understand the user's mental state and provide appropriate advice and counseling. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1624] Step 1:

[1625] Accepting user input

[1626] Specific behavior:

[1627] A user uses a terminal to provide text input to the system.

[1628] For example, the user may input, "Recently, I feel like nothing I do goes right."

[1629] Input: User text input

[1630] Output: Sending input data from the terminal to the server

[1631] Step 2:

[1632] Analyzing input data

[1633] Specific behavior:

[1634] The server passes the received user input data to a generative AI model (e.g., GPT-4).

[1635] The generative AI model analyzes what the user says and identifies the thought patterns behind it.

[1636] Input: User-entered data

[1637] Output: Analysis results (identification of thought patterns)

[1638] Step 3:

[1639] Generating Advice

[1640] Specific behavior:

[1641] The server generates advice based on the analysis results obtained from the generative AI model, based on the principles of cognitive behavioral therapy.

[1642] For example, create specific advice such as, "It's important to reflect on your own successes and focus on the positive aspects."

[1643] Input: Analysis results

[1644] Output: The generated advice

[1645] Step 4:

[1646] Emotional state assessment

[1647] Specific behavior:

[1648] The server uses an emotion engine to assess the user's emotional state from the input data.

[1649] For example, strong emotions such as "anger" or "sadness" can be detected from user input.

[1650] Input: User-entered data

[1651] Output: Emotional state assessment result

[1652] Step 5:

[1653] Providing counseling services

[1654] Specific behavior:

[1655] The server provides optimal counseling services according to the user's emotional state.

[1656] For example, if the user is showing signs of anger, the server will prioritize providing advice such as "Take a deep breath and take some time to relax."

[1657] Input: Emotional state assessment result

[1658] Output: Counseling services provided

[1659] Step 6:

[1660] Displaying the results

[1661] Specific behavior:

[1662] The server sends the generated advice and questions to the terminal.

[1663] The terminal displays this information to the user.

[1664] For example, the user's screen might display the message, "It's important to reflect on your own successes and focus on the positive aspects."

[1665] Input: Generated advice or question

[1666] Output: The results displayed on the user's terminal

[1667] (Application example 3)

[1668] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1669] In modern society, there is a demand for systems that can grasp users' emotional states in real time and provide appropriate advice and product suggestions. However, conventional systems have difficulty responding flexibly to users' emotional states, and have had issues with not being able to respond appropriately, particularly when users show strong emotions or are in a calm state. In addition, it is not possible to record users' actions or thoughts, making it impossible to review them later, making it difficult to provide continuous support.

[1670] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes: a means for listening to the user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with AI so as not to be preachy; a means for preventing depression and previous low moods and guiding the user to live a better life; a means for recording the user's actions and thoughts during the dialogue and reviewing them at a later date; a means for understanding the user's mental state in real time and providing appropriate advice and product suggestions; a means for providing advice to calm the user when the user shows strong emotions; and a means for providing questions and tasks to deepen the user's self-understanding when the user is calm and suggesting products based on the results. This enables flexible responses according to the user's mental state and provides continuous support.

[1671] "Voice dialogue format" refers to a format in which a user and a system communicate using voice.

[1672] "Complaints, etc." are statements that contain negative emotions such as dissatisfaction or worries that users feel in their daily lives.

[1673] "Avoiding preaching" means not giving the impression of instructing users in a condescending manner.

[1674] "AI" is an abbreviation for artificial intelligence, a technology that allows computers to act in a way that mimics human intelligence.

[1675] "Natural dialogue" means that the user and the system communicate smoothly, like a conversation between humans.

[1676] Cognitive behavioral therapy is a type of psychotherapy that encourages clients to reevaluate their thought patterns and engage in constructive behavior.

[1677] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[1678] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[1679] "Mood depression" refers to a temporary negative emotion or low mood experienced by a user.

[1680] "Behavior record" means recording the actions taken by a user.

[1681] "Thought recording" is the act of recording what the user thinks and feels.

[1682] "Real-time" means that information entered by a user is processed immediately.

[1683] "Advice" means advice or suggestions provided to a user.

[1684] "Product suggestion" refers to recommending appropriate products based on the user's needs and condition.

[1685] "Strong emotions" are strong emotions such as anger or sadness felt by the user.

[1686] "Calming advice" is advice to help users calm their strong emotions.

[1687] "Self-understanding" means that users gain a deep understanding of their own emotions and thoughts.

[1688] "Questioning" means asking questions that make users think.

[1689] "Issues" are problems or challenges that users must address.

[1690] The system for implementing this invention is configured as follows: First, the server listens to the user's complaints in a voice dialogue format, while engaging in a natural dialogue with the AI ​​without sounding preachy. This provides a counseling service similar to cognitive behavioral therapy. The server uses an emotion engine to grasp the user's mental state in real time and provide appropriate advice and product suggestions.

[1691] Hardware and software used

[1692] Hardware: Smartphone

[1693] Software: Python, sentiment analysis library (e.g. TextBlob, NLTK)

[1694] Data processing and calculation

[1695] 1. Getting user input: A smartphone application gets input from the user. For example, the user might type, "Lately, I feel like nothing I do is going right."

[1696] 2. Sentiment Analysis: The emotion engine analyzes the user's input and identifies their current emotional state. For example, the user may type "sad."

[1697] 3. Providing advice: Providing advice based on the emotional state. For example, "Take a short break to refresh yourself."

[1698] 4. Product proposal: When the user is in a calm state, we provide questions and tasks to deepen self-understanding, and then make product proposals based on those questions and tasks.

[1699] Specific examples

[1700] Example 1: Sentiment analysis and advice provision

[1701] If a user types, "I feel like nothing I do goes right these days," the emotion engine will interpret this as "sad" and offer the advice, "Take a break and refresh yourself."

[1702] Example 2: Product proposal

[1703] If a user types "I'm feeling good today," the emotion engine will interpret this as "happy" and suggest products based on the user's interests along with the advice "Keep it up!"

[1704] Prompt Sentence Examples

[1705] "Tell me how you're feeling right now: Lately, it feels like nothing I do is going right."

[1706] "Tell me how you feel right now: I feel good today."

[1707] In this way, a system can be realized that can respond flexibly to the user's mental state and provide continuous support.

[1708] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1709] Step 1:

[1710] The user launches the smartphone application and inputs their current feelings. The input text is sent to the server, which then uses the input data to analyze the user's emotional state.

[1711] Step 2:

[1712] The server analyzes the received user input data using a sentiment analysis library (e.g., TextBlob, NLTK). Specifically, emotions are extracted from the input text and classified as "happy," "sad," "angry," or "calm." For example, an input such as "I feel like nothing I do these days goes well" would be classified as "sad."

[1713] Step 3:

[1714] The server uses an emotion engine to generate advice based on the analysis results. Advice according to the emotional state is retrieved from the database and provided to the user. For example, if the emotional state is classified as "sad," the advice generated is "Take a short break and refresh yourself."

[1715] Step 4:

[1716] The server records the user's emotional state and advice, allowing the user to later reflect on their own emotional state and the advice they received. The recorded data is saved as a record of the user's actions and thoughts.

[1717] Step 5:

[1718] If the user shows strong emotions, the server will prioritize providing advice to calm them down. For example, if the user is classified as "angry," the server will provide advice such as "Take a deep breath and stay calm."

[1719] Step 6:

[1720] If the user is in a calm state, the server will provide questions and challenges to deepen self-understanding. For example, if the user is classified as "calm," the server will suggest related products along with advice such as "Try something new."

[1721] Step 7:

[1722] The server then makes appropriate product suggestions based on the user's input data and the results of emotion analysis. For example, if the emotion is classified as "happy," the server will suggest products based on the user's interests along with the advice, "Keep it up!"

[1723] Step 8:

[1724] The user can review the advice and product suggestions provided and take action if necessary. The user's feedback is sent to the server and reflected in future advice and suggestions.

[1725] In this way, a system can be realized that can respond flexibly to the user's mental state and provide continuous support.

[1726] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1727] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1728] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[1729] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1730] [Third embodiment]

[1731] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1732] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1733] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1734] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1735] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1736] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1737] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1738] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1739] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1740] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1741] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1742] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1743] "Example 1"

[1744] One embodiment of the present invention provides a voice dialogue system using AI. This system accepts voice input from a user and uses natural language processing technology to understand the content. It then generates an appropriate response based on the principles of cognitive behavioral therapy and provides it to the user as voice output. The purpose of this dialogue is to deepen understanding of the user's problems and concerns and to provide appropriate advice and guidance.

[1745] "Example 2"

[1746] Furthermore, this system has the function of creating a record of the user's actions and thoughts. Specifically, when the user describes their actions or thoughts while interacting with the system, the system records them and saves them for later reference. For example, if a user says, "I've been feeling depressed since this morning and haven't been able to get anything done," the system records that information and provides it as reference information for the user to use later when reflecting on their mood and actions that day.

[1747] "Example 3"

[1748] This system helps users understand their own mental state and guides them in taking concrete actions to improve it. For example, if a user says, "I feel like nothing I do goes well these days," the system will explore the underlying thought patterns and provide advice based on the principles of cognitive behavioral therapy. This will encourage users to reevaluate their own thought patterns and take more constructive action.

[1749] The processing flow of each embodiment will be described below.

[1750] "Example 1"

[1751] Step 1: The system accepts voice input from the user, which includes the user's emotions, thoughts, and actions.

[1752] Step 2: The system uses natural language processing technology to understand the voice input, extracting the user's emotions, thought patterns, and behavioral tendencies.

[1753] Step 3: The system generates an appropriate response based on the principles of cognitive behavioral therapy, which aims to deepen understanding of the user's problems and concerns and provide appropriate advice and guidance.

[1754] Step 4: The generated response is provided to the user as a voice output, which can provide the user with a new perspective or solution to their problem or concern.

[1755] "Example 2"

[1756] Step 1: The user describes their actions and thoughts while interacting with the system.

[1757] Step 2: The system analyzes the user's statements using natural language processing technology and creates a record of their actions and thoughts.

[1758] Step 3: The created records are saved in the system and can be referenced later by the user, allowing them to reflect on their own behavioral and thought patterns and deepen their self-understanding.

[1759] "Example 3"

[1760] Step 1: The user describes their problem or concern to the system.

[1761] Step 2: The system analyzes the user's statements using natural language processing technology and explores the thought patterns behind them.

[1762] Step 3: The system generates and provides advice based on principles of cognitive behavioral therapy to the user, encouraging them to reevaluate their thought patterns and adopt more constructive behaviors.

[1763] Example 1

[1764] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1765] Conventional counseling systems often lack an environment where users can feel free to talk about their complaints and worries, and it is difficult to have natural conversations without sounding preachy. Furthermore, systems that allow users to record their behavior and thoughts are limited, and lack the functionality to review them later. This means that users are not provided with sufficient support to prevent depression and lead better lives.

[1766] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1767] In this invention, the server includes means for accepting voice input and converting it into text data using voice recognition technology, means for analyzing the text data using natural language processing technology and generating an appropriate response, and means for converting the generated response into voice data and providing it as a voice output. This allows users to freely talk about their complaints and worries, and enables the provision of counseling services based on cognitive behavioral therapy through natural dialogue that is not preachy. Furthermore, the server can keep records of users' actions and thoughts, which can be reviewed later, providing sufficient support to prevent depression and lead a better life.

[1768] "Voice interaction" means that the user interacts with the system through voice.

[1769] "Artificial intelligence" is a technology that allows computers to mimic human intelligence and learn, reason, and self-correct.

[1770] "Natural language processing technology" is a technology that allows computers to understand and generate human language.

[1771] Cognitive behavioral therapy is a form of psychotherapy that improves emotional and behavioral problems by changing thoughts and behaviors.

[1772] "Counseling services" are services that provide advice and support to users regarding their worries and problems.

[1773] "Voice input" refers to a user inputting voice into the system through a microphone.

[1774] "Speech recognition technology" is a technology that converts voice into text data.

[1775] "Text data" is character string data converted using voice recognition technology.

[1776] "Response generation" is the process of generating an appropriate reply based on the analyzed text data.

[1777] "Audio data" refers to data obtained by converting text data into an audio signal.

[1778] "Audio output" refers to playing the generated audio data through a speaker or the like.

[1779] "Behavior record" is data that records the user's behavior.

[1780] "Thought records" are data that record the user's thoughts.

[1781] "Analysis" is the process of understanding text data and extracting meaning.

[1782] This invention is a system that provides counseling services based on cognitive behavioral therapy by listening to users' complaints and worries in a voice dialogue format, while engaging in natural dialogue with artificial intelligence to avoid being preachy. The system aims to prevent users from becoming depressed and provide support to help them live better lives.

[1783] System configuration

[1784] Hardware

[1785] Device: A device with a microphone and speaker (e.g., smartphone, tablet, computer)

[1786] Server: a computer system with high-performance computing power

[1787] software

[1788] Speech recognition technology: Software that converts voice data into text data (e.g., Google Cloud Speech-to-Text API)

[1789] Natural language processing technology: Software that analyzes text data and generates appropriate responses (e.g., OpenAI's GPT-4)

[1790] Speech synthesis technology: Software that converts text data into voice data (e.g., Google Cloud Text-to-Speech API)

[1791] System Operation

[1792] Accepting voice input

[1793] The user speaks into the device's microphone. For example, they might say, "I've been feeling a lot of stress lately." The device captures this speech as digital audio data.

[1794] Converting audio data to text

[1795] The device sends the captured voice data to a server, which uses voice recognition technology to convert the voice data into text data. During this conversion process, the voice signal is analyzed and a corresponding string of characters is generated.

[1796] Text data analysis

[1797] The server receives the converted text data and analyzes it using natural language processing technology. This analysis uses a generative AI model. The server extracts and understands the user's intentions and emotions from the text data.

[1798] Generating a response

[1799] Based on the analysis results, the server generates appropriate responses based on the principles of cognitive behavioral therapy using a pre-trained generative AI model. The generated responses are stored on the server as text data.

[1800] Response transcription

[1801] The server converts the generated text data into voice data using speech synthesis technology, in which the text data is converted into voice signals and generated as natural-sounding speech.

[1802] Audio Output

[1803] The server transmits the generated voice data to the terminal, which plays the voice data through a speaker and provides a response to the user.

[1804] Specific examples

[1805] As a concrete example, consider the case where a user voice-inputs, "I've been feeling a lot of stress lately, and it's bothering me." This voice input is captured by the device via a microphone and sent to the server. The server then uses voice recognition technology to convert it into text data, "I've been feeling a lot of stress lately, and it's bothering me."

[1806] The server then analyzes this text data using natural language processing technology to understand the user's intention regarding stress, and generates a response based on the principles of cognitive behavioral therapy, such as, "To reduce stress, it is important to first recognize and accept your own emotions. Specifically, keeping a diary and setting aside time to relax are effective."

[1807] The generated response is converted into voice data using voice synthesis technology and provided to the user through the device's speaker.

[1808] An example of a prompt might be:

[1809] User: "I've been feeling a lot of stress lately."

[1810] Sarver: "The key to reducing stress is to first recognize and accept your emotions. Specifically, journaling and setting aside time to relax can be effective."

[1811] In this way, the system can better understand the user's problems and concerns and provide appropriate advice and guidance.

[1812] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1813] Step 1:

[1814] The user speaks into the microphone of the device. For example, they might say, "I've been feeling a lot of stress lately." The device captures this speech as digital audio data. The input is the user's voice, and the output is digital audio data.

[1815] Step 2:

[1816] The device sends the captured voice data to a server, which uses voice recognition technology to convert the voice data into text data. During this conversion process, the voice signal is analyzed and a corresponding string of characters is generated. The input is digital voice data, and the output is text data.

[1817] Step 3:

[1818] The server receives the converted text data and analyzes it using natural language processing technology. A generative AI model is used for this analysis. The server extracts and understands the user's intentions and emotions from the text data. The input is the text data, and the output is the analysis results.

[1819] Step 4:

[1820] The server generates an appropriate response based on the principles of cognitive behavioral therapy based on the analysis results. A pre-trained generative AI model is used to generate this response. The generated response is saved as text data on the server. The input is the analysis results, and the output is the text data of the response.

[1821] Step 5:

[1822] The server converts the generated text data into voice data using speech synthesis technology. In this conversion process, the text data is converted into voice signals and generated as natural-sounding speech. The input is the response text data, and the output is voice data.

[1823] Step 6:

[1824] The server transmits the generated voice data to the terminal, which plays the voice data through a speaker and provides a response to the user. The input is the voice data, and the output is a voice response provided to the user.

[1825] In this way, the system can better understand the user's problems and concerns and provide appropriate advice and guidance.

[1826] (Application example 1)

[1827] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1828] In modern society, users experience various stresses and anxieties in their daily lives. In particular, depression, low mood, and security-related anxieties are on the rise, and appropriate support for these issues is needed. However, conventional counseling services and security advice require users to consult with experts directly, which places time and place restrictions on the users. There is also psychological resistance to consulting with experts. To solve these issues, a system that users can easily access is needed.

[1829] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1830] In this invention, the server includes: means for listening to the user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy in a natural dialogue with AI that does not sound preachy; means for preventing depression and previous low moods and guiding the user to live a better life; means for recording the user's actions and thoughts during the dialogue and allowing them to be reviewed at a later date; means for providing appropriate advice and guidance for security concerns and questions; means for converting voice input into text and generating an appropriate response using a generative AI model; and means for providing the generated text response as voice output. This allows users to easily receive counseling services and security advice.

[1831] "Voice interaction" means that the user interacts with the system through voice.

[1832] "Complaints, etc." refers to statements made by users regarding dissatisfaction or stress they feel in their daily lives.

[1833] "Avoiding preaching" means avoiding instructing or criticizing users and maintaining a natural dialogue.

[1834] "AI" refers to artificial intelligence technologies, specifically including natural language processing and generative AI models.

[1835] "Natural dialogue" is a dialogue format designed to allow users to converse with the system in a natural way.

[1836] "Cognitive behavioral therapy" is a type of psychotherapy that aims to improve a client's thoughts and behaviors.

[1837] "Counseling services" are services that provide support and advice to users regarding psychological problems and worries.

[1838] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[1839] "Mood depression" refers to a temporary state of depression or lethargy experienced by users.

[1840] "Behavior records" are data that record the user's daily behavior.

[1841] "Thought records" are data that record the user's thoughts and feelings.

[1842] "Security concerns" refers to concerns users have about the safety of their information and privacy.

[1843] "Advice and Guidance" means advice or guidance provided to a User.

[1844] "Voice input" refers to a user providing information to a system by voice via a microphone.

[1845] "Convert to text" is the process of converting audio data into text data.

[1846] A "generative AI model" is an artificial intelligence model that generates appropriate responses based on input data.

[1847] A "text response" is a response of text data generated by a generative AI model.

[1848] "Voice output" is the process of converting text data into speech and providing it to the user.

[1849] The following system configuration will be described as an embodiment of the present invention.

[1850] System Configuration

[1851] The system listens to users' complaints and concerns in a voice dialogue format, providing counseling services similar to cognitive behavioral therapy through natural dialogue with AI that avoids being preachy. It also offers ways to prevent depression and low mood and guide users toward a better life. It also includes a function that allows users to record their actions and thoughts during the dialogue, allowing them to review them later. It also has a function that provides appropriate advice and guidance for security-related concerns and questions.

[1852] Hardware and software used

[1853] Hardware: Smartphone (microphone, speaker)

[1854] software:

[1855] speech_recognition library: Used to convert voice input to text.

[1856] Transformers library: Uses generative AI models (e.g., GPT-3) to generate appropriate responses.

[1857] Data processing and calculation

[1858] 1. Acquiring voice input: The user provides information by voice through the smartphone microphone, and the server captures this voice data.

[1859] 2. Speech recognition: The server uses the speech_recognition library to convert the voice data into text.

[1860] 3. Natural Language Processing: The server uses a generative AI model (e.g., GPT-3) to generate an appropriate response based on the user's input.

[1861] 4. Audio output: The server provides the generated text response as audio output through the smartphone's speaker.

[1862] Specific examples

[1863] If a user asks, "I think I received a phishing email. What should I do?", the server inputs the following prompt into the generative AI model:

[1864] Prompt Sentence Examples

[1865] A user asked a security question: I think I received a phishing email. What should I do?

[1866] AI Assistant: Do not click on the link in that email. Check the sender's address and contact official support.

[1867] The generative AI model generates an appropriate response based on the prompt, and the server provides the response as voice output to the user, allowing users to easily receive counseling services and security advice.

[1868] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1869] Step 1:

[1870] The user provides information by voice through the smartphone microphone. The server captures this voice data. The input is the user's voice data, and the output is the captured voice data.

[1871] Step 2:

[1872] The server uses the speech_recognition library to convert the captured voice data into text. The input is voice data and the output is text data. In this step, speech recognition technology is used to convert the voice data into text data.

[1873] Step 3:

[1874] The server uses a generative AI model (e.g., GPT-3) to generate an appropriate response based on the text data. The input is the user's text data, and the output is the generated text response. In this step, the generative AI model generates an appropriate response based on the prompt sentence.

[1875] Step 4:

[1876] The server provides the generated text response as a voice output through the smartphone speaker. The input is the generated text response and the output is voice data. In this step, the text data is converted into voice and provided to the user.

[1877] Step 5:

[1878] The server records the user's actions and thoughts during the dialogue. The input is the user's text data and generated text responses, and the output is the action record and thought record data. In this step, the dialogue content is recorded so that it can be reviewed at a later date.

[1879] Step 6:

[1880] The server provides appropriate advice and guidance for security concerns and questions. The input is the user's security question, and the output is the generated security advice. In this step, a generative AI model is used to generate an appropriate security response.

[1881] Example 2

[1882] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1883] In modern society, many people suffer from stress and depression. Depression and its precursor, low mood, are particularly significant factors that significantly reduce quality of life. Conventional counseling services primarily involve face-to-face sessions with a specialist, but are often limited by time and location, making them difficult for users to access. Furthermore, systems for efficiently managing and later referencing users' activity and thought records have yet to be fully developed. To address these issues, a system is needed that can provide counseling services through natural, non-preachy dialogue while listening to users' complaints in a voice-based dialogue format, and that can also efficiently manage and reference users' activity and thought records.

[1884] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1885] In this invention, the server includes: means for listening to a user's complaints in a voice dialogue format while providing counseling services such as cognitive behavioral therapy through natural dialogue with an AI that avoids being preachy; means for preventing depression and guiding the user to live a better life; means for keeping a record of the user's actions and thoughts during the dialogue and allowing them to review them at a later date; means for a terminal to convert speech into text when the user speaks to the system and send the text to a generative AI model; means for the generative AI model to analyze the text and the server to store the analysis results in a database; and means for the server to retrieve the records from the database and display them on the terminal when the user wants to view the records. This allows users to easily receive counseling services regardless of time or place, and also enables them to efficiently manage and view their own action and thought records.

[1886] "Voice interaction" refers to a format in which a user interacts with a system using voice.

[1887] "Complaints, etc." refers to the dissatisfaction, stress, worries, etc. that users experience in their daily lives.

[1888] "Artificial intelligence" is a technology that allows computers to act in a way that mimics human intelligence.

[1889] "Natural dialogue" is a dialogue format designed to allow users to converse with the system in a natural way.

[1890] "Cognitive behavioral therapy" is a form of psychotherapy that aims to improve mood and behavior by changing the user's cognition and behavior.

[1891] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[1892] "Mood depression" refers to a temporary state of low emotion or depression experienced by a user.

[1893] "Behavior records" are data that record the user's daily behavior.

[1894] "Thought records" are data that record the user's thoughts and feelings.

[1895] A "terminal" is a device (e.g., smartphone, PC) that a user uses to interact with the system.

[1896] "Speech-to-text" is the process of converting audio data into text using speech recognition technology.

[1897] A "generative AI model" is a model that uses artificial intelligence to analyze text data and extract meaning.

[1898] "Analysis results" are information obtained by the generative AI model analyzing text data.

[1899] A "database" is a system for efficiently storing and managing data.

[1900] "Referring to records" refers to the act of checking stored data at a later date.

[1901] This invention is a system that listens to users' complaints and other issues in a voice dialogue format, provides counseling services such as cognitive behavioral therapy through natural dialogue with artificial intelligence that avoids being preachy, and can also efficiently manage and refer to users' behavioral and thought records.

[1902] Hardware and software used

[1903] This system is realized using the following hardware and software.

[1904] Hardware: Servers (e.g., cloud computing services), devices (e.g., smartphones, PCs)

[1905] Software: Generative AI models (e.g., natural language processing models), databases (e.g., relational database management systems)

[1906] Data processing and calculation

[1907] Voice Recognition

[1908] When a user speaks to the system through the device, the device uses voice recognition software to convert the speech into text, for example by using the Google Speech-to-Text API.

[1909] Text analytics

[1910] The converted text data is sent to a generative AI model. The generative AI model (e.g., a natural language processing model) analyzes the text data and extracts the user's actions and thoughts. For example, from the text "I've been feeling depressed since this morning and I haven't been able to get anything done," the information "I've been feeling depressed" and "I haven't been able to get anything done" can be extracted.

[1911] Data storage

[1912] The server receives the analysis results sent from the generative AI model and stores them in a database. The stored data includes the user ID, date and time, behavioral records, and thought records. A relational database management system (e.g., MySQL) is used as the database.

[1913] Data Reference

[1914] When a user wants to refer to the record of their actions or thoughts at a later date, they access the system using a terminal. The server retrieves the relevant record from the database and displays it on the terminal. For example, if a user requests "Show me yesterday's record," the server retrieves yesterday's record from the database and displays it on the terminal.

[1915] Specific examples

[1916] scenario:

[1917] A user talks to the system using a smartphone, stating, "I've been feeling depressed since this morning and haven't been able to get anything done."

[1918] Example prompt sentence:

[1919] "I've been feeling down since this morning and haven't been able to get anything done. Please record this information."

[1920] In this way, the system efficiently manages the user's records of actions and thoughts and makes them available for later reference.

[1921] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1922] Step 1:

[1923] The user talks to the system.

[1924] Specific action: The user speaks into the smartphone microphone, "I've been feeling depressed since this morning and haven't been able to get anything done."

[1925] Input: User's voice data.

[1926] Output: Audio data is input to the device.

[1927] Step 2:

[1928] The device converts the speech to text.

[1929] What happens: Your device calls speech recognition software (e.g., Google Speech-to-Text API) and converts your speech into text, such as "I've been feeling depressed since this morning and haven't been able to get anything done."

[1930] Input: Audio data.

[1931] Output: Text data.

[1932] Step 3:

[1933] The device sends the text to a generative AI model.

[1934] What it does: The device sends the converted text over the internet to a generative AI model (e.g., a natural language processing model).

[1935] Input: Text data.

[1936] Output: The text data sent to the generative AI model.

[1937] Step 4:

[1938] A generative AI model analyzes the text.

[1939] What it does: The generative AI model analyzes the text and extracts information such as "I feel depressed" and "I couldn't get anything done."

[1940] Input: Text data.

[1941] Output: Analysis results (behavioral record, thought record).

[1942] Step 5:

[1943] The server stores the analysis results in a database.

[1944] Specific operation: The server receives the analysis results and stores the user ID, date and time, behavioral record, and thought record in a database (e.g., a relational database management system).

[1945] Input: Analysis results (action log, thought log).

[1946] Output: Records stored in a database.

[1947] Step 6:

[1948] A user views a record.

[1949] Specific operation: When a user requests "Show me yesterday's records" on their smartphone, the server retrieves yesterday's records from the database and displays them on the smartphone.

[1950] Input: The user request.

[1951] Output: The transcript displayed on the terminal.

[1952] (Application example 2)

[1953] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1954] In modern society, there is a demand for counseling services to help users maintain their mental health. However, conventional counseling services make it difficult for users to record their own actions and thoughts and review them later. They also lack a means to record security-related actions and thoughts so that they can be referenced later. This makes it difficult for users to receive appropriate feedback to improve their mental health and security awareness.

[1955] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for providing counseling services such as cognitive behavioral therapy through a natural dialogue with an AI while listening to the user's complaints in a voice dialogue format so as not to sound preachy; a means for preventing depression and previous low moods and guiding the user to live a better life; a means for recording the user's actions and thoughts during the dialogue so that they can be reviewed at a later date; and a means for recording security-related actions and thoughts and saving them for future reference. This allows the user to receive appropriate feedback to maintain their mental health and improve their security awareness.

[1956] "Voice interaction" means that the user interacts with the system through voice.

[1957] "Complaints, etc." refers to statements made by users regarding dissatisfaction or stress they feel in their daily lives.

[1958] "Not preachy" means avoiding a pressured or instructional tone that users may feel while interacting with the system.

[1959] "AI" is an abbreviation for artificial intelligence, and refers to technology that allows machines to act in a way that mimics human intelligence.

[1960] "Natural dialogue" refers to a dialogue format that allows users to feel as if they are having a conversation with a system.

[1961] "Cognitive behavioral therapy" is a type of psychotherapy that improves mental health by improving the user's cognition and behavior.

[1962] "Counselling services" are services that provide consultation and advice to support the mental health of users.

[1963] "Depression" is a mental illness characterized by persistent low mood and loss of interest.

[1964] "Mood depression" refers to a temporary state of mental depression experienced by the user.

[1965] "Behavior record" refers to recording specific actions taken by a user.

[1966] "Thought recording" refers to recording what the user thinks and feels.

[1967] "Looking back" refers to revisiting past actions and thoughts.

[1968] "Security-related actions and thoughts" refer to the actions and thoughts that users take regarding their own safety and information protection.

[1969] "Storing" refers to storing recorded information for future reference.

[1970] The following system configuration is used as an embodiment of this invention. The system provides a counseling service similar to cognitive behavioral therapy by listening to the user's complaints in a voice dialogue format and engaging in natural dialogue with AI to avoid being preachy. The system also has a function to record the user's actions and thoughts and allow them to be reviewed at a later date. It also includes a function to record security-related actions and thoughts and save them for future reference.

[1971] System Program

[1972] The system includes the following programs:

[1973] 1. Voice interaction:

[1974] The server uses speech recognition software (e.g., Google Speech-to-Text API) to convert the user's speech into text, which is then analyzed using natural language processing techniques (e.g., OpenAI GPT-3) to generate an appropriate response.

[1975] 2. Providing counseling services:

[1976] The server converts the generated response into speech using speech synthesis software (e.g., Google Text-to-Speech API) and provides it to the user, allowing the user to receive counseling through natural dialogue.

[1977] 3. Keeping records of actions and thoughts:

[1978] The server records the user's actions and thoughts in text format and stores them in a database (e.g., MySQL). The stored data can be accessed by the user at a later date.

[1979] 4. Security-related records:

[1980] The server identifies the security-related actions and thoughts expressed by the user and stores them in a database, allowing users to refer to these records later to improve their security awareness.

[1981] Processing Description

[1982] The server uses speech recognition software to convert the user's speech into text and analyzes it using natural language processing technology. Based on the analysis results, it generates an appropriate response and converts it into speech using speech synthesis software. The user's actions and thoughts are recorded in text format and saved in a database, allowing the user to refer to these records at a later date.

[1983] Specific examples

[1984] For example, if a user says, "I upgraded my home security system today," that information is converted into text through speech recognition software and analyzed using natural language processing technology. The analysis results are stored in a database, and the user can refer to the record at a later date.

[1985] Prompt Sentence Examples

[1986] If you say, "Today I upgraded my home security system," record that information and save it for future reference.

[1987] In this way, a system is realized that provides appropriate feedback to maintain users' mental health and improve their security awareness.

[1988] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1989] Step 1:

[1990] The server uses speech recognition software (e.g., Google Speech-to-Text API) to convert the user's speech into text. The input is the user's voice, and the output is text data. For example, when the user says, "Today I upgraded my home security system," the speech is converted into text.

[1991] Step 2:

[1992] The server analyzes the converted text data using natural language processing technology (e.g., OpenAI GPT-3). The input is the text data obtained in step 1, and the output is an appropriate response as a result of the analysis. Specifically, the text "I upgraded my home security system today" is analyzed, and an appropriate response is generated.

[1993] Step 3:

[1994] The server converts the generated response into speech using speech synthesis software (e.g., Google Text-to-Speech API) and provides it to the user. The input is the response text obtained in step 2, and the output is audio data. Specifically, the generated response is converted into speech and played back to the user.

[1995] Step 4:

[1996] The server records the user's actions and thoughts in text format and stores them in a database (e.g., MySQL). The input is the text data obtained in step 1, and the output is the record stored in the database. Specifically, the text "I upgraded my home security system today" is stored in the database.

[1997] Step 5:

[1998] The server identifies the security-related actions and thoughts stated by the user and stores them in a database. The input is the text data obtained in step 1, and the output is stored in the database as a security-related record. Specifically, the part "I upgraded my security system" is identified and stored as a security-related record.

[1999] Step 6:

[2000] The user can access the database at a later date and view the saved records of their actions and thoughts. The input is a request to access the database, and the output is a display of the saved records. Specifically, the user searches for past records through the application and checks the displayed records.

[2001] In this way, a system is realized that provides appropriate feedback to maintain users' mental health and improve their security awareness.

[2002] Example 3

[2003] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2004] In modern society, many people suffer from stress and depression. Traditional counseling services are primarily conducted through face-to-face sessions, which are constrained by time and location. Furthermore, few systems allow users to record their thoughts and actions and reflect on them later. Furthermore, there is a lack of ways to provide advice through natural conversations without coming across as preachy. To address these issues, a system that provides more flexible and effective counseling services is needed.

[2005] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[2006] In this invention, the server includes a means for a user to input, a means for the terminal to send the input to the server, a means for the server to analyze the input, a means for the server to send a prompt to the generative AI model, a means for the generative AI model to generate advice, and a means for the server to receive and provide the advice to the user. This allows the user to receive advice based on cognitive behavioral therapy through natural dialogue without being restricted by time or place. In addition, the user can keep a record of their actions and thoughts, which can be reviewed at a later date, promoting self-understanding and behavioral improvement.

[2007] "Voice interaction" means that the user interacts with the system through voice.

[2008] "Artificial intelligence" is a technology that allows computers to imitate human intelligence and perform learning and reasoning.

[2009] "Natural dialogue" is a dialogue format designed to allow users to converse with the system in a natural way.

[2010] Cognitive behavioral therapy is a form of psychotherapy that aims to improve emotions and behavior by changing the client's thought patterns and behavior.

[2011] "Counseling services" are services that provide support to users to resolve their psychological problems and worries.

[2012] "Mood depression" is a temporary state of low emotion or depression experienced by a user.

[2013] "Behavior records" are data that users use to record their daily activities.

[2014] "Thought records" are data that users use to record their thoughts and feelings.

[2015] A "prompt sentence" is an input sentence that gives specific instructions or questions to a generative AI model.

[2016] A "generative AI model" is an artificial intelligence model that generates new information or advice based on input data.

[2017] A "server" is a computer system that processes and stores data on a network.

[2018] A "terminal" is a device that is directly operated by a user.

[2019] "Analysis" is the process of understanding input data and extracting meaning from it.

[2020] "Advice" is specific instructions or advice provided to a user.

[2021] This invention is a system that provides support for helping users understand their own mental state and derive specific actions to improve it. This system includes a means for a user to provide input, a means for a terminal to send the input to a server, a means for the server to analyze the input, a means for the server to send a prompt sentence to a generative AI model, a means for the generative AI model to generate advice, and a means for the server to receive the advice and provide it to the user.

[2022] Hardware and software used

[2023] Hardware

[2024] Terminal: A device that is directly operated by the user, such as a smartphone, tablet, or PC.

[2025] Server: A computer system that processes and stores data over a network.

[2026] software

[2027] Natural language processing engine: Software for analyzing input text data, such as SpaCy or NLTK.

[2028] Generative AI models: Artificial intelligence models that generate new information or advice based on input data, such as OpenAI's GPT-3.

[2029] Data processing and calculation

[2030] A means for users to provide input

[2031] The user opens an application on their smartphone or computer and types, "Lately, I feel like nothing I do goes right" into the text box.

[2032] A means by which a device sends input to a server

[2033] The terminal sends the text data entered by the user to the server using the HTTPS protocol. After the transmission is complete, the terminal waits for a response from the server.

[2034] How the server parses the input

[2035] The server analyzes the received text data using a natural language processing engine (e.g., SpaCy or NLTK). As a result of the analysis, the user's emotions and thought patterns are identified.

[2036] A means for the server to send prompts to the generative AI model

[2037] The server generates a prompt to send to the generative AI model based on the analysis results. For example, it generates a prompt such as, "The user has said, 'Recently, I feel like nothing I do goes well.' Please identify the thought pattern behind this and provide advice based on the principles of cognitive behavioral therapy."

[2038] How generative AI models generate advice

[2039] The generative AI model generates advice based on prompts received from the server, and leverages past data and learned knowledge to provide advice based on the principles of cognitive behavioral therapy.

[2040] A means by which the server receives and provides advice to the user

[2041] The server provides the user with advice received from the generative AI model. Specifically, the server displays the advice to the user through the device interface. For example, the server displays advice such as, "Reflect specifically on recent events and consider what thoughts are causing those emotions."

[2042] Examples of specific examples and prompts

[2043] As a concrete example, consider the case where a user inputs "I feel like nothing I do goes right these days." In this case, the server sends the following prompt to the generative AI model:

[2044] "A client says, 'Lately, I feel like nothing I do seems to work.' Identify the thought patterns behind this and offer advice based on the principles of cognitive behavioral therapy."

[2045] The generative AI model analyzes this prompt and returns the following advice:

[2046] "Think specifically about recent events and consider what thoughts are triggering those feelings."

[2047] "Evaluate whether your thinking is realistic and look for ways to develop a more realistic perspective."

[2048] In this way, the server provides the user with advice that encourages specific actions. The flow of the identification process in the third embodiment will be described with reference to FIG.

[2049] Step 1:

[2050] The user provides input

[2051] A user opens an application on a smartphone or PC and enters "Recently, I feel like nothing I do goes well" into the text box. The input data is in text format and expresses the user's state of mind and worries.

[2052] Step 2:

[2053] The device sends input to the server

[2054] The terminal sends the text data entered by the user to the server using the HTTPS protocol. The input data is encrypted and sent to the server over a secure communication channel. Once the transmission is complete, the terminal waits for a response from the server.

[2055] Step 3:

[2056] The server parses the input

[2057] The server analyzes the received text data using a natural language processing engine (e.g., SpaCy or NLTK). The input data is in text format, and the analysis results identify the user's emotions and thought patterns. Specifically, the server tokenizes the text data and performs sentiment analysis and keyword extraction.

[2058] Step 4:

[2059] The server sends a prompt to the generative AI model

[2060] The server generates a prompt to be sent to the generative AI model based on the analysis results. The prompt is in text format and includes the user's input and the analysis results. For example, a prompt might be generated such as, "The user says, 'Recently, I feel like nothing I do goes well.' Please identify the thought pattern behind this and provide advice based on the principles of cognitive behavioral therapy."

[2061] Step 5:

[2062] Generative AI models generate advice

[2063] The generative AI model generates advice based on prompts received from the server. The input data is in the form of prompts, and the output data is in the form of advice text. The generative AI model utilizes past data and learned knowledge to provide advice based on the principles of cognitive behavioral therapy.

[2064] Step 6:

[2065] The server receives the advice and provides it to the user.

[2066] The server provides the user with the advice received from the generative AI model. The input data is the text format of the advice from the generative AI model, and the output data is the text format of the advice to be displayed to the user. Specifically, the...

Claims

1. A means for acquiring voice data capturing a user's voice; A means for converting the acquired voice data into text data; A means for analyzing the text data using a natural language processing technique and extracting the user's intention or emotion; A means for generating a response based on the principles of cognitive behavioral therapy based on the extracted intention or emotion of the user; means for providing said response to said user audibly; A system including:

2. A means for acquiring voice data capturing a user's voice; A means for converting the acquired voice data into text data; A means for extracting information regarding the user's behavior or thoughts from the text data; A means for recording the extracted information in a database in association with a user ID and a date and time; means for providing, upon request, the information recorded in said database to a requesting user; A system including:

3. A means for acquiring text data sent by a user; A means for analyzing the text data using a natural language processing technique and extracting the user's emotions or thoughts; A means for generating a prompt sentence to be input to a generative AI model based on the extracted emotion or thought; A means for obtaining advice based on the principles of cognitive behavioral therapy, generated by the generative AI model, by inputting the generated prompt sentence into the generative AI model; means for providing the obtained advice to the user; A system including:

Images