Self-talk method and device therefor

Abstract

According to the present disclosure, a self-talking method using a device comprising: a microphone for collecting a user's voice; a speaker configured to transmit auditory information to the user; a processor for controlling the microphone and the speaker; and a memory configured to store executable commands that can be accessed by the processor, the method comprising: providing an app screen including app menu icons to the user by the processor; an Ecological Momentary Assessment (EMA) step of collecting emotional state information including voice data from the user at time intervals set by the processor, storing it in the memory, and evaluating it in real time; and an Ecological Momentary Intervention (EMI) step of providing mediation content to the user according to the user's state by analyzing the data collected through the EMA step by the processor.

Description

Technology Field

[0001] The present disclosure relates to an apparatus and method for promoting self-talk by evaluating a user's emotional state in real time (EMA, Ecological Momentary Assessment) and providing appropriate intervention content (EMI, Ecological Momentary Intervention) to alleviate a person's anxious psychological state and enhance psychological flexibility. Background Technology

[0002] According to data released by the World Health Organization in 2018, the number of people suffering from depression and anxiety worldwide exceeded 300 million each; in particular, the population experiencing depression and anxiety is surging due to the recent COVID-19 pandemic. As depression or anxiety progresses, it can affect an individual's physical function and performance capabilities. While there is a great need to alleviate depression and anxiety that limit mental and physical activity, it is difficult for those suffering from these conditions to actively participate in treatment due to various reasons, such as negative public perception, fear of social stigma, and financial burdens.

[0003] Recently, many counseling, mindfulness, and wellness programs accessible via smartphone applications—which offer high accessibility and low financial burden—are being introduced for psychological resolution, and user demand and interest in these services are steadily increasing. However, application-based counseling services have limitations, such as the difficulty of providing real-time support and user concerns regarding the disclosure of personal information to others, even when counseling is conducted remotely.

[0004] Furthermore, in the case of wellness services such as mindfulness, some of the content provided to users presents attention-shifting techniques designed to help individuals suffering from depression and anxiety break free from maladaptive self-focus by shifting their attention to external information unrelated to themselves. However, limitations have been pointed out regarding these methods of shifting attention to external information, noting that they may be difficult for individuals experiencing psychological difficulties such as depression and anxiety depending on the situation, and carry the risk of increasing the tendency to suppress or avoid thoughts about oneself; consequently, they may not be sufficiently effective for long-term and sustainable solutions.

[0005] In other words, currently, methods for alleviating depression and anxiety through applications—such as the one-way consumption of wellness services like non-face-to-face counseling and mindfulness—are limited and fail to offer highly effective solutions. Prior art literature

[0006] Korean Registered Patent 10-2481216: Magnetic conversation device and method Korean Registered Patent 10-2495725: Magnetic conversation device and method The problem to be solved

[0007] In modern society, depression and anxiety have become established as serious mental health issues, and these symptoms have surged, particularly since the COVID-19 pandemic. However, many people find it difficult to receive help through face-to-face psychological counseling due to financial burdens and concerns about social stigma. To address this, smartphone application-based self-talk methods have been introduced and are gaining attention as useful tools for users to find emotional stability on their own. However, it is expected that current self-talk methods will enable more effective psychological intervention by providing customized emotional support and real-time feedback when combined with real-time data collection and personalized intervention functions, such as EMA (Ecological Moment Assessment) and EMI (Ecological Moment Intervention).

[0008] This disclosure proposes an Eco-Momentary Intervention (EMI) method that collects and evaluates a user's emotional state in real time based on Eco-Momentary Assessment (EMA) and provides appropriate intervention content based on this. Through this, it enhances the user's psychological flexibility, effectively alleviates negative emotional states, and helps the user continuously practice self-talk without face-to-face counseling. means of solving the problem

[0009] According to one embodiment of the present disclosure, a self-talking method using a device comprising: a microphone for collecting a user's voice; a speaker configured to transmit auditory information to the user; a processor for controlling the microphone and the speaker; and a memory configured to store executable commands that can be accessed by the processor, the self-talking method comprising: providing an app screen including app menu icons to the user by the processor; an Ecological Momentary Assessment (EMA) step of collecting emotional state information including voice data from the user at time intervals set by the processor, storing it in the memory, and evaluating it in real time; and an Ecological Momentary Intervention (EMI) step of providing mediation content to the user according to the user's state by analyzing the data collected through the EMA step by the processor.

[0010] According to one embodiment of the present disclosure, the mediation content may include breathing training and self-talk content.

[0011] According to one embodiment of the present disclosure, the EMI step may further include a step of personalizing mediation content by providing temporal context to data collected from the user.

[0012] According to one embodiment of the present disclosure, the EMA step may include sending a push notification to the user according to a set time interval to induce the user to evaluate the current state, and collecting at least one of a Likert scale, a slide scale, and binary response data from the user.

[0013] According to one embodiment of the present disclosure, the EMI step provides a user with intervention content designed based on Acceptance and Commitment Therapy (ACT), and the intervention content may include ACT training content (regular exercises) that can be performed in general situations and ACT intervention content (action exercises) suitable when the user faces a painful situation, depending on the emotional state and stress level.

[0014] According to one embodiment of the present disclosure, the EMI step may include the step of recommending and providing user-customized content according to the range of scores obtained in the EMA step.

[0015] According to one embodiment of the present disclosure, the EMI step may include a step of analyzing the user's current state data and providing feedback in real time according to the emotional and stress state.

[0016] According to one embodiment of the present disclosure, the EMI step may include providing a content introduction screen to the user and having the user read and record a sentence in their own voice.

[0017] According to one embodiment of the present disclosure, the EMI step may include the step of presenting words regarding emotion selection to the user and allowing the user to select one to three words, and the step of providing user-customized emotion regulation content based on the combination of words.

[0018] According to one embodiment of the present disclosure, the EMI step may include the step of causing the processor to send an additional notification to the user when the sentiment evaluation data exceeds a threshold value.

[0019] According to one embodiment of the present disclosure, the step of recording may include the step of reading to oneself and the step of speaking to oneself.

[0020] According to one embodiment of the present disclosure, the processor may include the step of providing a program execution record to a user in a calendar format, wherein the calendar displays the progress status from the start date of the program to the present by date, the status of the execution record is distinguished by color or symbol to indicate "completed" or "incomplete," the total duration and start date of the program are displayed, and the goal achievement rate to date is calculated as a percentage and provided to the user.

[0021] According to another embodiment of the present disclosure, an apparatus for performing the method is disclosed, comprising a memory, a microphone, a speaker, and a processor for controlling said memory, said microphone, and said speaker. Effects of the invention

[0022] According to one embodiment of the present disclosure, intervention content is personalized based on real-time user data collected through EMA. Content that reflects the user's temporal context and emotional state increases psychological flexibility and maximizes stress relief effects.

[0023] In addition, it analyzes user-inputted data in real time and provides feedback in the form of text, voice, and visual materials. This enables users to receive immediate assistance and helps them sustain self-talk and psychological recovery over the long term.

[0024] Since the present disclosure is provided based on a smartphone application, users can manage their emotional state without direct contact with others. This has the effect of reducing concerns about social stigma and increasing accessibility.

[0025] According to the present disclosure, by visually providing records of user activity and goal achievement rates (e.g., medication adherence rates), it supports users in checking their progress and feeling a sense of accomplishment. The present disclosure overcomes the limitations of existing face-to-face counseling or simple wellness apps, thereby providing the effect of helping users manage and improve their own emotional state. Brief explanation of the drawing

[0026] FIG. 1 is a block diagram of a psychological counseling device according to one embodiment of the present disclosure. FIG. 2 is a flowchart of a self-dialogue according to one embodiment of the present disclosure. FIG. 3 is an example of a screen provided to a user according to one embodiment of the present disclosure. Figure 4 is an example of a subsequent screen when "self-dialogue" in Figure 3 is selected. FIG. 5a shows an example of the first screen displayed after the user selects "Start" in FIG. 4, and FIG. 5b is the screen after starting the recording by pressing the "Read" button in FIG. 5a. Figure 6 is an example of a subsequent screen when "Next" in Figure 5 is selected. Figure 7 is an example of a subsequent screen when "Self-talk+(plus)" in Figure 3 is selected. Figure 8 is an example of a screen provided to the user following Figure 7. Figure 9 is an example of a subsequent screen when "Try speaking" in Figure 8 is selected. FIG. 10a is an example of a subsequent screen when the screen of FIG. 9 is touched, and FIG. 10b is an example of a screen where the user can listen to their own voice again after completing the recording in FIG. 10a. Figure 11 is an example of a subsequent screen when "breathing" in Figure 3 is selected. Figure 12 is an example of a subsequent screen when "Thought Record" in Figure 3 is selected. FIG. 13 is an example of a screen that can check the user's app performance record and goal achievement rate according to one embodiment of the present disclosure. Specific details for implementing the invention

[0027] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein.

[0028] In addition, to clearly explain the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification have been given similar reference numerals.

[0029] Throughout the specification, when a part is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0030] It should be understood that the technology described in this disclosure is not intended to be limited to specific embodiments and includes various modifications, equivalents, and / or alternatives to the embodiments of this disclosure.

[0031] The expression “configured to” as used in this disclosure may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only that which is “specifically designed to” in hardware. Instead, in some situations, the expression “device configured to” may mean that the device is “capable of” together with other devices or components. For example, the phrases “a processor configured (or set) to perform A, B, and C” and “a module configured (or set) to perform A, B, and C” may refer to a dedicated processor for performing the said operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or an application processor) capable of performing said operations by executing one or more software programs stored in a memory device.

[0032] The prior art described in this disclosure is incorporated herein by reference in its entirety, and it will be understood that a person skilled in the art may apply the contents described in the prior art to the parts briefly described in this disclosure.

[0033] Hereinafter, a self-talking device and a method according to an embodiment of the present disclosure will be described with reference to the drawings.

[0034] FIG. 1 is a block diagram of a self-dialogue device (1000) according to one embodiment of the present disclosure. The self-dialogue device (1000) may include all types of devices that use an internet line, such as an IPTV (Internet Protocol Television), a Smart TV and a Connected TV, a set-top box (STB), a smartphone, a tablet PC, etc. The self-dialogue device (1000) may provide a self-dialogue method according to the present disclosure through an application installed on the self-dialogue device (1000).

[0035] In one embodiment of the present disclosure, a self-talking device (1000) includes a user interface (1002), a memory (1004), a microphone (1006), a processor (1008), a speaker (1010), and a communication module (1012).

[0036] The user interface (1002) may provide an interface that provides content to the user. The user interface (1002) receives input from the user and provides content to the user. The user interface (1002) may include a display (not shown). The user interface (1002) may include a touch screen. The self-talk device (1000) may output information for performing content to the user through the user interface (1002). For example, the self-talk device (1000) may provide a survey based on an Ecological Momentary Assessment through the user interface (1002) to determine the user's emotions. Additionally, the self-talk device (1000) may provide content for self-talk to the user.

[0037] Memory (1004) is a computer-readable storage medium, such as data storage devices, that can be accessed by a computing device and provides permanent storage of data and executable instructions (e.g., software applications, programs, functions, etc.). Examples of memory (1004) include volatile memory and non-volatile memory, fixed and removable media devices, and any suitable memory device or electronic data storage that holds data for access by a computing device. Memory (1004) may include various embodiments of random access memory (RAM), read-only memory (ROM), flash memory, and other types of storage media of various memory device configurations. Memory (1004) is configured to store executable software instructions (e.g., computer-executable instructions) that can be executed with a processor (1008) or the same software applications that can be implemented as modules.

[0038] In one embodiment, the memory (1004) may store commands that enable the user to grasp contextual information or perform (or assist in) self-talk. The memory (1004) may store information for ecological moment evaluation and providing self-talk. Additionally, the memory (1004) may store commands necessary to modulate the voice of the received user. For example, voice modulation may mean changing the pitch, formant, speed, phonatory setting, prosodic intonation, prosodic settings, articulatory settings, etc., of the sound to generate the same text in multiple modified voices.

[0039] The memory (1004) stores content to be provided to the user. In one embodiment, the content may include at least one of text, background music, and an image. For example, the memory (1004) stores text to be provided to the user and words corresponding to the key words of the text. In one embodiment, the content to be provided to the user and the key words may be stored in pairs. For example, if words of negative emotion and content (text) of negative emotion are stored in the memory in pairs, when the user selects words of negative emotion, the paired content (text) of negative emotion may be provided to the user through the user interface (1002).

[0040] In one embodiment, the content may include text based on Positive Self Talk (PST), text based on the concepts of forgiveness, acceptance, self-respect, gratitude, self-compassion, and love-kindness, and text based on Acceptance and Commitment Therapy, a Cognitive Behavior Therapy (CBT) method for treating anxiety and depressive disorders.

[0041] The microphone (1006) can receive the user's voice. The user can record sentences provided by the self-talk device (1000) through the microphone (156). The self-talk device (1000) can collect the user's voice through the microphone (1006) and analyze the user's voice to determine the user's intentions and emotions. For example, the user can speak text provided through the user interface (1002). The microphone (1006) recognizes the user's speech, and the self-talk device (1000) can store the user's speech in memory (1004).

[0042] The processor (1008) may include components of other embodiments of silicon and / or hardware, such as an integrated circuit, a programmable logic device, a logic device formed using one or more semiconductors, and a processor and memory system implemented as a system-on-chip (SoC). The processor (1008) may be configured to analyze voice stored in memory (1004). Additionally, the processor (1008) may be configured to control components of the self-talk device (1000), provide information stored in memory (1004) to a user, or analyze information stored in memory (1004).

[0043] The self-dialogue device (1000) may further include any type of system bus or other data and command transmission system that combines various components within the self-dialogue device (1000). The system bus may include control and data lines as well as any one or a combination of different bus structures and architectures.

[0044] The speaker (1010) delivers content to the user as auditory information. In one embodiment, the speaker (1010) can deliver a sentence recorded by the user to the user as the user's recorded voice and a sound that modulates the user's voice.

[0045] The communication module (1012) is configured so that the magnetic conversation device (1000) communicates with an external device to receive information. The communication method of the communication module (1012) may utilize networks established according to GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), 5G, etc., but is not limited thereto and may include all transmission method standards to be developed in the future. It may include all methods capable of exchanging data via wired or wireless means. Content stored in memory, etc., can be updated through the communication module (1012).

[0046] The self-conversation device (1000) is configured to convert speech into text (Speech To Text, STT) and text into speech (Text To Speech, TTS). Since the functions of STT and TTS are functions provided by the smart device by default, a detailed description is omitted.

[0047] The self-conversation device (1000) may be configured to implement an artificial intelligence model. The artificial intelligence model of the present disclosure is configured to perform natural language processing on the user's speech. As described below, the artificial intelligence model may be an artificial intelligence model trained with a learning model including an artificial neural network (ANN). For example, the natural language processor may include Google's BERT (Bidirectional Encoder Representation from Transformers) and a model based thereon), GPT (Generative Pre-Training) and a model based thereon), XLNET, RoBERTa, ALBERT, etc. In the present disclosure, the artificial intelligence model can optimize parameters within the artificial neural network by training a learning model including an artificial neural network (ANN) through a large amount of training data, and obtain a response to a new input using the trained learning model. Artificial neural networks include at least one or a combination thereof, such as a Convolutional Neural Network (CNN), Deep Neural Network (DNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), Deep Belief Network (DBN), Bidirectional Recurrent Deep Neural Network (BRDNN), or Deep Q-Networks, but are not limited to the examples mentioned above.

[0048] Additionally, the self-talk device (1000) may include a voice equalization function. Voice equalization is designed to provide a natural and unnatural listening experience when the user listens to the voice recorded during the self-talk process. This function adjusts the voice based on frequency bands, and the following adjustments are made:

[0049] - Mid and High-Mid Frequency: Amplified to improve speech clarity.

[0050] - Low, Low-Mid, and High Frequency: Attenuated to minimize speech distortion.

[0051] The tone adjustment function contributes to increasing psychological acceptance and enhancing immersion in self-conversation by correcting the user's own voice to sound more natural when listening to voices recorded through the process of self-conversation. This tone adjustment function has been applied to the current Engzirax system and is continuously being improved to provide an optimized listening environment for users.

[0052] FIG. 2 is a flowchart of self-talk according to one embodiment of the present disclosure. A psychological counseling device (1000) provides an app screen including app menu icons to a user (S210). FIG. 3 is an example of a screen provided to a user according to one embodiment of the present disclosure. The home screen (300) of FIG. 3 includes a "Thought Record" icon (310), a "Breathing" icon (320), a "Self-Talk" icon (330), a "Self-Talk+" (Plus) icon (340), etc.

[0053] The user can use the app by selecting the desired program and menu from the home screen (300). The three-line icon (360) at the top left of the home screen (300) is the app menu. The "Thought Record" icon (310) at the top right allows the user to record their current experiences and emotional situations. In other words, the user can additionally record the events of the day. The first "Breathing" icon (320) in the center is a program that provides narration and background music (BGM) to aid breathing. The second "Self-Talk" icon (330) in the center allows the user to enter the first program provided to them. The third "Self-Talk+" icon (340) in the center allows entry into an emotion information-based program. The icon at the bottom right (350) allows entry into a chatbot screen where various help and questions / answers can be viewed.

[0054] The psychological counseling device (1000) executes an EMA (Ecological Momentary Assessment) step (S220) in which emotional state information, including voice data, is collected from the user at time intervals set by the processor (1008), stored in memory (1004), and evaluated in real time.

[0055] After that, the psychological counseling device (1000) executes an EMI (Ecological Momentary Intervention) step (S230) by the processor (1008), which analyzes data collected through the EMA step and provides intervention content to the user according to the user's condition. The intervention content may include breathing training and self-talk content. For example, if the user selects the "Breathing" icon (320) in FIG. 3, breathing training can be performed. Additionally, if the user selects the "Self-Talk" icon (330) or the "Self-Talk+" icon (340) in FIG. 3, self-talk content can be utilized.

[0056] The EMI stage enables the personalization of mediated content by adding temporal context to data collected from users. In other words, when analyzing data provided by users, it means evaluating the user's state by including temporal information such as "when," and providing appropriate customized content accordingly.

[0057] For example, by considering the time the user entered data or recent activities (e.g., emotions felt during the last 15 minutes), content suitable for the user's current state and situation can be provided.

[0058] The EMA step may include sending push notifications to the user according to set time intervals and collecting at least one of Likert scale, slide scale, or binary response data from the user. For example, push notifications are sent to the user at specific times three times a day to ask them to answer questions such as "How do you feel right now?" or "How stressed are you?" The user records their emotional state "currently" or "over the last 15 minutes." The user may receive EMA alarms three times a day at preferred times they have pre-set.

[0059] Temporal information can be added to user data. Example:

[0060] - 9 AM: High stress

[0061] - 2 PM: Feeling better

[0063] For example, if a “pattern of increasing stress in the afternoon” is repeated, the processor (1008) can analyze this and recommend content suitable for that time (e.g., breathing meditation, self-talk guide).

[0064] Temporal context is important because user states change over time (e.g., feeling less stressed in the morning but increasing in the afternoon); therefore, utilizing temporal information allows for a more accurate analysis of the user's state and the provision of personalized content.

[0065] In one embodiment of the present disclosure, the EMI step may include sending a notification to a user at time intervals set during the day, inducing the user to write a brief self-report on their current symptoms (e.g., emotions, cognitive state), activities, trends, and location through the notification, and storing the user's self-report data in memory for subsequent analysis. The method of users writing simple self-reports at regular intervals is a technical feature that can effectively collect emotional state data when combined with EMA (Ecological Moment Assessment).

[0066] In one embodiment of the present disclosure, the EMI step provides a user with intervention content designed based on Acceptance and Commitment Therapy (ACT), and the intervention content may include, depending on the emotional state and stress level, (1) ACT training content (regular exercises) that can be performed in general situations and (2) ACT intervention content (action exercises) suitable when the user faces a painful situation. Through a technical configuration that personalizes content based on the two main training methods of ACT, a method of enhancing the user's psychological flexibility may be highlighted.

[0067] ACT (Acceptance and Commitment Therapy) training content is divided into regular exercises and action exercises, each with different purposes and methods of execution. Below are representative types / categories corresponding to these two categories:

[0068] - ACT Training Content (Regular Exercises)

[0069] Focus on assessing the user's current state in general situations and cultivating psychological flexibility by practicing the basic principles of ACT (acceptance, defusion, mindfulness, etc.).

[0070] Types and Examples

[0071] 1. Mindfulness of the Present Moment

[0072] Description: Consciously observing the sensations currently being felt (sound, smell, touch, etc.).

[0073] Example: "Please listen intently to the sounds around you right now for one minute."

[0074] 2. Distance Between Thoughts and Emotions (Cognitive Defusion)

[0075] Explanation: Practice recognizing negative thoughts or emotions as simple "mental events" so as not to be swayed by them.

[0076] Example: "Imagine putting the negative words coming to mind onto a balloon and sending them away."

[0077] 3. Acceptance of Emotions

[0078] Description: Allowing uncomfortable emotions to be felt naturally without suppressing them.

[0079] Example: "Do not try to suppress the anxiety you are currently feeling; just feel the emotion as it is."

[0080] 4. Breathing Exercises

[0081] Description: Focus on the present moment and relieve tension through deep, steady breathing.

[0082] Example: "Slowly inhale through your nose, hold for 4 seconds, and then exhale through your mouth. Repeat."

[0083] 5. Imagining a Worthwhile Life (Value Visualization)

[0084] Description: Recall your important values ​​and imagine yourself putting them into practice.

[0085] Example: "Think of the one most important value and visualize yourself realizing that value."

[0086] - ACT Mediation Content (Action Exercises)

[0087] Helps the user adapt to the situation and adjust their behavior when facing psychological stress or painful situations.

[0088] Types and Examples

[0089] 1. Exploring Difficult Thoughts and Feelings

[0090] Explanation: Reducing the impact of uncomfortable or painful thoughts on behavior by facing and exploring them.

[0091] Example: "Write down the most uncomfortable thought you are currently feeling, and observe how it affects you."

[0092] 2. Committed Action in Difficult Situations

[0093] Description: Acting based on important values ​​even in painful moments.

[0094] Example: "In a stressful situation, think about the actions you would choose based on the values ​​you consider important."

[0095] 3. Visualizing Stress and Anxiety

[0096] Explanation: Viewing stress objectively by expressing it through concrete images (e.g., flowing river, wind).

[0097] Example: "Imagine anxiety like a leaf floating on a river, and visualize it flowing along with the current."

[0098] 4. Acting with Discomfort

[0099] Description: Training to act toward one's goals while feeling uncomfortable.

[0100] Example: "Even while feeling anxious, try to practice one small action (e.g., making an important phone call)."

[0101] 5. Distinguishing Between Thoughts and Reality (Thoughts Are Not Facts)

[0102] Explanation: An exercise that helps distinguish between thoughts and reality, without considering thoughts as "facts."

[0103] Example: "Try to distinguish whether the thought currently coming to your mind is an actual fact or just a thought."

[0104] Differences between Training Content and Intervention Content

[0105]

[0106] According to the present disclosure, by integrating EMA / EMI, regular exercises or action exercises can be recommended based on data entered by the user (e.g., current emotional state, stress level). Additionally, specific content can be provided to help the user take action in specific situations (e.g., facing stress).

[0108] In one embodiment of the present disclosure, the EMI step may include a step designed to induce a user to record their important values ​​every morning and to enable the user to evaluate whether they performed their value behaviors at the end of the day. The user's daily value recording and evaluation function implements a core element of ACT and provides a psychological effect that helps the user connect their behaviors with their values.

[0109] According to one embodiment of the present disclosure, beyond simply collecting user data, mediated content can be further personalized by reflecting temporal contexts, such as when the data was collected. That is, by considering when the user inputs data, the method includes recommending content suitable for the time the user needs. For example, if the user experiences high stress levels during a specific time period, content suitable for that time period is provided.

[0111] According to one embodiment of the present disclosure, the EMA step sends a push notification to a user at regular time intervals to induce the user to evaluate their current state and may allow the user to input binary response data such as a Likert scale (e.g., a choice from 1 to 5), a slide scale (e.g., visually adjusting stress intensity), or yes / no. Notifications are sent to the user at regular time intervals to induce them to answer a question such as "How do you feel right now?" That is, when responding, the user records their state in a simple way such as a choice from 1 to 5 (Likert scale), adjustment via a visual slide, or "yes / no".

[0112] According to one embodiment of the present disclosure, the EMA step may include a step of sending a second notification after a certain period of time to increase the response rate if the user does not respond to the first push notification sent to the user, and the additional notification may be set at an optimized frequency so as not to interfere with the user experience.

[0113] According to one embodiment of the present disclosure, the EMI step may include the step of recommending and providing customized intervention content suitable for the user (e.g., breathing meditation, self-talk script, thought journaling) based on the range of scores (e.g., stress index, emotional index, etc.) obtained in the EMA step.

[0114] In the EMA stage, the score obtained based on the user's response is interpreted within a defined range (e.g., 1 to 5 points), and the user's condition is analyzed based on this. For example, if the stress index reported by the user is high (score 4 to 5), the system provides "breathing meditation content" to help the user achieve psychological stability.

[0115] On the other hand, if the user's emotional index is positive (score 1 to 2), a "positive self-talk script" to reinforce self-talk may be recommended. The present disclosure is designed so that the user can receive help suitable for their condition through such customized content.

[0116] According to one embodiment of the present disclosure, the EMI step may include the step of analyzing the user's current state data and providing appropriate real-time feedback to the user in the form of text, voice, or visual materials according to the emotional state (e.g., anxiety, positivity, depression) and stress level.

[0117] The user's current state data includes scores collected through the EMA stage (e.g., stress index, emotional index, etc.) and user data entered in real time. In the EMI stage, based on this data, if the user's anxiety level is high, "real-time feedback content to alleviate anxiety (e.g., positive self-talk, relaxation training)" is provided. For example, if the user responds that "current stress is 5 points," the system can provide a breathing training video that the user can immediately perform, along with a text or voice notification.

[0118] When the stress level decreases, it helps maintain the user's psychological balance by adjusting future intervention content or recommending additional content based on the user's state.

[0119] FIG. 4 is an example of a subsequent screen when "Self-talk" in FIG. 3 is selected. After the user finishes reading the content introduction text in FIG. 4, if they press the "Start" icon (410), they proceed to FIG. 5.

[0120] FIG. 5 is an example of a subsequent screen when "Start" in FIG. 4 is selected. The user can read the content aloud by pressing the 'Read Aloud' microphone icon (510) below without reading it with their eyes.

[0121] FIG. 5a shows an example of the first screen displayed after the user selects "Start" in FIG. 4, and FIG. 5b is the screen after starting the recording by pressing the "Read" (510) button in FIG. 5a.

[0122] Description of the functions of the bottom icons in Fig. 5:

[0123] 'Read aloud' (510): Records the user's voice as they read. Pressing the button starts recording and switches to the pause (530) button. Pressing the pause (530) button ends the recording.

[0124] 'Rewind' (520): Rewinds the recorded audio to the beginning while playing.

[0125] 'Listen' (530): You can listen to the recorded voice of the user.

[0126] FIG. 6 is an example of a subsequent screen when "Listen" (530) in FIG. 5 is selected. When the "Listen" icon (530) in FIG. 5 is pressed, the main screen appears, allowing the user to listen to their recorded voice again. Here, the user can listen to their voice. If the user has listened to their voice sufficiently, they press the "Save" icon (610) in the upper right corner and exit the program.

[0127] Figure 7 is an example of a subsequent screen when "Self-dialogue+" (340) in Figure 3 is selected.

[0128] In the central part (710) of Fig. 7, words for selecting emotions are presented, allowing the user to express their current emotions as weather. The level is adjusted to be closer to 'cloudy' when the emotion currently being experienced is negative, and to 'clear' when it is closer to positive. Various words related to emotions appear depending on the degree of cloudiness-clearness. The user can select one to three related words, and after completing the selection, press the 'Select' button (720). The processor (1008) can provide user-customized emotion regulation content based on the combination of selected words. That is, the processor (1008) can analyze the emotion words selected by the user (e.g., "anxiety", "fatigue") and execute an algorithm that automatically recommends related content.

[0129] Figure 8 is an example of a screen provided to the user following Figure 7.

[0130] According to one embodiment of the present disclosure, the step of recording may include the step of reading to oneself and the step of speaking to oneself.

[0131] Figure 8 is a “Self-Talk+” page that helps with current emotions, providing various content related to the emotion selected by the user. The training types of the content are divided into “Speaking” (811, 812) and “Reading” (820), and the user can select and perform the content they want.

[0132] "Speak" content (811, 812): Training that allows the user to speak their thoughts on a given topic out loud and record them.

[0133] "Read" content (820): Training for the user to engage in self-dialogue while reading text.

[0134] When the user scrolls down the screen, additional "Read-A-Read" content is displayed, providing a wider variety of options.

[0135] In addition, if you press the heart-shaped 'bookmark' (830) button at the top right, the user can save content they like and check it again later.

[0136] Figure 9 is an example of a subsequent screen when "Tell me" in Figure 8 is selected.

[0137] In Fig. 9, a short question is provided to the user. The user can press the 'Speak' icon (910) at the bottom to speak their thoughts and answers to the question.

[0138] FIG. 10a is an example of a subsequent screen when the screen of FIG. 9 is touched, and FIG. 10b is an example of a screen where the user can listen to their own voice again after completing the recording in FIG. 10a.

[0139] FIG. 10a shows a screen where a user can read self-talk content and speak the content aloud. A self-talk topic in the form of a question is displayed at the top of the screen, and related examples and text are presented at the bottom. The user can press the 'Speak' button (1010) at the bottom to speak their thoughts aloud and record them in response to the question.

[0140] FIG. 10b shows a screen where the user can listen to their own voice recorded in FIG. 10a. The 'Rewind' button (1020) at the bottom of the screen allows the recording to be listened to again from the beginning, and the 'Listen' button (1030) provides the function to play the recording. After playback is complete, the user can press the 'Save' button (1040) to save the recording or exit the content. Additionally, the user can view the text again by touching the screen.

[0141] FIG. 11 is an example of a subsequent screen when "breathing" (320) in FIG. 3 is selected. The user can try breathing that is comfortable for them by following the movements of the provided narration (1120) or screen graphics (1130). The background image of the screen graphics (1130) moves, and in FIG. 11, a leaf image is provided as a breathing example screen.

[0142] You can return to the home screen by pressing the left 'Close (X)' button (1110) after stopping the breathing training in the middle or after finishing the training.

[0143] FIG. 12 is an example of a subsequent screen when "Thought Record" (310) in FIG. 3 is selected. "Thought Record" is used when a user wants to leave an objective record of various situations, such as when they suddenly feel a great deal of anxiety or when they want to escape from the rumination process. When the question mark icon (1210) at the top right of the screen is pressed, a new explanation pop-up window appears. This informs users who are encountering "Thought Record" for the first time about the purpose, usage situations, methods, and examples of "Thought Record."

[0144] FIG. 13 is an example of a screen that can check the user's app performance record and goal achievement rate according to one embodiment of the present disclosure.

[0145] According to one embodiment of the present disclosure, a processor (1008) may include the step of providing a program execution record to a user in the form of a calendar, wherein the calendar displays the progress status from the start date of the program to the present on a daily basis, the status of the execution record is distinguished by color or symbol to indicate "completed" or "incomplete," the total duration and start date of the program, and the goal achievement rate to date is calculated as a percentage and provided to the user.

[0146] The "Garden Record" screen in Fig. 13 is a screen where the user can check the program execution record and the goal achievement rate. This screen is displayed in a calendar format so that the user can easily distinguish between the days the program was executed and the days it was not executed.

[0147] The progress from the program start date to the present is displayed by date, allowing the user to check it at a glance. The record status by date is distinguished by color and symbol, a green square box (1330) indicates the current date, an empty square box (1320) indicates the date the execution was completed, and the absence of a square box (1310) indicates that the program was not executed on that date.

[0148] At the bottom of the screen, the program's start date and scheduled end date are displayed, allowing the user to check how many days have passed since the start of the program. Additionally, the percentage of the program goal achieved by the user (medication adherence rate) is calculated and provided as a percentage (%). For example, the progress to date is presented numerically, such as, "As of the start date, 2.9% of the goal has been achieved."

[0149] These visual components help users intuitively understand their current record status and goal achievement rate. By displaying the goal achievement rate (i.e., medication adherence rate), it motivates users to maintain continuous engagement and is designed to help them recognize their personal performance and focus more on achieving their goals.

[0150] According to one embodiment of the present disclosure, the EMI step may include, based on the result of evaluating the user's emotional state, a) providing content including a behavioral activation protocol for a user in an inactive state, b) providing a short video including educational content regarding emotional regulation, and c) providing audio content including relaxation techniques for a user in a severely anxious state.

[0151] According to one embodiment of the present disclosure, the EMI step may include, when the emotion assessment data exceeds a threshold (e.g., a sadness score of 6 or higher, for 5 consecutive days), a) causing the processor to send an additional notification to the user, b) automatically sending a message or warning to a therapist to inform the user of the user's condition, and c) enabling the user to receive direct counseling via a short phone call or video call if necessary. The present embodiment includes complementary measures, such as additional notifications and connection with a therapist, when the emotion assessment results exceed a threshold.

[0153] The devices and methods described above may be implemented as hardware components, software components, and / or combinations of hardware and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on the operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0154] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively. Software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave in order to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0155] The embodiments described in this disclosure may also be implemented in a distributed computing environment in which tasks are performed by remote processing devices connected via a communication network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

[0156] Although the embodiments have been described above with reference to the limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0157] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below. Explanation of the symbols

[0158] 1000: Self-talking device 1002: User Interface 1004: Memory 1006: Microphone 1008: Processor 1010: Speaker 1012: Communication module

Claims

Claim 1 A self-talking method using a device comprising: a microphone for collecting a user's voice; a speaker configured to transmit auditory information to the user; a processor for controlling the microphone and the speaker; and a memory configured to store executable commands that can be accessed by the processor, the method comprising: a step of providing the user with an app screen including app menu icons by the processor; an Ecological Momentary Assessment (EMA) step of collecting emotional state information including voice data from the user at time intervals set by the processor, storing it in the memory, and evaluating it in real time; and an Ecological Momentary Intervention (EMI) step of analyzing the data collected through the EMA step by the processor and providing intervention content to the user according to the user's state. Claim 2 In paragraph 1, the above mediation content is a self-talk method including breathing training and self-talk content. Claim 3 A self-talking method according to paragraph 2, wherein the EMI step further includes a step of personalizing mediation content by providing temporal context to data collected from the user. Claim 4 A self-dialogue method according to claim 3, wherein the EMA step includes the step of sending a push notification to the user according to a set time interval to induce the user to evaluate the current state, and collecting at least one of a Likert scale, a slide scale, and binary response data from the user. Claim 5 In paragraph 4, the EMI step provides the user with intervention content designed based on Acceptance and Commitment Therapy (ACT), and the intervention content includes ACT training content (regular exercises) that can be performed in general situations and ACT intervention content (action exercises) suitable when the user faces a painful situation, depending on the emotional state and stress level, a self-talk method. Claim 6 A self-talking method according to claim 5, wherein the EMI step includes the step of recommending and providing user-customized content based on the range of scores obtained in the EMA step. Claim 7 A self-talking method according to claim 6, wherein the EMI step includes a step of analyzing the user's current state data and providing real-time feedback according to emotional and stress states. Claim 8 A self-dialogue method according to claim 7, wherein the EMI step includes the step of providing the user with a content introduction screen and allowing the user to read and record a sentence in their own voice. Claim 9 A self-talking method according to claim 1, wherein the EMI step comprises the steps of presenting words regarding emotion selection to the user and allowing the user to select one to three words, and providing user-customized emotion regulation content based on the combination of words. Claim 10 A self-talking method according to claim 9, wherein the EMI step includes the step of, when the emotional evaluation data exceeds a threshold, causing the processor to send an additional notification to the user and automatically send a message or warning to the therapist to inform the user of the user's condition. Claim 11 In paragraph 8, the step of recording includes a step of reading to oneself and a step of speaking to oneself, a self-talk method. Claim 12 A self-talking method according to claim 8 or 11, wherein the processor provides a program execution record to a user in a calendar format, the calendar displays the progress from the start date of the program to the present by date, the status of the execution record is distinguished by color or symbol to indicate "completed" or "incomplete," the total duration and start date of the program are displayed, and the goal achievement rate to date is calculated as a percentage and provided to the user. Claim 13 A device comprising a memory, a microphone, a speaker, and a processor controlling said memory, said microphone, and said speaker, and a device for performing the method described in any one of claims 1 to 11.

Images