Management of psychiatric or mental conditions using digital or augmented reality with personalized exposure progressions
The system provides personalized exposure progression in digital or augmented reality for mental health treatment, addressing the inefficiencies of traditional methods by allowing autonomous and adaptive therapeutic engagement, thereby enhancing mental health management.
Patent Information
- Application Number
- JP2024532703
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-10-13
- Filing Date
- 2022-12-01
- Publication Date
- 2024-12-03
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Traditional mental health treatments, including face-to-face meetings and computer-based gaming sessions, are burdensome and ineffective for conditions like PTSD, SAD, and panic disorder, straining healthcare professionals and patients alike, and existing digital solutions require therapist presence, increasing resource demands.
A system and method for personalized exposure progression using digital or augmented reality, comprising a series of experiences categorized by therapy type, with biometric feedback and gating criteria, allowing subjects to engage in therapeutic tasks autonomously and adaptively.
Enhances mental health management by reducing burden on subjects and professionals, improving therapeutic efficacy through personalized and adaptive exposure therapy.
Smart Images

Figure 2024544658000001_ABST
Abstract
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority to U.S. Provisional Patent Application No. 63 / 284,862, entitled "Management of Psychiatric or Mental Conditions Using Digital or Augmented Reality with Personalized Exposure Progression," filed December 1, 2021, which is incorporated by reference in its entirety for all purposes. This application also claims priority to U.S. Provisional Patent Application No. 63 / 415,876, entitled "Management of Psychiatric or Mental Conditions Using Digital or Augmented Reality with Personalized Exposure Progression," filed October 13, 2022, which is incorporated by reference in its entirety for all purposes. [Technical field]
[0002] The present disclosure relates to systems, methods and devices for preparing a digital or augmented reality based therapy regimen for managing a psychiatric or mental condition exhibited by a subject. [Background technology]
[0003] The demand for access to psychiatric facilities and services to improve the mental health of patients is at an all-time high. However, no evidence has been found that this increased access to psychiatric facilities has resulted in a decrease in the causes of mental health problems. On the contrary, there has been an increase in mental health problems among patients in recent years. See Mojtabai et al., “Trends in Psychological Distress, Depressive Episodes and Mental-Health Treatment-Seeking in the United States: 2001-2012,” Journal of Affective Disorders, 174, pg. 556.
[0004] Moreover, the increased demand for mental health facilities proportionally increases the demand for health care workers and professionals who provide services in mental health facilities. Thus, health care workers and professionals are exposed to increased psychological and physiological stress, which prevents them from providing optimal services. See Ruiz-Fernandez et al., 2020, “Compassion Fatigue, Burnout, Compassion Satisfaction and Perceived Stress in Healthcare Professionals During the COVID-19 Health Crisis in Spain,” Journal of Clinical Nursing, 29(21-22), pg. 4321-4430.
[0005] Traditional solutions to improving mental health are cumbersome and resource intensive for all parties involved. For example, traditional solutions often require time-consuming and costly face-to-face meetings between clinicians and patients. Furthermore, these face-to-face meetings do not easily allow clinicians to observe patients in situations that would uncover the patient's underlying mental health issues, given the intimate and private nature of face-to-face meetings with clinicians.
[0006] Furthermore, traditional solutions lack sufficient efficacy in treating certain mental health problems. For example, traditional face-to-face cognitive and / or behavioral exposure techniques have generally shown some efficacy, but lack significant efficacy for post-traumatic stress disorder (PTSD), social anxiety disorder (SAD), and panic disorder in particular. See Carpenter et al., 2018, “Cognitive Behavioral Therapy for Anxiety and Related Disorders: A Meta-analysis of Randomized Placebo-controlled Trails,” Depression and Anxiety, 25(56), pg. 502.
[0007] Concurrently, interactive computer-implemented games and services are expanding. However, previous solutions that link services to improve mental health with computer-implemented games have been unsatisfactory. One source of such failure is the requirement that therapists must be present with patients during computer-implemented game sessions. See Freeman et al., 2017, “Virtual Reality in the Assessment, Understanding, and Treatment of Mental Health Disorders,” Psychological Medicine, 47(14), pg. 2393. However, this requirement is a burden on both patients and physicians in terms of available time, space, and monetary resources.
[0008] Thus, there is a need for systems, methods and devices that improve the mental health of a subject without unduly burdening the subject or their medical provider. Summary of the Invention
[0009] In view of the above background, what is needed in the art are systems and methods for preparing therapy to improve a subject's ability to manage a psychiatric or mental condition exhibited by the subject.
[0010] The present disclosure provides improved systems and methods for implementing exposure progressions that improve a subject's ability to manage or improve their psychiatric or mental condition.
[0011] One aspect of the present disclosure relates to providing systems, methods, and devices for implementing an exposure progression. The exposure progression is a sequence of events in a digital reality configured to improve the subject's ability to manage the subject's psychiatric or mental condition. For example, in some embodiments, the sequence of events includes a variety of experiences presented to the subject, such as 2 or more experiences, 3 or more experiences, 5 or more experiences, 10 or more experiences, etc. Thus, in some such embodiments, the method of the present disclosure is implemented in a computer system associated with the subject. The computer system includes one or more processors and a display for presenting at least the digital reality scene. In some embodiments, the computer system includes one or more speakers or headphones for presenting auditory aspects of the digital reality scene. Additionally, the computer system includes a plurality of sensors and a memory coupled to the one or more processors. The memory includes one or more programs configured to be executed by the one or more processors.
[0012] Thus, the method includes obtaining a plurality of categories for the subject. In some embodiments, each respective category in the plurality of categories is directed to improving a particular ability of the subject to manage a psychiatric or mental condition. In some embodiments, the plurality of categories includes an exposure category, a cognitive reframing therapy (CBT) category, a mindfulness category, a general category, or a combination thereof. A non-limiting example of an exposure category includes a first social interaction and / or interaction anxiety category, a second public performance anxiety category, a third fear of being observed category, a fourth intake anxiety (e.g., anxiety associated with the intake of food) category, a fifth assertiveness anxiety category, or a combination thereof. Another non-limiting example of a CBT category includes a sixth cognitive reframing category, a seventh utility category, an eighth defusion category, or a combination thereof. Each respective category is associated with a corresponding plurality of proposed experiences. As such, each suggested experience in the corresponding plurality of suggested experiences is a task or challenge in digital reality configured to improve a particular ability of the subject to manage a psychiatric or mental condition. A non-limiting example of an experience associated with a first social interaction and / or interaction anxiety category includes an exercise to improve interaction anxiety by being left alone (e.g., at a wedding, in a park, etc.) and having to interact with a stranger. Another non-limiting example of an experience associated with a CBT category includes a cognitive reframing exercise configured to identify the subject's catastrophic thoughts and beliefs about how they are perceived that lead to interaction anxiety.
[0013] Further, each respective category is associated with at least one respective gating criterion in the plurality of gating criteria. In some embodiments, the gating criterion is a condition precedent that must be achieved to consider the respective category completed for the subject. A non-limiting example of a precedent condition is a requirement that at least two proposed experiences in the corresponding plurality of suggested experiences are successfully completed by the subject before the subject is allowed to invoke a given category. Another non-limiting example of a precedent condition is a requirement that a threshold number of interactions with digital reality objects must be met when interacting with the experience. In this manner, each respective proposed experience in the corresponding plurality of suggested experiences is associated with a corresponding digital reality scene that manifests a corresponding challenge designed for the respective proposed experience of the respective category.
[0014] In some embodiments, each proposed experience is further associated with at least one biometric measurement and thresholds in a plurality of biometric thresholds, allowing the method to correlate capturing at least one biometric data element from the subject during the digital reality scene. For example, in some embodiments, the at least one biometric measurement includes a voice feature associated with the subject (e.g., entropy of a voice signal obtained from the subject), or a spatial feature associated with the subject when interacting with the digital reality scene (e.g., the subject's hand movement when interacting with the digital reality scene). Thus, in some embodiments, the disclosed method includes presenting on the display a first digital reality scene that manifests a first challenge designed for a first proposed experience of a first category based on the subject's selection of a plurality of categories. In some embodiments, in conjunction with this presentation of the first digital reality scene, the disclosed method includes acquiring a first plurality of data elements. In some embodiments, the first plurality of data elements includes a first set of biometric data elements. The first set of biometric data elements is acquired from a subset of sensors in the plurality of sensors. In some embodiments, the subset of sensors includes one sensor, at least two sensors, or at least four sensors. As such, the subset of sensors includes at least one biometric sensor configured to capture at least one biometric data element associated with the subject when the subject is completing the first task in the first digital reality scene. In some embodiments, the at least one biometric sensor includes a first biometric sensor that is a heart rate sensor, a heart rate variability sensor, a blood pressure sensor, an electrodermal activity sensor, a galvanic skin response sensor, an electroencephalogram sensor, an eye tracking sensor, a recorder, a microphone, a thermometer, or any combination thereof.From this, in some such embodiments, the disclosed method includes determining whether the subject's performance during the presentation meets or exceeds various biometric measurement thresholds, determining when each gating criterion in at least one respective gating criterion associated with the first category is met, or both. In some such embodiments, based on this determination, which includes an assessment of at least one biometric data element, the disclosed method includes determining a second category in the plurality of categories for the subject to next perform that best improves the subject's ability to manage the psychiatric or mental condition based at least in part on the result of the determination of whether the subject's performance during the presentation meets or exceeds various biometric measurement thresholds. Thus, the disclosed method performs an exposure progression from a first category to a second category that improves the subject's ability to manage the subject's psychiatric or mental condition by selecting the second category for the subject as opposed to a third category that is less optimal for the subject compared to the second category.
[0015] In some embodiments, the multiple categories in obtaining the multiple categories are initially placed in an initial instance of an exposure progression that is set by a system administrator, the subject, a medical professional (e.g., physician) associated with the subject, a model (e.g., a computational model), or a combination thereof.
[0016] In some embodiments, the method further includes presenting a graph representing an initial instance of the exposure progression on the display prior to presenting the first digital reality scene. The graph includes a plurality of nodes and a plurality of edges. In some embodiments, for each respective node in the plurality of nodes, the graph further includes a corresponding plurality of experience graphics displayed adjacent the respective node. In some embodiments, each respective node in the plurality of nodes corresponds to a respective category in the plurality of categories. Further, in some embodiments, each respective node is associated with a corresponding plurality of suggested experiences. Further, each respective node is associated with at least one respective gating criterion in the plurality of gating criteria. For each respective node in the plurality of nodes, each respective experience graphic in the corresponding plurality of experience graphics corresponds to a respective proposed experience in the plurality of suggested experiences and is associated with at least one biometric threshold in the plurality of biometric thresholds. Further, in some embodiments, each respective node in the plurality of nodes is connected to at least one other node of the graph by an edge in the plurality of edges. Further, in some embodiments, each respective edge in the plurality of edges represents a progression in the graph between a respective initial node and a respective subsequent node in the graph when a required number of corresponding tasks associated with the respective initial node are successfully completed by the subject.
[0017] In some embodiments, for each respective node in the plurality of nodes, the graph further includes a corresponding plurality of branches, and each respective experience graphic in the corresponding plurality of experience graphics is connected to the respective node by a branch in the corresponding plurality of branches.
[0018] In some embodiments, determining the second category includes evaluating whether a category immediately following the first category in the initial instance of the exposure progression is suitable for the subject to perform next. In some embodiments, determining the second category further includes indicating the immediately following category in the initial instance of the exposure progression as the second category for the subject to perform if the immediately following category in the initial instance of the exposure progression is suitable for the subject to perform next.
[0019] In some embodiments, determining the second category further includes recommending a category other than the immediately succeeding category in the initial instance of the exposure progression as the second category for the subject to next perform if the immediately succeeding category in the initial instance of the exposure progression is not suitable for the subject to next perform.
[0020] In some embodiments, the first biometric sensor is configured to capture biometric data elements associated with a physiological or psychological state of the subject at a predetermined sampling rate.
[0021] In some embodiments, the predetermined sampling rate is between 40 ms (milliseconds) and 160 ms, in some embodiments the predetermined sampling rate is adjustable or the predetermined sampling rate is fixed.
[0022] In some embodiments, the first biometric sensor is a heart rate sensor, a heart rate variability sensor, a blood pressure sensor, an electrodermal activity sensor, a galvanic skin response sensor, an electroencephalogram sensor, an eye tracking sensor, a recorder, a microphone, or a thermometer.
[0023] In some embodiments, the first subset of biometric data elements is captured by the first biometric sensor in response to a particular trigger, such as a particular trigger event, configured to initiate capture of the first subset of biometric data elements.
[0024] In some embodiments, the first biometric sensor is a heart rate sensor. In some such embodiments, the first subset of the biometric data elements is used to determine the subject's heart rate.
[0025] In some embodiments, the first biometric sensor is a heart rate variability sensor. In some such embodiments, the first subset of biometric data elements is used to determine the subject's beat-to-beat intervals to provide an assessment of heart rate variability.
[0026] In some embodiments, the first biometric sensor is an eye tracking sensor, and the first subset of the biometric data elements is used to determine the subject's gaze fixation, the subject's smooth motion, the subject's saccades, blinks by the subject, the subject's scan-path length, the subject's eye openness, the subject's pupil dilation, the subject's eye position, hypervigilance exhibited by the subject, gaze avoidance exhibited by the subject, or any combination thereof.
[0027] In some embodiments, the first biometric sensor is an eye tracking sensor. In some such embodiments, the first subset of biometric data elements is used to determine a gaze fixation of the subject. In some such embodiments, the gaze fixation is determined based on spatial and temporal criteria of a region of interest of the first digital reality scene.
[0028] In some embodiments, the first biometric sensor is an eye tracking sensor. In some such embodiments, the first subset of biometric data elements is used to determine hyperarousal exhibited by the subject. In some such embodiments, hyperarousal is defined as a time to first fixation during a particular task in the first digital reality scene.
[0029] In some embodiments, the first biometric sensor is an eye tracking sensor. In some such embodiments, the first subset of biometric data elements is used to determine gaze aversion exhibited by the subject. In some such embodiments, gaze aversion is defined as the number of fixations exhibited by the subject during a particular task in the first digital reality scene divided by the total number of fixations exhibited by the subject in the first digital reality scene.
[0030] In some embodiments, the first biometric sensor is a recorder. In some such embodiments, a sentiment or emotion analysis is performed on the first subset of the biometric data elements to assess whether the first task was successfully completed.
[0031] In some embodiments, the first subset of biometric data elements is replicated (e.g., by a computational model) to create a transcription. In some such aspects, the transcription is extracted to generate words. In some such embodiments, sentiment analysis is performed on the extracted words.
[0032] In some embodiments, the first subset of biometric data elements, determining fundamental frequency, speech rate, pauses, duration of silence, voice intensity, voice onset time, pitch perturbations, loudness perturbations, voice breaks, pitch jumps, voice quality, sound quality, or combinations thereof, are used to assess whether the first challenge is successfully completed by satisfying at least one biometric threshold associated with the first proposed experience for the first challenge.
[0033] In some embodiments, a first subset of the biometric data elements captured by the first biometric sensor is stored, enabling playback of the first subset of the biometric data elements after completion of the first digital reality scene.
[0034] In some embodiments, one or more specific keywords are used in the analysis of the first subset of biometric data elements to prevent spoofing.
[0035] In some embodiments, the first subset of biometric data elements are pre-processed to remove background noise before using the first subset of biometric data elements to assess whether the first challenge will be successfully completed by satisfying at least one biometric threshold associated with a first proposed experience for the first challenge.
[0036] In some embodiments, the first subset of biometric data elements is captured by the first biometric sensor with an automatic noise cancellation feature enabled.
[0037] In some embodiments, the method further includes receiving in electronic form a second plurality of data elements associated with the subject. In some such embodiments, the second plurality of data elements includes a second set of biometric data elements associated with an initial psychiatric or mental condition of the subject. Further, a corresponding threshold baseline characteristic is formed by the second plurality of biometric data elements.
[0038] In some embodiments, the method further includes obtaining, at or before initiating presentation of the first digital reality scene, a second set of biometric data elements from a first biometric sensor in the at least one biometric sensor, wherein a corresponding threshold baseline characteristic is formed by the second set of biometric data elements.
[0039] In some embodiments, obtaining the second set of biometric data elements is performed during an introduction or tutorial task.
[0040] In some embodiments, the introduction or tutorial assignment is presented in a digital reality scene, which includes a resting place (e.g., a digital space configured to calm or normalize the subject by providing educational and / or soothing content).
[0041] In some embodiments, the method further includes, if a gating criterion in at least one respective gating criterion associated with the first category is not satisfied, repeating the presenting of the first digital reality scene, obtaining the first plurality of data elements, and determining a degree of satisfaction of one or more thresholds (e.g., at least one biometric threshold, a corresponding first threshold baseline characteristic, a gating criterion, or a combination thereof) one or more times for other challenges associated with the first category.
[0042] In some embodiments, the method further includes recommending another suggested experience challenge in the plurality of suggested experiences corresponding to the first category for the subject to perform next if the first challenge is determined to be not successfully completed by failing to meet at least one biometric threshold associated with the first suggested experience for the first challenge. The recommending a challenge is indicated textually, graphically, audibly, or a combination thereof.
[0043] In some embodiments, the recommended challenge poses a challenging challenge equal to or less than the first challenge in the first category. In some embodiments, the recommended challenge is the same first challenge designed for a first suggested experience in the first category. Further, in some embodiments, the recommended challenge is a challenge designed for a different suggested experience in the first category. In some embodiments, the recommended challenge is a challenge designed for a suggested experience in a different category in the plurality of categories. Further, in some embodiments, the recommended challenge is a challenge outside any category in the plurality of categories.
[0044] In some embodiments, the method further includes, in response to a selection of the recommended challenge, iterating between presenting the first digital reality scene, acquiring a first plurality of data elements, and determining a degree of satisfaction of one or more thresholds (e.g., at least one biometric threshold, a corresponding first threshold baseline characteristic, a gating criterion, or a combination thereof) for the recommended challenge.
[0045] In some embodiments, the challenge is a unique mindfulness challenge customized to the first category, a universal mindfulness challenge accessible from each category in the plurality of categories, a unique cognitive reframing challenge customized to the first category, or a universal cognitive reframing challenge accessible from each category in the plurality of categories.
[0046] In some embodiments, the method further includes, in response to selection of the challenge, showing, on the display, a second digital reality scene illustrating the challenge.
[0047] In some embodiments, the method further includes acquiring a third plurality of data elements from a subset of sensors in the plurality of sensors in coordination with presenting the second digital reality scene. The third plurality of data elements includes a third plurality of biometric data elements associated with the subject. Further, the third plurality of data elements is captured when the subject is completing the second digital reality scene exhibiting the challenge. In some such embodiments, the method further includes determining a change or improvement by comparing the third plurality of biometric data elements against a corresponding threshold baseline characteristic or against the first plurality of biometric data elements from acquiring the first plurality of data elements.
[0048] In some embodiments, the method further includes presenting a subjective evaluation option, such as an assessment, on the display prior to determining the second category. In some such embodiments, the method further includes performing a subjective evaluation in response to a selection of the subjective evaluation option. Determining the second category is based, at least in part, on a result of the subjective evaluation.
[0049] In some embodiments, the subjective assessment is based on a Clinical Global Impression (CGI), a Patient Generated Index (PGI), the Liebowitz Social Anxiety Scale (LSAS), or a combination thereof. In some embodiments, the subjective assessment is based on a Minimal Clinically Important Difference (MCID) considering the CGI, PGI, LSAS, or a combination thereof. In some embodiments, the subjective assessment is based on a Generalized Anxiety Disorder (GAD) scale, such as GAD-2, GAD-7, etc. In some embodiments, the subjective assessment is based on a Patient Health Questionnaire (PHQ), such as PHQ-2, PHQ-9, etc.
[0050] In some embodiments, the method further includes iterating the presentation of the first digital reality scene, obtaining the first plurality of data elements, and determining a sufficiency of one or more thresholds (e.g., at least one biometric threshold, a corresponding first threshold baseline characteristic, a gating criterion, a combination thereof) for the digital reality scene that manifests a challenge designed for a proposed experience of a second category. In some such embodiments, the method further includes iterating the determination of a second category for the second category.
[0051] In some embodiments, in obtaining the plurality of categories, the plurality of suggested experiences associated with a first category are initially placed in a first sub-progression, in some embodiments the first sub-progression is set by a system administrator, the subject, a medical professional associated with the subject, a model, or a combination thereof.
[0052] In some embodiments, the method further includes assessing whether a proposed experience immediately following the first proposed experience in the initial first sub-progression is suitable for the subject to subsequently perform. In some such embodiments, the method further includes presenting a digital reality scene that demonstrates a challenge designed for the immediately following proposed experience in the initial first sub-progression if the immediately following proposed experience is deemed suitable for the subject to subsequently perform. Furthermore, in some such embodiments, the method further includes iterating between obtaining a first plurality of data elements and determining sufficiency of one or more thresholds (e.g., at least one biometric threshold, a corresponding first threshold baseline characteristic, a gating criterion, a combination thereof) for a challenge designed for the immediately following proposed experience in the first sub-progression of the initial exposure.
[0053] In some embodiments, the method further includes recommending a suggested experience other than the immediately following suggested experience for the subject to subsequently perform if the immediately following suggested experience is deemed not suitable for the subject to subsequently perform.
[0054] In some embodiments, determining sufficiency of one or more thresholds (e.g., at least one biometric threshold, a corresponding first threshold baseline characteristic, a gating criterion, or a combination thereof. Further, the method further includes determining whether the first set of biometric data elements satisfies a second biometric threshold in the at least one biometric threshold.
[0055] In some embodiments, one of the first and second biometric thresholds in the at least one biometric threshold is a required minimal change in utterance compared to the subject's utterance baseline. Thus, the other of the first and second biometric thresholds in the at least one biometric threshold is a required minimal change in assertiveness compared to the subject's assertiveness baseline, a required minimal change in decibel level compared to the subject's decibel level baseline, a required minimal change in pitch compared to the subject's pitch baseline, or a combination thereof, in a first digital reality scene that manifests a first challenge to be designed for a first proposed experience associated with a first category.
[0056] In some embodiments, the at least one biometric data element captured in obtaining the first plurality of data elements includes a fourth set of biometric data elements captured by a second biometric sensor in the at least one biometric sensor. In some embodiments, the fourth set of biometric data elements is different from the first set of biometric data elements. Further, in some such embodiments, determining sufficiency of one or more thresholds (e.g., at least one biometric threshold, a corresponding first threshold baseline characteristic, a gating criterion, a combination thereof) includes determining whether a comparison of the fourth set of biometric data elements to a third baseline characteristic satisfies a third biometric threshold in the at least one biometric threshold.
[0057] In some embodiments, one of the first and third biometric thresholds is a required minimum change in word count compared to the subject's word baseline, a required minimum change in utterance count compared to the subject's utterance baseline, a required minimum change in assertiveness compared to the subject's assertiveness baseline, a required minimum change in decibel level compared to the subject's decibel level baseline, a required minimum change in pitch compared to the subject's pitch baseline, or a combination thereof. Further, the other of the first and third biometric thresholds in the at least one biometric threshold is a required minimum change in eye contact length compared to the subject's eye contact baseline during a first digital reality scene that manifests a first challenge to be designed for the first proposed experience associated with the first category.
[0058] In some embodiments, each category in the plurality of categories is associated with a unique rank.
[0059] In some embodiments, the plurality of sensors includes a heart rate sensor, hi some such embodiments, the corresponding threshold baseline characteristic is an initial heart rate of the subject.
[0060] In some embodiments, the plurality of sensors includes a blood pressure sensor, hi some such embodiments, the corresponding threshold baseline characteristic is the subject's systolic blood pressure or the subject's diastolic blood pressure.
[0061] In some embodiments the display is a head mounted display.
[0062] In some embodiments, at least one respective gating criterion comprises a ranking gating criterion associated with a hierarchical ranking of each category in the plurality of categories.
[0063] In some embodiments, the at least one respective gating criterion includes a physician gating criterion associated with approval from a physician associated with the subject of a category in the plurality of categories corresponding to the at least one respective gating criterion.
[0064] In some embodiments, at least one respective gating criterion comprises an arrangement gating criterion associated with an order of one or more categories in the plurality of categories.
[0065] In some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder or a sub-clinically diagnosed mental disorder.
[0066] In some embodiments, the psychiatric or mental condition comprises being stressed in a social setting, being frightened in a social setting, or being overwhelmed in a social setting.
[0067] In some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder. Further, the clinically diagnosed mental disorder is an anxiety disorder, a mood disorder, a psychotic disorder, an eating disorder, an impulse control disorder, an addictive disorder, a personality disorder, an obsessive-compulsive disorder, or a post-traumatic stress disorder.
[0068] In some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder. Further, the clinically diagnosed mental disorder is an anxiety disorder. In some such embodiments, the anxiety disorder comprises separation anxiety disorder, selective mutism, specific phobia, social anxiety disorder, panic disorder, agoraphobia, generalized anxiety disorder, substance-induced anxiety disorder, or an anxiety disorder due to the subject's medical condition.
[0069] In some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder, hi some such embodiments, the clinically diagnosed mental disorder is a mood disorder, comprising a depressive disorder, a bipolar disorder, or a cyclothymic disorder.
[0070] In some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder. Further, the clinically diagnosed mental disorder is a psychotic disorder. In some such embodiments, the psychotic disorder comprises a schizophrenic disorder, a delusional disorder, or a hallucinatory disorder.
[0071] In some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder. Further, the clinically diagnosed mental disorder is an eating disorder, which includes anorexia nervosa, bulimia nervosa, or binge eating disorder.
[0072] In some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder. Further, the clinically diagnosed mental disorder is an impulse control disorder, including pyromania disorder, kleptomania disorder, or compulsive gambling disorder.
[0073] In some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder. Further, the clinically diagnosed mental disorder is an addictive disorder, which includes an alcohol use disorder or a substance abuse disorder.
[0074] In some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder. Further, the clinically diagnosed mental disorder is a personality disorder, comprising antisocial personality disorder, obsessive-compulsive personality disorder, or paranoid personality disorder.
[0075] In some embodiments, the corresponding digital reality scene is a virtual reality scene.
[0076] In some embodiments, the corresponding digital reality scene is an augmented reality scene.
[0077] In some embodiments, the corresponding digital reality scene is a mixed reality scene.
[0078] In some embodiments, a gating criterion associated with a category in the plurality of categories specifies a condition that a subject must meet before proceeding to another category in the plurality of categories.
[0079] In some embodiments, the gating criteria for each of the multiple categories is set by a system administrator, the subject, a model, a medical professional associated with the subject, or a combination thereof.
[0080] In some embodiments, the gating criteria for each of a first category in the plurality of categories is set by a system administrator or a medical professional associated with the subject, and the gating criteria for each of a second category in the plurality of categories is set by the subject.
[0081] In some embodiments, the biometric threshold for each of the suggested experiences in the plurality of suggested experiences associated with each of the categories in the plurality of categories is set by a system administrator, the subject, a medical professional associated with the subject, a model, or a combination thereof.
[0082] In some embodiments, the biometric threshold for each of the plurality of suggested experiences associated with a first category in the plurality of categories is set by a system administrator, the subject, a medical professional associated with the subject, a model, or a combination thereof.
[0083] In some embodiments, the biometric threshold for each of the suggested experiences in the plurality of suggested experiences associated with the first category is an absolute parameter, a relative parameter, a normalized parameter, or any combination thereof.
[0084] In some embodiments, the biometric threshold for each respective suggested experience in the plurality of suggested experiences associated with the first category is an eye contact threshold, a heart rate threshold, an assertiveness threshold, a decibel level threshold, a pitch threshold, a speech threshold, a word threshold, a sentiment analysis criterion, or a combination thereof, that manifests a corresponding challenge designed for the first suggested experience associated with the first category.
[0085] In some embodiments, the biometric threshold for each of the plurality of suggested experiences associated with the first category is an eye contact threshold, and further, the eye contact threshold includes a minimum length of eye contact, an increment of eye contact, or both a minimum length of eye contact and an increment of eye contact.
[0086] In some embodiments, the biometric threshold for each of the plurality of suggested experiences associated with the first category is a heart rate threshold. Further, the heart rate threshold includes a maximum heart rate, a reduced heart rate, or both a maximum heart rate and a reduced heart rate.
[0087] In some embodiments, the biometric threshold of each of the suggested experiences in the plurality of suggested experiences associated with the first category is an assertiveness threshold. Further, the assertiveness threshold includes an absolute assertiveness threshold, a relative assertiveness threshold, or both an absolute assertiveness threshold and a relative assertiveness threshold.
[0088] In some embodiments, the biometric threshold of each of the suggested experiences in the plurality of suggested experiences associated with the first category is a decibel level threshold. Further, the decibel level threshold includes a lower decibel level threshold, an upper decibel level threshold, a required decibel level increase, a required decibel level decrease, or any combination thereof.
[0089] In some embodiments, the biometric threshold for each of the plurality of suggested experiences associated with the first category is a pitch threshold. Further, the pitch threshold includes a lower pitch threshold, an upper pitch threshold, a required pitch increase, a required pitch decrease, or any combination thereof.
[0090] In some embodiments, the biometric threshold for each of the suggested experiences in the plurality of suggested experiences associated with the first category is an utterance threshold, which includes a minimum number of utterances, a maximum number of utterances, an increase in the number of utterances required, a decrease in the number of utterances required, or a combination thereof.
[0091] In some embodiments, the biometric threshold for each of the plurality of suggested experiences associated with the first category is a word threshold. Further, in some such embodiments, the word threshold includes a minimum number of words, a maximum number of words, an increase in the number of words required, a decrease in the number of words required, or a combination thereof.
[0092] In some embodiments, the respective biometric thresholds for each respective suggested experience in the plurality of suggested experiences associated with the first category are sentiment analysis criteria. In some such embodiments, the sentiment analysis criteria include an excited sentiment threshold and an over-excited sentiment threshold.
[0093] In some embodiments, the method further includes, for each statement in the list of statements deemed to be characteristic of a given sentiment, determining whether a sentiment analysis criterion is met by taking a cosine similarity or dot product of one or more utterances of the subject made during a corresponding task designed for a first proposed experience associated with the first category.
[0094] In some embodiments, the predetermined sentiment is amusement, anger, anxiety, awkwardness, boredom, calm, confusion, craving, disgust, empathic distress, ecstasy, excitement, fear, horror, interest, joy, annoyance, nostalgia, relief, sadness, satisfaction, or surprise.
[0095] In some embodiments, the plurality of categories comprises one or more exposure categories, one or more cognitive behavioral therapy (CBT) categories, one or more mindfulness categories, or a combination thereof.
[0096] In some embodiments, the first category is a mindfulness category and the second category is a CBT category. In some embodiments, the first category is an exposure category and the second category is a CBT category.
[0097] Another aspect of the present disclosure is directed to providing a non-transitory computer-readable storage medium storing one or more programs comprising instructions that, when executed by a computer system, cause the computer system to perform a method of the present disclosure.
[0098] Yet another aspect of the present disclosure is directed to providing a use of a computer system for improving a subject's ability to manage a psychiatric or mental condition exhibited by the subject. The computer system includes one or more processors, a display, and a memory coupled to the one or more processors. In some embodiments, the computer system includes an audio speaker and / or a microphone. The memory includes one or more programs configured to be executed by the one or more processors to implement the methods of the present disclosure.
[0099] Yet another aspect of the present disclosure is directed to providing a device for implementing an exposure progression. In some embodiments, the device is configured to improve a subject's ability to manage the subject's psychiatric or mental condition. Additionally, the device includes one or more processors and a memory coupled to the one or more processors. The memory includes one or more programs configured to be executed by the one or more processors. The one or more programs are configured to cause a computer system to perform the methods of the present disclosure. In some embodiments, the device includes a display and / or audio circuitry. In some embodiments, the device includes an objective lens in optical communication with a two-dimensional pixelated detector. [Brief description of the drawings]
[0100] The file of this patent contains at least one drawing of color. [Figure 1] FIG. 1 shows a block diagram illustrating an embodiment of a system for displaying a digital reality scene according to an embodiment of the present disclosure. [Figure 2A] FIG. 2A illustrates a digital reality host system for facilitating a digital reality experience according to one embodiment of the present disclosure. [Figure 2B] FIG. 2B illustrates a digital reality host system for facilitating a digital reality experience according to one embodiment of the present disclosure. [Diagram 3] FIG. 3 illustrates a client device for displaying a digital reality scene according to one embodiment of the present disclosure. [Figure 4A] 4A illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4B]4B illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4C] 4C illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4D] 4D illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4E] 4E illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4F] 4F illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4G] 4G illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4H] 4H illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4I] 4I illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4J]4J illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4K] 4K illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4L] 4L illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4M] 4M illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4N] 4N illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4O] 4O illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4P] 4P illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4Q] 4Q illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 4R]4R illustrates an exemplary method for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, according to some embodiments of the present disclosure. Optional embodiments are indicated with dashed boxes. [Figure 5A] FIG. 5A illustrates an exemplary digital reality scene for social task training according to one embodiment of the present disclosure. [Figure 5B] FIG. 5B illustrates an exemplary digital reality scene for social challenge training according to one embodiment of the present disclosure. [Figure 6A] FIG. 6A illustrates an exemplary digital reality scene for introductory or educational training according to one embodiment of the present disclosure. [Figure 6B] FIG. 6B illustrates an exemplary digital reality scene for mindfulness training according to one embodiment of the present disclosure. [Figure 6C] FIG. 6C illustrates an exemplary digital reality scene for cognitive reframing training according to one embodiment of the present disclosure. [Figure 7A] FIG. 7A illustrates an exemplary digital reality scene for illustrating an initial category hierarchy in a graph including a proposed subject's experience progression, according to one embodiment of the present disclosure. [Figure 7B] FIG. 7B illustrates an exemplary digital reality scene for presenting a recommended category hierarchy and allowing a user to personalize the category hierarchy according to one embodiment of the present disclosure. [Figure 8A] FIG. 8A illustrates a user interface for obtaining a subject's assessment or subjective evaluation on a client device according to one embodiment of the present disclosure. [Figure 8B] FIG. 8B illustrates a user interface for obtaining a subject's assessment or subjective evaluation on a client device according to one embodiment of the present disclosure. [Figure 8C] FIG. 8C illustrates a user interface for obtaining a subject's assessment or subjective evaluation on a client device according to one embodiment of the present disclosure. [Figure 8D] FIG. 8D illustrates a user interface for obtaining a subject's assessment or subjective evaluation on a client device according to one embodiment of the present disclosure. [Figure 9A] FIG. 9A illustrates another exemplary digital reality scene for cognitive reframing training according to one embodiment of the present disclosure. [Figure 9B] FIG. 9B illustrates yet another exemplary digital reality scene for cognitive reframing training according to one embodiment of the present disclosure. [Figure 9C] FIG. 9C illustrates yet another exemplary digital reality scene for cognitive reframing training according to one embodiment of the present disclosure. [Figure 10A] FIG. 10A illustrates an exemplary therapy according to some embodiments of the present disclosure. [Figure 10B] FIG. 10B illustrates another exemplary therapy according to some embodiments of the present disclosure. [Figure 10C] FIG. 10C illustrates another exemplary therapy according to some embodiments of the present disclosure. [Figure 11A] FIG. 11A illustrates an exemplary user interface of a DR scene or client application configured to show a subject's progress within an interactive DR activity, according to some embodiments of the present disclosure. [Figure 11B] FIG. 11B illustrates an exemplary user interface of a DR scene or client application configured to show a subject's progress within an interactive DR activity, according to some embodiments of the present disclosure. [Figure 12A] FIG. 12A illustrates another exemplary therapy according to some embodiments of the present disclosure. [Figure 12B] FIG. 12B illustrates another exemplary therapy according to some embodiments of the present disclosure. [Figure 13] FIG. 13 illustrates another client device for displaying a digital reality scene according to one embodiment of the present disclosure. [Figure 14] FIG. 14 illustrates various logic functions that may be used and implemented in some embodiments of the present disclosure. It should be understood that the accompanying drawings are not necessarily to scale and depict somewhat simplified representations of various features illustrating the underlying principles of the present invention. The specific design features of the invention disclosed herein, including, for example, specific dimensions, orientations, locations, and shapes, are determined in part by the specific intended application and environment of use. In the drawings, reference numerals refer to the same or equivalent parts of the invention throughout the several views of the drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0101] The present disclosure provides systems and methods for improving a subject's ability to manage a psychiatric or mental condition by implementing a personalized exposure progression for the subject. In some embodiments, the personalized exposure progression, known as exposure therapy or therapy, is configured specifically for the subject such that the exposure progression is targeted in a personalized manner to the subject. Furthermore, in some embodiments, the personalized exposure progression is dynamically configured such that the exposure progression flexibly changes with the subject as the subject interacts with the systems and methods of the present disclosure. Thus, in some such embodiments, by combining at least exposure to a digital reality, biometric data captured during exposure to a digital reality, the subject's historical achievements, or a combination thereof, the systems, methods, and devices of the present disclosure create a personalized exposure progression that is tailored to the subject. Furthermore, in some such embodiments, the personalized exposure progression is dynamically updated based on the timing and / or nature of the exposure experienced by the subject. This allows for subject-specific and condition-specific tailoring of the subject's personalized exposure progression.
[0102] In some embodiments, the personalized exposure progression is dynamically created or modified based, at least in part, on the subject's initial assessment, biometric data captured as the subject completes one or more social tasks while exposed to a particular digital reality, the level of success the subject has in one or more tasks (e.g., exposure tasks, social tasks, CBT tasks, mindfulness tasks, etc.), the subject's subjective evaluation and / or subjective evaluation after completing one or more digital tasks, evaluation or confirmation by a medical professional (e.g., health care professional) associated with the subject, evaluation or confirmation by a computational model, or combinations thereof. By implementing a personalized exposure progression at least in part through a digital reality, the systems, methods, and devices of the present disclosure improve the likelihood of higher emotional and physiological arousal, engagement, better clinical outcomes for the subject, or combinations thereof, and improve the subject's ability to manage a psychiatric or mental condition.
[0103] Thus, the personalized exposure progression provided by the disclosed systems, methods, and devices is designed to address the psychiatric or mental condition exhibited by the subject by improving the subject's ability to manage the psychiatric or mental condition. In some such embodiments, the subject's ability to manage the psychiatric or mental condition is achieved by educating the subject (e.g., about one or more coping exercises with mindfulness tasks and / or CBT tasks, about the frequency of occurrence of events associated with the psychiatric or mental condition, about therapeutic practices that best fit the subject and / or the psychiatric or mental condition, about the thought patterns exhibited by the subject, etc.), engaging with the subject (e.g., within a digital reality scene), treating the subject (e.g., by administering to the subject and / or by deeming the subject to have completed the personalized exposure progression), or a combination thereof. By way of example, in some embodiments, the systems, methods, and devices of the present disclosure are designed to address stressful and / or overwhelmed feelings associated with social situations, such as excessive worry, excessive anxiety, avoidance of feared situations, etc. As another non-limiting example, in some embodiments, the systems, methods, and devices of the present disclosure are designed to address mental or psychiatric conditions exhibited by a subject, such as excessive worry, excessive anxiety, worry about everyday events associated with common anxiety disorders, such as difficulty concentrating, etc. As yet another non-limiting example, in some embodiments, the systems, methods, and devices of the present disclosure are designed to address persistent sadness, anxiety, emptiness, or combinations thereof associated with major depressive disorder.As yet another non-limiting example, in some embodiments, the disclosed systems, methods, and devices are designed to address dysphoria, anhedonia, apathy, irritability, anger, abolition, lack of motivation, sleep dysregulation, low energy, fatigue, behavioral disorders, and / or disruptions, agitation, restlessness, or combinations thereof that are detrimental to daily functioning. Thus, the disclosed systems, methods, and devices address psychiatric or mental conditions by including interactions with others, such as other users or non-player characters (e.g., via digital reality scenes) in various scenarios such as social interactions, work, school, etc., while addressing both performance-based and / or interaction-based challenges (e.g., social challenges, focus challenges, etc.). In some embodiments, the systems, methods, and devices of the present disclosure address psychiatric or mental conditions by providing educational or therapeutic challenges using digital reality scenes such as cognitive reframing training, cognitive reframing challenges, mindfulness training, mindfulness challenges, and alternative / additional exposure exercises. However, the present disclosure is not limited thereto. Thus, in various embodiments, the systems, methods, and devices of the present disclosure allow the subject to select a social challenge that they wish to undertake based at least in part on the subject's initial assessment, biometric data captured while the subject is completing one or more social challenges, the level of success the subject has in one or more social challenges, the subject's subjective evaluation and / or subjective evaluation after completing such social challenges, the evaluation or confirmation of a medical professional associated with the subject, or a combination thereof. In some embodiments, a physician (e.g., clinician) is associated with the subject and is involved in implementing the personalized exposure program. In some embodiments, the physician overrides the subject's selected personalized exposure program or modifies the personalized exposure program.
[0104] The systems, methods, and devices of the present disclosure allow subjects to revisit tasks they have already completed for repeated exposure.
[0105] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. However, it will be apparent to those skilled in the art that the present disclosure may be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
[0106] It can also be understood that terms such as first, second, etc. may be used herein to describe various elements, but these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first digital chart can be referred to as a second digital chart, and similarly, a second digital chart can be referred to as a first digital chart, without departing from the scope of the present disclosure. The first digital chart and the second digital chart are both digital charts, but are not the same digital chart.
[0107] The terms used in this disclosure are for the purpose of describing particular embodiments only and are not intended to be limiting of the invention. When used in the description of the invention and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms unless the context clearly indicates otherwise. It will also be understood that the term "and / or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms "comprises" and / or "comprising" as used herein specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0108] The description herein includes exemplary systems, methods, techniques, instruction sequences, and computing machine program products embodying exemplary implementations. For purposes of explanation, numerous specific details are set forth to provide an understanding of various embodiments of the inventive subject matter. However, it will be apparent to those skilled in the art that implementations of the inventive subject matter may be practiced without these specific details. In general, well-known instruction instances, protocols, structures, and techniques are not shown in detail.
[0109] The description herein is described with reference to specific implementations for purposes of illustration. However, the illustrative description is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. Many modifications and variations are possible in light of the teachings disclosed. The implementations have been chosen and described to best explain the principles and their practical applications, so as to enable others skilled in the art to best utilize the implementations and the various implementations with various modifications suited to the particular applications contemplated.
[0110] For clarity, not all of the routine features of the implementations described herein are shown and described. In the development of any such actual implementation, it can be understood that numerous implementation-specific decisions are made to achieve the designer's particular goals, such as adherence to use cases and business-related constraints, and that these particular goals will vary from implementation to implementation and from designer to designer. Moreover, it can be understood that such design efforts may be complex and time-consuming, but are nevertheless a routine undertaking of engineering for those of ordinary skill in the art having the benefit of this disclosure.
[0111] As used herein, the term "if" may be interpreted to mean "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "when determined" or "when [a described condition or event] is detected" may be interpreted to mean "when determining" or "in response to determining" or "when [a described condition or event] is detected" or "in response to detecting [a described condition or event]," depending on the context.
[0112] As used herein, the term "about" or "approximately" can mean within an acceptable error range for a particular value as determined by one of ordinary skill in the art, which may depend in part on how the value is measured or determined, e.g., the limitations of the measurement system. For example, "about" may mean within or more than one standard deviation, as is customary in the art. "About" may mean within ±20%, ±10%, ±5%, or ±1% of a given value. When a particular value is described in this application and claims, unless otherwise indicated, the term "about" means within an acceptable error range for the particular value. The term "about" may have the meaning commonly understood by one of ordinary skill in the art. The term "about" may refer to ±10%. The term "about" may refer to ±5%.
[0113] As used herein, unless otherwise specified, the term "equally spaced" means that the distance from a first feature to a corresponding second feature is the same for consecutive pairs of features.
[0114] As used herein, the term "dynamically" refers to the ability to update a program while it is currently executing.
[0115] Furthermore, the terms "client," "patient," "subject," and "user" are used interchangeably herein, unless otherwise noted.
[0116] Additionally, the terms "avatar" and "player character" are used interchangeably herein unless otherwise specified.
[0117] Furthermore, the terms "therapy" and "treatment" are used interchangeably herein, unless otherwise specified.
[0118] Further, as used herein, the term "parameter" refers to any coefficient or any similar value of an internal or external element (e.g., weights and / or hyperparameters) of an algorithm, model, regressor, and / or classifier that can affect (e.g., change, tailor, and / or tune) one or more inputs, outputs, and / or functions in the algorithm, model, regressor, and / or classifier. For example, in some embodiments, a parameter refers to any coefficient, weight, and / or hyperparameter that can be used to control, change, adapt, and / or tune the behavior, learning, and / or performance of an algorithm, model, regressor, and / or classifier. In some cases, a parameter is used to increase or decrease the influence of an input (e.g., feature) to an algorithm, model, regressor, and / or classifier. As a non-limiting example, in some embodiments, a parameter is used to increase or decrease the influence of a node (e.g., of a neural network), where the node includes one or more activation functions. The assignment of parameters to specific inputs, outputs, and / or functions is not limited to any one paradigm for a given algorithm, model, regressor, and / or classifier, but can be used in any suitable algorithm, model, regressor, and / or classifier architecture for desired performance. In some embodiments, the parameters have fixed values. In some embodiments, the values of the parameters are manually and / or automatically adjustable. In some embodiments, the values of the parameters are changed by a validation and / or training process of the algorithm, model, regressor, and / or classifier (e.g., by error minimization and / or backpropagation). In some embodiments, the algorithms, models, regressors, and / or classifiers of the present disclosure include multiple parameters.In some embodiments, the plurality of parameters is n parameters, where n>2, n>5, n>10, n>25, n>40, n>50, n>75, n>100, n>125, n>150, n>200, n>225, n>250, n>350, n>500, n>600, n>750, n>1,000, n>2,000, n>4,000, n>5,000, n>7,500, n>10,000, n>20,000, n>40,000, n>75,000, n>100,000, n>200,000, n>500,000, n>1x10. 6 , n ≥ 5 × 10 6 , or n ≥ 1 × 10 7 In some embodiments, n is between 10,000 and 1×10 7 Numbers between 100,000 and 5×10 6 or between 500,000 and 1×10 6 It is a number between.
[0119] Additionally, when a reference number is given the notation "i-th," the reference number refers to a general component, set, or embodiment. For example, a digital reality scene referred to as "digital reality scene i" refers to the i-th digital reality scene of the plurality of digital reality scenes (e.g., digital reality scene 40-i within the plurality of digital reality scenes 40). In this disclosure, unless otherwise indicated, descriptions of devices and systems include one or more computer implementations.
[0120] FIG. 1 illustrates a block diagram of a distributed client-server system (e.g., distributed client-server system 100) according to some embodiments of the present disclosure. System 100 facilitates the preparation of a therapy to improve a subject's ability to manage a psychiatric or mental condition, such as a clinically diagnosed mental disorder, a subclinically diagnosed medical disorder, an undiagnosed condition (a condition not diagnosed for the subject by a medical professional), or a combination thereof. In some embodiments, system 100 facilitates the preparation of a regime to improve the subject's general wellness, such as maintaining and / or promoting the subject's general health or healthy activities. In some embodiments, the regime improves the subject's general wellness by linking the role of the subject's healthy lifestyle with helping to reduce the risk or impact of certain mental and / or psychiatric conditions. However, the present disclosure is not limited thereto. System 100 generally includes a digital reality system (e.g., digital reality system 200) and one or more client devices 300 (e.g., a first client device 300-1, a second client device 300-2, ..., an Rth client device 300-R, etc.) that communicate with the digital reality system via a communications network (e.g., communications network 106). In some embodiments, each client device is associated with at least one subject (e.g., a test subject).
[0121] The system 100 also includes a plurality of sensors, e.g., sensor 110-1, sensor 110-2, ..., sensor 110-S of FIG. 5. The plurality of sensors includes at least one biometric sensor (e.g., sensor 110-1 and / or sensor 110-2 that is or includes a biometric sensor) configured to capture biometric data of the subject. In some embodiments, one or more sensors in the plurality of sensors are incorporated into the client device 300 or are components of the client device. In some embodiments, the one or more sensors communicate with the one or more client devices (e.g., via an ANT+ or Bluetooth or network interface of the client device). For example, in some embodiments, data captured by the one or more sensors is transmitted and / or aggregated to the one or more client devices. In some embodiments, the one or more sensors are in communication with a remote system, e.g., connected to the digital reality system 200 via the communication network 106, and data captured by the one or more sensors is transmitted to the remote system, which collects, stores, and / or processes the captured biometric data.
[0122] In some embodiments, the system 100 facilitates the delivery of therapy to a population of subjects, at least one of which exhibits a psychiatric or mental condition. In some embodiments, the therapy is prepared in a digital reality system and provided to the subjects via a graphical user interface (GUI) displayed on each client device 300. In some embodiments, a physician (e.g., clinician) associated with the subject prepares the therapy on a client device (e.g., client device 300-1) and the subject performs the therapy on another client device (e.g., client device 300-2). In some embodiments, the computational model prepares the therapy in a digital reality system and the subject performs the therapy on a client device (e.g., client device 300-1). However, the disclosure is not limited thereto.
[0123] Examples of communication network 106 include the World Wide Web (WWW), intranets and / or cellular telephone networks, wireless networks such as wireless local area networks (LANs) and / or metropolitan area networks (MANs), and other devices via wireless communication. The wireless communication may selectively be any of the following: Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Evolution Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPADA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n, ... 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for email (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communications protocol, including communications protocols not yet developed as of the filing date of this document.
[0124] In some embodiments, communications network 106 optionally includes the Internet, one or more local area networks (LANs), one or more wide area networks (WANs), other types of networks, or a combination of such networks.
[0125] It should be noted that the exemplary topology shown in FIG. 1 is merely useful for illustrating features of one embodiment of the present disclosure, as will be readily understood by those skilled in the art. Other topologies of the system 100 are possible. For example, in some embodiments, any of the illustrated devices and systems may actually constitute several computer systems linked together in a network, or may be one or more virtual machines and / or containers of a cloud computing environment. Furthermore, rather than relying on a physical communication network 106, the illustrated devices and systems may wirelessly transmit information to each other.
[0126] 2A and 2B illustrate an exemplary digital reality system 200 for preparing a therapy to improve a subject's ability to manage a psychiatric or mental condition exhibited by the subject. In various embodiments, the digital reality system 200 includes one or more processing units (CPUs) 202, a network or other communication interface 204, and a memory 212.
[0127] The memory 212 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices, and optionally also includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 212 may optionally include one or more storage devices located remotely from the CPU 202. The memory 212, or the non-volatile memory devices in the memory 212, include non-transitory computer-readable storage media. Access to the memory 212 by other components of the digital reality system 200, such as the CPU 202, is optionally controlled by a controller. In some embodiments, the memory 212 may include mass storage located remotely relative to the CPU 202. In other words, some data stored in the memory 212 may actually be hosted on devices that are external to the digital reality system 200, but can be electronically accessed by the digital reality system 200 via the Internet, intranet, or other forms of network 106 or electronic cables using the communication interface 204.
[0128] In some embodiments, the memory 212 of the digital reality system 200 for preparing therapy to improve a subject's ability to manage a psychiatric or mental condition exhibited by the subject stores the following: An operating system 8 (e.g., an embedded operating system such as ANDROID, iOS, DARWIN, RTXC, LINUX, UNIX, OSX, WINDOWS, or VxWorks) containing procedures for handling various basic system services. An electronic address 10 associated with the digital reality system 200 that identifies the digital reality system 200, such as within a distributed computer system. · an optional assessment module 12 for obtaining an assessment of a subject providing identification of multiple proposed experiences through the assessment; A user profile store 14 for holding information associated with a population of users (e.g., users of client devices 300 of FIG. 1). The user profile store 14 includes a user profile 16 for each user in the population of users. The user profile 16 includes a corresponding well-being store 18 and a therapy store 20 associated with the subject of the user profile 16. An experience store 22 that includes a number of experiences (e.g., a first experience 24-1, a second experience 24-2, ..., experience 24-I in FIG. 2B). Each experience 24 includes a corresponding challenge 26. · A gate store 30 that includes a number of gating criteria (eg, a first gating criteria 32-1, a second gating criteria 32-2, ..., gating criteria G 32-G in FIG. 2B). Each gating criteria 32 represents a condition for user engagement. · An application server module 34 that facilitates providing a plurality of digital reality scenes 40 to a population of client devices 300. The application server module 34 includes a login module 36 for accessing the digital reality scenes 40 and a digital reality session engine 38 that facilitates providing a plurality of digital reality scenes (e.g., a first digital reality scene 40-1, a second digital reality scene 40-2, ..., digital reality scene H 40-H of FIG. 2B) to a population of users (e.g., client devices 300). an application model library 50 holding one or more models for providing an evaluation of characteristics of each input, such as providing a first evaluation of whether completion of the corresponding challenge 26 satisfies one or more corresponding gating criteria 32;
[0129] In some embodiments, the electronic address 10 is associated with the digital reality system 200. The electronic address 10 is utilized to at least uniquely identify the digital reality system 200 from other devices and components of the distributed system 100 (e.g., to uniquely identify the digital reality system 200 from the client device 300-1, the client device 300-2, ..., or the client device 300-R of FIG. 1). For example, in some embodiments, the electronic address 10 is utilized to receive requests from the client devices to join the respective digital reality scene via the login module 36 of the application server module 34. As another non-limiting example, in some embodiments, the electronic address 10 is utilized to receive a plurality of data elements, including a set of biometric data elements, that are acquired when presenting the digital reality scene to a user at the remote client device 300. However, the present disclosure is not limited thereto.
[0130] In some embodiments, the assessment module 12 facilitates obtaining assessments from subjects, such as users of respective client devices or physicians associated with the users. In some embodiments, the assessment module 12 includes one or more assessments that are communicated (e.g., via the communication network 106 of FIG. 1) to respective client devices. For example, in some embodiments, the assessment module 12 stores a standardized assessment to be provided to each subject. The standardized assessment provides a uniform assessment to each subject. In some embodiments, by utilizing the standardized assessment, the assessments obtained from multiple users are normalized to optimize discrimination of multiple proposed experiences (e.g., from experiences 24 of experience store 22 of FIG. 2B) between different users. However, the present disclosure is not limited in this respect.
[0131] In some aspects, the assessment includes a plurality of prompts answered by the subject. In some embodiments, an identification of a plurality of suggested experiences is obtained for the subject through responses to the plurality of prompts provided by the subject. For example, an assessment for a psychiatric or medical condition of social anxiety includes questioning a user of a client device, e.g., client device 300-1, and providing a plurality of predefined answers (e.g., none, mild, moderate, or severe). In some embodiments, a user selection of a first answer from the predefined answers forms the basis for the identification of a plurality of suggested experiences 24.
[0132] In some embodiments, the assessment module 12 includes one or more authorization criteria associated with approving an assessment obtained from a subject. For example, in some embodiments, an assessment is provided to a first subject at a first client device 300-1, the first subject exhibiting a psychiatric or mental condition. In some such embodiments, obtaining the assessment from the first subject is conditioned on meeting a first authorization criterion. In some embodiments, this first authorization criterion is associated with the first subject obtaining authorization for the assessment from a physician associated with the subject. By way of example, in some embodiments, the first authorization criterion requires the physician and / or the computational model to verify certain aspects of the assessment, such as the veracity of the assessment, the accuracy of the assessment, the precision of the assessment, the consistency of the assessment, the eligibility of the assessment, the appropriateness of the assessment, the pass / fail of the assessment, the global rating scale of the assessment, or a combination thereof. In some embodiments, by adding levels of authorization, such as human authorization and / or computational model authorization, the digital reality system 200 ensures that a subject exhibiting a psychiatric or mental condition can improve their ability to manage their psychiatric or mental condition when utilizing the systems, methods, and devices of the present disclosure, for example, by ensuring that the subject is providing reliable answers to the assessment. Thus, in some such embodiments, the assessment module 12 prevents the subject from distorting the assessment to generate a therapy that may not improve the subject's ability to manage the psychiatric or mental condition.
[0133] In some embodiments, the user profile store 14 maintains a plurality of user profiles 16. Each respective user profile 16 is associated with a corresponding user of the digital reality system 200, such as a user of the client device exhibiting a psychiatric or mental condition and / or a physician associated with the user. For example, in some embodiments, each user initially customizes a profile (e.g., a first user profile 16-1) at the client device by selecting a plurality of user login information, such as a password, an address (e.g., email address, physical address, etc.), a personal name (e.g., given name, user name, etc.). In some embodiments, each user provides or is collected by the client device 300 (e.g., using any GPS) one or more demographic characteristics (e.g., user age, user weight, user height, user gender, etc.) and / or one or more geographic characteristics (e.g., area associated with the user, physical address associated with the user, etc.). However, the disclosure is not limited in this respect. In some embodiments, the user profile uniquely identifies each user in the digital reality scene 40. In this manner, each user profile 16 allows the digital reality system 200 to maintain login information, privacy information (e.g., which psychiatric or mental conditions are exhibited by the corresponding subject associated with each user profile 16), and other preferences and / or biographical data. In some embodiments, the login name associated with each user is the same as the username displayed to the user. In other embodiments, the login name associated with each user is different from the username displayed to the user (e.g., the username displayed in the digital reality scene 40 is different from the associated user login). In some embodiments, the user profile 16 includes some or all of the corresponding medical records of the subject associated with the user profile 16.In some embodiments, the digital reality system 200 stores multiple avatar information including multiple traits of each avatar user and / or a contact list of contacts within the digital reality scene 40. Thus, the systems, methods, and devices of the present disclosure enable personalizing the digital reality scene based on information associated with the user using a user profile 16. By way of example, in some embodiments, the subject provides the subject's age, and depending on the subject's age, the appearance and / or intensity level (e.g., difficulty) of non-player characters associated with the digital reality scene are altered based on the subject's age.
[0134] Additionally, in some embodiments, each user profile 16 includes a well-being store (e.g., a first user profile 16-1 includes a first well-being store 18-1, a second user profile 16-2 includes a second well-being store 18-2, ..., user profile A 16-A includes a well-being store B 18-B, etc.). In some embodiments, the well-being store 18 holds a number of health information associated with the subject, such as an indication of a clinical diagnosis of a psychiatric or mental condition, a number of insurance information associated with the corresponding subject's insurance provider, electronic medical records, etc. In some embodiments, the well-being store 18 includes the status of treatments administered to the subject, such as the results of previous treatments for the psychiatric or mental condition, the results of previous therapies 20 provided to the subject, etc.
[0135] In some embodiments, the well-being store 18 includes a plurality of biometric data elements associated with each user. For example, in some embodiments, a set of biometric data elements is obtained when presenting a digital reality scene to a client device, and a plurality of biometric data elements from the set of biometric data elements (e.g., a first set of biometric data elements) are retained by the well-being store 18. As a non-limiting example, in some embodiments, the plurality of biometric data elements retained by the well-being store 18 includes a subject's heart rate (e.g., a baseline heart rate, one or more heart rate zones of the subject, etc.). In some embodiments, the plurality of biometric data elements retained by the well-being store 18 includes a subject's blood pressure (e.g., a baseline systolic blood pressure, a threshold diastolic blood pressure, etc.). Furthermore, in some embodiments, the plurality of biometric data elements includes a plurality of spatio-temporal data elements that describe the spatial and temporal aspects of the user when engaging with the digital reality scene. Non-limiting examples of the plurality of spatio-temporal data elements include an area of a portion of the user's eye, a change in the position of the subject's eye when engaging with a corresponding challenge 26, a number of times the user's eye is in a predetermined reference position, etc. In some embodiments, the plurality of biometric data elements maintained by well-being store 18 includes one or more vocal biometric data elements, such as vocal features associated with usage. As another non-limiting example, in some embodiments, the plurality of biometric data elements maintained by well-being store 18 includes temporal vocal features (e.g., root mean square (RMS) energy of a vocal feature), spectral vocal features (e.g., spectrogram centroid of a vocal feature, spectrogram roll-off, etc.), cepstral vocal features (e.g., Mel-Frequency Cepstral Coefficients (MFCCs)), entropy of a vocal feature (e.g., spectral entropy, probability density function entropy, etc.), or combinations thereof.
[0136] In some embodiments, the well-being store 18 includes one or more annotations. In some embodiments, each annotation is associated with a corresponding subject participating in the digital reality scene 40 and / or one or more assessments obtained from the subject. For example, in some embodiments, the one or more assessments obtained from the subject stored in the well-being store 18 include a first assessment to obtain an identification of a plurality of proposed experiences and / or a second assessment based on the proposed experiences 24 performed by a user. In some embodiments, the one or more annotations include a first annotation provided by a physician that is associated with the subject if the subject performs the proposed experience. In some embodiments, the one or more annotations include a second annotation provided by the subject. In some embodiments, the one or more annotations include a third annotation provided by a computational model associated with the digital reality system 200.
[0137] In some embodiments, each user profile includes a therapy store that holds information associated with the corresponding subject (e.g., a first user profile 16-1 includes a first therapy store 20-1, a second user profile 16-2 includes a second therapy store 20-2, ..., user profile A 16-A includes a therapy store C 20-C, etc.). By way of example, in some embodiments, the information held by a therapy store of a user profile includes a plurality of sessions of the corresponding user engaged with a digital reality system. In some embodiments, the plurality of sessions include exposure sessions in which the subject engages in exposure tasks, cognitive behavioral therapy sessions in which the subject engages in cognitive behavioral therapy tasks, mindfulness-based cognitive therapy sessions in which the subject engages in mindfulness tasks, or combinations thereof. Thus, the user profile enables the systems, methods, and devices of the present disclosure to track various parameters associated with improving a subject's ability to manage a psychiatric or mental condition. In some embodiments, various parameters associated with improving the subject's ability to manage a psychiatric or mental condition are maintained by the therapy store 20 and include, but are not limited to, the state of each exposure progression associated with the subject, the state of each interactive digital chart representing each exposure progression associated with the subject, the availability of each exposure category or experience within each exposure progression associated with the subject, the availability of other exposure categories or experiences for placement in each exposure progression, a determination of whether one or more gating criteria 32 have been met, the position of an avatar associated with the subject in the digital reality scene 40, or any combination thereof.
[0138] In some embodiments, by maintaining a well-being store 18 and a therapy store 20 in each user profile 16, the digital reality system 200 allows each subject associated with a user profile to engage with the digital reality system 200 when and where the subject wishes, without losing progress in improving their ability to manage a psychiatric or mental condition (e.g., progress through the therapies of the present disclosure).
[0139] In some embodiments, experience store 22 includes a plurality of experiences 24 (e.g., a first experience 24-1, a second experience 24-2, ..., experience 24-D of FIG. 2B). Each experience 24 includes a digital reality task in the form of a challenge (e.g., a first challenge 26-1, a second challenge 26-2, ..., challenge E26-2 of FIG. 2B, etc.) designed to improve the subject's ability to manage a psychiatric or mental condition. For example, in some embodiments, each experience 24 is a challenge 26 that challenges the subject to perform a digital reality task within a digital reality scene 40.
[0140] In some embodiments, the experiences 24 are grouped into categories, with each such category including one or more experiences that challenge the subject to perform the same or similar task. For example, in some embodiments, a first category includes one or more experiences 24 that target a general performance task for the subject, such as challenging the subject to give a presentation to an audience in a digital reality scene 40 or to tell a story to a group in a digital reality scene 40.
[0141] In some embodiments, the second category includes one or more experiences 24 that are designed to engage the subject in active practice, such as challenging the subject to walk to an individual in the digital reality scene 40 or to remind an individual in the digital reality scene 40 of a task assigned to the subject. In some embodiments, the second category includes one or more experiences 24 that are designed to engage the subject in interaction with a person, such as challenging the subject to look someone in the eye in the digital reality scene 40. However, the disclosure is not limited thereto.
[0142] Further, in some embodiments, the third category includes one or more experiences 24 that are targeted to CBT tasks. For example, in some embodiments, the third category includes one or more experiences 24 designed to have the user self-identify harmful or negative evidence for thoughts spoken by the user, evaluate whether the self-identified evidence is sufficient to restructure the thoughts, and restructure the thoughts, for example, by modulating the expectation of harm and / or the perception of control over the subject, or a combination thereof, to improve the psychiatric or mental condition of the subject. In some embodiments, the third category includes one or more experiences 24 designed to identify negative thoughts or statements provided by the subject, and / or disrupt native cognitive patterns associated with the formation of negative thoughts or statements by the subject with new cognitive patterns associated with the formation of adaptive or adaptive thoughts or statements.
[0143] Further, in some embodiments, the fourth category includes one or more experiences directed to mindfulness challenges.
[0144] In some embodiments, the experience is directed to challenging the subject to perform a single task, such as, for example, a first task of making a presentation, a second task of being proactive, a third task of collecting evidence, a fourth task of cognitive reframing, a fifth task of cognitive diffusion, a sixth task of setting goals, and a seventh task of completing a mindfulness task. Thus, in some such embodiments, such an experience is associated with a single category. However, the present disclosure is not limited thereto. In some embodiments, the experience is directed to challenging the subject to perform multiple tasks, such as making an active presentation. Thus, in some embodiments, such an experience is associated with multiple categories (e.g., two categories, three categories, four categories, five categories, etc.).
[0145] In some embodiments, each respective task 26 is associated with a particular setting, such as a particular digital reality scene 40. For example, consider a first experience 24-1 to be a first task 26-1 (e.g., an exposure task) that tasks the subject with approaching a person in a first digital reality scene 40-1 depicting a crowded public setting, and a second experience 24-2 to be a second task 26-2 (e.g., another exposure task) that tasks the subject with approaching a person in a second digital reality scene 40-2 depicting a quiet private setting. Thus, both the first experience 24-1 and the second experience 24-2 are associated with an exposure task of being proactive, but achieve the goal of improving the subject's ability to manage a psychiatric or mental condition at different granularities. Thus, in some embodiments, the corresponding experience 24 provides a broad categorization of content in a digital reality scene designed to improve a subject's ability to manage a psychiatric or mental condition, and the challenge is to provide a granular implementation of the corresponding experience.
[0146] Further, in some embodiments, each experience 24 in the experience store 22 is provided by the digital reality system 200 without being associated with a respective digital reality scene 40. This allows the digital reality system 200 to design and configure each digital reality scene based on the experience 24.
[0147] Further, in some embodiments, the reference store 30 facilitates maintaining multiple criteria. In some embodiments, a criterion in the multiple criteria is used to determine whether a task associated with an experience is successfully completed by the subject, to identify a subsequent task for the subject to complete, to determine whether a category is successfully completed by the subject, to identify a subsequent category for the subject to complete, or any combination thereof. For example, in some embodiments, the reference store 30 includes multiple gating criteria (e.g., gating criteria 32-1, gating criteria 32-2, ...). In some embodiments, the gating criteria set conditions for determining whether a category is successfully completed and / or for identifying one or more subsequent categories for the subject to complete. In some embodiments, the gating criteria set conditions precedent to performing a category or conditions that must be achieved for a category to be considered completed. In some embodiments, the reference store 30 also includes multiple biometric thresholds (e.g., biometric thresholds 33-1, ...). In some embodiments, the gating criteria include a biometric threshold that sets conditions for determining whether a task associated with the experience has been successfully completed and / or for identifying subsequent tasks for the subject to complete. In some embodiments, the biometric threshold sets a prerequisite for the gating criteria for performing a task associated with the experience or sets a condition that must be achieved to consider a task associated with the experience completed.
[0148] It should be noted that while FIG. 2B illustrates the gating criteria and biometric thresholds separately, the gating criteria and biometric thresholds can be arranged in the reference store in other ways. For example, in some embodiments, a category is associated with a gating criteria that includes one or more biometric thresholds for determining whether a challenge(s) of one or more experiences associated with the category is successfully completed. In such embodiments, the reference store may or may not include separate biometric thresholds. Furthermore, it should be noted that while FIG. 2B illustrates only the gating criteria and biometric thresholds, the reference store can include other criteria. For example, in some embodiments, the reference store includes at least one criterion for immediate termination of a social challenge. Furthermore, the gating criteria, biometric thresholds, or any other type of criteria can be standard criteria that are applicable to multiple subjects, or personalized criteria that are specifically designed for a single subject. In one embodiment, the reference store includes at least one standard criterion. In another embodiment, the reference store includes at least one personalized criterion. In yet another embodiment, the reference store includes both standard and personalized criteria.
[0149] Additionally, in some embodiments, the digital reality system 200 includes an application server module 34 that facilitates providing users of the client devices 300 with access to the digital reality scene 40. In some embodiments, the application server module 34 transmits data elements associated with the digital reality scene 40 to each respective client device 300 upon a request for such data elements by the respective client device 300, such as when the user logs into a client application 320 at the client device 300 or in response to a determination by the computer system 200. For example, the login module 36 of the application server 34 may match information provided by a user of the client device 300 against information stored in the user profile 16 to ensure that the correct user is requesting access to the digital reality scene 40. Thus, a population of users may use the client devices 300 to access the application server module 34 of the digital reality system 200 and interact with the digital reality scene 40 hosted by the digital reality system 200.
[0150] In some embodiments, the application server module 34 also facilitates enabling a user of the client device 300 to configure the digital reality scene 40 in accordance with a determination that the user is a physician. For example, in some embodiments, the user interface of the client device enables the user to configure one or more aspects of the digital reality scene, such as a number of non-player characters (NPCs) associated with one or more challenges, such as a first social challenge 26-1 and a second social challenge 26-2. Examples of NPCs include other avatars associated with the digital reality scene 40 with which the subject may interact (e.g., a coffee shop barista, a party guest, a co-worker, a transportation official, a menu narrator, a computer-implemented communication agent, etc.). However, the present disclosure is not limited thereto.
[0151] In some embodiments, each respective digital reality scene 40 defines a digital domain for use by a population of users. A digital reality scene broadly refers to any space (e.g., digital space and / or real-world space) in which digital reality content (e.g., avatars, digital reality objects, etc.) is presented to users, e.g., via a display of a client device. For example, in some embodiments, a digital reality scene 40 includes an avatar creation client application, a video game, a social networking website or forum, a messaging client application, or any other application in which a user desires a digital representation.
[0152] In some embodiments, the digital reality scene 40 is configured to expose the subject to a therapy for improving the subject's psychiatric or mental condition. For example, in some aspects, the therapy for improving the subject's psychiatric or mental condition is cognitive therapy (a therapy provided by completing experiences associated with a CBT task) and / or exposure therapy (e.g., a therapy provided by completing experiences associated with an exposure task). As a non-limiting example, in some such embodiments, the cognitive therapy is cognitive behavioral therapy (CBT) or mindfulness-based cognitive therapy (MBCT). Thus, in some embodiments, the digital reality scene is configured to expose the subject to cognitive reframing training, cognitive reframing sessions, mindfulness training, mindfulness sessions, exposure therapy (e.g., a digital reality scene for illustrating a task), and / or other educational or therapeutic sessions. Further details and information regarding exposing subjects to cognitive therapy can be found in Segal et al., 2018, "Mindfulness-based Cognitive Therapy for Depression," Guilford Publications, print; Hayes et al., 2018, "Process-based CBT: The Science and Core Clinical Competencies of Cognitive Behavior Therapy," New Harbinger Publications, print, each of which is incorporated herein by reference in its entirety for all purposes.
[0153] Specifically, each digital reality scene 40 includes a plurality of objects (e.g., a first object 42-1, a second object 42-2, ..., an object J42-J in digital reality scene H40-H of FIG. 2B) that populate the respective digital reality scene 40. In some embodiments, the plurality of objects 42 includes a plurality of player character objects 42 (e.g., avatars) that represent and / or are controlled by the user, a plurality of NPC objects 42 that represent NPCs in the respective digital reality scene that are not directly controllable by the user, and a plurality of scene objects 42 (e.g., objects that are not player character objects 42 or NPC objects 42, such as bodies of water in the digital reality scene 40, buildings, and furniture in the digital reality scene 40). As used herein, a digital reality scene refers to any space (e.g., digital space and / or real-world space) in which digital reality content (e.g., avatars, digital reality objects, etc.) are shown to a user via a display (e.g., a display of the client device 300).
[0154] However, the disclosure is not so limited. For example, in some embodiments, the objects 42 are consumable by a user in the digital reality scene 40, such as video, text, or an in-game consumable object (e.g., a digital reality drink object). Collectively, the objects 42 interact in the digital reality scene 40 online, allowing users of the client devices 300, such as one or more users forming the respective digital reality scene 40, to actively engage with the digital reality scene 40.
[0155] In some embodiments, each respective object 42 includes a number of attributes that describe how the respective object 42 interacts with the digital reality scene 40, e.g., other objects 42 in the digital reality scene 40, as well as how the respective object 42 interacts with other users of the digital reality scene 40. In some embodiments, the attributes of the object 42 that can be changed or altered include the mass of the object 42, the volume of the object 42, the coefficient of friction of the object 42, the state of matter of the object 42, the stiffness of the body of the object 42, the position of the object 42, the health value of the object 42 (e.g., the hit points of the object 42, the energy points of the object, etc.), the joints of the object 42, etc. As a non-limiting example, consider a first attribute that describes a response to a collision with the respective object 42 (e.g., the hardness of the object 42, the adhesiveness of the object 42, etc.).
[0156] In some embodiments, the attributes associated with each object 42 are the same for each user of the digital reality scene 40. For example, if each object 42 has an attribute that makes the respective object 42 interactive with the user, then each user of the digital reality scene 40 can interact with the respective object 42. On the other hand, if each object 42 has an attribute that makes the respective object 42 interactive with a selected group of users, such as subjects having an indication in their user profile 16 that indicates a psychiatric or mental condition, then only users in the selected group of users can interact with the respective object 42. For example, in some embodiments, an administrator user of the digital reality scene 40 may restrict interaction with a particular object 42 to all users except the administrator user, or to one or more particular users that indicate a psychiatric or mental condition.
[0157] In some embodiments, the digital reality system 200 includes an application model library 50 that stores one or more models (e.g., classifiers, regressors, etc.). In some embodiments, the models are implemented as an artificial intelligence engine. For example, in some embodiments, the models include one or more gradient boosting models, one or more random forest models, one or more neural networks (NNs), one or more regression models, one or more Naive Bayes models, one or more machine learning algorithms (MLAs), or combinations thereof. In some embodiments, the MLAs or NNs are trained from a training dataset (e.g., a first training dataset including the user profile store 14, the experience store 22, the gate store 30, the application server module logs 34, or a combination thereof) that includes one or more features identified from a dataset. By way of example, in some embodiments, the training dataset includes data associated with the first user profile 16-1 and data associated with the user's tendency when confronted with the experience 24 in the digital reality scene 40.
[0158] Thus, in some embodiments, for example, the first model is a neural network classification model and the second model is a naive Bayes classification model. Further, in some embodiments, the model includes a decision tree algorithm, a neural network algorithm, a support vector machine (SVM) algorithm, etc. Further, in some embodiments, the model described herein is a logistic regression algorithm, a neural network algorithm, a convolutional neural network algorithm, a support vector machine (SVM) algorithm, a naive Bayes algorithm, a nearest neighbor algorithm, a boosting tree algorithm, a random forest algorithm, a decision tree algorithm, a clustering algorithm, or a combination thereof.
[0159] In some embodiments, the model is utilized to normalize values or data sets, for example, by transforming a value or set of values into a common frame of reference for comparison purposes. For example, in some embodiments, if one or more pixel values corresponding to one or more pixels of each image are normalized to a predetermined statistic (e.g., the mean and / or standard deviation of one or more pixel values across one or more images), the pixel value of each pixel is compared to the respective statistic to determine the amount by which the pixel value differs from the statistic.
[0160] In some embodiments, an untrained model (e.g., an "untrained classifier" and / or an "untrained neural network") includes a machine learning model or algorithm, such as a classifier or neural network, that has not been trained on a target dataset. In some embodiments, training a model (e.g., training a neural network) refers to the process of training an untrained or partially trained model (e.g., an untrained or partially trained neural network). For example, consider the case of a plurality of training samples including a corresponding plurality of images (e.g., image captures of a case showing a digital reality scene on a display of a client device 300), as described below. The plurality of images are applied as collective inputs to the untrained or partially trained model, along with corresponding measured indications of one or more objects (e.g., scene objects 42) for each respective image (hereinafter, a training dataset), to train the untrained or partially trained model with indications identifying objects associated with morphological classes and obtain a trained model. Furthermore, it may be understood that the term "untrained model" does not exclude the possibility that transfer learning techniques are used in such training of an untrained or partially trained model. For example, Fernandes et al, 2017, “Transfer Learning with Partial Observability Applied to Cervical Cancer Screening,” Pattern Recognition and Image Analysis:8 thIberian Conference Proceedings, 243-250 provide a non-limiting example of such transfer learning. This document is incorporated by reference in its entirety for all purposes. When transfer learning is used, the untrained model described above is provided with additional data in addition to the primary training dataset. That is, in a non-limiting example of an embodiment of transfer learning, the untrained model receives (i) a plurality of images and a measured indication of each respective image ("primary training dataset") and (ii) additional data. In some embodiments, this additional data is in the form of parameters (e.g., coefficients, weights, and / or hyperparameters) learned from another auxiliary training dataset. Furthermore, although a description of a single auxiliary training dataset is disclosed, it can be understood that there is no limit to the number of auxiliary training datasets that may be used to complement the primary training dataset in training the untrained model in this disclosure. For example, in some embodiments, two or more auxiliary training datasets, three or more auxiliary training datasets, four or more auxiliary training datasets, or five or more auxiliary training datasets are used to complement the primary training dataset by transfer learning. Each such auxiliary dataset is different from the primary training dataset. In such an embodiment, any method of transfer learning may be used. For example, consider the case where there is a first auxiliary training data set and a second auxiliary training data set in addition to the primary training data set. The parameters learned from the first auxiliary training data set (by applying the first model to the first auxiliary training data set) may be applied to the second auxiliary training data set using a transfer learning technique (e.g., a second model that is the same as or different from the first model), resulting in the generation of an intermediate model to be trained.The parameters of the intermediate model are applied to the primary training dataset, which, together with the primary training dataset itself, is applied to the untrained model. Also, a first set of parameters learned from the first auxiliary training dataset (by applying a first model to the first auxiliary training dataset) and a second set of parameters learned from the second auxiliary training dataset (by applying a second model, the same or different from the first model, to the second auxiliary training dataset) may each be independently applied (e.g., by separate independent matrix multiplications) to separate instances of the primary training dataset. Both such applications of parameters separating instances of the primary training dataset, together with the primary training dataset itself (or some educated form of the primary training dataset, such as principal components or regression coefficients learned from the primary training set), may be applied to the untrained model to train the untrained model. In some examples, additionally or alternatively, knowledge about objects associated with morphological classes derived from the auxiliary training dataset is used together with the objects and / or class-labeled images of the primary training dataset to train the untrained model.
[0161] As used herein, the term "model" refers to a machine learning model or algorithm.
[0162] In some embodiments, the model is an unsupervised learning algorithm. One example of an unsupervised learning algorithm is cluster analysis.
[0163] In some embodiments, the model is a supervised machine learning. Non-limiting examples of supervised learning algorithms include, but are not limited to, logistic regression, neural network, support vector machine, naive Bayes algorithm, nearest neighbor algorithm, random forest algorithm, decision tree algorithm, boosted tree algorithm, multinomial logistic regression algorithm, linear model, linear regression, gradient boosting, mixture model, hidden Markov model, Gaussian NB algorithm, linear discriminant analysis, or any combination thereof. In some embodiments, the model is a multinomial classifier algorithm. In some embodiments, the model is a two-stage stochastic gradient descent (SGD) model. In some embodiments, the model is a deep neural network (e.g., deep and wide sample level classifier).
[0164] Neural Network. In some embodiments, the model is a neural network (e.g., a convolutional neural network and / or a residual neural network). Neural network algorithms, also known as artificial neural networks (ANNs), include convolutional neural network algorithms and / or residual neural network algorithms (deep learning algorithms). A neural network can be a machine learning algorithm that may be trained to map an input data set to an output data set. A neural network includes an interconnected group of nodes organized into multiple layers of nodes. For example, a neural network architecture may include at least an input layer, one or more hidden layers, and an output layer. A neural network may include any number of layers and any number of hidden layers. A hidden layer acts as a trainable feature extractor that allows a set of input data to be mapped to an output value or a set of output values. As used herein, a deep learning algorithm (DNN) may be a neural network that includes multiple hidden layers, e.g., two or more hidden layers. Each layer of a neural network may include several nodes (or "neurons"). A node can receive inputs coming either directly from the input data or from the output of a node in a previous layer and perform a particular operation, e.g., an addition operation. In some embodiments, the connections from the inputs to the nodes are associated with parameters (e.g., weights and / or weighting coefficients). In some embodiments, a node can perform a summation operation for every pair x of inputs. iand their associated parameters may be summed. In some embodiments, the weighted sum is offset by a bias b. In some embodiments, the output of a node or neuron may be gated using a threshold or activation function f, which may be a linear or nonlinear function. The activation function may be, for example, a rectified linear unit (ReLU) activation function, a leaky ReLU activation function, or other functions such as a saturated hyperbolic tangent, identity, binary step, logistic, arcTan, soft sine, parametric rectified linear unit, exponential linear unit, softPlus, bending identity, soft exponential, sinusoid, sine, Gaussian, sigmoid function, or any combination thereof.
[0165] The weighting coefficients, bias values, and thresholds, or other computational parameters of a neural network can be "taught" or "learned" during a training phase using one or more sets of training data. For example, the parameters can be trained using input data from a training data set and gradient descent or backpropagation techniques such that the output values that the ANN computes match the examples contained in the training data set. The parameters can be obtained from a backpropagation neural network training process.
[0166] Any of a variety of neural networks may be suitable for use in carrying out the methods disclosed herein. Examples may include, but are not limited to, feedforward neural networks, radial basis function networks, recurrent neural networks, residual neural networks, convolutional neural networks, residual convolutional neural networks, or any combination thereof. In some embodiments, the machine learning utilizes pre-trained and / or transfer-learned ANNs, or deep learning architectures. Convolutional neural networks and / or residual neural networks may be used to analyze images of subjects according to the present disclosure.
[0167] For example, a deep neural network model includes an input layer, a number of individually parameterized (e.g., weighted) convolution layers, and an output scorer. The parameters (e.g., weights) of each convolution layer and input layer contribute to a number of parameters (e.g., weights) associated with the deep neural network model. In some embodiments, at least 100 parameters, at least 1000 parameters, at least 2000 parameters, or at least 5000 parameters are associated with the deep neural network model. In this way, deep neural network models cannot be solved mentally and therefore require the use of a computer. In other words, given the input to the model, in such embodiments, the model output needs to be determined using a computer, not mentally. See, e.g., Krizhevsky et al., 2012, “Imagenet classification with deep convolutional neural networks,” in Advances in Neural Information Processing Systems 2, Pereira, Burges, Bottou, Weinberger, eds., pp. 1097-1105, Curran Associates, Inc.; Zeiler, 2012 “ADADELTA: an adaptive learning rate method,” CoRR, vol. abs / 1212.5701; and Rumelhart et al., 1988, “Neurocomputing: Foundations of research,” ch. Learning Representations by Back-propagating Errors, pp. 696-699, Cambridge, MA, USA: MIT Press. Each of these references is incorporated herein by reference in its entirety for all purposes.
[0168] Neural network algorithms, including convolutional neural network algorithms, suitable for use as models are disclosed, for example, in Vincent et al., 2010, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion," J Mach Learn Res 11, pp. 3371-3408; Larochelle et al., 2009, "Exploring strategies for training deep neural networks," J Mach Learn Res 10, pp. 1-40; and Hassoun, 1995, Fundamentals of Artificial Neural Networks, Massachusetts Institute of Technology, each of which is incorporated herein by reference. Additional exemplary neural networks suitable for use as models are disclosed in Duda et al., 2001, Pattern Classification, Second Edition, John Wiley & Sons, Inc., New York; and Hastie et al., 2001, The Elements of Statistical Learning, Springer-Verlag, New York, each of which is incorporated herein by reference in its entirety for all purposes.Additional exemplary neural networks suitable for use as models are also described in Draghici, 2003, Data Analysis Tools for DNA Microarrays, Chapman & Hall / CRC; and Mount, 2001, Bioinformatics: sequence and genome analysis, Cold Spring Harbor Laboratory Press, Cold Spring Harbor, New York, each of which is incorporated herein by reference in its entirety for all purposes.
[0169] Support Vector Machine. In some embodiments, the model is a support vector machine (SVM). SVM algorithms suitable for use as models are described, for example, in Cristianini and Shawe-Taylor, 2000, “An Introduction to Support Vector Machines,” Cambridge University Press, Cambridge; Boser et al., 1992, “A training algorithm for optimal margin classifiers,” in Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, ACM Press, Pittsburgh, Pa., pp. 142-152; Vapnik, 1998, Statistical Learning Theory, Wiley, New York; Mount, 2001, Bioinformatics: sequence and genome analysis, Cold Spring Harbor Laboratory Press, Cold Spring Harbor, NY; Duda, Pattern Classification, Second Edition, 2001, John Wiley & Sons, Inc., pp. 259, 262-265; and Hastie, 2001, The Elements of Statistical Learning, Springer, New York; and Furey et al., 2000, Bioinformatics 16, 906-914, each of which is incorporated herein by reference in its entirety. When used for classification, SVM separates a given set of binary labeled data with a hyperplane that is maximally distant from the labeled data. When linear separation is not possible, SVM can be operated in combination with the technique of "kernels" that automatically achieve a nonlinear mapping to the feature space.The hyperplane found by the SVM in the feature space can correspond to a non-linear decision boundary in the input space. In some embodiments, multiple parameters (e.g., weights) associated with the SVM define the hyperplane. In some embodiments, the hyperplane is defined by at least 10, at least 20, at least 50, or at least 100 parameters. SVM models require a computer to compute because they cannot be solved mentally.
[0170] Naive Bayes Algorithm. In some embodiments, the model is a naive Bayes algorithm. A naive Bayes classifier suitable for use as a model is disclosed, for example, in Ng et al., 2002, “On discriminative vs. generative classifiers: A comparison of logistic regression and naive Bayes,” Advances in Neural Information Processing Systems, 14, which is incorporated herein by reference in its entirety for all purposes. A naive Bayes classifier is any classifier in the family of “probabilistic classifiers” based on applying Bayes’ theorem with strong (simple) independence assumptions between features. In some embodiments, they are combined with kernel density estimation. See, for example, Hastie et al., 2001, The elements of statistical learning: data mining, inference, and prediction, eds. Tibshirani and Friedman, Springer, New York, which is incorporated herein by reference in its entirety for all purposes.
[0171] TIFF2024544658000002.tif86169
[0172] The k-nearest neighbor model is a non-parametric machine learning method whose input consists of the k-nearest training examples in feature space. The output is class membership. An object is classified by the votes of its neighbors, and the object is assigned to the most common class among its k-nearest neighbors (k is a positive integer, typically small). If k=1, the object is simply assigned to the class of its single nearest neighbor. See Duda et al., 2001, Pattern Classification, Second Edition, John Wiley & Sons, which is incorporated by reference in its entirety for all purposes. In some embodiments, the number of distance calculations required to solve the k-nearest neighbor model is such that it cannot be performed mentally and therefore a computer is used to solve the model for a given input.
[0173] Random Forest, Decision Tree, and Boosting Tree Algorithms. In some embodiments, the model is a decision tree. Decision trees suitable for use as models are generally described in Duda, 2001, Pattern Classification, John Wiley & Sons, Inc., New York, pp. 395-396, which is incorporated herein by reference. Tree-based methods divide the feature space into a set of rectangles and fit a model (such as a constant) to each. In some embodiments, the decision tree is a random forest regression. One particular algorithm that may be used is a classification and regression tree (CART). Other particular decision tree algorithms include, but are not limited to, ID3, C4.5, MART, and random forest. CART, ID3, and C4.5 are described in Duda, 2001, Pattern Classification, John Wiley & Sons, Inc., New York, pp. 396-408 and pp. 411-412, which is incorporated herein by reference in its entirety for all purposes. CART, MART and C4.5 are described in Hastie et al., 2001, The Elements of Statistical Learning, Springer-Verlag, New York, Chapter 9, which is incorporated herein by reference in its entirety for all purposes. Random forests are described in Breiman, 1999, "Random Forests--Random Features," Technical Report 567, Statistics Department, UC Berkeley, September 1999, which is incorporated herein by reference in its entirety for all purposes. In some embodiments, the decision tree model includes at least 10, at least 20, at least 50, or at least 100 parameters (e.g., weights and / or decisions) and is not mentally solvable, requiring a computer to compute.
[0174] Regression. In some aspects, the model uses a regression algorithm. The regression algorithm can be any type of regression. For example, in some embodiments, the regression algorithm is logistic regression. In some embodiments, the regression algorithm is logistic regression with lasso, L2, or elastic net regularization. In some embodiments, extracted features with corresponding regression coefficients that do not meet a threshold are removed from consideration. In some embodiments, a generalization of the logistic regression model that handles multi-category responses is used as the model. The logistic regression algorithm is disclosed in Agresti, An Introduction to Categorical Data Analysis, 1996, Chapter 5, pp. 103-144, John Wiley & Son, New York, which is incorporated herein by reference in its entirety for all purposes. In some embodiments, the model utilizes the regression model disclosed in Hastie et al., 2001, The Elements of Statistical Learning, Springer-Verlag, New York. In some embodiments, the logistic regression model includes at least 10, at least 20, at least 50, at least 100, or at least 1000 parameters (e.g., weights) and cannot be solved mentally, requiring a computer to calculate.
[0175] Linear Discriminant Analysis Algorithms. Linear discriminant analysis (LDA), normal discriminant analysis (NDA), or discriminant function analysis may be a generalization of Fisher's Linear Discriminant, a method used in statistics, pattern recognition, and machine learning to characterize two or more classes of objects or events. The resulting combination can be used as a model (e.g., a linear classifier) in some embodiments of the present disclosure.
[0176] Mixture Models and Hidden Markov Models. In some embodiments, the model is a mixture model such as that described in McLachlan et al., Bioinformatics 18(3):413-422, 2002. In some embodiments, particularly those that include a temporal component, the model is a hidden Markov model as described by Schliep et al., 2003, Bioinformatics 19(1):i255-i263.
[0177] Clustering. In some embodiments, the model is an unsupervised clustering model. In some embodiments, the model is a supervised clustering model. Clustering algorithms suitable for use as models are described, for example, in Duda and Hart, Pattern Classification and Scene Analysis, 1973, John Wiley & Sons, Inc., New York (hereinafter, "Duda 1973", pp. 211-256, which is incorporated herein by reference in its entirety for all purposes). The problem of clustering can be described as one of finding natural groupings in a data set. To identify natural groupings, two problems can be addressed. First, a method can be determined to measure the similarity (or dissimilarity) between two samples. This metric (e.g., a similarity measure) can be used to ensure that samples in one cluster are more similar to each other than samples in another cluster. Second, a mechanism for partitioning the data into clusters using the similarity measure can be determined. One way to begin a clustering investigation is to define a distance function and generate a matrix of distances between all pairs of samples in the training data set. A possible solution is to calculate a risk of similarity between two clusters. If distance is a good measure of similarity, then the distance between reference entities in the same cluster may be significantly smaller than the distance between reference entities in different clusters. However, clustering does not have to use a distance metric. For example, a non-metric similarity function s(x,x') may be used to compare two vectors x and x'. s(x,x') may be a symmetric function whose value is large if x and x' are "similar" in some way. Once a method for measuring "similarity" or "dissimilarity" between points of a data set has been selected, clustering can use a criterion function that measures the clustering quality of any partition of the data. Partitions of the data set that produce extreme values of the criterion function may be used to cluster the data.Certain exemplary clustering techniques that may be used in the present disclosure may include, but are not limited to, hierarchical clustering (agglomerative clustering using nearest neighbor, longest method, average linkage, centroid, or sum of squares algorithms), k-means clustering, fuzzy k-means clustering algorithms, and Jarvis-Patrick clustering. In some embodiments, the clustering includes unsupervised clustering (e.g., no pre-setting of the number of clusters and / or no pre-setting of cluster assignments).
[0178] Ensembles and Boosting of Models. In some embodiments, an ensemble of models (two or more) is used. In some embodiments, boosting techniques such as AdaBoost are used in conjunction with many other types of learning algorithms to improve the performance of the models. In this approach, the outputs of any of the models disclosed herein, or their equivalents, are combined into a weighted sum that represents the final output of the boosted model. In some embodiments, the multiple outputs from the models are combined using any measure of central tendency known in the art, including but not limited to the mean, median, mode, weighted average, weighted median, weighted mode, etc. In some embodiments, the multiple outputs are combined using a voting method. In some embodiments, each model in the ensemble of models is weighted or unweighted.
[0179] The term "classification" may refer to any number or other character associated with a particular characteristic of a sample. For example, a "+" symbol (or the term "positive") may indicate that a sample is classified as having a desired outcome or characteristic, and a "-" symbol (or the term "negative") may indicate that a sample is classified as having an undesired outcome or characteristic. In other examples, the term "classification" refers to a respective outcome or characteristic (e.g., high risk, medium risk, low risk). In some embodiments, the classification is binary (e.g., positive or negative) or has more levels of classification (e.g., a scale of 1 to 10 or 0 to 1). In some embodiments, the terms "cutoff" and "threshold" refer to a predetermined number used in an operation. In one example, a cutoff value refers to a value above which a result is excluded. In some embodiments, a threshold is a value above or below which a particular classification is applied. Any of these terms can be used in any of these contexts.
[0180] Those skilled in the art will easily understand other models that can be applied to the systems and methods of the present disclosure. In some embodiments, the systems, methods, and devices of the present disclosure utilize two or more models to provide an improved assessment (e.g., arrive at an assessment given one or more inputs). For example, in some embodiments, each model arrives at a corresponding assessment when each data set is provided. Thus, each respective model can be arrived at independently, and after the results are obtained, the results of each respective model are verified together by model comparison or integration. Thus, the models provide cumulative results. However, the present disclosure is not limited thereto.
[0181] In some embodiments, each model is tasked with performing a corresponding activity. As a non-limiting example, in some embodiments, the tasks performed by each model include, but are not limited to, diagnosing a mental disorder, generating a corresponding manifestation of a challenge in the form of an experience 24 associated with a digital reality scene 40, identifying each category in a plurality of categories of assessments obtained from a subject, performing a validation of an assessment obtained from a subject, performing a further validation by a physician of an assessment obtained from a subject, generating respective gating criteria, generating respective biometric thresholds, generating an exposure progression including a plurality of categories arranged in a sequence, determining whether a task is completed successfully, identifying a subsequent task for the subject to complete, determining whether a category is completed successfully, identifying a subsequent category for the subject to complete, or any combination thereof. In some embodiments, each respective model of the present disclosure uses 10 or more parameters, 100 or more parameters, 1,000 or more parameters, 10,000 or more parameters, or 100,000 or more parameters. In some embodiments, each respective model of the present disclosure cannot be mentally implemented.
[0182] Each of the above identified modules and applications corresponds to a set of executable instructions for performing one or more of the functions and methods described herein. These modules (e.g., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and various subsets of these modules may optionally be combined or rearranged in various embodiments of the present disclosure. In some embodiments, memory 212 optionally stores a subset of the modules and data structures identified above. Additionally, in some embodiments, memory 212 stores additional modules and data structures not described above.
[0183] 2A and 2B are only one example of the digital reality system 200, and it should be understood that the digital reality system 200 may optionally have more or fewer components than shown, may optionally combine two or more components, or may optionally have a different configuration or arrangement of components. The various components shown in FIGS. 2A and 2B may be implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing and / or application specific integrated circuits. Furthermore, the digital reality system 200 may be a single device that includes all the functionality of the digital reality system 200. The client device 300 may also be a combination of multiple devices. For example, the functionality of the digital reality system 200 may be distributed across any number of networked computers and / or may reside on each of several networked computers and / or may reside hosted on one or more virtual machines and / or containers at remote locations accessible via a communications network (e.g., the communications network 106, the network interface 204, or both). Those skilled in the art will appreciate that a wide variety of different computer topologies are possible for the digital reality system 200, and other devices and systems of the present disclosure, and that all such topologies are within the scope of the present disclosure.
[0184] 3, an exemplary client device 300 is provided (e.g., a first client device 300-1). The client device 300 includes one or more processing units (CPUs) 302, one or more network or other communication interfaces 304, memory 312 (e.g., random access memory and / or non-volatile memory) optionally accessed by one or more controllers, and one or more communication buses 314 interconnecting the aforementioned components.
[0185] In some embodiments, the client device 300 includes a mobile device such as a mobile phone, a tablet, a laptop computer, a wearable device such as a smart watch, etc. In such embodiments, each digital reality scene 40 accessible via the client device 300 includes an augmented reality scene. In some embodiments, each digital reality scene accessible via the client device 300 includes a mixed reality scene. However, the present disclosure is not limited in this respect. For example, in some embodiments, the client device 300 is a desktop computer or other similar device that accepts one or more wearable devices (e.g., a wearable display). In some embodiments, the client device 300 is a standalone device dedicated to providing the digital reality scene 40 of the systems and methods of the present disclosure. Furthermore, in some embodiments, each client device 300 allows each subject to provide information associated with each subject (e.g., subject preferences, subject feedback, etc.).
[0186] The client device 300 also includes a user interface 306. The user interface 306 typically includes a display device 308 for presenting media, such as the digital reality scene 40, and for receiving instructions from a subject operating the client device 300. In some embodiments, the display device 308 is optionally integrated within the client device 300, such as a smart (e.g., smartphone) device (e.g., housed in the same chassis as the CPU 302 and memory 312). In some embodiments, the client device 300 includes one or more input devices 310 that allow the subject to interact with the client device 300. In some embodiments, the input device 310 includes a keyboard, a mouse, one or more cameras (e.g., an objective lens in communication with a two-dimensional pixelated detector) configured to determine the position of an object over a period of time (e.g., to track the subject's hand over space and / or time), and / or other input mechanisms. Alternatively or additionally, in some embodiments, the display device 308 includes a touch-sensitive surface, e.g., the display 308 is a touch-sensitive display or the client device 300 includes a touchpad.
[0187] In some embodiments, the client device 300 includes an input / output (I / O) subsystem 330 for interfacing with the client device 300 and one or more peripheral devices. For example, in some embodiments, audio is presented via an external device (e.g., speaker, headphones, etc.) that receives audio information from the client device 300 and / or a remote device (e.g., the digital reality system 200) and presents audio data based on the audio information. In some embodiments, the input / output (I / O) subsystem 330 also includes or interfaces with an audio output device, such as a speaker or an audio output for connecting to a speaker, earphone, or headphone. In some embodiments, the input / output (I / O) subsystem 330 also includes a speech recognition capability (e.g., to supplement or replace the input device 310).
[0188] In some embodiments, the client device 300 also includes one or more sensors (e.g., an accelerometer, magnetometer, proximity sensor, gyroscope, etc.), an image capture device (e.g., a camera device or an image capture module and related components), a location determination module (e.g., a Global Positioning System (GPS) receiver or other navigation or geolocation system module / device and related components), or combinations thereof.
[0189] As previously discussed, the client device 300 includes a user interface 306. The user interface 306 typically includes a display device 308, which is optionally integrated within the client device 300 (e.g., housed in the same chassis as the CPU and memory, such as with a smartphone or all-in-one desktop computer client device 300). In some embodiments, the client device 300 includes multiple input devices 310, such as a keyboard, a mouse, and / or other input buttons (e.g., one or more sliders, one or more joysticks, one or more radio buttons, etc.). Alternatively or additionally, in some embodiments, the display device 308 includes a touch-sensitive surface, e.g., the display 308 is a touch-sensitive display 308 or each client device 300 includes a touchpad.
[0190] In some embodiments, the pose of the client device 300 is determined based on one or more characteristics, e.g., one or more local characteristics of the client device 300 associated with the respective region of interest, such as the subject's hand using the client device 300 or the hand controller of the client device 300 (e.g., acceleration of the client device) and / or one or more proximity characteristics near the client device 300. For example, in some embodiments, the one or more proximity characteristics associated with the respective region of interest include the appearance of the region of interest. By way of example, in some embodiments, the respective proximity characteristics are associated with the shape of the region of interest (e.g., the subject's hand changing from an open fist to a closed fist), the color of the region of interest (e.g., evaluating the color of the clothing worn by the subject), the reflectance of the region of interest, etc. In some embodiments, the one or more proximity characteristics associated with the respective region of interest are derived from information derived from a previous assignment of the respective digital reality scene, such as a workflow of exposure progression (e.g., information maintained in the therapy store of the corresponding user profile). In some embodiments, the one or more proximity characteristics associated with the respective region of interest are based on a reference database including a plurality of characteristics having an association with a given region of interest.Additional details and information regarding determining pose based on characteristics of the region of interest can be found in Oe et al., 2005, “Estimating Camera Position and Posture by Using Feature Landmark Database,” Scandinavian Conference on Image Analysis, pg. 171; Lee et al., 1998, “Fine Active Calibration of Camera Position / Orientation through Pattern Recognition,” IEEE ISIE, print; Dettwiler et al., 1994, “Motion Tracking with an Active Camera,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(5), pg. 449; Kritikos et al., 2020, “Comparison between Full Body Motion Recognition Camera Interaction and Hand Controllers Interaction used in Virtual Reality Exposure Therapy for Acrophobia,” Sensors, 20(5), pg. 1244. Each of these documents is incorporated herein by reference in its entirety for all purposes.
[0191] Additionally, in some embodiments, the client device 300 includes a head-up display (HUD) device in which a display 308 is mounted on a user's head, such as, for example, a virtual reality headset that facilitates the presentation of a virtual reality scene 40, an augmented reality headset that facilitates the presentation of an augmented reality scene 40, or a mixed reality headset that facilitates the presentation of a mixed reality scene 40. In such embodiments, the client device 300 includes an input device 310, such as a haptic feedback device. Thus, the HUD client device 300 provides the functionality of a virtual reality client device 300 with synchronized haptic and audio feedback, an augmented reality client device 300 with synchronized haptic and audio feedback, a mixed reality client device 300 with synchronized haptic and audio feedback, or a combination thereof.
[0192] In some embodiments, the display 308 is a wearable display such as a smart watch, a head-mounted display, or a smart garment client device (e.g., display 1100 of FIG. 13). One such non-limiting example of the wearable display 308 includes a near-eye display or a head-mounted display. In other embodiments, the display 308 is a smart mobile device display (e.g., a smartphone), such as the client device 300-1 of FIG. 8A. In some embodiments, the display 308 is a head-mounted display (HMD) connected to the host computer system 300, a standalone HMD, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers. FIG. 13 is a perspective view of an example of a glasses-type near-eye display 1100 for implementing some of the examples of the display 308 disclosed herein. In some embodiments, the near-eye display 1100 is configured to operate as a virtual reality display, an augmented reality display, and / or a mixed reality display. In some embodiments, the near-eye display 1100 includes a frame 1105 and a display 1110. In some embodiments, the display 1110 is configured to present content to a user. In some embodiments, the display 1100 includes display electronics and / or display optics. For example, in some embodiments, the display 1100 includes an LCD display panel, an LED display panel, or an optical display panel (e.g., a waveguide display assembly). In some embodiments, the near-eye display 1100 further includes various sensors 1150a, 1150b, 1150c, 1150d, 1150e at or within the frame 1105.In some embodiments, the various sensors 1150a-1150e include one or more depth sensors, motion sensors, position sensors, inertial sensors, recorder sensors (e.g., microphone sensors), or ambient light sensors. In some embodiments, the various sensors 1150a-1150e include one or more image sensors configured to generate image data representing different fields of view in different directions. In some embodiments, the various sensors 1150a-1150e are used as input devices to control or affect the display content of the near-eye display 1100 and / or provide an interactive VR / AR / MR experience to a user of the near-eye display 1100. In some embodiments, the various sensors 1150a-1150e are also used for stereoscopic imaging.
[0193] In some embodiments, the near-eye display 1100 further includes one or more illuminators 1130 that project light into the physical environment. In some embodiments, the projected light is associated with different frequency bands (e.g., visible light, infrared light, ultraviolet light, etc.), which in such embodiments are used for various purposes. For example, in some embodiments, the illuminator 1130 projects light in a dark environment (or in an environment with low intensity of infrared light, ultraviolet light, etc.) to assist the sensors 1150a-1150e in capturing images of different objects in the dark environment. In some embodiments, the illuminator 1130 is used to project specific light patterns onto objects in the environment. In some embodiments, the illuminator 1130 is used as a locator.
[0194] In some embodiments, the near-eye display 1100 includes a high-resolution camera 1140. In some embodiments, the camera 1140 captures images of a physical environment in a field of view. In some embodiments, the captured images are processed, for example, by a virtual reality engine (e.g., engine 322 of FIG. 3 ) to add one or more virtual objects 42 to the captured image or to modify physical objects in the captured image. In some embodiments, the processed images are displayed to a user by the display 1100 for an AR or MR application provided by the present disclosure (e.g., client application 320 of FIG. 3 ).
[0195] Additionally, in some embodiments, the client device 300 includes or is a component of a digital reality kit for showing the digital reality scene 40. Further details and information regarding the digital reality kit may be found in U.S. Patent Application Publication No. 2020 / 0121050, filed October 18, 2019, entitled "Virtual Reality Kit," which is hereby incorporated by reference in its entirety for all purposes.
[0196] In some embodiments, client device 300 includes one or more readily available (e.g., off-the-shelf) components, such as Pico Neo3pro (Pico Interactive Inc., San Francisco, California), Oculus Quest2 (Oculus VR, Irvine, California), Snapchat Spectacles 3 (Snap Inc., Santa Monica, California), Google Cardboard (Google LLC, Mountain View, California), HTC VIVE Pro2 (HTC Corporation, Taoyuan City, Taiwan), etc. Those skilled in the art will appreciate that the disclosure is not limited in this respect.
[0197] In some embodiments, the client device 300 presents media to the user via the display 308. Examples of media presented on the display 308 include one or more images, video, audio (e.g., a waveform of an audio sample), or a combination thereof. In an exemplary embodiment, one or more images, video, audio, or a combination thereof are presented by the display via the digital reality scene 40. In some embodiments, the audio is presented via an external device (e.g., a speaker, headphones, etc.) that receives audio information from the client device 300, the digital reality system 200, or both, and presents audio data based on this audio information. In some embodiments, the user interface 306 also includes an audio output device, such as a speaker or an audio output for connecting to a speaker, earphone, or headphone. In some embodiments, the user interface 306 also includes an audio input device (e.g., a microphone) and optionally a voice recognition function (e.g., to supplement or replace a keyboard). Optionally, the client device 300 includes an audio input device 310 (e.g., a microphone) for capturing audio (e.g., speech from a user). In some embodiments, the audio input device 310 is a single omnidirectional microphone.
[0198] In some embodiments, the client device 300 also includes one or more of a sensor (e.g., an accelerometer, a magnetometer, a proximity sensor, a gyroscope), an image capture device (e.g., a camera device or module and associated components), and / or a location module (e.g., a Global Positioning System (GPS) receiver or other navigation or geolocation device and associated components). In some embodiments, the sensor includes one or more hardware devices that detect spatial and motion information regarding the client device 300. The spatial and motion information may include information regarding a position of the client device 300, an orientation of the client device 300, a velocity of the client device 300, a rotation of the client device 300, an acceleration of the client device 300, or a combination thereof. For example, in some embodiments, the sensor includes one or more inertial measurement units (IMUs) that detect a rotation of a user's head while the user is utilizing (e.g., wearing) the client device 300. In some embodiments, this rotational information is used (e.g., by the client application 320 of FIG. 3 and / or the digital reality session engine 38 of FIG. 2B) to adjust the image displayed on the display 308 of the client device 300. In some embodiments, each IMU includes one or more gyroscopes, one or more accelerometers, and / or one or more magnetometers that collect spatial and motion information. In some embodiments, the sensors include one or more cameras located on the client device 300.
[0199] The memory 312 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices, and optionally also includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 312 may optionally include one or more storage devices located remotely from the CPU 302. The memory 312 or non-volatile memory devices within the memory 312 include non-transitory computer-readable storage media. Access to the memory 312 by the CPU 302 and other components of the client device 300, such as the I / O subsystem 330, is optionally controlled by a controller. In some embodiments, the memory 312 may include mass storage located remotely relative to the CPU 302. In other words, some data stored in the memory 312 may actually be hosted on a device that is external to the client device 300, but can be electronically accessed by the client device 300 via the Internet, an intranet, or other forms of network 106 or electronic cables using the communication interface 304.
[0200] In some embodiments, the memory 312 of the client device 300 stores the following: · An operating system 316 that contains procedures for handling various basic system services. An electronic address 318 associated with the client device 300 that identifies the client device 300 within the distributed system 100. · A client application 320 for generating content for display via a graphical user interface shown on the display 308 of the client device 300. An engine 322 that enables the client application 320 to operate in conjunction with the client device 300 .
[0201] In some embodiments, an electronic address 318 is associated with the client device 300, which is utilized to at least uniquely identify the client device 300 from other devices and components of the distributed system 100. In some embodiments, the electronic address 318 associated with the client device 300 is used to determine the source of an assessment provided by the client device 300 (e.g., to receive an assessment from the digital reality system 200 and communicate one or more responses based on the assessment).
[0202] In some embodiments, each client application 320 is a group of instructions that, when executed by a processor, generates content for presentation to a user, such as a virtual reality scene 40, an augmented reality scene 40, or a mixed reality scene 40. The client application 320 may generate the content in response to input received from a user through movement of the client device 300, such as client device input 310. Here, the client application 320 includes a gaming application, a conferencing application, a video playback application, or a combination thereof. For example, in some embodiments, the client application 320 facilitates providing one or more sessions of a digital reality scene, such as digital reality scenes 40-1, 40-2, ..., or 40-H of FIG. 1. In some embodiments, the client application 320 is utilized to obtain an assessment from the subject, including an identification of a plurality of proposed experiences 24. In some embodiments, the client application 320 is utilized to configure one or more criteria associated with the experience 24, such as the number of player and / or non-player characters that may participate in the digital reality scene 40 during a given challenge, and optionally, to configure the experience within the digital reality scene 40.
[0203] In some embodiments, the engine 322 is a software module that enables the client application 320 to operate in conjunction with the client device 300. In some embodiments, the engine 322 receives information from sensors of the client device 300 and provides the information to the client application 320. Based on the received information, the engine 322 determines the type of media content and / or haptic feedback to provide to the client device 300 for presentation to the user via the display 308 or one or more audio devices. For example, if the engine 322 receives information from sensors of the client device 300 indicating that the user looked left, the engine 322 generates content for the display 308 that reflects the user's movements in the digital reality scene 40. As another example, when a user knocks on a wall (e.g., in the digital reality scene 40), the engine 322 generates a control signal for a haptic feedback mechanism of the client device 300 to generate vibrations and, optionally, generate a sound corresponding to the user's action (e.g., the sound of a person's fist hitting a wooden wall or the sound of a person's fist hitting a plexiglass wall is different than the sound generated for a wooden wall). As yet another non-limiting example, in some embodiments, the engine 322 receives information from one or more sensors in electronic communication with the client device 300 that obtain biometric data from a user of the client device 300, such as the user's instantaneous heart rate captured over a period of time. In such embodiments, the engine 322 generates content for the display 308 responsive to the biometric data from the user, such as changing a color of a first object 42-1 in the digital reality scene 40 from a first color of orange to a second color of violet to reflect a decrease in the user's instantaneous heart rate. However, the disclosure is not limited in this respect.
[0204] Similarly, in some embodiments, engine 322 receives information from sensors in client device 300 and provides information from the sensors to client application 320. Thus, in some embodiments, application 320 uses the information to perform actions within the digital reality scene of application 320. In this manner, if engine 322 receives information from a sensor that a user has raised their hand, the simulated hand in digital reality scene 40 is raised to a corresponding height. However, the disclosure is not limited in this respect.
[0205] In some embodiments, engine 322 generates control signals for a haptic feedback mechanism, which in turn generates one or more haptic ques. As previously discussed, the information received by engine 322 may also include information from client device 300. For example, in some embodiments, one or more cameras located on client device 300 (e.g., input 310, I / O subsystem 330 of FIG. 3) capture movements of client device 300, and client application 320 can use this additional information to perform actions within digital reality scene 40 of client application 320.
[0206] In some embodiments, the engine 322 provides feedback to the user that an action has been performed. In some embodiments, the feedback provided is provided visually via the display 308 of the client device 300, audibly via one or more audio devices (e.g., the I / O subsystem 330) of the client device 300, and / or tactilely via one or more of the haptic feedback mechanisms of the client device 300.
[0207] Further details and information regarding the use of engines (e.g., digital reality session engine 38 of FIG. 2B, engine 322 of FIG. 3) may be found in U.S. Patent Application Publication No. 2018 / 0254097, entitled "Dynamic Multi-Sensory Simulation System for Effecting Behavior Change," filed March 5, 2018, U.S. Patent Application Publication No. 2020 / 0022632, entitled "Digital Content Processing and Generation for a Virtual Environment," filed July 16, 2019, and U.S. Patent Application Publication No. 2020 / 0023157, entitled "Dynamic Digital Content Delivery in a Virtual Environment," filed July 16, 2019. Each of these documents is incorporated herein by reference in its entirety for all purposes.
[0208] Each of the above identified modules and applications corresponds to a set of executable instructions for performing one or more of the functions and methods described herein. These modules (e.g., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and various subsets of these modules are optionally combined or rearranged in various embodiments of the present disclosure. In some embodiments, memory 312 optionally stores a subset of the modules and data structures identified above. Additionally, in some embodiments, memory 312 stores additional modules and data structures not previously described.
[0209] FIG. 3 is only one example of a client device 300, and it should be understood that the client device 300 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have a different configuration or arrangement of components. The various components shown in FIG. 3 may be implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing and / or application specific integrated circuits. Furthermore, the client device 300 may be a single device that includes all of the functionality of the client device 300. The client device 300 may also be a combination of multiple devices. For example, the functionality of the client device 300 may be distributed across any number of networked computers and / or may reside on each of several networked computers and / or may be hosted on one or more virtual machines and / or containers at remote locations accessible across a communications network (e.g., the communications network 106, the network interface 304, or both). However, those skilled in the art will appreciate that a wide range of different computer topologies are possible for the client device 300 and other devices and systems disclosed herein, and all such topologies are within the scope of the present disclosure.
[0210] 4A-4R, a flow chart is shown illustrating an exemplary method 400 according to some embodiments of the present disclosure. In this flow chart, preferred portions of the method are shown in solid lined boxes, and additional, optional, or alternative portions of the method are shown in dashed lined boxes. The method creates a therapy to improve a subject's ability to manage a psychiatric or mental condition exhibited by the subject. In particular, the method 400 implements an exposure progression that improves the subject's ability to manage the subject's psychiatric or mental condition. In various embodiments, the method 400 combines digital reality (e.g., one or more virtual reality scenes), biometric capture, digital reality interaction from the subject, and / or other elements to create or modify each subject's personalized exposure progression in a targeted and flexible manner. Thus, in some such embodiments, the present disclosure not only provides an exposure progression that is tailored to each subject, but also dynamically personalizes the timing and / or nature of the exposure progression as the subject interacts with the exposure progression. For example, in some embodiments, the present disclosure dynamically builds or modifies a personalized exposure progression based at least in part on the level of success a subject has in one or more social challenges.
[0211] In some embodiments, the method 400 obtains a plurality of categories for the subject, each category in the plurality of categories being associated with a corresponding plurality of suggested experiences, each suggested experience in the corresponding plurality of suggested experiences being associated with a corresponding digital reality scene that manifests the corresponding challenge. The method 400 shows, on the display, a first digital reality scene that manifests a first challenge designed for the first suggested experience of the first category. While the subject is completing the first challenge in the first digital reality scene, the method 400 obtains at least one biometric data element associated with the subject. In some embodiments, using the obtained biometric data element, the method 400 determines whether the subject has successfully completed the first challenge. In some embodiments, following a determination that the subject has successfully completed the first challenge, the method 400 determines whether the subject has successfully completed the first category. In some embodiments, following a determination that the subject has successfully completed the first category, the method 400 determines a second category in the plurality of categories for the subject to next perform. In this manner, method 400 implements an exposure progression to improve the subject's ability to manage their psychiatric or mental condition.
[0212] In some embodiments, the method 400 includes or provides a comparison of the acquired biometric data elements to a baseline for the subject or to a baseline for a population of users. By comparing the acquired biometric data elements to a baseline, the disclosed methods and systems can analyze changes in biometric measurements (e.g., heart rate) over time to assess the stress or anxiety, if any, the subject is experiencing throughout the assignment, exposure progress, and / or the entire program, or a combination thereof. In some embodiments, the disclosed methods and systems can evaluate one or more assessments and / or provide one or more recommendations per exposure progress per subject. However, the disclosure is not limited thereto.
[0213] Block 402. Referring to block 402, in various embodiments, the method 400 is provided in a computer system (e.g., system 100 of FIG. 1, digital reality system 200 of FIG. 2, client device 300 of FIG. 3, etc.) associated with a subject. The computer system includes one or more processors (e.g., CPU 202 of FIG. 2A, CPU 302 of FIG. 3, etc.), a display (e.g., display of client device 300), a number of sensors (e.g., sensor 110-1, sensor 110-2 of FIG. 1), and a memory (e.g., member 212 of FIG. 2A, memory 312 of FIG. 3, etc.) coupled to the one or more processors. The memory includes one or more programs configured to be executed by the one or more processors. Thus, in some such embodiments, the method 400 is not mentally executable, as it requires the use of a computer system, such as to present information to the subject.
[0214] Block 404. Referring to block 404, the display may be any suitable display. For example, in some embodiments, the display is a wearable display, such as display 308 of FIG. 13. Examples of wearable displays include, but are not limited to, smart watches, head-mounted displays, smart clothing, near-eye displays, and smart mobile device displays (e.g., smartphones), such as the displays of FIG. 13. In some embodiments, the display is a head-mounted display (HMD) that is connected to a host computer system, such as client device 300 of FIG. 3. In some embodiments, the display is a standalone HMD, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
[0215] Blocks 406-410. Referring to blocks 406-410, in some embodiments, the plurality of sensors includes at least one biometric sensor (e.g., sensor 110-1 of FIG. 1) configured to collect a measurable biometric signal associated with a physiological or psychological state of the subject. A biometric sensor in the at least one biometric sensor may be any suitable biometric sensor. Examples of suitable biometric sensors include, but are not limited to, a heart rate sensor, a heart rate variability sensor, an electrodermal activity sensor, a galvanic skin response sensor, an electroencephalogram sensor, an eye tracking sensor, a recorder, a microphone, a thermometer, and a camera. In some embodiments, a biometric sensor in the at least one biometric sensor is incorporated into or is a component of a wearable device, such as a watch, a wristband, a headset, a garment, a vest, a shirt, or other suitable device.
[0216] In some embodiments, a biometric sensor in the at least one biometric sensor is integrated into or is a component of a client device. For example, in some embodiments, a smartphone microphone is used to capture audio data when a smartphone is used as a client device. In some embodiments, a biometric sensor in the at least one biometric sensor communicates with one or more client devices such that data captured by the one or more sensors can be transmitted and / or aggregated in the one or more client devices. For example, in some embodiments, an eye tracking sensor configured to track eye movements is physically or wirelessly connected to the client device. In some embodiments, a biometric sensor in the at least one biometric sensor is in communication with the system, e.g., connected to the digital reality system 200 via the communication network 106, such that data captured by the one or more sensors can be transmitted and / or aggregated in the system. In some embodiments, a biometric sensor in the at least one biometric sensor communicates with one or more client devices and the digital reality system 200.
[0217] In some embodiments, the at least one biometric sensor consists of a single biometric sensor. In some embodiments, the at least one biometric sensor includes two, three, four, five or more biometric sensors, either of the same type or of different types. For example, as a non-limiting example, in some embodiments, the at least one biometric sensor includes two first biometric sensors located at different locations, e.g., one heart rate sensor located on the subject's wrist and another heart rate sensor located on the subject's arm. As another non-limiting example, in some embodiments, the at least one biometric sensor includes a first biometric sensor, e.g., a heart rate sensor for measuring the subject's heart rate, and a second biometric sensor different from the first biometric sensor, e.g., an eye tracking sensor for tracking the subject's eye movements. As further non-limiting examples, in some embodiments, the at least one biometric sensor includes one or more heart rate sensors, one or more heart rate variability sensors, one or more electrodermal activity sensors, one or more galvanic skin response sensors, one or more brainwave sensors, one or more eye tracking sensors, one or more recorders, one or more microphones, one or more thermometers, one or more cameras, or any combination thereof.
[0218] In some embodiments, the biometric sensor features other sensors and capabilities. A non-limiting example is a heart rate sensor that includes an accelerometer to collect additional data. Another non-limiting example is a mobile device that includes one or more cameras and / or microphones that can be used to capture facial expressions and / or record voice or speech.
[0219] The sensors may include other sensors, such as, but not limited to, in some embodiments, an accelerometer, a magnetometer, a proximity sensor, a gyroscope, an image capture device (e.g., a camera device or image capture module and associated components), a location module (e.g., a Global Positioning System (GPS) receiver or other navigation or geolocation system module / device and associated components), or combinations thereof.
[0220] In some embodiments, the plurality of sensors includes between 2 and 100, between 2 and 50, between 2 and 20, between 2 and 15, between 2 and 10, between 2 and 5, between 3 and 100, between 3 and 50, between 3 and 20, between 3 and 15, between 3 and 10, between 3 and 5, between 6 and 100, between 6 and 50, between 6 and 20, between 6 and 15, between 6 and 10, between 12 and 100, between 12 and 50, between 12 and 20, or between 12 and 15. In some embodiments, the plurality of sensors includes at least 2 sensors, at least 3 sensors, at least 4 sensors, at least 5 sensors, at least 6 sensors, at least 8 sensors, at least 10 sensors, at least 12 sensors, at least 15 sensors, at least 20 sensors, at least 25 sensors, at least 50 sensors, at least 75 sensors, or at least 100 sensors. In some embodiments, the plurality of sensors includes up to 2 sensors, up to 3 sensors, up to 4 sensors, up to 5 sensors, up to 6 sensors, up to 8 sensors, up to 10 sensors, up to 12 sensors, up to 15 sensors, up to 20 sensors, up to 25 sensors, up to 50 sensors, up to 75 sensors, or up to 100 sensors.
[0221] In some embodiments, the plurality of sensors includes continuous sensors configured to acquire an uninterrupted or recurring (e.g., periodic) stream of data elements from the subject. In some embodiments, the plurality of sensors includes passive sensors configured to acquire information from an environment associated with the subject. Further, in some embodiments, the plurality of sensors includes non-invasive sensors configured to acquire data elements from the subject without being introduced into the subject's body. Thus, in some such embodiments, method 400 can provide a subject-specific exposure progression based on information (e.g., data) provided by the plurality of sensors associated with the computer system, enabling the subject's performance to be improved.
[0222] Blocks 412-430. Referring to blocks 412-430, in some embodiments, the psychiatric or mental condition is a clinically diagnosed mental disorder or a subclinically diagnosed mental disorder. Examples of psychiatric or mental conditions include, but are not limited to, being stressed in a social environment, being afraid of a social environment, or being overwhelmed in a social environment. For example, in some embodiments, the clinically diagnosed mental disorder is an anxiety disorder, such as separation anxiety disorder, selective mutism, specific phobia, social anxiety disorder, panic disorder, agoraphobia, generalized anxiety disorder, substance-induced anxiety disorder, or an anxiety disorder due to the subject's medical condition. In some embodiments, the clinically diagnosed mental disorder is a mood disorder, such as a depressive disorder, a bipolar disorder, or a cyclothymic disorder. For example, in some embodiments, the depressive disorder is a major depressive disorder. In some embodiments, the clinically diagnosed mental disorder is a psychotic disorder, such as a schizophrenic disorder, a delusional disorder, or a hallucinatory disorder. In some embodiments, the clinically diagnosed mental disorder is an eating disorder, such as anorexia nervosa, bulimia nervosa, or binge eating disorder. In some embodiments, the clinically diagnosed mental disorder is an impulse control disorder, such as pyromania disorder, kleptomania disorder, or compulsive gambling disorder. In some embodiments, the clinically diagnosed mental disorder includes, but is not limited to, a personality disorder, an obsessive-compulsive disorder, or a post-traumatic stress disorder. In some embodiments, the clinically diagnosed mental disorder is an addictive disorder, such as an alcohol use disorder or a substance abuse disorder. In some embodiments, the clinically diagnosed mental disorder is a personality disorder, such as an antisocial personality disorder, an obsessive-compulsive personality disorder, or a paranoid personality disorder. However, the present disclosure is not limited thereto.
[0223] Block 432. Referring to block 432, in various embodiments, the method includes obtaining a plurality of categories of the subject. In some embodiments, each respective category of the plurality of categories is directed to improving the subject's ability to manage the subject's psychiatric or mental condition. Each respective category of the plurality of categories is associated with a corresponding set of suggested experiences, e.g., experiences 24-1, experiences 24-2, ..., and / or experiences 24-I, from the experience store 22 of the digital reality system 200. In some embodiments, each respective category of the plurality of categories is associated with a corresponding plurality of suggested experiences. Each respective category of the plurality of categories is also associated with at least one respective gating criterion of a plurality of gating criteria, e.g., gating criterion 32-1, gating criterion 32-2, ..., from the criteria store 30 of the digital reality system 200.
[0224] For each respective category of the plurality of categories, a corresponding set of suggested experiences or each respective suggested experience of the plurality of suggested experiences (e.g., experience 24-1) is associated with a corresponding digital reality scene (e.g., digital reality scene 40-1) of a corresponding plurality of digital reality scenes. The corresponding digital reality scene (e.g., digital reality scene 40-1) of the corresponding plurality of digital reality scenes manifests a corresponding challenge (e.g., challenge 26-1) in a corresponding plurality of challenges designed for the respective suggested experience of the respective category. For each respective category of the plurality of categories, a corresponding set of suggested experiences or each respective suggested experience of the plurality of suggested experiences (e.g., experience 24-1) is also associated with at least one biometric threshold of a plurality of biometric thresholds, e.g., biometric threshold 33-1, threshold 33-2, ..., from a reference store 30 of the digital reality system 200.
[0225] It should be noted that the plurality of categories may include any suitable number of categories. For example, in some embodiments, the plurality of categories includes at least a first category and a second category. In some embodiments, the plurality of categories includes at least a first category, a second category, and a third category. In some embodiments, the plurality of categories includes more than three categories, more than four categories, more than five categories, more than ten categories, or more than twenty categories. In some embodiments, the categories are directed to improving the subject's ability to manage a psychiatric or mental condition in social interaction and / or interaction anxiety (e.g., going to a party, meeting strangers), performance anxiety (e.g., reporting to a small group), observational phobia (e.g., writing while being observed), intake anxiety (e.g., eating and / or drinking), assertiveness anxiety (e.g., resisting a sale), or any combination thereof. However, the present disclosure is not limited thereto. In some embodiments, each respective category of the plurality of categories is directed to improving the subject's inherent ability to manage the subject's psychiatric or mental condition. For example, in some embodiments, the first category (e.g., the Exposure category) is associated with improving the subject's ability to face a conflict associated with the subject, such as a fear of inducing a conflict. In some embodiments, the second category (e.g., the CBT category) is associated with improving the subject's ability to restructure thoughts associated with the subject. In some embodiments, the third category (e.g., the CBT category) is associated with improving the subject's ability to use thoughts associated with the subject. In some embodiments, the fourth category (e.g., the CBT category) is associated with improving the subject's ability to get rid of thoughts associated with the subject.
[0226] In some embodiments, the plurality of obtained categories is a predetermined set of categories or a subset of the predetermined set of categories. In some embodiments, the plurality of obtained categories is selected by the subject, a physician associated with the subject, a model, or a combination thereof. For example, in some embodiments, the plurality of obtained categories is initially selected by the subject, and the first selection is refined by the physician and / or model to provide a second selection of categories. In some aspects, the plurality of obtained categories is adapted based on a psychiatric or mental condition exhibited by the subject. For example, consider a first user of the first client device 300-1 exhibiting a social anxiety disorder and a second user of the second client device 300-2 exhibiting an addictive disorder. The method 400 can obtain different plurality of categories for the first and second users, each plurality of categories being specific to a user based on a psychiatric or mental condition exhibited by the user.
[0227] The corresponding set of suggested experiences may include any suitable number of suggested experiences, such as 1, 2, 3, 4, 5, greater than 5, greater than 10, greater than 20, greater than 50, greater than 100 suggested experiences, etc. In some demonstrative embodiments, each respective category of the plurality of categories is associated with a corresponding plurality of suggested experiences, e.g., 2, 3, 4, 5, greater than 5, greater than 10, greater than 20, greater than 50, greater than 100 suggested experiences. In some embodiments, each respective category of the plurality of categories is associated with between 2 and 100 categories, between 2 and 50 categories, between 2 and 25 categories, between 2 and 10 categories, between 2 and 5 categories, between 3 and 100 categories, between 3 and 50 categories, between 3 and 25 categories, between 3 and 10 categories, between 3 and 5 categories, between 7 and 100 categories, between 7 and 50 categories, between 7 and 25 categories, between 7 and 10 categories, between 30 and 100 categories, or between 30 and 50 categories.
[0228] In some embodiments, different categories in the plurality of categories are associated with the same number of suggested experiences or different numbers of suggested experiences. For example, in some embodiments, the first category and the second category are associated with the same number of suggested experiences (e.g., 6), and the third category is associated with a different number of suggested experiences than the first and second categories (e.g., 8). In some embodiments, different categories in the plurality of categories are associated with completely different sets of suggested experiences or partially overlapping sets of suggested experiences. In other words, in some embodiments, the suggested experiences associated with one category are completely distinct from the suggested experiences associated with another category (e.g., no suggested experiences are associated with two different categories) or overlap with the suggested experiences associated with another category (e.g., at least one suggested experience is shared by two or more different categories). For example, as a non-limiting example, in some embodiments, the first category is associated with a first set of suggested experiences consisting of experience 24-1, experience 24-2, experience 24-3, and experience 24-4, and the second category is associated with a second set of suggested experiences consisting of experience 24-5, experience 24-6, and experience 24-7 from the experience store 22 of the digital reality system 200. In such embodiments, the experiences associated with the first category are not the same as the experiences associated with the second category. As another non-limiting example, in some alternative embodiments, the first category is associated with a first set of suggested experiences consisting of experience 24-1, experience 24-2, experience 24-3, and experience 24-4, and the second category is associated with a second set of suggested experiences consisting of experience 24-4, experience 24-5, and experience 24-6 from the experience store 22 of the digital reality system 200. In such embodiments, experience 24-4 is associated with both the first and second categories.
[0229] In some embodiments, the categories are associated with the first experience 24-1 and the second experience 24-2 of FIG. 2B. The first experience 24-1 is associated with a corresponding digital reality scene, e.g., the first digital reality scene 40-1, that manifests a corresponding challenge, e.g., the first challenge 26-1. Similarly, the second experience 24-2 is associated with a corresponding digital reality scene, e.g., the second digital reality scene 40-2, that manifests a corresponding challenge, e.g., the second challenge 26-2.
[0230] In some embodiments, the experience is associated with a digital reality scene that exhibits a challenge. For example, in some embodiments, the experience is an exposure experience, for example, of social interaction or interaction anxiety (e.g., meeting a stranger). In some embodiments, the experience is an exposure experience associated with a digital reality scene that exhibits a verbal / non-verbal performance challenge, such as performance by a subject in front of others or public speaking (e.g., reporting to a small group). In some embodiments, the experience is an exposure experience associated with a digital reality scene that exhibits a challenge of observation fear (e.g., writing while being observed). In some embodiments, the experience is an exposure experience associated with a digital reality scene that exhibits a challenge in intake anxiety (eating and / or drinking). By way of example, FIG. 5A and FIG. 5B show exemplary digital reality scenes for social challenge training.
[0231] In some embodiments, the experience is a CBT experience associated with a digital reality scene that demonstrates a challenge to collect evidence associated with the subject's thoughts. In some embodiments, the experience is a CBT experience associated with a digital reality scene that demonstrates a challenge to reconstruct the subject's thoughts. In some embodiments, the experience is a CBT experience associated with a digital reality scene that demonstrates a challenge to clear the subject's thoughts. In some embodiments, the experience is mindfulness associated with a digital reality scene that demonstrates a challenge to be actively present (e.g., the subject's ability to be fully present, aware of where they are and what they are doing, etc.).
[0232] In some embodiments, a category in the plurality of categories is associated with one or more experiences 24 directed to meeting strangers, e.g., at a wedding reception, at a home event, in a dating application, when going to school, etc. In some embodiments, a category in the plurality of categories is associated with one or more experiences 24 directed to interacting with people, e.g., participating in a small group at work, participating in a small group, making small talk with a neighbor, asking a coworker a question, receiving feedback from a manager, etc. In some embodiments, a category in the plurality of categories is associated with one or more experiences 24 directed to performing in front of people, e.g., making a presentation at work, giving a toast at a party, having a job interview, speaking in front of a class, etc.
[0233] In some embodiments, a category in the plurality of categories is associated with one or more experiences 24 directed to one or more exposure techniques, such as exposure therapy techniques. In some embodiments, through interaction with the exposure experiences of the exposure category, the subject is gradually confronted with one or more anxiety triggers associated with the subject. In some embodiments, for example, through exposure to social experiences over a period of time, the subject's anxiety may be reduced (e.g., as determined based on one or more data sets acquired by sensors and evaluated by a physician and / or a model of the present disclosure), building self-confidence, and expanding the scope of activity in a manner that improves the subject's performance.
[0234] For example, in some embodiments, an exposure category includes one or more social interaction experiences 24 that target performance in front of others. In some embodiments, an exposure category in a plurality of categories includes or is associated with one or more experiences 24 that target interaction anxiety (e.g., specific challenges 26 of meeting strangers), public speaking (e.g., specific challenges 26 of reporting to a small group), observational phobia (e.g., specific challenges 26 of writing while being observed), intake anxiety (e.g., specific challenges 26 of eating and / or drinking), or any combination thereof. As a non-limiting example, consider the interaction anxiety of meeting strangers. A non-limiting example of an exposure category configured for interaction anxiety of meeting a stranger includes a first proposed experience 24-1 in a corresponding first task 26-1 of making eye contact with an unfamiliar bartender when taking a drink from a bar, a second proposed experience 24-2 in a corresponding second task 26-2 of introducing oneself and saying something about oneself to a player character (e.g., another avatar) in a digital reality scene 40, and a third proposed experience 24-3 in a corresponding third task 26-3 of participating in an augmented or mixed digital reality scene 40. In other embodiments, an exposure category in a plurality of categories includes one or more experiences 24 targeting interaction anxiety (e.g., meeting a stranger), non-verbal performance anxiety (e.g., taking an exam), intake anxiety, public performance anxiety, assertiveness anxiety (e.g., resisting a high-handed salesman), or any combination thereof.In some embodiments, an exposure category in the plurality of categories includes one or more experiences 24 directed at interacting with strangers (e.g., speaking face-to-face with a person one does not know well, such as another non-player character or NPC in a digital reality scene), general performance (e.g., speaking clearly during a meeting, giving a prepared oral talk to a group, etc.), assertiveness (e.g., expressing disagreement or disapproval with a person one does not know well), or any combination thereof.
[0235] More specifically, in some embodiments, the corresponding tasks 26 of the proposed exposure experience 24 include a first task 26-1 of using a phone in public, a second task 26-2 of participating in a small group activity, a third task 26-3 of eating in public, a fourth task 26-4 of drinking with others, a fifth task 26-5 of speaking with someone in a position of authority, a sixth task 26-6 of acting, performing, or speaking in front of an audience, and a seventh task 26-7 of going to a party. 26-7, Working while being observed, Task 8; 26-8, Writing while being observed, Task 9; 26-9, Calling a stranger, Task 10; 26-10, Speaking face-to-face with a stranger, Task 11; 26-11, Meeting a stranger urinating in a public restroom, Task 12; 26-12, Entering a room when someone else is already sitting, Task 13; 26-13, Being the center of attention, Task 14; 26-14, Speaking clearly in a meeting, Task 16 Task 26-16, taking a test of ability, skill, or knowledge Task 17-16, expressing disagreement or disapproval with someone you don't know very well Task 18-18, looking someone you don't know very well directly in the eyes (e.g., maintaining eye contact) Task 90-26-19, giving a prepared oral talk to a group Task 20-26-20, attempting to get to know someone for a romantic and / or sexual relationship Task 21-26 26-21, a 22nd task 26-22 of returning an item to a store for a refund, a 23rd task 26-23 of having a party, a 24th task 26-24 of resisting a high-pressure salesman, or any subcombination thereof (e.g., any 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, or 22 of the foregoing tasks).
[0236] Further details and information regarding exposure therapy can be found in U.S. Provisional Patent Application No. 63 / 223,871, filed July 20, 2021, U.S. Provisional Patent Application No. 63 / 284,862, filed December 1, 2021, U.S. Provisional Patent Application No. 17 / 869,670, filed July 20, 2022, U.S. Provisional Patent Application No. 63 / 415,860, filed October 13, 2022, and U.S. Provisional Patent Application No. 63 / 415,876, filed October 13, 2022. Each of these documents is incorporated by reference herein in its entirety for all purposes.
[0237] In some embodiments, a category in the plurality of categories is associated with one or more experiences 24 directed to one or more CBT techniques, such as one or more cognitive reframing CBT techniques, one or more gathering evidence CBT techniques, one or more usefulness CBT techniques, or any combination thereof. In some embodiments, the one or more experiences for the CBT category include a task to identify a thought or statement or statements generated by the subject. In some aspects, the one or more experiences for the CBT category include a task to disrupt a first (e.g., native, initial, etc.) cognitive pattern associated with the formation of a negative thought or statement by the subject with a second (e.g., novel) cognitive pattern associated with the formation of a second thought or statement different from the first thought, such as a second positive or affirmative thought. In some embodiments, a CBT category in the plurality of categories includes one or more experiences directed to the implementation of a cognitive restructuring task within a digital reality scene. As a non-limiting example, in some embodiments, one or more experiences in the CBT category, when deemed completed by the subject, result in behavioral activation for the subject, and are conducted through long-term and short-term goal setting within the client application, such as within a digital reality scene shown via the client application. In some aspects, Acceptance and Commitment Therapy (ACT) and / or Behavioral Activation (BA) are forms of CBT techniques utilized within an experience in one or more experiences, providing particularly effective challenges for anxiety disorders and depression for use in the systems, methods, and devices of the present disclosure. However, the present disclosure is not limited thereto.
[0238] In some embodiments, the gather evidence experience for one or more CBT categories includes performing a cognitive restructuring task within the digital reality scene, including having the subject self-identify harmful or negative evidence for a thought spoken by the subject, having the subject, doctor, model, or any combination thereof evaluate whether the self-identified evidence is sufficient to restructure the thought, having the subject restructure the thought to improve the subject's psychiatric or mental condition, for example, by modulating the subject's harm expectancy and / or perception of control, or any combination thereof. In some embodiments, the one or more beneficial experiences for the CBT category include performing a cognitive restructuring task within the digital reality scene by having the subject, doctor, model, or any combination thereof identify core beliefs associated with the thought and relate the core beliefs to one or more short-term and / or long-term goals associated with the subject. In some embodiments, the one or more useful experiences for the CBT category include performing a cognitive restructuring task within the digital reality scene by having the subject, doctor, model, or any combination thereof identify core beliefs associated with anxious thoughts, such as statements captured from the subject by a recorder sensor of the client device. In some embodiments, the useful CBT experience includes performing a cognitive restructuring task within the digital reality scene by having the subject, doctor, model, or any combination thereof determine how helpful or harmful the core beliefs are in helping the subject achieve one or more short-term and / or long-term goals. In some embodiments, the one or more diffusion experiences for the CBT category include performing a cognitive restructuring task within the digital reality scene by having the subject repeat thoughts associated with the subject while speaking in third person within the digital reality scene.In some embodiments, the one or more diffuse experiences include performing a cognitive restructuring task within the digital reality scene by having the subject, physician, model, or any combination thereof determine whether anxiety-inducing thoughts or statements have a reduced or suppressed effect on the subject (e.g., lose their intensity) based on one or more data sets obtained from a sensor in the plurality of sensors (e.g., based on the subject's heart rate, based on characteristics of the subject's voice such as the subject's cadence).
[0239] Further details and information regarding the categories and / or types of experiences proposed can be found in Heimberg et al., 1999, Psychometric Properties of the Leibowitz Social Anxiety Scale,” Psychological Medicine, 29(1), pg. 199; Safren et al., 1999, “Factor Structure of Social Fears: The Liebowitz Social Anxiety Scale,” Journal of Anxiety Disorders, 13(3), pg. 253; Baker et al., 2002, “The Liebowitz Social Anxiety Scale as a Self-Report Instrument: A Preliminary Psychometric Analysis,” Behavior Research and Therapy, 40(6), pg. 701; Loenen I et al., “The Effectiveness of Virtual Reality Exposure-Based Cognitive Behavioral Therapy for Severe Anxiety Disorders, Obsessive-Compulsive Disorder, and Posttraumatic Stress Disorder: Meta-analysis,” J Med Internet Res. 2022 Feb 10;24(2); Wu et al., “Virtual Reality-Assisted Cognitive Behavioral Therapy for Anxiety Disorders: A Systematic Review and Meta-Analysis,” Front Psychiatry. 2021 Jul 23;12:575094; Garland et al., “Biobehavioral Mechanisms of Mindfulness as a Treatment for Chronic Stress: An RDoC Perspective,” Chronic Stress (Thousand Oaks). 2017 Feb., 1:2470547017711912; Hofmann et al., 2017, “Mindfulness-Based Interventions for Anxiety and Depression,” Psychiatr. Clin. North Am., 40(4), pg. 739-749; Creswell et al., “Mindfulness Training and Physical Health: Mechanisms and Outcomes,” Psychosom Med. 2019 Apr, 81(3):224-232; Seabrook et al., “Understanding How Virtual Reality Can Support Mindfulness Practice: Mixed Methods Study.” J Med Internet Res. 2020 Mar 18, 22(3); Navarro-Haro et al., “Meditation experts try Virtual Reality Mindfulness: A pilot study evaluation of the feasibility and acceptability of Virtual Reality to facilitate mindfulness practice in people attending a Mindfulness conference,” PLoS One. 2017 Nov 22, 12(11); Chandrasiri et al., “A virtual reality approach to mindfulness skills training,” Virtual Reality 24, 143-149 (2020); Bluett et al., 2014, “Acceptance and commitment therapy for anxiety and OCD spectrum disorders: an empirical review,” J Anxiety Disord., 28(6), pg. 612-24; Zawn et al., 2021, “What is behavioral activation?,” Medical News Today, October 24, 2021; Celik et al., “Acrophobia treatment with virtual reality-assisted acceptance and commitment therapy: two case reports,” 2020; Paul et al., “Virtual Reality Behavioral Activation as an Intervention for Major Depressive Disorder: Case Report,” JMIR mental health, 7(11), 2020. Each of these documents is incorporated herein by reference in its entirety for all purposes. By using these previously described different limited types of proposed experiences (e.g., interactive, performative, and / or assertive), subjects can more easily follow and track their progress in therapy 20. Further, in some embodiments, different types of suggested experiences are configured for each psychiatric or mental condition. For example, in some embodiments, an addictive disorder condition requires the use of a first experience, while a social anxiety disorder condition requires the use of a second experience that is different from the first experience. However, the present disclosure is not limited in this respect.
[0240] Blocks 434-436. Referring to blocks 434-436, in some embodiments, at least one gating criterion is set by a system administrator (e.g., an administrator of the digital reality system 200), a model or algorithm, a user (e.g., a subject), a physician associated with the subject, or any combination thereof. For example, in some embodiments, the gating criterion is set by a system administrator configuring a gating criterion that is contingent on receipt of payment from the subject (e.g., for access to the digital reality system 200, access to a particular digital reality scene 40, etc.). However, the disclosure is not limited thereto, and one of ordinary skill in the art of the disclosure would understand that other respective gating criteria set by a system administrator are within the scope of the disclosure. In some embodiments, the gating criterion set by the system is a geographic gating criterion, imposing a geographic restriction on utilizing the systems, methods, and devices of the disclosure within one or more geographic regions, for example, by restricting a subject and / or physician from using the system if outside a first geographic region. However, the disclosure is not limited thereto.
[0241] In some embodiments, the gating criteria is set by the subject (e.g., a user of the first client device 300-1). For example, in some embodiments, the gating criteria is a number of short-term goals achieved by the subject, a number of reframed thoughts by the subject, a number of exposure tasks completed by the subject, a period of time interacting with the digital reality scene, or a combination thereof.
[0242] In some embodiments, the gating criteria are set by a medical professional, such as a physician, associated with the subject (e.g., a user of the second client device 300-2, via the client application 320). In some embodiments, the gating criteria of the first category are set by a system administrator or medical professional associated with the subject, and the gating criteria of the second category are set by the subject.
[0243] In some embodiments, the at least one gating criterion is further modified by a physician associated with the subject or model based on the classification, clustering, or other parameters associated with the user that indicate that modifying the respective gating criterion in the at least one gating criterion would improve the likelihood of engagement and / or better clinical outcome. For example, in some embodiments, the physician associated with the subject or model based on the classification modifies a first gating criterion associated with a framed thought threshold that must be met by the subject, a second gating criterion associated with an exposure challenge threshold that must be met by the subject, etc.
[0244] Blocks 438-448. Referring to blocks 438-448, in some embodiments, at least one respective gating criterion associated with a respective category includes a ranking gating criterion. In some embodiments, the ranking gating criterion is associated with a hierarchical ranking of each category in the plurality of categories. In some embodiments, the ranking gating criterion includes a subjective rating from highest to lowest (e.g., a user-provided rating of "mild," "moderate," "severe," or "no reaction"), an objective rating from highest to lowest (e.g., a ranking from most effective to least effective as determined by the digital reality system 200 or a physician associated with the subject), or a combination thereof. In some embodiments, each category in the hierarchical ranking is a weakly ordered ranking or a total preorder ranking, such as a competition ranking, a crowded ranking, an ordinal ranking, a fractional ranking, or a combination thereof. For example, in some embodiments, the first ranking gate criterion is ranked higher than the second ranking gate criterion, lower than the second ranking gate criterion, or equally to the second ranking gate criterion.
[0245] In some embodiments, at least one respective gating criterion associated with each category includes a difficulty gating criterion. The difficulty gating criterion is associated with a complexity or level of demand required by the subject to complete the respective challenge. For example, in some embodiments, based on the respective age of the subject, the difficulty gating criterion modifies how one or more NPC characters of the digital reality scene engage with the subject, such as how the tone and / or speech of the NPC characters are used to address the subject within the digital reality scene. However, the disclosure is not limited thereto. In some embodiments, the difficulty gating criterion is utilized to determine whether a level of interaction with the digital reality scene by the subject, such as a degree of interaction or supervision by a physician, is required to progress through the exposure progression.
[0246] In some embodiments, at least one respective gating criterion associated with each category includes a physician gating criterion. The physician gating criterion is associated with approval from a physician associated with the subject. In this manner, a physician associated with the subject can provide oversight toward improving a psychiatric or mental condition exhibited by the subject by approving or denying access to the categories and the proposed experiences associated with the categories. For example, a physician can deny a particular user access to a particular category and a particular proposed experience until the physician believes the user is "ready" for the particular category and the proposed experience.
[0247] In some embodiments, at least one respective gating criterion associated with each respective category includes a user gating criterion. In some embodiments, the user gating criterion is associated with an approval or confirmation of the selection of the category from the subject. In this manner, the user can be actively involved in the selection of a particular category to work with or reject the category if the user feels unprepared for the particular category and one or more proposed experiences associated with the particular category.
[0248] In some embodiments, the gating criteria sets conditions for determining whether a category has been successfully completed and / or for identifying one or more subsequent categories for the subject to complete. In some embodiments, the gating criteria sets conditions precedent to the execution of a category or conditions that must be achieved to consider a category completed. A non-limiting example of a precedent condition is a requirement that some categories (e.g., a first category) be successfully completed before the user is allowed to invoke a particular category (e.g., a second category). For example, in some embodiments, a first precedent condition is a requirement that a first tutorial category be successfully completed before the user is allowed to invoke a second category that is different from the first tutorial category. Another non-limiting example of a condition that must be achieved to consider a category completed is a minimum number of proposed experiences associated with a category that must be successfully completed.
[0249] In some embodiments, at least one respective gate criterion associated with a respective category includes an arrangement gate criterion. The arrangement gate criterion is associated with an order of one or more categories in a plurality of categories, such as an order of one or more categories in a sequence of categories that form a story or common narrative thread. For example, consider a set of three categories A, B, and C that form a story or common narrative thread. To realize the story or common narrative thread in the correct order of A, B, then C, a first arrangement gate criterion is imposed on B that requires A to be completed before B can be started, and a second arrangement gate criterion is imposed on C that requires both A and B to be completed before C can be started.
[0250] Blocks 450-452. Referring to blocks 450-452, the corresponding digital reality scene may be a virtual reality scene, an augmented reality scene, or a mixed reality scene. For example, in some embodiments, the corresponding digital reality scene is a virtual reality scene that facilitates full digital immersion and considers one or more digital objects (e.g., object 42 of FIG. 2B) in a digital space (e.g., a three-dimensional digital space). In some alternative embodiments, the corresponding digital reality scene is an augmented reality scene that shows an augmentation of the real world using digital objects. In other embodiments, the corresponding digital reality scene is a mixed reality scene 40 that provides spatial mapping and contextualization of data in real time and considers one or more digital objects in a digital space that are correlated to a user space (e.g., the field of view of the user or client device 300). Additional details and information regarding types of digital reality scenes can be found in Parveau et al., 2018, 3iVClass: A New Classification Method for Virtual, Augmented and Mixed Realities,” Procedia Computer Science, 141, pg. 263, which is incorporated by reference in its entirety for all purposes. Thus, presenting the challenge within a digital reality scene immerses the subject in the experience, improving the interaction between the subject and the systems and methods of the present disclosure and improving the subject's performance.
[0251] Block 454. Referring to block 454, in some embodiments, the respective biometric threshold (e.g., biometric threshold 33-1) of each proposed experience (e.g., experience 24-1) in the plurality of proposed experiences is set by a system administrator, the subject, a medical professional associated with the subject, a model or algorithm, or any combination thereof. For example, as a non-limiting example, in some embodiments, the biometric threshold of the proposed experience, such as a maximum heart rate threshold, is set by the subject (e.g., a user of the first client device 300-1). As another non-limiting example, in some embodiments, the biometric threshold of the proposed experience is set by a medical professional (e.g., a doctor) associated with the subject, for example, by configuring a threshold voice feature that must be met by the subject. As yet another non-limiting example, in some embodiments, the biometric threshold of a first proposed experience (e.g., experience 24-1) in the plurality of proposed experiences is set by the subject, and the biometric threshold of a second proposed experience (e.g., experience 24-2) in the plurality of proposed experiences is set by a medical professional associated with the subject. In some embodiments, the biometric threshold of the proposed experience is further modified by a physician associated with the subject or model based on classification, clustering, or other parameters associated with the user that indicate modifying the biometric threshold would improve the likelihood of engagement and / or better clinical outcome.
[0252] In some embodiments, the biometric threshold at least partially sets a condition for determining whether a task associated with the proposed experience has been successfully completed and / or a condition for identifying a subsequent task / experience for the subject to complete. In some embodiments, the biometric threshold at least partially sets a prerequisite condition for executing the digital reality scene associated with the proposed experience, or a condition that must be achieved to consider a task / experience completed. A non-limiting example of a prerequisite condition is a requirement that several tasks (e.g., attending a small party, reframing thoughts, determining the usefulness of core beliefs, etc.) be successfully completed before the subject is allowed to invoke a particular task (e.g., speaking in front of a large audience, clearing thoughts, etc.). A non-limiting example of a condition that must be achieved to consider a task completed is a minimum length (e.g., sustained for a period of time) of eye contact with a specified portion of the corresponding digital reality scene associated with the corresponding task. Another non-limiting example of a condition that must be achieved to consider a task completed is a threshold mean square of a data set captured by a recorder, such as displaying a continuous output of the subject's voice. Yet another non-limiting example of a condition that must be achieved to deem a task complete is a threshold audio entropy, which describes the capacity of audio features obtained from a subject, such as the amount of information carried by the audio features. Block 458. Referring to block 458, the biometric threshold may be an absolute parameter, a relative parameter, a normalized parameter, or the like. For example, in some embodiments, the biometric threshold of the experience is an absolute parameter. Non-limiting examples of absolute biometric thresholds include, but are not limited to, a minimum number of utterances required of the subject while the subject is completing a corresponding task of the experience, a minimum decibel level of one or more utterances that the subject can hear, a minimum length of eye contact required of the subject while the subject is completing a corresponding task of the experience, a threshold spectral entropy of a voice feature (e.g., a measure of irregularity of a voice feature), a threshold PDF entropy of a voice feature (e.g., a measure of stability of a voice feature), or combinations thereof. In some embodiments, the biometric threshold of the experience is a parameter relative to, for example, an individual subject's baseline or to a population baseline. A non-limiting example of a relative biometric threshold is a change in decibel level (e.g., decibel level when speaking without pressure) relative to a subject's decibel level baseline to determine a reduction in subjective anxiety or an improvement in a biometric measure achieved by a subject during a corresponding task of the experience. Another non-limiting example of a relative biometric threshold is a condition for determining whether a subject has reached a relaxed state based on a subject's heart rate relative to a baseline heart rate of the subject or population indicative of a relaxed state. Yet another non-limiting example of a relative biometric threshold is a condition for determining whether a subject has reached a relaxed state based on a PDF entropy of a voice feature obtained from the subject using a recorder relative to a baseline PDF entropy of the subject or population indicative of a relaxed state. In some embodiments, the biometric threshold of the experience is a normalized parameter, such as assertiveness based on a scale. In some embodiments, the biometric threshold of the experience includes a combination of absolute parameters, relative parameters, and / or normalized parameters. However, the disclosure is not limited thereto.
[0253] Block 460. Referring to block 460, biometric thresholds may be set for various biometric measurements. Examples of biometric thresholds include, but are not limited to, eye contact thresholds, heart rate thresholds, assertiveness thresholds, decibel level thresholds, pitch thresholds, speech thresholds, word thresholds, emotion criteria, etc.
[0254] Block 462. Referring to block 462, in some embodiments, the biometric threshold for the proposed experience is an eye contact threshold. In some embodiments, the eye contact threshold comprises a threshold length of eye contact, e.g., a minimum eye contact duration, to a subject in a corresponding digital reality scene that manifests a corresponding challenge designed for the proposed experience. In some embodiments, the threshold length of eye contact is at least 2 seconds, at least 3 seconds, at least 5 seconds, at least 10 seconds, or at least 30 seconds. In some embodiments, the threshold length of eye contact is at most 2 seconds, at most 3 seconds, at most 5 seconds, at most 10 seconds, or at most 30 seconds. In some embodiments, the threshold eye contact is between 2 seconds and 30 seconds, between 2 seconds and 10 seconds, between 3 seconds and 30 seconds, between 3 seconds and 10 seconds, between 4 seconds and 30 seconds, between 4 seconds and 10 seconds, between 5 seconds and 30 seconds, or between 5 seconds and 10 seconds. Alternatively, optionally, or additionally, in some embodiments, the biometric threshold of the proposed experience includes an increment of eye contact to a subject in a corresponding digital reality scene that is indicative of a corresponding challenge designed for the proposed experience, e.g., an increased length of eye contact compared to the subject's eye contact baseline. In some embodiments, the increment of eye contact is at least 1 second, at least 2 seconds, at least 3 seconds, at least 5 seconds, or at least 10 seconds. In some embodiments, the increment of eye contact is at most 1 second, at most 2 seconds, at most 3 seconds, at most 5 seconds, or at most 10 seconds. In some embodiments, the increment of eye contact is between 1 second and 10 seconds, between 1 second and 5 seconds, between 2 seconds and 10 seconds, between 2 seconds and 5 seconds, between 3 seconds and 10 seconds, between 3 seconds and 5 seconds, between 4 seconds and 10 seconds, or between 4 seconds and 5 seconds.
[0255] In some embodiments, the required minimum length of eye contact and / or the required increment of eye contact are associated with a portion of the corresponding digital reality scene of the proposed experience. For example, and by way of non-limiting example, in the digital reality scene shown in FIG. 5A, the required minimum length of eye contact and / or the required increment of eye contact are associated with a portion of the digital reality scene in which the subject is engaged (e.g., talking) with a player character, e.g., object 42-1. In the digital reality scene shown in FIG. 5B, the required minimum length of eye contact and / or the required increment of eye contact are associated with a portion of the digital reality scene in which the subject is engaged (e.g., talking) with a player character, e.g., object 42-2.
[0256] Block 464. Referring to block 464, in some embodiments, the biometric threshold of the proposed experience includes a heart rate threshold that is indicative of a corresponding challenge designed for the proposed experience. In some embodiments, the heart rate threshold includes a maximum heart rate, e.g., a maximum beats per minute (bpm), for a subject in a corresponding digital reality scene that is indicative of a corresponding challenge designed for the proposed experience. In some embodiments, the threshold heart rate is, e.g., at most 200 bpm, at most 190 bpm, at most 180 bpm, at most 170 bpm, at most 160 bpm, at most 150 bpm, at most 140 bpm, at most 130 bpm. In some embodiments, the threshold heart rate is, e.g., at least 200 bpm, at least 190 bpm, at least 180 bpm, at least 170 bpm, at least 160 bpm, at least 150 bpm, at least 140 bpm, at least 130 bpm, etc. In some embodiments, for example, the threshold heart rate is between 55 bpm and 100 bpm, between 90 bpm and 120 bpm, between 105 bpm and 140 bpm, between 120 bpm and 120 bpm, between 135 bpm and 180 bpm, or between 150 bpm and 200 bpm.
[0257] Alternatively, optionally, or additionally, in some embodiments, the biometric threshold of the proposed experience includes a reduction in heart rate for the subject in the corresponding digital reality scene that manifests the corresponding challenge designed for the proposed experience, e.g., a reduced heart rate per minute compared to the subject's heart rate baseline. In some embodiments, the reduction in heart rate is, e.g., at least 2 bpm, at least 4 bpm, at least 6 bpm, at least 8 bpm, at least 10 bpm, at least 15 bpm, at least 20 bpm, at least 25 bpm, at least 30 bpm, at least 40 bpm, at least 50 bpm. In some embodiments, the reduction in heart rate is, e.g., at most 2 bpm, at most 4 bpm, at most 6 bpm, at most 8 bpm, at most 10 bpm, at most 15 bpm, at most 20 bpm, at most 25 bpm, at most 30 bpm, at most 40 bpm, at most 50 bpm. In some embodiments, the decrease in heart rate is between 2 bpm and 50 bpm, between 2 bpm and 40 bpm, between 2 bpm and 30, between 2 bpm and 20, between 2 bpm and 10 bpm, between 2 bpm and 5 bpm, between 4 bpm and 50 bpm, between 4 bpm and 40 bpm, between 4 bpm and 30 bpm, between 4 bpm and 20 bpm, between 4 bpm and 10 bpm, between 4 bpm and 5 bpm, between 7bpm and 50bpm, between 7bpm and 40bpm, between 7bpm and 30bpm, between 7bpm and 20bpm, between 7bpm and 10bpm, between 15bpm and 50bpm, between 15bpm and 40bpm, between 15bpm and 30bpm, between 15bpm and 20bpm, between 25bpm and 50bpm, between 25bpm and 40bpm, or between 25bpm and 30bpm.
[0258] Blocks 466-472. Referring to blocks 4666-472, in some embodiments, the biometric thresholds for the proposed experience include assertiveness, decibel level, pitch, or a combination thereof, of one or more utterances by the subject in a corresponding digital reality scene that manifests a corresponding challenge designed for the proposed experience. In some embodiments, similar to the eye contact threshold and / or heart rate threshold, the assertiveness threshold may include an absolute assertiveness threshold, a relative assertiveness threshold, or both. The decibel level threshold may include an absolute decibel level threshold, a relative decibel level threshold, or both. The pitch threshold may include an absolute pitch threshold, a relative pitch threshold, or both. The relative assertiveness, decibel level, or pitch threshold sets the conditions for determining an improvement achieved by the subject during the corresponding challenge compared to the subject's baseline.
[0259] In some embodiments, the absolute assertiveness threshold is represented, for example, by a score, e.g., 50 on a scale of 1 to 100, or by a range having a lower threshold and a higher threshold, e.g., 40 to 60 on a scale of 1 to 100. In some embodiments, statements having a score above the absolute assertiveness threshold indicate that the subject is making statements with assertiveness or confidence. In some embodiments, the relative assertiveness threshold is the increase or decrease in assertiveness required compared to the subject's assertiveness baseline, and is set, for example, at 2, 3, 4, 5, 10, 15, 20, etc.
[0260] In some embodiments, the absolute decibel level threshold is indicated by a range having a lower decibel level threshold and an upper decibel level threshold, e.g., 30-85 dB, 40-80 dB, 50-70 dB, etc. Speech at decibels below the lower decibel level threshold is not loud enough to be heard, and speech at decibel levels above the upper decibel level threshold is too loud. Generally, 0 dB is the minimum sound level that a person with good hearing can hear. 130 dB is the point at which a sound becomes harsh. A quiet whisper may produce a sound at a decibel level of about 30 dB. A normal conversation may produce a sound at a decibel level of about 60 dB. Loud singing may produce a sound at a decibel level of about 70 dB.
[0261] In some embodiments, the relative decibel level threshold is the required increase or decrease in decibel level compared to the subject's decibel level baseline. In some embodiments, the relative decibel level threshold is, for example, at least 1 dB, at least 2 dB, at least 3 dB, at least 4 dB, at least 5 dB, at least 6 dB, at least 7 dB, at least 8 dB, at least 9 dB, at least 10 dB. In some embodiments, the relative decibel level threshold is, for example, at most 1 dB, at most 2 dB, at most 3 dB, at most 4 dB, at most 5 dB, at most 6 dB, at most 7 dB, at most 8 dB, at most 9 dB, at most 10 dB. For example, for a subject who normally speaks too quietly, the relative decibel level threshold sets the condition for the subject to increase the decibel level. For example, for another subject who normally speaks too loudly, the relative decibel level threshold sets the condition for the subject to decrease the decibel level.
[0262] In some embodiments, the absolute pitch threshold is indicated by a range having a lower pitch threshold and an upper pitch threshold, e.g., 0.1 kHz to 15 kHz, 0.3 kHz to 10 kHz, 0.5 kHz to 5 kHz, etc. In some embodiments, the relative pitch threshold is the required increase or decrease in pitch compared to the subject's pitch baseline. In some embodiments, the relative pitch threshold is, for example, at least 10 Hz, at least 20 Hz, at least 30 Hz, at least 40 Hz, at least 50 Hz, at least 60 Hz, at least 70 Hz, at least 80 Hz, at least 90 Hz, at least 100 Hz, at least 150 Hz, at least 200 Hz, at least 250 Hz, at least 300 Hz. In some embodiments, the relative pitch threshold is, for example, at most 10 Hz, at most 20 Hz, at most 30 Hz, at most 40 Hz, at most 50 Hz, at most 60 Hz, at most 70 Hz, at most 80 Hz, at most 90 Hz, at most 100 Hz, at most 150 Hz, at most 200 Hz, at most 250 Hz, at most 300 Hz. For example, for a subject who normally speaks in a low pitch, the relative pitch threshold sets a condition for the subject to increase the pitch. For example, for a subject who normally speaks in a high pitch, the relative pitch threshold sets a condition for the subject to decrease the pitch.
[0263] In some embodiments, the pitch threshold and the decibel level threshold are correlated with each other, for example, based on the hearing sensitivity of human hearing. Generally, the human ear perceives frequencies between 20 Hz (lowest pitch) and 20 kHz (highest pitch). However, the hearing sensitivity of the human ear varies with frequencies between 20 Hz and 20 kHz. For example, at about 2 kHz, a good ear can hear sounds with decibel levels between 0 dB and 120 dB. At lower and higher frequencies, the hearing sensitivity narrows. For example, at frequencies close to 20 Hz, the human ear can generally hear sounds with decibel levels between 80 dB and 100 dB, and at frequencies close to 20 kHz, the human ear can generally hear sounds with decibel levels between 60 dB and 80 dB. Taking hearing sensitivity into account, in some embodiments, the decibel level thresholds are set to have a relatively large range or increment when the pitch threshold is about 1 kHz to 2 kHz, and a relatively small range or increment when the pitch threshold is less than kHz or greater than 2 kHz. However, the present disclosure is not limited thereto. For example, in some embodiments, the pitch threshold and the decibel level thresholds are set independently of each other, with or without taking hearing sensitivity into account.
[0264] Blocks 474-476. Referring to blocks 474-476, in some embodiments, the biometric threshold of the proposed experience includes an utterance threshold for the subject in the corresponding digital reality scene that manifests a corresponding challenge designed for the proposed experience. In some embodiments, the utterance threshold includes an absolute utterance threshold expressed as a range having a minimum utterance number and a maximum utterance number. Generally, the minimum utterance number sets a condition that encourages the subject to utter, and the maximum utterance number sets a condition that discourages the subject from relentlessly uttering. In some embodiments, the threshold number of utterances is at least 2 utterances, at least 3 utterances, at least 5 utterances, at least 10 utterances, or at least 30 utterances. In some embodiments, the threshold number of utterances is at most 100 utterances, at most 90 utterances, at most 70 utterances, or at most 60 utterances. In some embodiments, the threshold number of utterances is between 2 utterances and 100 utterances, between 2 utterances and 80 utterances, between 2 utterances and 50 utterances, between 2 utterances and 20 utterances, between 2 utterances and 10 utterances, between 5 utterances and 100 utterances, between 5 utterances and 80 utterances, between 5 utterances and 50 utterances, between 5 utterances and 20 utterances, between 5 utterances and 10 utterances, between 15 utterances and 100 utterances, between 15 utterances and 80 utterances, between 15 utterances and 50 utterances, between 15 utterances and 20 utterances, between 35 utterances and 100 utterances, between 35 utterances and 80 utterances, or between 35 utterances and 50 utterances.
[0265] Alternatively, optionally, or additionally, in some embodiments, the speech threshold comprises a relative speech threshold in the corresponding digital reality scene that manifests a corresponding challenge designed into the proposed experience, e.g., an increase or decrease in speech compared to the subject's speech baseline. In some embodiments, the relative speech threshold is at least 1 speech, at least 2 speeches, at least 3 speeches, at least 5 speeches, at least 10 speeches, at least 15 speeches, or at least 20 speeches. For example, for a subject who tends to be quiet when nervous, the relative speech threshold prompts the subject to speak more. For example, for a subject who tends to talk incessantly when nervous, the relative speech threshold prompts the subject to speak less.
[0266] In some embodiments, the biometric thresholds for the proposed experience include word thresholds for the subject in a corresponding digital reality scene that manifest a corresponding challenge designed for the proposed experience. Similar to the utterance thresholds, in some embodiments, the word thresholds include absolute word thresholds represented by ranges having minimum and maximum word counts, and / or relative word thresholds that require an increase or decrease in word count compared to the subject's word baseline.
[0267] Block 478. Referring to block 478, in some embodiments, the biometric threshold of the proposed experience is the satisfaction or failure of a sentiment analysis criterion by the subject during the corresponding digital reality scene that manifests a corresponding challenge designed for the proposed experience. In some embodiments, the sentiment analysis criterion includes an excited sentiment threshold and an over-excited sentiment threshold. However, the disclosure is not limited thereto. For example, in some embodiments, the sentiment analysis criterion is utilized to determine a change in sentiment when comparing a first thought or statement obtained from the subject to a second thought or statement obtained from the subject, such as a change from neutral sentiment to positive sentiment, a change from neutral sentiment to negative sentiment, or a change from negative sentiment to positive sentiment. In some embodiments, the sentiment analysis criterion is associated with a determination that a thought or statement associated with the subject is further associated with the first sentiment. In some embodiments, the first sentiment is an all-or-nothing sentiment, an overgeneralizing sentiment, a filter sentiment, a disqualifying positive sentiment, a mind-reading sentiment, a catastrophizing sentiment, an emotional reasoning sentiment, a labeling sentiment, a personalization sentiment, or a combination thereof.
[0268] In some embodiments, all-or-nothing sentiments are associated with thoughts or statements from subjects describing a binary (e.g., black and white) categorization by the subject. In some embodiments, overgeneralization sentiments are associated with thoughts or statements from subjects describing a unique event as a never-ending event, or a patterned event. In some embodiments, filter sentiments are associated with thoughts or statements from subjects over-describe a single detail. In some embodiments, disqualifying positive sentiments are associated with thoughts or statements from subjects describing a rejection of a positive vent. In some embodiments, mind-reading sentiments are associated with thoughts or statements from subjects describing any third-party description associated with the subject. In some embodiments, catastrophizing sentiments are associated with thoughts or statements from subjects describing an exaggeration of aspects of an event. In some embodiments, emotional reasoning sentiments are associated with thoughts or statements from subjects describing a depiction of an internal emotion with an external characteristic. In some embodiments, labeling sentiments are associated with thoughts or statements from subjects describing the attachment of one or more labels to a behavior by a subject. In some embodiments, the personalization sentiment is associated with a thought or statement from the subject that describes the subject as responsible or responsible for the behavior. However, the present disclosure is not limited thereto. Further details and information regarding the sentiments of the present disclosure can be found in Burns et al., 1981, "Feeling Good: The New Mood Therapy," New York, pg. 393, print, which is incorporated herein by reference in its entirety for all purposes.
[0269] It should be noted that in some embodiments, even for the same type of biometric threshold, the biometric thresholds for different experiences may be different. For example, as a non-limiting example, assume that a first proposed experience is associated with a first digital reality scene for an exposure category, where the subject is speaking, face-to-face, with one person in a private setting. A second proposed experience for the exposure category is associated with a second digital reality scene, where the subject is speaking in front of an audience at a party with background noise. In such an embodiment, the decibel level threshold of the second proposed experience may generally be higher than the decibel level threshold of the first proposed experience. For example, the decibel level threshold of the second proposed experience may be 60-80 dB, and the decibel level threshold of the first proposed experience may be 40-60 dB. However, the present disclosure is not limited thereto.
[0270] It should also be noted that the biometric thresholds of the same experience may be different for different subjects. For example, as a non-limiting example, assume that a first subject and a second subject are involved in the same exposure (e.g., social) task, such as having a job interview. The first subject tends to be quiet when nervous, whereas the second subject tends to talk incessantly, with an elevated (e.g., increased) heart rate and / or a change in pitch when nervous. In such an embodiment, the biometric thresholds (absolute and / or relative thresholds) for the first subject and the second subject may generally be different. For example, the speech threshold for the first subject may be set to encourage the first subject to speak more, whereas the speech threshold for the second subject is set to encourage the second subject to speak less.
[0271] It should further be noted that the biometric threshold of experience may be reset or altered by the subject, a medical professional associated with the subject, a model / algorithm, or any combination thereof. For example, and by way of non-limiting example, assume that a subject engages in a social challenge for a second time (e.g., after a first attempt at a social challenge in the exposure category) after undergoing some educational or therapeutic challenges (e.g., mindfulness and / or cognitive reframing challenges) and achieving some improvement in managing a psychiatric or mental condition. The biometric threshold of experience when the subject engages with the corresponding challenge may be reset or altered according to the progress the subject has made.
[0272] Block 480. Referring to block 480, the method includes presenting on a display a first digital reality scene that manifests a first challenge designed for a first proposed experience of a first category. For example, as a non-limiting example, in some embodiments, the method presents on a display a first digital reality scene 40-1. The first digital reality scene 40-1 manifests a first challenge 26-1 (e.g., fear) designed for the first experience 24-1. In some embodiments, the challenge is specific to the experience. However, the disclosure is not limited in this respect.
[0273] The first digital reality scene may be any suitable type of digital reality scene, including, but not limited to, a virtual reality scene, an augmented reality scene, or a mixed reality scene. In some embodiments, the first digital reality scene depends on the type of display of the respective client device 300. For example, in some embodiments, for a first client device 300-1 having processing capabilities to display a virtual reality scene, the first digital reality scene is a virtual reality scene. For a second client device 300-1 having processing capabilities to display an augmented reality scene, the first digital reality scene is an augmented reality scene. In some embodiments, the first digital reality scene depends on the type of experience. For example, the first experience is associated with a virtual reality scene and the second experience is associated with an augmented reality scene. In some embodiments, the first digital reality scene depends on the type of challenge. For example, the first challenge is associated with a virtual reality scene and the second challenge is associated with a mixed reality scene.
[0274] Block 482. Referring to block 482, the method includes (C) in cooperation with the presenting (B), acquiring a plurality of data elements from all or a subset of the sensors in the plurality of sensors (e.g., sensor 110-1, sensor 110-2, ... of FIG. 1). The subset of sensors includes at least one biometric sensor (e.g., sensor 110-1). The at least one biometric sensor is configured to capture at least one biometric data element associated with the subject while the subject completes the first task in the first digital reality scene. In some embodiments, the at least one biometric sensor includes, but is not limited to, a heart rate sensor, a heart rate variability sensor, a blood sensor, an electrodermal activity sensor, a galvanic skin response sensor, an electroencephalogram sensor, an eye tracking sensor, a recorder, a microphone, a thermometer, a heat map sensor, a camera, or any combination thereof. For example, in some embodiments, at least one biometric sensor including a recorder, microphone, camera, or combination thereof is utilized to capture audio characteristics (eg, utterances) from the subject.
[0275] Blocks 484-490. Referring to blocks 484-490, the method includes (D) determining whether the set of biometric data elements (e.g., a first set of biometric data elements) acquired from acquiring (C) satisfies at least one biometric threshold of the first challenge to assess whether the first challenge is successfully completed. The set of biometric data elements includes a first plurality of biometric data elements captured by a first biometric sensor (e.g., sensor 110-1 of FIG. 1) in the at least one biometric sensor. The at least one biometric threshold includes a first biometric threshold (e.g., biometric threshold 33-1 from reference store 30 of digital reality system 200 of FIG. 2B). Determining (D) includes determining whether a comparison of the first plurality of biometric data elements to a corresponding threshold baseline characteristic satisfies the first biometric threshold.
[0276] By comparing the first plurality of biometric data elements against the corresponding threshold baseline characteristics, the disclosed method and system can assess each subject's improvement based on subject-specific values, task-specific values, and / or population values. In one embodiment, the corresponding threshold baseline characteristics are the subject's biometric baseline captured at the start of the corresponding task in the first digital reality scene. In another embodiment, the corresponding threshold baseline characteristics are the subject's biometric baseline captured when the subject is in a relaxed state, such as when being in a resting place or starting an experience, where the baseline does not reflect anticipatory anxiety for the task. FIG. 6A shows a non-limiting example of a resting place where the subject can play an introduction or instructional video (e.g., a psycho-educational task that requires the subject to watch a duration of the introduction or instructional video). In yet another embodiment, the corresponding threshold baseline characteristics are the subject's biometric baseline captured before the subject starts any task and / or experience.
[0277] For example, in some embodiments, the first biometric sensor is a heart rate sensor and the corresponding threshold baseline characteristic is an initial heart rate of the subject captured at the start of a corresponding task in the first digital reality scene while the subject is in a relaxed state or before the subject begins any experiences and / or tasks. In such embodiments, comparison of the first plurality of biometric data elements to the corresponding threshold baseline characteristic provides a change in heart rate over time based on the subject's particular initial value. By comparing the first plurality of biometric data elements to the corresponding threshold baseline characteristic, the methods and systems of the present disclosure can distinguish improvements by different subjects, or by the same subject between different tasks, or by the same subject between repeated social tasks. For example, the disclosed methods and systems can distinguish between an improvement achieved by a first subject whose heart rate drops from a high initial heart rate (e.g., 140 bpm) to a moderate heart rate (e.g., 120 bpm), an improvement by a second subject whose heart rate drops from a moderate initial heart rate (e.g., 125 bpm) to a moderate heart rate (e.g., 120 bpm), and a deterioration by a third subject whose heart rate increases from a moderate initial heart rate (e.g., 110 bpm) to a moderate heart rate (e.g., 120 bpm). However, the disclosure is not limited thereto.
[0278] The first biometric sensor may be any suitable biometric sensor, including, but not limited to, a heart rate sensor, a heart rate variability sensor, a blood sensor, an electrodermal activity sensor, a galvanic skin response sensor, an electroencephalogram sensor, an eye tracking sensor, a recorder, a microphone, a thermometer, a heat map sensor, a camera, or any combination thereof. For example, as a non-limiting example, in some embodiments, the at least one biometric sensor includes a heart rate sensor configured to capture the subject's heart rate while the subject completes the first task in the first digital reality scene. As another non-limiting example, in some embodiments, the at least one biometric sensor includes a heart rate sensor variability configured to capture the subject's heart rate variability while the subject completes the first task in the first digital reality scene. As yet another non-limiting example, in some embodiments, the at least one biometric sensor includes a microphone or recorder or the like configured to record the subject's utterances while the subject completes the first task in the first digital reality scene, and one or more voice features are identified and evaluated from the utterances obtained from the subject. As yet another non-limiting example, in some embodiments, the first biometric sensor is a blood pressure sensor and the corresponding threshold baseline characteristic is the subject's systolic blood pressure or the subject's diastolic blood pressure. In some embodiments, the systolic or diastolic blood pressure is captured at the start of a corresponding task in the first digital reality scene. In some embodiments, the systolic or diastolic blood pressure is captured when the subject is in a relaxed state. In some aspects, the systolic or diastolic blood pressure is captured before the subject begins any educational or therapeutic program.
[0279] Blocks 494-498. Referring to blocks 494-498, in some embodiments, the method further includes receiving (H) in electronic form a second plurality of data elements associated with the subject. The second plurality of data elements includes a second plurality of biometric data elements associated with an initial psychiatric or mental condition of the subject. A first baseline characteristic is formed from the second plurality of biometric data elements.
[0280] For example, in one embodiment, the second plurality of biometric data elements (e.g., the subject's heart rate, pitch, decibel level, entropy, temporal features, etc.) are acquired or captured at the start of a corresponding task in the first digital reality scene. In another embodiment, the second plurality of biometric data elements are acquired or captured when the subject is in a relaxed state during an introduction or tutorial task shown in a digital reality scene comprising a resting place, such as the resting place shown in FIG. 6. In yet another embodiment, the second plurality of biometric data elements are acquired or captured during a mindfulness task. FIG. 6B illustrates a non-limiting example of a digital reality scene in which a subject can initiate a mindfulness task by having an avatar press a play button. In some embodiments, the second plurality of biometric data elements are acquired or captured during a CBT task. FIGS. 9A-9C illustrate non-limiting examples of digital reality scenes in which a subject can initiate a CBT task, such as an evidence collection task, while interacting with a digital reality object, such as a digital reality recording object. In some embodiments, the second plurality of biometric data elements is obtained when or before starting to present the first digital reality scene (B) that manifests the first challenge designed for the first proposed experience of the first category. However, the disclosure is not limited thereto. For example, in some embodiments, the second plurality of biometric data elements is obtained before starting the entire program (e.g., before running the client application on the client device), during a previous challenge, etc. In some embodiments, the second plurality of biometric data elements are average values for one or more subjects for a previous challenge, or average values for a population of users associated with the subject, such as a population of users having a similar condition to the subject.
[0281] Block 500. Referring to block 500, in some embodiments, the first biometric sensor is a heart rate sensor, and the first plurality of biometric data elements captured by the first biometric sensor are used to determine the heart rate per minute. The methods of the present disclosure can capture the biometric data elements using any suitable type of heart rate sensor. For example, in some embodiments, the heart rate sensor is an electrical heart rate sensor (e.g., electrocardiography or ECG) that includes electrodes located on the subject's chest to monitor the electrical activity of the subject's heart. In some embodiments, the heart rate sensor is an optical heart rate sensor (e.g., photoplethysmography or PPG) that includes one or more light sources (e.g., LEDs) to detect the amount of blood flow under the subject's skin. In some embodiments, the optical heart rate sensor is a wearable / mobile device or is incorporated into a wearable / mobile device, such as a watch, an activity tracker, an arm strap, and a mobile phone.
[0282] Block 502. Referring to block 502, in some embodiments, the first biometric sensor is a heart rate variability sensor, and the first plurality of biometric data elements captured by the first biometric sensor are used to determine heart rate cycles and provide an assessment of heart rate variability (HRV). HRV is frequently applied as a reliable indicator of health status, stress, and mental effort. Studies have linked HRV to cardiovascular disease, post-traumatic stress disorder, depression, and fibromyalgia. HRV has been proposed as a sensitive index of autonomic stress reactivity, for example, in panic disorder and work stress and mental effort.
[0283] In some embodiments, the heart rate variability sensor includes a chest-worn electrocardiogram sensor or a wearable / mobile photoplethysmogram (PPG) sensor that captures and provides cardiac signals for HRV analysis. In some embodiments, the heart rate variability sensor is a non-contact sensor. For example, in one embodiment, the heart rate variability sensor includes a camera that takes images or videos of the subject while the subject is completing a task. The images or videos taken by the camera are used to extract arterial pulse information and derive HRV. Further information regarding non-contact sensors can be found in “The PhysioCam: A Novel Non-Contact Sensor to Measure Heart Rate Variability in Clinical and Field Applications,” Davila et al., Front Public Health, November 2017, Volume 5, Article 300, which is incorporated herein by reference in its entirety for all purposes.
[0284] Blocks 506-512. Referring to blocks 506-512, in some embodiments, the first biometric sensor is an eye tracking sensor. The eye tracking sensor may be mounted or incorporated into a device (e.g., a desktop, a stand, a wall, etc.), glasses, a virtual reality headset, etc. It generally includes a projector that projects light (e.g., near-infrared light) onto a user's eye, a camera that takes an image of the user's eye, and / or algorithms that process the image to determine eye position, gaze point, and / or other characteristics. In some embodiments, the eye tracking sensor does not include image processing capabilities, but instead, biometric data elements acquired by such an eye tracking sensor are transmitted to a client device (e.g., client device 300-1) or a remote system (e.g., digital reality system 200) for image processing. In some embodiments, the eye tracking sensor is based on optical tracking of corneal reflexes to assess visual attention, such as tracking the pupil center and where light reflects off the cornea. Light reflecting from the cornea and the center of the pupil is used to determine eye movement and direction.
[0285] In some embodiments, the first plurality of biometric data elements captured by the first biometric sensor are used to determine gaze fixation, smooth movements, saccades, blinks, scan path length, eye openness, pupil dilation, eye position, hyperarousal or hyperscanning, avoidance, or any combination thereof.
[0286] In some embodiments, the fixation is based on spatial and temporal criteria of a region of interest (ROI) in the digital reality scene (e.g., the eye of object 42-2 in the digital reality scene shown in FIG. 6B). In some embodiments, the spatial criteria are, for example, a diameter of 0.8 degrees, 0.9 degrees, 1 degree, 1.1 degrees, 1.2 degrees, 1.3 degrees, and the temporal criteria are, for example, a minimum of 120 ms, 130 ms, 140 ms, 150 ms. In some embodiments, the spatial reference is a diameter visual angle of 0.8 degrees to 1.3 degrees, 0.8 degrees to 1.2 degrees, 0.8 degrees to 1.1 degrees, 0.8 degrees to 1 degree, 0.8 degrees to 0.9 degrees, 0.9 degrees to 1.3 degrees, 0.9 degrees to 1.2 degrees, 0.9 degrees to 1.1 degrees, 0.9 degrees to 1 degree, 1 degree to 1.3 degrees, 1 degree to 1.2 degrees, 1 degree to 1.1 degrees, 1.1 degrees to 1.3 degrees, 1.1 degrees to 1.2 degrees, or 1.1 degrees to 1.3 degrees. In some embodiments, the spatial reference is a diameter visual angle of at least 0.8 degrees, at least 0.9 degrees, at least 1 degree, at least 1.1 degrees, at least 1.2 degrees, or at least 1.3 degrees. In some embodiments, the spatial reference is at most 0.8 degrees, at most 0.9 degrees, at most 1 degree, at most 1.1 degrees, at most 1.2 degrees, or at most 1.3 degrees of diametric visual angle. In some embodiments, the time reference is a duration of 120ms to 150ms, 120ms to 145ms, 120ms to 140ms, 120ms to 135ms, 120ms to 130ms, 120ms to 125ms, 125ms to 150ms, 125ms to 145ms, 125ms to 140ms, 125ms to 135ms, 125ms to 130ms, 130ms to 130ms, 130ms to 145ms, 130ms to 140ms, 130ms to 135ms, 135ms to 150ms, 135ms to 145ms, 135ms to 140ms, 140ms to 150ms, 140ms to 145ms, or 145ms to 150ms. In some embodiments, the time reference is at least 120 ms, at least 125 ms, at least 130 ms, at least 135 ms, at least 140 ms, at least 145 ms, or at least 150 ms.In some embodiments, the time reference is at most 120 ms, at most 125 ms, at most 130 ms, at most 135 ms, at most 140 ms, at most 145 ms, or at most 150 ms.
[0287] In some embodiments, hyperarousal is defined as the time to first fixation during a specific task in a digital reality scene. In some embodiments, avoidance is defined as the number of fixations during a specific task in a digital reality scene divided by the total number of fixations in the first digital reality scene. Research suggests that socially anxious humans direct their initial attention to emotionally threatening information (hyperarousal) and subsequently avoid negative information (attention avoidance) to reduce psychological distress. Additional information regarding eye tracking can be found in “Gaze Behavior in Social Fear Conditioning: An Eye-Tracking Study in Virtual Reality,” Reichenberger et al., Frontiers in Psychology, published 23 January 2020, and at “Capturing Hypervigilance: Attention Biases in Elevated Trait Anxiety and Posttraumatic Stress Disorder” by Lorana H. Stewart submitted for the degree of Doctor of Philosophy, University College London, September 2011. Each of these documents is incorporated herein by reference in its entirety for all purposes.
[0288] In some embodiments, the method demarcates one or more ROIs for objects in a digital reality scene (e.g., an avatar's eyes, an avatar's face, a non-player object, etc.), and in some embodiments, the method determines the percentage of time the subject spends with their gaze within each ROI, the average number of fixations within each ROI, the median duration of fixations within each ROI, the average distance of fixations to the center of each ROI, or any combination thereof.
[0289] However, the disclosure is not limited thereto. For example, in some embodiments, the method records the scanning path of the subject's eyes and examines the subject's facial expressions using one or more models. In some embodiments, the examination of the subject's facial expressions is performed by a medical professional associated with the subject. In some embodiments, the method determines other eye activities or characteristics, such as changes in eye position when performing a corresponding task, the number of times the eyes appear at a predetermined reference position, etc.
[0290] Blocks 514-520. Referring to blocks 514-520, in some embodiments, the first biometric sensor is a recorder. The methods of the present disclosure can capture the biometric data elements using any suitable recorder. Examples of recorders include, but are not limited to, an online voice recorder, a microphone recorder, a USB flash drive voice recorder, a portable digital recorder, a voice-activated recorder, an audio recorder, a video recorder, and a vibration-responsive sensor.
[0291] In some embodiments, a recorder is utilized to obtain statements, utterances, voice features, or combinations thereof from the subject. In some embodiments, vocally expressed emotions are generally analyzed at multiple levels: physiological level, vocal articulatory level, acoustic level, or combinations thereof. In some embodiments, the physiological level represents, for example, nerve impulses or muscle innervation patterns of key structures involved in the speech production process. The vocal articulatory level represents, for example, the position or movement of key structures such as the vocal cords. The acoustic level represents, for example, the characteristics of the speech waveform emanating from the mouth. Most of the current methods for measurements at the physiological and vocal articulatory levels are rather intrusive and require specialized equipment and a high level of expertise. Contractually, acoustic cues of vocal emotion expressions can be obtained objectively, economically, and unobtrusively from speech recordings without the need for specialized equipment.
[0292] In some embodiments, the biometric threshold is associated with one or more audio cues. In some embodiments, the one or more audio cues include (a) fundamental frequency (e.g., F0, etc., correlates of perceived pitch), (b) vocal perturbations (e.g., short-term variations in sound production), (c) voice quality (e.g., correlates of perceived "timbre"), (d) intensity (e.g., correlates of perceived volume), (e) one or more temporal aspects of speech (e.g., speech rate), and various combinations of these aspects (e.g., prosodic features). In some embodiments, the first plurality of biometric data elements captured by the first biometric sensor are used to determine fundamental frequency, speech rate, one or more pauses (e.g., pauses in speaking by the subject), duration of silence by the subject, voice intensity, voice onset time, one or more pitch perturbations, one or more volume perturbations, one or more voice breaks, one or more pitch jumps, voice quality (e.g., stuttering, shakey, "like," "um"), timbre (e.g., pitch change, stuttering), or combinations thereof.
[0293] In some embodiments, the first plurality of biometric data elements captured by the first biometric sensor (e.g., a recorder) are transcribed, for example, by one or more computational models to create a transcription, such as a text object, representing the utterance obtained from the subject via the recorder. For example, in some aspects, the transcription is extracted by one or more models to generate a set of one or more words. In some embodiments, the first plurality of biometric data elements includes waveform data, and the method first segments the first plurality of biometric data elements captured by the first biometric sensor (e.g., speech recorded by the recorder) into one or more voiced and unvoiced sounds, one or more words, one or more syllables, or combinations, and segments the waveform data or transcription to allow for quantitative description of relatively homogenous and comparable portions of each utterance. As yet another non-limiting example, in some embodiments, the first plurality of biometric data elements including the waveform data are input to a NN computational model, such as a one-dimensional CNN, to extract speech features. However, the disclosure is not limited thereto.
[0294] In some embodiments, an utterance can be a word, a short phrase, or a complex sentence with many embedded clauses. Non-limiting examples of utterances include one or more spoken phrases or words, such as, but not limited to, "OK?", "uhhuh", "not on the floor!", "the pink one", and "yeah, well, I thought she was going to, but she never did". In some embodiments, splitting the recorded audio is based on a pause in the recorded audio, e.g., two utterances separated by a pause of at least 2 seconds, at least 2.5 seconds, at least 3 seconds, at least 3.5 seconds, or at least 4 seconds. In some embodiments, splitting the recorded audio is based on a pause of at most 2 seconds, at most 2.5 seconds, at most 3 seconds, at most 3.5 seconds, or at most 4 seconds. In some embodiments, an utterance is never longer than one complete sentence. That is, two complete sentences are split into two utterances even if there is no detectable pause between the two complete sentences.
[0295] In some embodiments, the first plurality of biometric data elements includes or is utilized to determine a plurality of phonetic features. In some embodiments, the phonetic features are phenomes associated with utterance such as pitch, cadence, inflection, etc. In some embodiments, the plurality of phonetic features are between 5 phonemes and 200 phonemes, between 5 phonemes and 150 phonemes, between 5 phonemes and 100 phonemes, between 5 phonemes and 80 phonemes, between 5 phonemes and 60 phonemes, between 5 phonemes and 40 phonemes, between 5 phonemes and 20 phonemes, between 15 phonemes and 200 phonemes, between 15 phonemes and 150 phonemes, between 15 phonemes and 100 phonemes, between 15 phonemes and 80 phonemes, between 15 phonemes and 60 phonemes, between 15 phonemes and 40 phonemes. , between 15 and 20 phonemes, between 35 and 200 phonemes, between 35 and 150 phonemes, between 35 and 100 phonemes, between 35 and 80 phonemes, between 35 and 60 phonemes, between 35 and 40 phonemes, between 60 and 200 phonemes, between 60 and 150 phonemes, between 60 and 100 phonemes, between 60 and 80 phonemes, between 80 and 200 phonemes, between 80 and 150 phonemes, or between 80 and 100 phonemes. In some embodiments the plurality of phonetic features comprises at least 5 phonemes, at least 10 phonemes, at least 15 phonemes, at least 20 phonemes, at least 25 phonemes, at least 30 phonemes, at least 35 phonemes, at least 40 phonemes, at least 45 phonemes, at least 50 phonemes, at least 55 phonemes, at least 60 phonemes, at least 65 phonemes, at least 70 phonemes, at least 75 phonemes, at least 80 phonemes, at least 85 phonemes, at least 90 phonemes, at least 95 phonemes, at least 100 phonemes, at least At least 105 phonemes, at least 110 phonemes, at least 115 phonemes, at least 120 phonemes, at least 125 phonemes, at least 130 phonemes, at least 135 phonemes, at least 140 phonemes, at least 145 phonemes, at least 150 phonemes, at least 155 phonemes, at least 160 phonemes, at least 165 phonemes, at least 170 phonemes, at least 175 phonemes, at least 180 phonemes, at least 185 phonemes, at least 190 phonemes, at least 195 phonemes, or at least 200 phonemes.In some embodiments the plurality of phonetic features is at most 5 phonemes, at most 10 phonemes, at most 15 phonemes, at most 20 phonemes, at most 25 phonemes, at most 30 phonemes, at most 35 phonemes, at most 40 phonemes, at most 45 phonemes, at most 50 phonemes, at most 55 phonemes, at most 60 phonemes, at most 65 phonemes, at most 70 phonemes, at most 75 phonemes, at most 80 phonemes, at most 85 phonemes, at most 90 phonemes, at most 95 phonemes, at most 10 ... at most 105 phonemes, at most 110 phonemes, at most 115 phonemes, at most 120 phonemes, at most 125 phonemes, at most 130 phonemes, at most 135 phonemes, at most 140 phonemes, at most 145 phonemes, at most 150 phonemes, at most 155 phonemes, at most 160 phonemes, at most 165 phonemes, at most 170 phonemes, at most 175 phonemes, at most 180 phonemes, at most 185 phonemes, at most 190 phonemes, at most 195 phonemes, or at most 200 phonemes.
[0296] In some embodiments, the method extracts various audio cues related to speech emotion. In some embodiments, the various audio cues include, but are not limited to, fundamental frequency, speech rate, one or more pauses, audio intensity, audio onset time, jitter (e.g., one or more pitch perturbations), shimmer (e.g., one or more volume perturbations), one or more audio breaks, one or more pitch jumps, one or more measures of voice quality (e.g., the relative degree of high-frequency and low-frequency energy in the spectrum, the frequency and bandwidth of energy peaks in the spectrum due to natural resonances of the vocal tract called formants, etc.), or combinations thereof. Several measures may be obtained for each type of cue. In some embodiments, the extraction of the audio cues is unsupervised, e.g., automatic, without human involvement. In some embodiments, the extraction of the various audio cues is supervised, e.g., carefully checked by the subject, a system administrator, or a medical professional associated with the subject.
[0297] In some embodiments, sentiment or emotion analysis is performed on the first plurality of biometric data elements captured by the recorder. For example, in some embodiments, sentiment analysis is performed on words, phrases, and / or sentences extracted from the first plurality of biometric data elements. In some embodiments, the predetermined sentiment is amusement, anger, anxiety, awkwardness, boredom, calm, confusion, craving, disgust, empathic distress, entrancement, excitement, fear, horror, interest, joy, annoyance, nostalgia, relief, sadness, satisfaction, or surprise.
[0298] In some embodiments, sentiment analysis is performed based at least in part on a lexicon (e.g., a list of words and emotions they convey), a sentiment analysis dictionary (e.g., a dictionary containing information about the emotion or polarity expressed by a word, phrase, or concept), a library (e.g., a library that computes a set of prosodic and spectral features that support emotion recognition), a complex machine learning algorithm (e.g., Naive Bayes, Support Vector Machines, Maximum Entropy), or a combination thereof.
[0299] TIFF2024544658000003.tif78170
[0300] Table 1 below shows various other types of measures for distance and further explains the terminology of the formulas identified above.
[0301] TIFF2024544658000004.tif35169TIFF2024544658000005.tif149155
[0302] Those skilled in the art will understand that other sentiments are within the scope of the systems and methods of the present disclosure. Additional information regarding sentiment analysis or analysis of speech data can be found in “Sentiment Analysis and Opinion Mining,” Bing Liu, Morgan & Clypool Publishers, May 2012, “Speech motion analysis,” Juslin et al., (2008), Scholarpedia, 3(10):4240. Each of these documents is incorporated herein by reference in its entirety for all purposes. Additional details and information regarding distance-based classification models can be found in Yang et al., 1999, “DistAI: An Inter-pattern Distance-based Constructive Learning Algorithm,” Intelligent Data Analysis, 3(1), pg. 55.
[0303] Blocks 522-526. Referring to blocks 522-526, in some embodiments, the first plurality of biometric data elements captured by the first biometric sensor are stored to enable replay of the first plurality of biometric data elements after completion of the first digital reality scene. For example, as a non-limiting example, in one embodiment, the first plurality of biometric data elements captured by the first biometric sensor (e.g., audio recorded) are stored in a recorder. As another non-limiting example, in another embodiment, the first plurality of biometric data elements captured by the first biometric sensor are transmitted to and stored on a client device (e.g., client device 300-1), a remote system (e.g., digital reality system 200), etc.
[0304] In some embodiments, one or more specific keywords are used in the analysis of the first plurality of biometric data elements captured by the first biometric sensor to prevent spoofing. For example, as a non-limiting example, in some embodiments where the subject is tasked with requesting a napkin from a non-player character (e.g., a bartender), the subject is required to say the specific word "Napkin" or "Napkins" to initiate the conversation. As another non-limiting example, in some embodiments, where the subject is tasked with reconstructing thoughts, the subject is required to say a first word (e.g., "will") or cannot say a second word (e.g., "cannot") during the conversation. However, the present disclosure is not limited thereto.
[0305] In some embodiments, the first plurality of biometric data elements captured by the first biometric sensor are pre-processed to remove background noise, for example, by modulating waveform data in the first plurality of biometric data elements, and in some embodiments, the first plurality of biometric data elements are captured by the first biometric sensor with an automatic noise cancellation function enabled.
[0306] Block 528. Referring to block 528, in some embodiments, the first plurality of biometric data elements captured by the first biometric sensor (e.g., recorder, camera, eye tracking sensor) are stored to enable replay of the first plurality of biometric data elements after completion of the first digital reality scene. For example, as a non-limiting example, in one embodiment, the first plurality of biometric data elements captured by the first biometric sensor (e.g., recorded voice) are stored in a recorder. As another non-limiting example, in another embodiment, the first plurality of biometric data elements captured by the first biometric sensor are transmitted to and stored on a client device (e.g., client device 300-1), a remote system (e.g., digital reality system 200), etc. As yet another non-limiting example, the first plurality of biometric data elements (e.g., images or videos) captured by the first biometric sensor may be stored, for example, in a camera, or transmitted and stored in a client device (e.g., client device 300-1), or transmitted and stored in a remote system (e.g., digital reality system 200). For example, in some embodiments, when completing a CBT task, a first thought or statement made by the subject that is associated with the first plurality of biometric data elements (e.g., waveform data of the first thought or statement) is stored, allowing the subject to reframe the first thought or statement in the future (e.g., to complete the first task).
[0307] Block 530. Referring to block 530, in some embodiments, the first plurality of biometric data elements are captured by a first biometric sensor in response to a particular trigger. For example, as a non-limiting example, in some embodiments where the first biometric sensor is or includes an eye tracking sensor, the first plurality of biometric data elements are captured in response to the subject looking at a particular object in the digital reality scene, e.g., looking at another player's characterizer, such as a bartender in the eye. As another non-limiting example, in some embodiments, the first plurality of biometric data elements are captured in response to the subject or a medical professional associated with the subject selecting or deselecting a checkbox. As yet another non-limiting example, the first plurality of biometric data elements are captured in response to a voice command from the subject or a medical professional associated with the subject. In some embodiments, the particular trigger includes changing the state of an input on the client device, e.g., by pressing a button input or moving the position of a sensor on the client device. In some embodiments, a particular trigger is associated with an interaction with a digital reality object in a digital reality scene, such as an interaction with a digital reality recording object.
[0308] However, the disclosure is not limited in this respect, and any suitable trigger may be used to start and / or stop the capture of the biometric data elements. For example, in some embodiments, the first plurality of biometric data elements is captured in response to a touch on the first biometric sensor, in response to a switch of an input mechanism, by the subject or a medical professional associated with the subject, by a change in state of the digital reality scene (e.g., interacting with a digital reality object), or a combination thereof. In some embodiments, the first plurality of biometric data elements is captured in response to one or more specific keywords provided by the subject, such as one or more specific keywords obtained via a recorder.
[0309] Blocks 534-538. Referring to blocks 534-538, in some embodiments, a first biometric sensor in the at least one biometric sensor is configured to capture biometric data elements associated with a physiological or psychological state of the subject at a predetermined sampling rate, such as a repetitive sampling rate, a periodic sampling rate, an aperiodic sampling rate, etc. For example, in some embodiments, the first biometric sensor captures biometric data elements at a predetermined sampling rate, e.g., once every 200 ms or less, once every 160 ms or less, once every 140 ms or less, once every 120 ms or less, once every 100 ms or less, once every 80 ms or less, once every 60 ms or less, once every 40 ms or less, once every 30 ms or less, once every 20 ms or less, or once every 10 ms or less. In some embodiments, the first biometric sensor captures biometric data elements at a predetermined sampling rate of once every 200 ms or more, once every 160 ms or more, once every 140 ms or more, once every 120 ms or more, once every 100 ms or more, once every 80 ms or more, once every 60 ms or more, once every 40 ms or more, once every 30 ms or more, once every 20 ms or more, or once every 10 ms or more. In some embodiments, the first biometric sensor captures biometric data elements at a predetermined sampling rate of between 10 ms and 200 ms, between 10 ms and 150 ms, between 10 ms and 100 ms, between 10 ms and 50 ms, between 25 ms and 200 ms, between 25 ms and 150 ms, between 25 ms and 100 ms, between 25 ms and 50 ms, between 60 ms and 200 ms, between 60 ms and 150 ms, between 60 ms and 100 ms, between 130 ms and 200 ms, or between 130 ms and 150 ms.
[0310] In some embodiments, the predetermined sampling rate is constant while the subject completes the first task in the first digital reality scene. In some other embodiments, the predetermined sampling rate is adjustable or variable, e.g., adjusted or changed in response to previously captured biometric data elements. For example, in one embodiment, the method adjusts (e.g., increases) the predetermined sampling rate if it detects a dramatic variation in the biometric measurement (e.g., a sudden increase in heart rate) over a relatively short period of time. In another embodiment, the method adjusts (e.g., decreases) the predetermined sampling rate if it does not detect a change in the biometric measurement over a relatively long period of time (e.g., a constant and normal heart rate).
[0311] In some embodiments, the first biometric sensor captures biometric data elements at a constant predetermined sampling rate while the subject completes a portion of the first digital reality scene and captures biometric data elements at an adjustable or variable predetermined sampling rate while the subject completes another portion of the first digital reality scene.
[0312] In some embodiments, the first biometric sensor captures biometric data elements intermittently while the subject completes a corresponding first task in the first digital reality scene. For example, by way of non-limiting example, in some embodiments, while a method or system is providing instructions or when the subject is not speaking, the first biometric sensor begins capturing biometric data elements while the subject is speaking in the first digital reality scene and stops collecting biometric data elements while other player characters in the first digital reality scene (e.g., object 42-2 in FIG. 6B ) are speaking.
[0313] Blocks 540-542. Referring to blocks 540-542, in some embodiments, determining (D) includes determining whether a comparison of the first plurality of biometric data elements to a second baseline characteristic satisfies a second biometric threshold in the at least one biometric threshold. For example, as a non-limiting example, assume that the first biometric sensor is a recorder and the first plurality of biometric data elements is a subject's voice recorded during at least a portion of a first digital reality scene that manifests a first challenge designed for a first proposed experience associated with a first category. The recorded voice is divided into one or more utterances. Determining (D) includes determining whether a comparison of the first plurality of biometric data elements to threshold baseline characteristics corresponding to the first plurality of biometric data elements (e.g., relaxed subject speech baseline, subject pitch baseline, subject cadence baseline, subject inflection baseline, subject vernacular baseline, subject grammar baseline, etc.) satisfies a first biometric threshold (e.g., a relative speech threshold, a relative pitch threshold, a relative cadence threshold, a relative inflection threshold, a relative vernacular threshold, a relative grammar threshold, etc.) and a comparison of the first plurality of biometric data elements to a second baseline characteristic (e.g., relaxed subject decibel level or pitch baseline, subject PDF entropy baseline, etc.) satisfies a second biometric threshold (e.g., a relative decibel level or pitch threshold, a relative PDF entropy threshold, etc.).
[0314] It should be noted that in embodiments where the first plurality of biometric data elements is stored speech, the first or second biometric thresholds can be any thresholds related to speech, including, but not limited to, a relative speech threshold, a relative assertiveness threshold, a relative decibel level threshold, a relative pitch threshold, or any combination thereof. For example, in one embodiment, the first biometric threshold is a required minimum change in speech count compared to the subject's speech baseline, and the second biometric threshold is (i) a required minimum change in assertiveness compared to the subject's assertiveness baseline, (ii) a required minimum change in decibel level compared to the subject's decibel level baseline, and / or (iii) a required minimum change in pitch compared to the subject's pitch baseline, during a first digital reality scene that manifests a first challenge to be designed for a first proposed experience associated with a first category. In another embodiment, during a first digital reality scene that manifests a first challenge designed for a first proposed experience associated with a first category, the first biometric threshold is (i) a required minimum change in assertiveness compared to the subject's assertiveness baseline, (ii) a required minimum change in decibel level compared to the subject's decibel level baseline, and / or (iii) a required minimum change in pitch compared to the subject's pitch baseline, and the second biometric threshold is a required minimum change in number of utterances compared to the subject's utterance baseline. However, the disclosure is not limited in this respect.
[0315] Blocks 546-548. Referring to blocks 546-548, in some embodiments, the at least biometric data elements captured in acquiring (C) include a fourth plurality of biometric data elements captured by a second biometric sensor (e.g., sensor 110-2 of FIG. 1) in the at least one biometric sensor. The fourth plurality of biometric data elements are different from the first plurality of biometric data elements.
[0316] For example, as a non-limiting example, the first biometric sensor may be a recorder and the first plurality of biometric data elements may be recorded audio captured by the recorder, while the second biometric sensor may be an eye tracking sensor and the fourth plurality of biometric data elements may be eye tracking data (e.g., images) captured by the eye tracking sensor, or vice versa. In such an embodiment, any threshold value for audio or eye tracking may be used. For example, as a non-limiting example, during a first digital reality scene manifesting a first challenge designed for a first proposed experience associated with a first category, one of the first and third biometric thresholds may be (i) a required minimum change in word count compared to the subject's word baseline, (ii) a required minimum change in utterance count compared to the subject's speech baseline, (iii) a required minimum change in assertiveness compared to the subject's assertiveness baseline, (iv) a required minimum change in decibel level compared to the subject's decibel level baseline, and / or (v) a required minimum change in pitch compared to the subject's pitch baseline, and the other of the first and third biometric thresholds may be a required minimum change in eye contact length compared to the subject's eye contact baseline.
[0317] As another non-limiting example, the first biometric sensor is a recorder and the first plurality of biometric data elements are recorded voice captured by the recorder, while the second biometric sensor is a heart rate sensor and the fourth plurality of biometric data elements are heart rate data captured by the heart rate sensor, or vice versa. In such an embodiment, any threshold related to voice or heart rate may be used. For example, as a non-limiting example, one of the first and third biometric thresholds is (i) a required minimum change in word count compared to the subject's word baseline, (ii) a required minimum change in utterance count compared to the subject's utterance baseline, (iii) a required minimum change in assertiveness compared to the subject's assertiveness baseline, (iv) a required minimum change in decibel level compared to the subject's decibel level baseline, and / or (v) a required minimum change in pitch compared to the subject's pitch baseline, and the other of the first and third biometric thresholds is a required minimum change in heart rate compared to the subject's heart rate baseline.
[0318] As a further non-limiting example, the first biometric sensor is a heart rate sensor and the first plurality of biometric data elements is heart rate data captured by the heart rate sensor, while the second biometric sensor is a heart rate sensor and the fourth plurality of biometric data elements is heart rate data captured by the heart rate sensor. In such an embodiment, any threshold related to heart rate or eye tracking may be used. For example, as a non-limiting example, one of the first and third biometric thresholds is a required minimum change in heart rate compared to the subject's heart rate baseline and the other of the first and third biometric thresholds is a required minimum change in length of eye contact compared to the subject's eye contact baseline during a first digital reality scene that manifests a first challenge to be designed for a first proposed experience associated with a first category.
[0319] In some embodiments, determining (D) includes determining whether a comparison of the fourth plurality of biometric data elements to the third baseline characteristic satisfies a third biometric threshold in the at least one biometric threshold. For example, as a non-limiting example, in an embodiment where the fourth plurality of biometric data elements is eye tracking data captured by an eye tracking sensor, determining (D) determines whether a comparison of the eye tracking data (e.g., a length of eye contact) to an eye contact baseline characteristic (e.g., a length of eye contact for the subject in a relaxed state) satisfies an eye contact threshold. As another non-limiting example, in an embodiment where the fourth plurality of biometric data elements is heart rate data captured by a heart rate sensor, determining (D) determines whether a comparison of the heart rate data (e.g., bpm) to a heart rate baseline characteristic (e.g., bpm for the subject in a relaxed state) satisfies a heart rate threshold.
[0320] In some embodiments, the method includes determining whether at least one gating criterion associated with the first category is met if the first challenge is determined to be successfully completed. In some embodiments, the determination if the first challenge is determined to be successfully completed is based at least in part on an outcome of determining whether the first set of biometric data elements meets at least one biometric threshold associated with a first proposed experience for the first challenge, the at least one biometric threshold comprising a first biometric threshold, evaluating whether the first challenge is successfully completed by satisfying the at least one biometric threshold associated with the first proposed experience for the first challenge, the first set of biometric data elements comprising a subset of the first biometric data elements captured by a first biometric sensor in the at least one biometric sensor, based at least in part on an outcome of determining whether the first set of biometric data elements meets a corresponding first threshold baseline characteristic, based at least in part on an outcome of determining whether at least one gating criterion associated with the first category is met, or based at least in part on a combination thereof. For example, as a non-limiting example, assume that at least one gating criterion associated with the first category includes a single gating criterion that requires the subject to successfully complete a minimum number of tasks (e.g., 3, 4, or 5), such as a threshold number of exposure tasks, a threshold number of CBT tasks (e.g., a threshold number of reframed thoughts). In such an embodiment, the determining determines whether the number of tasks successfully completed by the subject meets or exceeds the minimum number of tasks required. As another non-limiting example, assume that at least one gating criterion associated with the first category includes a first gating criterion and a second gating criterion. The first gating criterion requires the subject to successfully complete a threshold number of tasks, and the second gating criterion requires the subject to successfully complete one or more specific tasks (e.g., task 26-2) associated with the first category.In such embodiments, determining (E) determines not only whether the number of tasks successfully completed by the subject meets or exceeds the minimum number of tasks required, but also whether the subject successfully completed each of the one or more specific tasks required.
[0321] Block 552. Referring to block 552, the method includes determining a second category in the plurality of categories for the subject to next perform based at least in part on the results of determining (D) (e.g., successful completion of the first set of biometric data elements, whether the first set of biometric data elements meets a corresponding first threshold baseline characteristic, and successful completion of whether the at least one gating criterion associated with the first category is met) if each gating criterion in the at least one respective gating criterion associated with the first category is met, and performing an exposure progression that improves the subject's ability to manage the subject's psychiatric or mental condition (E). For example, by way of non-limiting example, assume that the multiple categories obtained for the subject are a set of three, category A, category B, and category C, and category A is the first category in which the subject successfully passes (e.g., each gating criterion in at least one respective gating criterion associated with the first category is satisfied). Determining (E) determines whether category B or category C should be the second category in which the subject next performs.
[0322] Determining the second category for the subject to perform next (E) is based at least in part on determining whether at least one biometric data element satisfies at least one biometric threshold of the first task (D) and on determining whether at least one gating criterion associated with the first category is met (E). For example, in some embodiments, determining the second category for the subject to perform next (E) is based not only on the number of tasks the subject successfully completed, but also on how well the subject completed these tasks (e.g., meets the requirements, exceeds some requirements, exceeds most requirements, exceeds all requirements), and / or on the degree of improvement the subject achieved through these tasks (e.g., merely, moderate, significant). In some embodiments, determining the second category for the subject to perform next (E) is based not only on whether the subject successfully completed each of the one or more specific tasks required, but also on any additional tasks the subject intended or successfully completed. In some embodiments, determining which second category the subject will next perform (E) is additionally or optionally based on other substances, including, but not limited to, the subject's performance during other educational or therapeutic tasks, the performance of a population of users during the same task, etc. In this manner, the disclosed method not only provides an exposure progression that is tailored to each subject, but also personalizes the timing and / or nature of the exposure practice. This dynamically builds or modifies an individual's exposure progression based at least in part on the subject's level of success in one or more social tasks.
[0323] Blocks 554-556. Referring to blocks 554-556, in some embodiments, determining the second category for the subject to perform next (E) includes assessing (E.1) whether a category immediately following the first category in the initial exposure progression (e.g., the initial exposure progression based on assessments from the subject and / or other data, as illustrated at least by block 480) is appropriate for the subject to perform next. In some embodiments, determining the second category for the subject to perform next (E) also includes indicating the immediately following category in the initial exposure progression as the second category for the subject to perform next (E.2) if the immediately following category in the initial exposure progression is appropriate for the subject to perform next. In some embodiments, determining the second category for the subject to perform next (E) further includes recommending a category other than the immediately following category in the initial exposure progression as the second category for the subject to perform next (E.3) if the immediately following category in the initial exposure progression is inappropriate for the subject to perform next.
[0324] For example, as a non-limiting example, assume that the multiple categories obtained for the subject are a set of three categories A (e.g., exposure category), category B (e.g., CBT category), and category C (e.g., mindfulness category) in an initial exposure progression with category A as the first category, followed immediately by category B, which is then followed by category C. If it is determined that the subject has successfully completed category A (the first category in the initial exposure progression), the method determines in evaluating (E.1) whether category B (the category immediately following category A in the initial exposure progression) is appropriate for the subject to perform next. If it is determined that category B is appropriate for the subject to perform next, the method presents (e.g., on a display) category B for the subject to perform in presenting (E.2). If it is determined that category B is not appropriate for the subject to perform next, the method recommends category C or other educational / therapeutic tasks (e.g., mindfulness or cognitive reframing tasks) for the subject to perform in recommending (E.3). Recommendations may be made, for example, by placing an indicator (eg, text, graphics, etc.) on a display, via audio, etc.
[0325] Block 558. Referring to block 558, in some embodiments, the method further includes repeating (I) the indicating (B), obtaining (C), and determining (D) one or more times for other tasks associated with the first category if a gating criterion in at least one respective gating criterion associated with the first category is not satisfied. For example, as a non-limiting example, assume that the at least one gating criterion associated with the first category includes a first gating criterion that requires the subject to successfully complete a minimum of three tasks. If it is determined that the subject has successfully completed only one task associated with the first category (e.g., task 26-1), repeating (J) repeats the indicating (B), obtaining (C), and determining (D) at least twice for other tasks associated with the first category (e.g., task 26-2, task 26-3). If it is determined that the subject has successfully completed two tasks (e.g., Task 26-1, Task 26-2), repeating (I) repeats indicating (B), obtaining (C), and determining (D) at least once for another task associated with the first category (e.g., Task 26-3).
[0326] As another non-limiting example, assume that at least one gating criterion associated with a first category includes a second gating criterion that requires the subject to successfully complete one or more specific tasks associated with the first category (e.g., task 26-4). If it is determined that the subject has not successfully completed each of the one or more specific tasks required, the method may notify the subject of the requirement and recommend specific tasks required by the subject even if the subject has successfully completed a minimum number of tasks associated with the first category. In some embodiments, upon selection of one or more required tasks (e.g., task 26-4) by the subject or a health care professional associated with the subject, repeating (I) repeats indicating (B), obtaining (C), and determining (D) one or more times for one or more required tasks associated with the first category.
[0327] Blocks 560-574. Referring to 560-570, in some embodiments, the method further includes recommending (J) a challenge for the subject to perform next if the first challenge is determined to have been completed with failure. The recommended challenge may be, but is not limited to, a challenge that presents a challenge of the same or lesser difficulty as the first challenge in the first category, the same first challenge designed for a first suggested experience in the first category, a challenge designed for a different suggested experience in the first category, a challenge designed for a suggested experience of a different category (e.g., the second category) in the multiple categories, a challenge not associated with any category in the multiple categories, etc. In some embodiments, the recommendation is based at least in part on the subject's performance on the first challenge and / or one or more other challenges.
[0328] For example, and by way of non-limiting example, assume that the plurality of categories includes a first category associated with four tasks (e.g., task 26-1, task 26-2, task 26-3, and task 26-4) and a second category associated with three tasks (e.g., task 26-5, task 26-6, and task 26-7), with task 26-2 presenting a task of equal or lesser difficulty than task 26-1. In one embodiment, if task 26-1 is determined to be unsuccessfully completed, the method, in recommending (K), recommends task 26-2 for the subject to perform next. In another embodiment, if task 26-1 is determined to be unsuccessfully performed, the method, in recommending (K), recommends task 26-1 for the subject to perform next (i.e., repeat the same task one or more times). In a further embodiment, if task 26-1 is determined to be unsuccessfully performed, the method, in recommending (J), recommends task 26-5 for the subject to perform next, which is not associated with the first category. In an alternative embodiment, the method, in recommending (J), recommends a next task for the subject to perform.
[0329] The recommended tasks may be, but are not limited to, mindfulness tasks, cognitive reframing tasks, etc. In some embodiments, the tasks are specific mindfulness tasks customized for the first category, universal mindfulness tasks accessible from each category in the plurality of categories, specific cognitive reframing tasks customized for the first category, or universal cognitive reframing tasks accessible from each category in the plurality of categories.
[0330] The recommendations may be presented to the subject in any suitable manner. For example, in some embodiments, the recommendations are presented textually, graphically, audio (e.g., spoken by a digital reality host), or a combination thereof. With the recommendations, the systems, methods, and devices of the present disclosure improve the likelihood of engagement and / or better clinical outcome.
[0331] Block 576. Referring to block 576, in some embodiments, the method further includes repeating (K) the indicating (B), obtaining (C), and determining (D) for the recommended challenge in response to a selection of the recommended challenge. For example, in response to a selection of the recommended challenge, the method presents a digital reality scene illustrating the recommended challenge, similar to that disclosed herein and illustrated at least by block 480. In coordination with the presentation of the digital reality scene illustrating the recommended challenge, the method obtains a plurality of data elements from all sensors or a subset of sensors in the plurality of sensors, similar to that disclosed herein and illustrated at least by block 482, wherein at least one biometric sensor captures at least one biometric data element associated with the subject while the subject completes the recommended challenge. Based on the at least one biometric data element captured while the subject completes the recommended challenge, the method determines whether the recommended challenge was...
Claims
1. 1. A method for implementing an exposure progression that improves a subject's ability to manage a psychiatric or mental condition, comprising: In a computer system associated with the subject, the computer system comprises one or more processors, a display, a plurality of sensors, and a memory coupled to the one or more processors, the memory comprising one or more programs configured to be executed by the one or more processors, the method comprising: (A) obtaining a plurality of categories for the subject; Each respective category in the plurality of categories (i) is directed to improving the subject's ability to manage a psychiatric or mental condition, (ii) is associated with a corresponding plurality of suggested experiences, and (iii) is associated with at least one respective gating criterion in a plurality of gating criteria; For each respective category in the plurality of categories, each respective suggested experience in the corresponding plurality of suggested experiences is (i) associated with a corresponding digital reality scene in a corresponding plurality of digital reality scenes that manifests a corresponding challenge in a corresponding plurality of challenges designed for the respective suggested experience of the respective category; and (ii) associated with at least one biometric threshold in a plurality of biometric thresholds for the corresponding challenge of the respective suggested experience; (B) presenting on the display a first digital reality scene illustrating a first challenge designed for a first suggested experience in a first category in the plurality of categories; (C) in cooperation with the indicating (B), acquiring a first plurality of data elements, the first plurality of data elements comprising a first set of biometric data elements from a subset of sensors in a plurality of sensors, the subset of sensors including at least one biometric sensor configured to capture at least one biometric data element associated with the subject when the subject completes the first task in the first digital reality scene; (D)(i) determining whether the first set of biometric data elements satisfy the at least one biometric threshold associated with the first proposed experience for the first challenge, the at least one biometric threshold comprising a first biometric threshold that evaluates whether the first challenge is successfully completed by satisfying the at least one biometric threshold associated with the first proposed experience for the first challenge, the first set of biometric data elements including a subset of first biometric data elements captured by a first biometric sensor in the at least one biometric sensor; (ii) determining whether the first set of biometric data elements satisfy corresponding first threshold baseline characteristics; (iii) determining whether at least one gating criterion associated with the first category is satisfied; (E) determining a second category in the plurality of categories for the subject to next perform if each gating criterion in the at least one respective gating criterion associated with the first category is satisfied, wherein the exposure progression improves the subject's ability to manage a psychiatric or mental condition, and wherein the determining (E) is based at least in part on the results of the determining (D).
2. 2. The method of claim 1 , wherein the plurality of categories in obtaining (A) are initially arranged in an initial instance of the exposure progression that is set by (i) a system administrator, (ii) the subject, (iii) a medical professional associated with the subject, (iv) a model, or (v) a combination thereof.
3. The method further comprising: (F) prior to said presenting (B), presenting on the display a graph representing the initial instance of the exposure progression, the graph comprising a plurality of nodes and a plurality of edges, and for each respective node in the plurality of nodes, the graph further comprising a corresponding plurality of experience graphics displayed adjacent the respective node; Each respective node in the plurality of nodes (i) corresponds to a respective category in the plurality of categories, (ii) is associated with the corresponding plurality of suggested experiences associated with the respective category corresponding to the respective node, and (iii) is associated with the at least one respective gating criterion in the plurality of gating criteria associated with the respective category corresponding to the respective node; For each respective node in the plurality of nodes, each respective experience graphic in a corresponding plurality of experience graphics (i) corresponds to a respective suggested experience in the corresponding plurality of suggested experiences associated with the respective category corresponding to the respective node, and (ii) is associated with the at least one biometric threshold in the plurality of biometric thresholds for the corresponding challenge of the respective suggested experience; each respective node in the plurality of nodes is connected to at least one other node in the plurality of nodes by an edge in the plurality of edges; 3. The method of claim 2, wherein each respective edge in the plurality of edges represents a progression in the graph between a respective initial node and a respective subsequent node in the graph upon successful completion by a requisite number of subjects of a corresponding task associated with the respective initial node.
4. 4. The method of claim 3, wherein for each respective node in the plurality of nodes, the graph further comprises a corresponding plurality of branches, and each respective experience graphic in the corresponding plurality of experience graphics is connected to the respective node by a branch in the corresponding plurality of branches.
5. The determining step (E) comprises: (E.1) evaluating whether a category immediately following the first category in the initial instance of the exposure progression is suitable for the subject to perform next; (E.2) if the immediately following category in the initial instance of the exposure progression is suitable for the subject to perform next, indicating the immediately following category in the initial instance of the exposure progression as the second category for the subject to perform; The method according to any one of claims 2 to 4, comprising:
6. The determining step (E) comprises: (E.3) recommending a category other than the immediately succeeding category in the initial instance of the exposure progression as the second category for the subject to next perform if the immediately succeeding category in the initial instance of the exposure progression is inappropriate for the subject to next perform. The method of claim 5 further comprising:
7. The method of any preceding claim, wherein the first biometric sensor is configured to capture biometric data elements associated with a physiological or psychological state of the subject at a predetermined sampling rate.
8. The method of claim 7, wherein the predetermined sampling rate is between 40 ms and 160 ms.
9. The method of claim 7 , wherein the predetermined sampling rate is adjustable or fixed.
10. The method of any of claims 1 to 9, wherein the first biometric sensor is a heart rate sensor, a heart rate variability sensor, a blood pressure sensor, an electrodermal activity sensor, a galvanic skin response sensor, an electroencephalogram sensor, an eye tracking sensor, a recorder, a microphone, or a thermometer.
11. The method of claim 10 , wherein the subset of first biometric data elements is captured by the first biometric sensor in response to a particular trigger.
12. The method of claim 10 , wherein the first biometric sensor is a heart rate sensor and the subset of the first biometric data elements is used to determine a heart rate of the subject.
13. 11. The method of claim 10, wherein the first biometric sensor is a heart rate variability sensor and the subset of the first biometric data elements is used to determine the subject's heart rate cycle and provide an assessment of heart rate variability.
14. 11. The method of claim 10, wherein the first biometric sensor is an eye tracking sensor, and the subset of the first biometric data elements is used to determine the subject's gaze fixation, the subject's smooth movement, the subject's saccades, blinks by the subject, the length of the subject's scan path, the subject's eye openness, the subject's pupil dilation, the subject's eye position, hyperarousal exhibited by the subject, gaze aversion exhibited by the subject, or any combination thereof.
15. 11. The method of claim 10, wherein the first biometric sensor is an eye tracking sensor, and the subset of the first biometric data elements is used to determine a gaze fixation of the subject, the gaze fixation being determined based on spatial and temporal references of an area of interest in the first digital reality scene.
16. 11. The method of claim 10, wherein the first biometric sensor is an eye tracking sensor, and the subset of the first biometric data elements is used to determine hyperarousal exhibited by the subject, the hyperarousal being defined as a time to first fixation during a specific task in the first digital reality scene.
17. 11. The method of claim 10, wherein the first biometric sensor is an eye tracking sensor, and the subset of the first biometric data elements is used to determine gaze aversion exhibited by the subject, the gaze aversion being defined as the number of fixations exhibited by the subject during a particular task in the first digital reality scene divided by the total number of fixations exhibited by the subject in the first digital reality scene.
18. 11. The method of claim 10, wherein the first biometric sensor is a recorder and a sentiment or emotion analysis is performed on the subset of the first biometric data elements to evaluate whether the first challenge is successfully completed by satisfying the at least one biometric threshold associated with the first proposed experience for the first challenge.
19. 11. The method of claim 10, wherein the first biometric sensor is a recorder and the first subset of biometric data elements includes temporal biometric data elements, spectral biometric data elements, cepstral biometric data elements, entropic biometric data elements, or a combination thereof.
20. 20. The method of claim 18, wherein the subset of the first biometric data elements is copied to create a transcription, the transcription is extracted to generate words, and the sentiment analysis is performed on the extracted words.
21. 20. The method of claim 18, wherein the first subset of biometric data elements is used to determine fundamental frequency, speech rate, pauses, silence duration, voice intensity, voice start time, pitch perturbation, volume perturbation, voice breaks, pitch jumps, voice quality, sound quality, or combinations thereof to assess whether the first challenge is successfully completed by satisfying the at least one biometric threshold associated with the first proposed experience for the first challenge.
22. 20. The method of claim 18, wherein a subset of the first biometric data elements captured by the first biometric sensor is stored to enable playback of the subset of the first biometric data elements after completion of the first digital reality scene.
23. 20. The method of claim 18, wherein one or more specific keywords are used in the analysis of the first subset of biometric data elements to prevent spoofing.
24. 20. The method of claim 18, wherein the first subset of biometric data elements is pre-processed to remove background noise prior to using the first subset of biometric data elements to evaluate whether the first challenge is successfully completed by satisfying the at least one biometric threshold associated with the first proposed experience for the first challenge.
25. 20. The method of claim 18, wherein the first subset of biometric data elements is captured by the first biometric sensor with an automatic noise cancellation feature enabled.
26. The method of any one of claims 1 to 10, further comprising: (G) receiving in electronic form a second plurality of data elements associated with the subject, the second plurality of data elements including a second set of biometric data elements associated with an initial psychiatric or mental condition of the subject, and the corresponding threshold baseline characteristic formed by the second plurality of biometric data elements.
27. 11. The method of claim 1, further comprising: (H) obtaining a second set of biometric data elements from the first biometric sensor in the at least one biometric sensor when or before initiating the indicating (B), wherein the corresponding threshold baseline characteristic is formed by the second set of biometric data elements.
28. 28. The method of claim 27, wherein said obtaining (H) is performed during an introduction or tutorial.
29. 30. The method of claim 28, wherein the introduction or tutorial is presented in a digital reality scene comprising a rest area associated with a digital representation of a house.
30. 30. The method of claim 1, further comprising: (I) repeating the indicating (B), obtaining (C), and determining (D) one or more times for other suggested experience challenges in the corresponding plurality of suggested experiences associated with the first category if a gating criterion in the at least one respective gating criterion associated with the first category is not satisfied.
31. 31. The method of any of claims 1 to 30, further comprising: (J) recommending another suggested experience challenge in the corresponding plurality of suggested experiences for the first category for the subject to next perform if it is determined that the first challenge is not successfully completed by failing to satisfy the at least one biometric threshold associated with the first suggested experience for the first challenge, wherein the recommending (J) is indicated textually, graphically, audio, or a combination thereof.
32. 32. The method of claim 31, wherein the recommended challenges pose challenges that are equal to or less challenging than the first challenge in the first category.
33. 32. The method of claim 31, wherein the recommended challenge is the same first challenge designed for the first suggested experience of the first category.
34. 32. The method of claim 31, wherein the recommended challenges are challenges designed for the first category of different suggested experiences.
35. 32. The method of claim 31, wherein the recommended challenges are challenges designed for a suggested experience in a different category in the plurality of categories.
36. 32. The method of claim 31, wherein the recommended assignments are assignments outside any category in the plurality of categories.
37. 37. The method of claim 31, further comprising: (K) repeating the indicating (B), obtaining (C), and determining (D) for the recommended challenge in response to a selection of the recommended challenge.
38. 32. The method of claim 31 , wherein the task is a specific mindfulness task customized for the first category, a universal mindfulness task accessible from each category in the plurality of categories, a specific cognitive reframing task customized for the first category, or a universal cognitive reframing task accessible from each category in the plurality of categories.
39. 40. The method of claim 31 or 38, further comprising: (L) in response to selection of the challenge, showing on the display a second digital reality scene illustrating the challenge.
40. The method comprises: (M) in coordination with the indicating (L), further comprising obtaining a third plurality of data elements from a subset of sensors in the plurality of sensors, the third plurality of data elements including a third plurality of biometric data elements associated with the subject and captured when the subject completes the second digital reality scene exhibiting the task; 40. The method of claim 39, further comprising: (N) determining change or improvement by comparing the third plurality of biometric data elements against the corresponding threshold baseline characteristic or the first plurality of biometric data elements from the obtaining (C).
41. (O) showing a subjective evaluation option on the display prior to said determining (E); and (P) performing a subjective evaluation in response to a selection of the subjective evaluation option. Further comprising: The method of any of claims 1 to 40, wherein said determining (E) is based at least in part on the outcome of said subjective evaluation.
42. 42. The method of claim 41, wherein the subjective assessment is based on a Minimal Clinically Important Difference (MCID), a Clinical Global Impression (CGI), a Patient Generated Index (PGI), the Liebowitz Social Anxiety Scale (LSAS), Generalized Anxiety Disorder (GAD), the Patient Health Questionnaire (PHQ), or a combination thereof.
43. (Q) repeating the indicating (B), obtaining (C), and determining (D) for a digital reality scene that demonstrates a problem designed for the second category of proposed experiences; and (R) repeating said determining (E) for said second category. The method of any of claims 1 to 42, further comprising:
44. 44. The method of any of claims 1 to 43, wherein in obtaining (A), the plurality of suggested experiences associated with the first category are initially placed in an initial first sub-progression set by (i) a system administrator, (ii) the subject, (iii) a medical professional associated with the subject, (iv) a model, or (v) a combination thereof.
45. (S) evaluating whether a proposed experience immediately following a first proposed experience in the initial first sub-progression is suitable for the subject to perform; (T) presenting a digital reality scene that illustrates a task designed for the immediately following proposed experience in the first sub-progression if the immediately following proposed experience is deemed suitable for the subject to perform next; (U) repeating the obtaining (C) and the determining (D) for the task designed for the immediately proposed experience in a first sub-progression of the initial exposure.
45. The method of claim 44, further comprising:
46. 46. The method of claim 45, further comprising: (V) recommending a suggested experience other than the immediately subsequent suggested experience for the subject to next perform if the immediately subsequent suggested experience is deemed not suitable for the subject to next perform.
47. The method of any preceding claim, wherein the determining (D) further comprises determining whether the first set of biometric data elements satisfies a second biometric threshold in the at least one biometric threshold.
48. 48. The method of claim 47, wherein one of the first and second biometric thresholds of the at least one biometric threshold is a required minimum change in utterances compared to a utterance baseline for the subject, and the other of the first and second biometric thresholds of the at least one biometric threshold is (i) a required minimum change in assertiveness compared to a baseline for an assertiveness of the subject, (ii) a required minimum change in decibel level compared to a baseline for a decibel level of the subject, and / or (iii) a required minimum change in pitch compared to a baseline for a pitch of the subject, during the first digital reality scene that manifests the first challenge to be designed for the first proposed experience associated with the first category.
49. 49. The method of any of claims 1-48, wherein the at least one biometric data element captured in obtaining (C) includes a fourth set of biometric data elements captured by a second biometric sensor in the at least one biometric sensor, the fourth set of biometric data elements being different from the first set of biometric data elements, and wherein determining (D) comprises determining whether a comparison of the fourth set of biometric data elements to a third baseline characteristic satisfies a third biometric threshold in the at least one biometric threshold.
50. 50. The method of claim 49, wherein one of the first biometric threshold and the third biometric threshold is (i) a required minimum change in word count compared to the subject's word baseline, (ii) a required minimum change in utterances compared to the subject's utterance baseline, (iii) a required minimum change in assertiveness compared to the subject's assertiveness baseline, (iv) a required minimum change in decibel level compared to the subject's decibel level baseline, and / or (v) a required minimum change in pitch compared to the subject's pitch baseline, and the other of the first biometric threshold and the third biometric threshold in the at least one biometric threshold is a required minimum change in eye contact length compared to the subject's eye contact baseline in the first digital reality scene manifesting the first challenge to be designed for the first proposed experience associated with the first category.
51. The method of any preceding claim, wherein each category in the plurality of categories is associated with a unique rank.
52. The method of any preceding claim, wherein the plurality of sensors includes a heart rate sensor and the corresponding threshold baseline characteristic is an initial heart rate of the subject.
53. The method of any preceding claim, wherein the plurality of sensors includes a blood pressure sensor and the corresponding threshold baseline characteristic is the subject's systolic blood pressure or the subject's diastolic blood pressure.
54. The method of any preceding claim, wherein the display is a head-mounted display.
55. The method of any preceding claim, wherein the at least one respective gating criterion comprises a ranking gating criterion associated with a hierarchical ranking of each category in the plurality of categories.
56. 56. The method of any of claims 1-55, wherein the at least one respective gating criterion comprises a physician gating criterion associated with approval from a physician associated with the subject of the category in the plurality of categories corresponding to the at least one respective gating criterion.
57. A method according to any preceding claim, wherein said at least one respective gating criterion comprises an arrangement gating criterion associated with an ordering of one or more categories in said plurality of categories.
58. 58. The method of any one of claims 1 to 57, wherein the psychiatric or mental condition is a clinically diagnosed mental disorder or a subclinically diagnosed mental disorder.
59. 59. The method of claim 58, wherein the psychiatric or mental condition comprises being stressed in a social environment, being afraid of a social environment, or being overwhelmed in a social environment.
60. 60. The method of claim 58 or 59, wherein the psychiatric or mental condition is a clinically diagnosed mental disorder, wherein the clinically diagnosed mental disorder is an anxiety disorder, a mood disorder, a psychotic disorder, an eating disorder, an impulse control disorder, an addictive disorder, a personality disorder, an obsessive-compulsive disorder, or a post-traumatic stress disorder.
61. 60. The method of claim 58 or 59, wherein the psychiatric or mental condition is a clinically diagnosed mental disorder, said clinically diagnosed mental disorder being an anxiety disorder, said anxiety disorder comprising separation anxiety disorder, selective mutism, specific phobia, social anxiety disorder, panic disorder, agoraphobia, generalized anxiety disorder, substance-induced anxiety disorder, or an anxiety disorder due to a medical condition of the subject.
62. 60. The method of claim 58 or 59, wherein the psychiatric or mental condition is a clinically diagnosed mental disorder, said clinically diagnosed mental disorder being a mood disorder, said mood disorder comprising a depressive disorder, a bipolar disorder, or a cyclothymic disorder.
63. 60. The method of claim 58 or 59, wherein the psychiatric or mental condition is a clinically diagnosed mental disorder, said clinically diagnosed mental disorder is a psychotic disorder, said psychotic disorder comprising a schizophrenic disorder, a delusional disorder, or a hallucinatory disorder.
64. 60. The method of claim 58 or 59, wherein the psychiatric or mental condition is a clinically diagnosed mental disorder, said clinically diagnosed mental disorder is an eating disorder, said eating disorder comprising anorexia nervosa, bulimia nervosa, or binge eating disorder.
65. 60. The method of claim 58 or 59, wherein the psychiatric or mental condition is a clinically diagnosed mental disorder, said clinically diagnosed mental disorder being an impulse control disorder, said impulse control disorder comprising pyromania disorder, kleptomania disorder, or compulsive gambling disorder.
66. 60. The method of claim 58 or 59, wherein the psychiatric or mental condition is a clinically diagnosed mental disorder, said clinically diagnosed mental disorder is an addictive disorder, said addictive disorder comprising an alcohol use disorder or a substance abuse disorder.
67. 60. The method of claim 58 or 59, wherein the psychiatric or mental condition is a clinically diagnosed mental disorder, the clinically diagnosed mental disorder is a personality disorder, the personality disorder comprising antisocial personality disorder, obsessive-compulsive personality disorder, or suspicious personality disorder.
68. A method according to any preceding claim, wherein the corresponding digital reality scene is a virtual reality scene.
69. A method according to any preceding claim, wherein the corresponding digital reality scene is an augmented reality scene.
70. 70. The method of any of claims 1-69, wherein a gating criterion associated with a category in the plurality of categories specifies a condition to be met by the subject before proceeding to another category in the plurality of categories.
71. 71. The method of claim 70, wherein each gating criteria for each category in the plurality of categories is set by (i) a system administrator, (ii) the subject, (iii) a model, or (iv) a medical professional associated with the subject.
72. gating criteria for each of a first category in the plurality of categories is set by a system administrator or a medical professional associated with the subject; 72. The method of claim 71, wherein the gating criteria for each second category in the plurality of categories is set by the subject.
73. 73. The method of any of claims 1-72, wherein each biometric threshold for each suggested experience in the plurality of suggested experiences associated with each category in the plurality of categories is set by (i) a system administrator, (ii) the subject, (iii) a medical professional associated with the subject, (iv) a model, or (v) a combination thereof.
74. 73. The method of any of claims 1-72, wherein a biometric threshold for each suggested experience in the plurality of suggested experiences associated with the first category in the plurality of categories is set by (i) a system administrator, (ii) the subject, (iii) a medical professional associated with the subject, (iv) a model, or (v) a combination thereof.
75. 75. The method of claim 74, wherein the respective biometric thresholds of the respective suggested experiences in the plurality of suggested experiences associated with the first category are absolute parameters, relative parameters, normalized parameters, or any combination thereof.
76. 76. The method of claim 74 or 75, wherein the respective biometric threshold of the respective suggested experience in the plurality of suggested experiences associated with the first category is an eye contact threshold, a heart rate threshold, an assertiveness threshold, a decibel level threshold, a pitch threshold, a speech threshold, a word threshold, or a sentiment analysis criterion that is indicative of the corresponding challenge designed for the first suggested experience associated with the first category.
77. 76. The method of claim 74 or 75, wherein the respective biometric threshold of the respective suggested experiences in the plurality of suggested experiences associated with the first category is an eye contact threshold, the eye contact threshold including a minimum length of eye contact, an increment of eye contact, or both the minimum length of eye contact and the increment of eye contact.
78. 76. The method of claim 74 or 75, wherein the respective biometric threshold of the respective suggested experiences in the plurality of suggested experiences associated with the first category is a heart rate threshold, the heart rate threshold including a maximum heart rate, a reduction in heart rate, or both the maximum heart rate and the reduction in heart rate.
79. 76. The method of claim 74 or 75, wherein the respective biometric thresholds of the respective suggested experiences in the plurality of suggested experiences associated with the first category are assertiveness thresholds, the assertiveness thresholds including an absolute assertiveness threshold, a relative assertiveness threshold, or both the absolute assertiveness threshold and the relative assertiveness threshold.
80. 76. The method of claim 74 or 75, wherein the respective biometric thresholds of the respective suggested experiences in the plurality of suggested experiences associated with the first category are decibel level thresholds, the decibel level thresholds including a lower decibel level threshold, an upper decibel level threshold, a requested increase in the decibel level, a requested decrease in the decibel level, or any combination thereof.
81. 76. The method of claim 74 or 75, wherein the respective biometric threshold of the respective suggested experiences in the plurality of suggested experiences associated with the first category is a pitch threshold, the pitch threshold comprising a lower pitch threshold, an upper pitch threshold, a requested increase in the pitch, a requested decrease in the pitch, or any combination thereof.
82. 76. The method of claim 74 or 75, wherein the respective biometric threshold of the respective suggested experiences in the plurality of suggested experiences associated with the first category is an utterance threshold, the utterance threshold including a minimum number of utterances, a maximum number of utterances, an increase in the number of utterances required, a decrease in the number of utterances required, or a combination thereof.
83. 76. The method of claim 74 or 75, wherein the respective biometric threshold of each of the suggested experiences in the plurality of suggested experiences associated with the first category is a word threshold, the word threshold comprising a minimum number of words, a maximum number of words, an increase in the number of words required, a decrease in the number of words required, or a combination thereof.
84. 76. The method of claim 74 or 75, wherein the respective biometric thresholds of the respective suggested experiences in the plurality of suggested experiences associated with the first category are sentiment analysis criteria, the sentiment analysis criteria including an excited sentiment threshold and an over-excited sentiment threshold.
85. 85. The method of claim 84, further comprising: for each statement in a list of statements deemed to be characteristic of a given sentiment, determining whether the sentiment analysis criteria are met by taking a cosine similarity or dot product of one or more utterances of the subject performed during the corresponding task designed for the first proposed experience associated with the first category.
86. 86. The method of claim 85, wherein the predetermined sentiment is amusement, anger, anxiety, awkwardness, boredom, calm, confusion, craving, disgust, empathic distress, ecstasy, excitement, fear, horror, interest, joy, annoyance, nostalgia, relief, sadness, satisfaction, or surprise.
87. 87. The method of any of claims 1-86, wherein the plurality of categories comprises one or more exposure categories, one or more cognitive behavioral therapy (CBT) categories, one or more mindfulness categories, or a combination thereof.
88. The method of any preceding claim, wherein the first category is a mindfulness category and the second category is a CBT category.
89. The method of any preceding claim, wherein the first category is an exposure category and the second category is the CBT category.
90. 90. A computer system for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, the computer system comprising one or more processors, a display, and a memory coupled to the one or more processors, the memory including one or more programs configured to be executed by the one or more processors and to cause the computer system to perform a method according to any one of claims 1 to 89.
91. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by a computer system, cause the computer system to perform a method according to any one of claims 1 to 89.
92. 90. A device for implementing an exposure progression to improve a subject's ability to manage a psychiatric or mental condition, the device comprising one or more processors and a memory coupled to the one or more processors, the memory comprising one or more programs configured to be executed by the one or more processors and to cause the computer system to perform a method according to any one of claims 1 to 89.
Citation Information
Cited By
Information processing device, information processing method, and information processing program
JP7786775B1
