Virtual reality-mediated art therapy

Abstract

A computing system and a treatment method includes a therapist generating a baseline of a patient; the patient and / or a caregiver creating one or more pre-condition portraits that represent the patient before an onset of a condition; the patient and / or the caregiver creating one or more post-condition portrait) s) that represent the patient after the onset of the condition and / or at some time in the future; and performing analysis and follow-up based on a comparison between the pre-condition portraits and / or the postcondition portraits. The therapist client system is configured to be used by a therapist; a client system configured to provide a patient and / or caregiver with a virtual reality (VR) experience, and collect biometric data of the patient and / or caregiver; and a server configured to receive the collected biometric data from the client system(s), analyze the collected biometric data, and transmit analyzed biometric data to the therapist client system.

Description

VIRTUAL REALITY-MEDIATED ART THERAPYCROSS-REFERENCE TO RELATED APPLICATIONS AND INCORPORATION BY REFERENCE

[0001] The following application is incorporated herein by reference in its entirety: U.S. Provisional Application No. 63 / 531,173 filed on August 7, 2023.TECHNICAL FIELD

[0002] The present disclosure relates to a computing system and to a method, for example, a computing and system for providing art therapy and art as therapy using virtual reality (VR).BACKGROUND

[0003] Many people suffer from conditions that lead to mental and emotional distress. For example, a significant number of people are impacted by traumatic brain injury (TBI), resulting in exorbitant treatment costs for both the brain trauma and often comorbid posttraumatic stress, where posttraumatic stress disorder (PTSD) can result from the incident causing the injury or from the injury itself. As another example, oncology patients often suffer severe emotional distress, due to the deterioration of their physical condition, the toll of treatments, and possible mortality. People may suffer mental and emotional distress due a wide range of conditions, including acute injuries (e.g., TBI, stroke, spinal cord injury, physical injury, etc.), diseases (e.g., cancer, cardiovascular diseases, endocrine disorders, leukemia) neurological disorders (e.g. autism spectrum disorder - ASD, Parkinson’s disease, dementia, Alzheimer’s, etc.), mental illnesses or disorders (eating disorders such as anorexia or bulimia, anxiety, depression, ADHD, etc.), emotional trauma disorders (e.g., PTSD, Acute Stress Disorder, vicarious trauma), and even from conditions such as burnout or the aging process.

[0004] Although a number of methods have been attempted for treating the mental and / or emotional states of patients, including medication, cognitive therapy, psychological counseling, occupational therapy, speech therapy, social skills training, etc., these treatments have shown limited degrees of success.

[0005] Art therapy, which herein refers to both therapeutic sessions mediated by a trained therapist (“mediated art therapy”) as well as non-mediated, self-guided “art as therapy” sessions, are forms of creative arts therapies that originated in the fields of art and psychotherapy. It is an effective treatment for persons experiencing developmental, medical, educational, social, or psychological impairment. Creative therapies are proven to allow unique access to traumatic experiences and associated emotions as they are often stored implicitly (sensory) and not explicitly (verbally). Art therapy has been shown to help patients overcome emotional barriers by providing them with an avenue to express themselves in novel ways, including symbolic and sensory-oriented expression.

[0006] Unfortunately, traditional art therapy is limited in the availability of knowledgeable and trained therapists within a patient’s local area and the availability of teachers or guides to help people learn how to approach self-guided art therapy. Thus, there is a need to be able to expand access to art therapy, whether mediated or self- guided, to a greater number of people. As a corollary, there is a need to enable a trained art therapist to meet with and counsel patients that may be far removed from the therapist’s local region, or to provide someone with the ability to participate in art therapy when a therapist is unavailable or otherwise not desired.SUMMARY

[0007] Accordingly, there exists a need for providing art therapy in a manner that is consistent with the evolving technological landscape. In this regard, Virtual Reality (VR) may be an option for the in-person and remote delivery of art therapy. For example, a therapist may provide a therapeutic environment for treating a condition from a physical location that is different from that of the patient being treated. Alternatively, a patient or user may engage in self-guided art therapy without the need for an art therapist.

[0008] In some aspects, a method comprises generating, by a therapist, a baseline of a patient; creating, by the patient and / or a caregiver, one or more pre-condition portraits that represent the patient before an onset of a condition; creating, by the patient and / or the caregiver, one or more post-condition portraits that represent the patient after the onset of the condition and / or one or more post-condition portraits that represent the patient in the future; and performing analysis and follow-up based on a comparison between the precondition portraits and / or the post-condition portraits.

[0009] In some aspects, a computing system comprises a therapist client system configured to be used by a therapist; a patient client system configured to provide a patient with a virtual reality (VR) experience, and collect patient biometric data of the patient; and a server configured to receive the collected patient biometric data from the patient client system, analyze the collected patient biometric data, and transmit analyzed patient biometric data to the therapist client system. In one or more optional aspects, a computing system further comprises a caregiver client system configured to provide a caregiver with a VR experience, and collect caregiver biometric data of the caregiver.

[0010] In some aspects, a computing system comprises a therapist client system configured to be used by a therapist; a plurality of patient client systems configured to provide a respective patient with a virtual reality (VR) experience, and collect patient biometric data of the respective patient; and a server configured to receive collected patient biometric data from each patient client system, analyze the collected patient biometric data, and transmit analyzed patient biometric data to the therapist client system.BRIEF DESCRIPTION OF THE DRAWINGS / FIGURES

[0011] The accompanying drawings, which are incorporated herein and form part of the specification, illustrate the present disclosure and, together with this written description, further serve to explain the principles of the present disclosure and to enable a person skilled in the relevant art(s) to make and use embodiments described herein.

[0012] FIG. 1 shows a computing system, according to some aspects.

[0013] FIG. 2 shows a server, according to some aspects.

[0014] FIG. 3 shows a client system, according to some aspects.

[0015] FIG. 4 shows a computing system, according to some aspects.

[0016] FIG. 5 shows a process for a method of providing art therapy, according to some aspects.

[0017] FIG. 6 shows a process for a method of providing self-guided art therapy, according to some aspects.

[0018] FIG. 7 shows a process for a method of providing mediated art therapy, according to some aspects.

[0019] FIG. 8 shows a process for a method of generating a baseline, according to some aspects.

[0020] FIG. 9 shows a process for a method of creating a pre-condition portrait, according to some aspects.

[0021] FIG. 10 shows a process for a method of creating a post-condition portrait, according to some aspects.

[0022] FIG. 11 shows a process for a method of using generative Al to analyze a user’s artwork, according to some aspects.

[0023] The features of the present disclosure will become more apparent from the detailed description set forth below when taken in conjunction with the drawings, in which like reference characters identify corresponding elements throughout. In the drawings, like reference numbers generally indicate identical, functionally similar, and / or structurally similar elements. Additionally, generally, the left-most digit(s) of a reference number identifies the drawing in which the reference number first appears. Unless otherwise indicated, the drawings provided throughout the disclosure should not be interpreted as to-scale drawings.DETAILED DESCRIPTION

[0024] This specification discloses one or more embodiments that incorporate the features of the present disclosure. The disclosed embodiment! s) are provided as examples. The scope of the present disclosure is not limited to the disclosed embodiment! s). Claimed features are defined by the claims appended hereto.

[0025] The embodiment! s) described, and references in the specification to “one embodiment,” “an embodiment,” “an example embodiment,” etc., indicate that the embodiment! s) described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is understood that it is within the knowledge of one skilled in the art to effect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.

[0026] Spatially relative terms, such as “beneath,” “below,” “lower,” “above,” “on,” “upper” and the like, may be used herein for ease of description to describe one element or feature’s relationship to another element(s) or feature(s) as illustrated in the figures.The spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. The apparatus may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein may likewise be interpreted accordingly.

[0027] The terms “substantially,” “about,” “approximately,” or the like may be used herein to indicate a value of a quantity that may vary or be found to be within a range of values, based on a particular technology. Based on the particular technology, the terms may indicate a value of a given quantity that is within, for example, 1-20% of the value (e.g., ±1%, ±5% ±10%, ±15%, or ±20% of the value).

[0028] As used herein, the term “condition” may be used to refer to a range of psychologically distressing conditions, including an acute injury, a physical illness, a disease, a mental illness, an emotional disorder, or the like. Thus, the term “condition” should be broadly understood as meaning any condition that imposes a physical, mental, or emotional limitation on a patient. Correspondingly, the term “patient” should be broadly understood as meaning a “user” or any person struggling from one or more conditions.

[0029] Aspects are directed towards both mediated art therapy and self-guided art therapy. Because self-guided art therapy may be conducted without the presence of a therapist, the following discussion in some instances uses the term “user” instead of “patient.” Thus, the terms “user” and “patient” may each be used interchangeably depending on the context of the art therapy being provided. In addition, self-guided art therapy may be assisted by, for example, a software system that may provide a user with prompts, feedback, and / or analysis.COMPUTING SYSTEM

[0030] FIG. 1 shows a configuration of a computing system 100 for providing art therapy, according to some aspects. Computing System 100 may include a server 102 that may be in communication with a plurality of client systems including a therapist client system 104, a user client system 106, and a caregiver client system 108. This configuration is merely illustrative, and it should be understood that computing system 100 may, in some aspects, consist only of a user client system 106 capable of providing art therapy without communication with other systems. In some aspects, computing system 100 may include a plurality of user client systems 106. In some aspects,computing system 100 may include zero, one, or a plurality of caregiver client systems 108. In some aspects, computing system 100 may include zero, one, or a plurality of therapist client systems 104. In some aspects, computing system 100 can include only a user client system 106, a therapist client 104, and no caregiver client systems 108. In another aspect, computing system 100 can include only one user client system 106 and a plurality of caregiver client systems 108. In some aspects, server 102 may be omitted from computing system 100.

[0031] According to some aspects, server 102, if present, may communicate with the client system(s) via one or more private or public networks. For example, server 102 may communicate with the client system(s) via the internet, by virtual private network (VPN), by a dedicated network, etc. In some aspects, server 102 may provide each connected client system with access to a program or application to facilitate communication between the connected client systems. In addition, server 102 may receive data from one or more client systems. Server 102 may then analyze the received data, or may send the collected data to another device or system for analysis. Server 102 may also send analyzed data to one or more client systems.

[0032] As described above, the client systems may include one or more therapist client systems 104, one or more user client systems 106, and one or more caregiver systems 108. These client systems may be implemented as a variety of personal computing devices capable of providing a virtual reality (VR) environment to a user. According to some aspects, a user and a caregiver may each experience the same VR environment at the same time (i.e., simultaneously). In some aspects, a user and a caregiver may each experience a different VR environment. In some exemplary aspects, each client system may be implemented as, for example, a head mounted display device (HMD) for displaying a virtual environment to a user of the HMD. Alternatively, or in addition to such an HMD, each client system may constitute a personal computer (PC), a laptop computer, a portable computer, a mobile computing device, a personal digital assistant (PDA), a cellular phone or smart phone, a wearable device, or the like. In some aspects, if applicable, the client systems may communicate with server 102 using a wireless or cellular network, using a wired connection, or using a combination of wireless and wired connections. For example, according to one aspect, therapist client system 104 may be a personal computer that communicates with server 102 via a broadband wired connection, while user client system 106 and caregiver client system 108 may be HMDs and / orsmartphones that communicate with server 102 via a cellular connection or a combination of cellular and wired connections. This example is merely illustrative, and it is to be understood that the present disclosure should not be limited to such examples.

[0033] Server 102 can be implemented, in some aspects, as a hardware server or a software server. According to some aspects, server 102 can be implemented as a cloudbased server system. For example, server 102 can be implemented as an application in a cloud-based computing platform. In some aspects, server 102 of computing system 100 can be implemented by server 200 shown in FIG. 2. As shown in FIG. 2, server 200 can include a processor unit 202, a memory unit 204, a storage unit 206, a graphics processing unit (GPU) 208, one or more I / O units 210 for connecting to input and / or output devices, and a communication device unit 212.

[0034] Processor 202 and GPU 208 can be connected to communication device 212, which can be configured to communicate with one or more client systems, one or more network devices, one or more other servers, and / or the internet using at least one communication path. Memory 204 can comprise random access memory (RAM) or other temporary memory, such as one or more caches. In some aspects, memory 204 may store processing instructions (i.e., computer software) and / or data. Storage 206 may comprise long term or permanent memory, such as a hard-disk drive, removable storage (e.g., a compact disk drive, an optical disk drive, a floppy disk drive, a cartridge device, a memory stick or card, or the like), and / or read-only memory (ROM).

[0035] Input / output devices connected to I / O unit(s) 210 may comprise, in some aspects, one or more of a keyboard, a joystick, a mouse or pointing device, a microphone, a camera, speakers, one or more monitors or displays, and the like. Input / output devices connected to I / O unit(s) 210 can be used by a user of server 200 to interact with server 200.

[0036] According to some aspects, processor 202 and GPU 208 can be implemented as a single processor (e.g., as separate processing units) or as individual respective processors. In some aspects, processor 202 and GPU 208 can carry out similar processes, but can also be configured to carry out mutually exclusive processes. For example, in some aspects, GPU 208 may render a virtual reality (VR) environment, while processor 202 may execute instructions from memory 204 and VO unit(s) 210 to perform processes requested by one or more applications or programs.

[0037] In some aspects, one or more client systems, such as therapist client system 104, user client system 106, and caregiver client system 108, may be implemented as client system 300 shown in FIG. 3. Client system 300 may include a processor unit 302, memory 304, storage unit 306, GPU 308, one or more I / O units 310 for connecting to input and / or output devices, and a communication device unit 312. Processor unit 302, memory 304, storage unit 306, GPU 308, I / O unit(s) 310, and communication device unit 312 may perform functions similar to those discussed above for processor unit 202, memory unit 204, storage unit 206, GPU 208, I / O unit(s) 210 for connecting to input and / or output devices, and communication device unit 212, respectively.

[0038] In addition, in some aspects, GPU 308 may communicate with one or more displays 330, which may vary depending on the type of client system. For example, in a user client system or caregiver client system, display 330 may be configured to display a virtual reality (VR) environment to a user. In some aspects, display 330 in a user client system or caregiver client system may comprise a head mounted display device (HMD). In some aspects, each client system 300 may be configured as a single HMD, or as an HMD connected to additional input / output device. In some aspects, display 330 may be the monitor of a PC, laptop computer, smartphone, mobile computing device, or other similar computing device. In a therapist client system, display 330 may be configured to display a VR environment to a user, but may also be configured to display additional information to the user, such as data received from a server. In some aspects, display 330 in a therapist client system may be configured to allow the user to view a VR environment as viewed by one or more user and / or caregiver client systems. In some aspects, display 330 in a therapist client system may not display a VR environment to the user, for example, to reduce the computing power used by the therapist client system. Thus, in some aspects, a user client system may include a display 330 that is an HMD, while a therapist client system may include a display 330 including a plurality of monitors for displaying the VR environment, the user’s view, and data about the user received from the server. These examples are merely illustrative, and various other configurations of hardware and / or displays are possible without departing from the invention.

[0039] While input / output devices connected to VO unit(s) 310 may comprise, in some aspects, one or more of a keyboard, a joystick, a mouse or pointing device, a microphone, a camera, speakers, a monitors or display, and the like, such input / output devices may comprise, or may additionally comprise, one or more of a motion tracking device (e.g., anaccelerometer), a face tracking device (e.g., an external camera), an eye tracking device (e.g., a camera that tracks the direction, dilation, etc. of a user’s pupil), a gesture tracking device (e.g., VR gloves or sensors), or the like. In some aspects, an input device on a user client system may collect real-time biometric data. For example, in some aspects, a user client system may include one or more sensors configured to measure a patient’s electroencephalogram (EEG), electrocardiogram (ECG or EKG), heart rate, blood pressure, or other biometric data.

[0040] In some aspects, client system 300 may monitor and collect biometric data on a user’s motion, body, face, eyes, gesture, or the like, as discussed below in more detail. Biometric data collected by client system 300 may be transmitted to a server (e.g., server 102) for analysis and communication with another client system (e.g., a therapist client system). That is, according to some aspects, one or more input / output devices of a user client system and / or caregiver client system may collect biometric data on a user of the client system and may transmit the data to a server. The server may analyze the collected biometric data and transmit the analyzed biometric data to a therapist client system, for review and use by the user of the therapist client system. This collection and analysis of biometric data may be done in a batch process (e.g., at the end of a session), or may be done in real-time, so that a therapist can understand a patient’s emotional, mental, and / or physical state during the current session, as discussed below in detail.

[0041] In some aspects, client system 300 may be configured to create virtual content based on the measurement of a user’s biodata. As one example of this principle, client system 300 may be configured to track a user’s vision, to determine a user’s intent to interact with one or more objects in a virtual environment. As another example, client system 300 may be configured to measure one or more electrical and / or magnetic signals of a user’s brain such as, for example, an alpha wave pattern (approximately 8-12 Hz), a beta wave pattern (approximately 12-35 Hz), a theta wave pattern (approximately 4-8 Hz), a gamma wave pattern (above approximately 35 Hz), a delta wave pattern (approximately .5-4 Hz), or the like. In some aspects, client system 300 may measure electrical signals within the brain, such as the firing of individual or groups of neurons, using, for example, a brain-computer interface or the like. By measuring activity in a user’s brain, client system 300 may determine a user’s intent to interact with one or more objects in a VR environment. Thus, it is envisioned that, in some aspects, client system 300 may be configured with a brain-computer interface, a vision tracking interface, orsimilar such interface, to help, for example, a paralyzed or disabled user to interact with the VR environment in the ways discussed below.

[0042] In some aspects, client device 300 may also be configured to create and enhance virtual content for a user. For example, in some aspects, client device 300 may include one or more physical sensory-enhancing elements that enhance a user’s actual physical perception of an environment. In some aspects, client device 300 may include elements that enhance a user’s olfactory sensations by emitting scents, that enhance a user’s auditory sensations by emitting sounds, that enhance a user’s tactile sensations by providing physical textures, or the like, so that the user actually physically experiences a sensation related to one or more objects that exist in the VR environment. In some aspects, client device 300 may be configured to play music, such as a playlist provided by a therapist or other auditory input, to provide music to help a user avoid distractions, and / or to provide alarms or other audio cues. In some aspects, client device 300 may include one or more probes that provide a user with a simulated sensory-enhancing experience. For example, client device 300 may be configured to provide electrical stimulation to a user’s brain and / or nerves that simulates physical scents, sounds, tactile sensations, or the like.

[0043] According to some aspects, server 102 may receive, analyze, and transmit biometric data collected from one or more of the user client systems. Biometric data may comprise patient biometric data collected by a user client system 106 and / or caregiver biometric data collected by a caregiver client system 108. In some aspects, where computing system 100 comprises a plurality of user client systems and / or a plurality of caregiver client systems, each user client system may collect patient biometric data of a user using the respective user client system, and each caregiver client system may collect caregiver biometric data of a caregiver using the respective caregiver client system. Biometric data may collected by, for example, one or more of a brain and / or body monitoring device (e.g., EEG or ECGZEKG probes), a motion tracking device, a face tracking device, an eye tracking device, and a gesture tracking device, as described above. As one example, a face-tracking device may collect biometric data of a patient recording a patient’s facial expressions before, during, and after creating artwork, as described below. In some aspects, collected biometric data may include one or more of a user’s facial expressions, gestures, heart rate, stress level, blood pressure, galvanic skin response, or the like. In some aspects, collecting biometric data may include recordingone or more of an EEG, an ECG / EKG, blood pressure in one or more poses, or the like. In some aspects, collected biometric data may also include a pressure that the user applies to virtual tool or a virtual canvas, as described below, as measured using a motion tracking device, a gesture-tracking device, a haptic feedback device, or the like. In some aspects, one or more biometric data may be analyzed, evaluated, and / or combined with other data to provide a comprehensive analysis of a user’s neurological, physiological, and psychological factors.

[0044] According to some aspects, biometric data may also include audio data. For example, a user’s voice may be recorded during a session and used to track the emotional state of the user during a session, to compare to previous sessions, or to track over time. Biometric data can also be used across groups of users to track emotions, levels of vulnerability, forms of discussion or other information across specific groups.

[0045] In some aspects, the collected patient biometric data and / or collected caregiver biometric data may be received by server 102 from respective user client system(s) and caregiver client system(s). Collected biometric data may be analyzed by server 102, therapist client system 104, and / or user client system 106 to provide useful information to a patient and / or therapist. For example, server 102 may be configured as a cloud processor to analyze collected biometric data to determine when a user’s heart rate is elevated, when a user’s face or eyes indicates one or more emotions (e.g., happiness, sadness, anger, etc.), or when a user is experiencing an emotion based on other indicators within the collected biometric data. According to some aspects, biometric data may be analyzed by using machine-learning algorithms to identify patterns in one or more type of biometric data. As an example, a machine-learning algorithm could be trained to identify changes in a patient’s heart rate and / or blood pressure that correlate with changes on the patient’s face that indicate anger or sadness. Thus, in some aspects, machine-learning may be used to identify patterns across data sets that otherwise may or may not be apparent to a therapist.

[0046] According to some aspects, such biometric data may be stored in a secure manner. In some aspects, the biometric data may be stored only locally on a user client system 106. In some aspects, the biometric data may be collected in a cloud-only environment in which the biometric data can be stored, acted upon, and sent / received through a custom API. In some aspects, an API may connect to one or more government platforms such as VA Video Connect (the electronic health record for the Veteran’s Administration), MHSGenesis (for the Defense Health Agency), the Armed Forces Health Longitudinal Technology Application (AHLTA), or the like.

[0047] Computing system 100 may include one or more applications that can be used to monitor patient(s) and / or caregiver(s). According to some aspects, server 102 may be configured to transmit analyzed biometric data to one or more therapist client systems 104 or to one or more user client systems 106. Received biometric data can be analyzed, stratified, and used in conjunction with machine-learning algorithms to identify patterns, predictive modeling, and other outcome driven methods. In some aspects, analyzed biometric data may be reported to a therapist, patient, and / or caregiver in a custom report. In some aspects, analyzed biometric data may be reported in one or more data representations, such as graphs, charts, summaries, virtual dashboards, and the like, created for individual therapists, departments, or organizations that monitor and evaluate healthcare data across various populations.

[0048] According to aspects, reported analyzed biometric data may be reviewed to determine how certain emotions or other indicators correlate to a user’s experience during an art therapy session. This review may, in aspects, be accomplished by a therapist, a therapist in conjunction with a software system, or by a software system alone. For example, a therapist and / or software system may review a patient’s (or caregiver’s) biometric data to determine one or more of a degree of loneliness, a degree of social support and / or group cohesiveness (i.e., feelings of belonging to a group), a degree of hopefulness, a degree of universality (e.g., a recognition of a shared experience and a user’s understanding that one patient’s problems are not unique), a degree of altruism, a level of self-esteem, level(s) of social skill(s), a degree of personal responsibility, etc. A therapist and / or software system may also review biometric data to look for signs of catharsis, learning from the experiences of others, more cost effective treatment options, etc. For example, in some aspects, a therapist and / or software system may review analyzed biometric data to determine if a patient experiences sadness, anger, or other emotions, or changes in emotional state such as greater focus, flow, decreased stress and / or pain, or the like, while creating an art piece. This example is merely illustrative to show how a therapist and / or software system may use analyzed biometric data to gain insight into the emotional state of a patient, and it should be understood that a therapist and / or software system may use analyzed biometric data to understand a wide range of emotions of both patients and caregivers during an art therapy session. In addition,machine-learning algorithms may be employed to search biometric data for patterns. For example, an algorithm may be trained to review a patient’s word choices and changes in facial features, which may indicate that the patient is feeling hopeless or depressed or that the patient possesses a low level of self-esteem. As another example, an algorithm could be trained to look for signs of increased hopefulness, which may help a therapist and / or software system understand if the art therapy is having a positive impact on the patient.

[0049] FIG. 4 shows a configuration of a computing system 400 for conducting a group therapy intervention, according to some aspects. Computing system 400 may include a server 402, a therapist client system 404, and a plurality of user client systems 406, 407, and 408. It should be appreciated that, although three user client systems 406-408 are shown in FIG. 4, this number is merely illustrative. In some aspects, computing system 400 may include only two user client systems, or four or more user client systems. Similarly, computing system 400 may include none or a plurality of servers 402 and / or none or a plurality of therapist client systems 404. In some aspects, a group art therapy session could include only a plurality of user client systems 406-408 without a server 402 or therapist client 404.

[0050] In some aspects, the structure and functions of server 402, therapist client system 404, and user client systems 406-408 may be similar to server 102, therapist client system 104, and user client system 106 discussed above (including implementations such as server 200 and client system 300). In computing system 400, therapist client system 404 and / or user client systems 406-408 may receive analyzed biometric data from server 402 for each respective user of a user client system 406-408. In some aspects, in computing system 400, user client systems 406-408 may also be configured to receive analyzed biometric data from server 402 for each respective user of a different user client system. Thus, in computing system 400, user client systems 406-408 may be configured to have access to some or all of the analyzed biometric data received by therapist client system 404 from server 402.THERAPEUTIC METHOD

[0051] FIG. 5 shows a process for a method 500 for providing mediated or self-guided art therapy to a user according to some aspects. FIG. 6 shows a process for a method 600 for providing a self-guided art therapy session, wherein a user accesses an art therapy device without the presence of a therapist, according to some aspects. FIGS. 7-10 show steps fora method for providing a mediated art therapy session, wherein a user engages in art therapy with one or more therapists and (possibly) one or more caregivers, either remotely or in person, according to aspects.

[0052] The following discussion is directed towards the provision of user -centered art therapy for the treatment and / or management of one or more conditions, so that the details of the therapeutic methods discussed below are applicable to a wide range of conditions and treatments. As described above, the following therapeutic methods could be used to help manage disabilities and / or disorders resulting from acute injury, physical illness, disease, mental illness, emotional trauma, or the like. It is also envisioned that the following therapeutic methods can be used in providing telehealth services to users that are unable, due to disability, age, or distance, other factors, to receive therapy in a location outside user’s home.

[0053] According to aspects, method 500 in FIG. 5 begins by establishing a user baseline at step 502. In some aspects, establishing a user’s baseline may comprise various exercises, such as one or more formal assessments, one or more informal assessments, one or more grounding exercises, or other similar steps. In some aspects, establishing a user’s baseline may comprise providing the user(s) and / or caregiver(s) with an introduction to the VR or XR equipment, such as providing a tutorial or instructions for using the user client system(s) and / or caregiver client system(s). Step 502 may include allowing time for the user(s) and / or caregiver(s) to become acquainted with the input devices as well as any user interface (UI) being used. In some aspects, such tutorials or instructions may be omitted where user(s) and / or caregiver(s) are already familiar with the user client system(s) and / or caregiver client system(s).

[0054] According to aspects, once the user(s) and / or caregiver(s) are acquainted with the VR or XR equipment, the user(s) and / or caregiver(s) may be asked to participate in one or more informal assessments and / or formal assessments. For example, in aspects of a mediated art therapy session, a therapist may conduct a formal assessment of the user, as discussed below. In aspects of a self-guided art therapy session, a software system may conduct an informal assessment of the user. An informal assessment may include questions designed to elicit the user’s emotional state or determine if the user’s emotional state has changed from the last session. These examples are not limiting, and either type of assessment may be used in either mediated or self-guided art therapy sessions.According to some aspects, one or more assessments may be conducted before or during onboarding.

[0055] In addition, step 502 may, according to aspects, include one or more grounding exercises intended to help a user enter into a relaxed and focused state before art making and processing portions. In some aspects, such grounding exercises can include breathing exercises, counting exercises, stretching, meditation, mindfulness or the like. According to aspects, grounding exercises may be suggested by a therapist in a mediated art therapy session or by a software system in a self-guided art therapy session. In some aspects, grounding exercises may be omitted according to a user’s preference.

[0056] Once a user’s baseline has been established, art therapy method 500 may proceed to step 504, according to aspects. In step 504, a user may be prompted to engage in the creation of some type of art. In step 504, the user and a caregiver, if present, may be prompted to use a virtual canvas to create an art piece. In some aspects, the art piece may, for example, represent the user before or after the onset of their condition(s). In some aspects, the user may be more generally prompted simply to express their feelings using art. In some aspects, the user and / or caregiver may use a virtual template provided in the VR environment. In some aspects, the virtual template may include a virtual canvas such as a blank “mask,” a blank full-body model, or a limited model of a portion of the human body. In some aspects, the virtual template may comprise one or more of a landscape, a visible feature, open space, another object, etc. In some aspects, the choice of virtual canvas may be left to the discretion of a therapist, the choice of a user, the determination of a software system, or may be dictated by the particular type of condition being treated.

[0057] According to aspects, the user and caregiver, if present, may each use VR tools to create an artwork. In some aspects, such VR tools may include drawing and coloring tools, whereby the user and caregiver may “paint,” “draw,” or “color” the virtual canvas in the VR environment. In some aspects, such VR tools may include collaging tools, whereby the user and caregiver cover the virtual canvas in images, to thereby create a mosaic or collage. In some aspects, the VR tools may include, in addition to or in place of, a brush or other tool, one or more of an image, illustration, text, three-dimensional content, sound, or other virtual content. In some aspects, users may upload one or more images to form a custom collage. Various other VR tools for creating art work may be used without departing from the invention. In some aspects, a generative art platform may be used to assist the user. For example, in some aspects, a user may provide a visual,textual, or audio prompt of what they would like to see, and a generative Al platform may be used to create a sketch or illustration in response to the user’s prompt. In some aspects, generative Al may be used as a method of artwork enhancement. According to some aspects, Al algorithms may be applied to user’s original artwork to make the artwork look more creative or more realistic, to add details, or to diminish some details

[0058] In addition, in some aspects, the VR tools or the VR application may include one or more Accessibility features. For example, an Accessibility feature may allow a user to work with only one hand, or with no hands. Another Accessibility feature may provide color contrasting to aid users suffering from color blindness. Yet another Accessibility feature may provide users with voice controls or other controls that allow a user to work without moving hands, arms, legs, etc. In some aspects, machine-learning algorithms could be trained to assist a user and / or caregiver in creating such an art piece. For example, an algorithm may assist a user by compensating for a user’s limited mobility or dexterity in manipulating VR tools. According to some aspects, a machine-learning algorithm could be trained to recommend additional images for use in a collage based on a user’s previously selected image(s). Such Accessibility features may include visiontracking and / or a brain-computer interface, or similar such measurement device, as discussed above.

[0059] According to aspects, step 504 may also include monitoring the user and / or caregiver before, during, and after the creation of the artwork. For example, as discussed earlier, input / output devices connected to VO unit(s) 310 in client system 300 may monitor the motion, face, eyes, and gestures of the user and / or caregiver. These input / output devices may provide biometric data on various aspects of the user and / or caregiver. As discussed above, collected biometric data may then be analyzed by server 102 and / or one or more client systems to provide insight to the therapist as to the emotional state of the user and / or caregiver before, throughout, and after the creation of the artwork.

[0060] According to aspects, the collected biometric data may be analyzed make various determinations. For example, in some aspects, an EEG recording (one example of the collected biometric data) may be analyzed to determine if the user’s brain has entered into a more relaxed or more focused state, or if the user’s brain is cognitively drained, indicating the user may need a break. In some aspects, an EKG reading (another example of the collected biometric data) may be analyzed to determine if the user’s heart rateincreases or decreases in response to a potential stressor. In some cases, an EKG reading may be analyzed to determine if the user is processing trauma or reliving a difficult memory. In some aspects, the collected biometric data may be analyzed to determine a user’s level (e.g., 0-10) of experiencing one or more emotions. According to some aspects, these determinations may be shown in real time by a chart, dashboard, etc., and / or shown overtime on a graph.

[0061] In some aspects of a mediated art therapy session, the analyzed data may be provided to the therapist to help the therapist understand if the user feels particular emotions (e.g., happiness, sadness, anger, surprise, etc.), along with measurements revealing their level of physiological arousal or neurological focus, etc., before, during and after creation of their artwork, which can give the therapist insight into the emotional state of the user. In aspects of a self-guided art therapy session, similar analysis can be performed by a software system and provided directly to the user. In some aspects, machine-learning algorithms may be used, as discussed above, to provide the therapist and / or software system with greater insight into biometric data, including by identifying patterns that arise across different types of biometric data.

[0062] In some aspects, an art therapy session may be recorded for future playback. For example, a separate video of the artwork may be captured for each user and each caregiver. In some implementations, a video of a session can be “scrubbed” so that a viewer is able to move through the video forward and backwards by clicking and holding a play marker or other indicator. In some aspects, user and caregiver videos may be played back independently or played back in sync. The Therapist or facilitator may also be able to select different session feeds (e.g., user or caregiver). In some aspects, a user may access one or more feeds that are accessible only to the user. In some aspects, such a user-only accessible feed may be displayed only to the user (e.g., only on the display of the user’s user client system 106). According to some aspects, one or more feeds may be uploaded to a local or cloud-based repository for viewing by others as indicated by the user. For example, in some aspects, a user may choose to share a particular feed to a cloud-based “viewing area” that is secured by one or more authentication factors such as a password, virtual token, or the like. In some aspects, a user’s and / or caregiver’s artwork may be used to generate a design or printing file (e.g., a Computer Aided Design “CAD” file), which may be used to print or publish the artwork (e.g., via 3-D printing).

[0063] According to aspects, art therapy method 500 may conclude with processing at step 506. Processing, as used here, refers to the user’s processing of the overall experience, the art making process, the final art piece, and the user’s emotional state. In some aspects, processing may refer to analysis of the artwork. In aspects of a mediated art therapy session, processing may include a dialogue between the user(s), caregiver(s) (if present), and / or therapist(s). In aspects of a self-guided art therapy session, processing may include reflection on the user’s own artwork. For example, the user may be prompted by the software system to contemplate one or more features of the artwork and the potential meaning(s) to the client.

[0064] In some aspects, processing at step 506 may be accompanied with the results of the user’s collected and analyzed biodata, to help the user understand his or her emotional state. In some aspects, machine-learning algorithms may be used to provide greater insight into biometric data, including by identifying patterns that arise across different types of biometric data. In some aspects, examples of such patterns may include changes in a user’s heart rate, blood pressure, galvanic skin response, and or increases or decreases in brain wave activity in response to the user’s session(s). However, it should also be appreciated that machine-learning is not limited to the review of biometric data across one portrait or a single session. Indeed, according to some aspects, machinelearning algorithms may be employed on a long-term basis, to search for patterns in the biometric data, across a session or multiple sessions, that indicate changes in a user’s emotions, physiology, and overall mental health. For example, a machine-learning algorithm may be implemented to compare a user’s biometric data during the creation of the pre-condition portrait to that user’s biometric data during the creation of the postcondition portrait, or even to that user’s biometric data after discussing and comparing the portraits with the therapist, to determine if the user has shown any signs of a catharsis. Alternatively, or in combination, a machine-learning algorithm may be used to compare a user’s biometric data to a representative biometric data (e.g., a statistical average across many users, anonymized data from users of similar demographics, data from other clients of the therapist, etc.), to determine if the user is experiencing particular emotions. Such machine-learning algorithms may help a therapist understand the effect of the therapy on a user even where the user does not openly exhibit emotional responses to the therapy.

[0065] During step 506, in some aspects, the therapist and / or software system may also determine if any follow-up to the art therapy session(s) is desirable. For example, thetherapist and / or software system may determine if additional art therapy may be helpful. In some cases, the therapist and / or software system may recommend that a user continues regular art therapy sessions, and the user may comply by engaging in creating additional artwork using the VR application. In some cases, the therapist and / or software system may suggest that the user switches from mediated to self-guided art therapy or vice-versa. In addition, the therapist and / or software system may determine if the results of the art therapy session(s) should be shared with other members of the user’s care team. The therapist and / or software system may also determine if any referrals for additional care, outside of the user’s current care team, may be helpful to the user.

[0066] In some aspects, therapy method 500 may be facilitated, for example, by one or more applications or processes that establish a remote connection between a therapist, a user, and a caregiver (if present) or other users. In one example of a mediated art therapy session, a therapist may create a virtual “room” and / or “session.” In aspects of a self- guided art therapy session, an application may create a virtual session or room for the user that persists after the user logs out. Users can join the virtual room or session using one or more authentication means, including log-in information, a secure session code, or similar. In at least one aspect, a therapist or administrator may share a four-digit session code in the application so that the user and caregiver can enter the virtual room created by the therapist. The virtual room and session may be cloud-based in that the virtual room and session are created and maintained by a cloud server. Alternatively, the virtual room and session may be maintained by a server based at one or more of the therapist’s office, the user’s home, or the like. In some aspects, a therapist or other administrator may create and manage “types” of users, such as “user,” “caregiver,” or the like. Session information (e.g., biometric data, video recordings, etc.) may be attached to one or more users, and may be imported through, for example, formatted data files or Application Program Interface (API) connections.

[0067] In some aspects, a VR application may be used not only for user-centered therapy, as is described below, but may also be used to facilitate remote or in-person group therapy (for example, using computing system 400 shown in FIG. 4). In some aspects, the VR application may be used as a cloud platform that simultaneously connects a plurality of users, caregivers, and / or therapists in a single session. Thus, the virtual “room” or session may include a “public room” accessible to all users, and one or more “private rooms” accessible only to designated users. Users in a remote group therapy session maybe identified by a name or other personal identifying information, or may remain anonymous. The VR application may also permit the presence of multiple therapists, and may differentiate between types of therapists (e.g., based on administrative privileges of different therapists).SELF-GUIDED ART THERAPY

[0068] According aspects, method 600 in FIG. 6 may begin at step 602 of establishing a user’s baseline. Step 602 may be similar in many respects to step 502 of method 500. In some aspects, a user of method 600 may, at step 602, be instructed in the use of the VR or XR device using, for example, a series of guides, tutorials, instructions, or the like. According to aspects, at step 602, the user may also be prompted to complete one or more formal assessments or informal assessments. The user may also be prompted to complete one or more grounding exercises, such as those discussed with regard to step 502.

[0069] Method 600 may then, according to aspects, proceed to step 604, wherein the user may be prompted to select either an unguided session or a guided session. If the user selects an unguided session, method 600 may proceed to step 612. If the user selects a guided session, method 600 may proceed to step 614.

[0070] At step 612, the software system may, according to aspects, provide the user with a blank virtual canvas and suggest art therapy exercises that may help the user regulate their emotional state. In some aspects, such art therapy exercises may include one or more meditative drawing, drawing of iterative geometric shapes (i.e., mandalas), free drawing structured by shapes (e.g., zentangles), doodling, open studio exploration, or the like.

[0071] At step 614, the software system may, according to aspects, provide the user with more focused art therapy exercises to help the user focus on one or more specific topics. In some aspects, at step 614, the user may be provided with a particular type of canvas, such as a blank mask, flat canvas, or open space. In aspects, the user may then be prompted to draw, color, etc. on the canvas.

[0072] According to aspects, during a self-guided art therapy session, the user may be prompted to focus on certain events or time periods. For example, in some aspects, the user may be prompted to create a portrait that reflects the condition of the user before the onset of their condition (a “pre-condition portrait”) or after the onset of their condition (a “post-condition portrait”) or a future self.

[0073] In some aspects, the user may be prompted to create other types of artwork. For example, in some aspects, the user may be prompted to create an artwork (e.g., a landscape, a collage, etc.) that reflects the user’s current emotional state or the user’s feelings along their individual journey. In some aspects, the user may be prompted to create an artwork that focuses on the user’s changes in self and emotional experiencing over time.

[0074] According to aspects, step 612 and 614 may each proceed to step 620 after the completion of one or more pieces of artwork. Step 620 may include processing as discussed above regarding step 506. In some aspects, the software system may provide the user with an analysis of the user’s biodata during the session, as described above. The user may also be prompted to reflect on the artwork and emotional state. According to aspects, method 600 may end at step 620 or may proceed to step 625.

[0075] At step 625, in some aspects, the software system may identify any potential follow-up to the session. For example, in some aspects, the software system may prompt the user to schedule another art therapy session. In some aspects, the software system may prompt the user to contact a therapist to engage in mediated art therapy. In some aspects, the software system may conclude that additional art therapy is not necessary. For example, in some aspects, the software system may determine, based on the user’s analyzed biometric data, that a user is experiencing intense emotions such as anger or sadness or displaying biofactors consistent with PTSD, or the like. In such cases, the software system may recommend that the user contact a licensed therapist, according to some aspects. In some aspects, biometric data indicating less strong emotions may be used as basing for recommending continued self-guided art therapy sessions.MEDIATED ART THERAPY

[0076] FIG. 7 shows an exemplary process for a method of providing a mediated art therapy session including multiple artworks according to some aspects. Because these aspects relate to mediated art therapy, the term “patient” is used to connote a relationship between a user and a therapist. However, as described above, the terms “user” and “patient” are used interchangeably throughout. In addition, as used herein, the term “portrait” may refer to any artwork created by the patient and / or caregiver with the intention of representing any aspect of the patient at a point in time. Thus, the term“portrait” should be understood to mean any artwork of a patient created by a patient and / or caregiver or loved one.

[0077] In some aspects, method 700 may begin with generating a baseline in step 702. Step 702 may be similar in some aspects to step 502 in method 500 of FIG. 5. After generating a baseline, therapy method 700 may move to steps 704 and 706 of creating artwork. Steps 704 and 706 may correspond, in some aspects, to step 504 in method 500 of FIG. 5. In step 704, the patient(s) and / or caregiver(s) may create a pre-condition portrait of the patient. In step 706, the patient(s) and / or caregiver(s) may create a postcondition portrait of the patient. In some aspects, therapy method 700 may conclude at step 708. Step 708 may correspond in some aspect to step 506 in method 500 of FIG. 5. According to some aspects, in step 708, the created portraits may be analyzed and compared, and any follow-up discussion, treatments, or care may be determined. These steps are discussed in more detail below.

[0078] FIG. 8 shows a detailed set of steps that may take place during the generating a baseline of step 702, according to some aspects. For example, step 702 may begin at step 802 with having a patient and / or a caregiver complete an assessment such as a self- awareness questionnaire. In some aspects, such a self-awareness questionnaire may provide a quantitative baseline for the patient’s level of self-awareness. Such a self- awareness assessment may include having the patient and / or the caregiver complete a questionnaire that provides the therapist with a baseline quantitative understanding of the patient’s abilities in performing one or more tasks or functions. In some aspects, the self- awareness questionnaire may be a psychometric examination, evaluation, or questionnaire. In at least one aspect, the self-awareness questionnaire may be, for example, the Patient Competency Rating Scale (PCRS). In some aspects, the self- awareness questionnaire may provide a therapist with a baseline quantitative score of the patient’s daily living activities, behavioral and emotional functions, cognitive abilities, and physical functions.

[0079] Although the PCRS described above may rely on both the patient and the caregiver completing the questionnaire, in some aspects, various other examinations, evaluations, or questionnaires could be used in step 802. Thus, in some aspects, only the patient may answer a self-awareness questionnaire at step 802, while, in some aspects, a caregiver, if present, may also answer a similar questionnaire, so that the therapist can analyze the differences between the patient’s attitudes and beliefs and those of thecaregiver. According to some aspects, a quantitative score may be determined by, for example, subtracting a patient’s score on the self-awareness questionnaire and a caregiver’s score on the same questionnaire. In some aspects, the therapist may also complete a similar questionnaire, and the therapist’s score may or may not be factored into a quantitative score.

[0080] Step 702 of method 700 may include an emotional state assessment at step 804, according to some aspects. In some aspects, such an emotional state assessment may provide a quantitative baseline for the patient’s emotional state. Similar to the self- awareness questionnaire, an emotional state assessment may be a psychometric examination, evaluation, or questionnaire. In at least one aspect, step 804 may comprise having the patient complete, for example, the Positive and Negative Affect Schedule (PANAS), which helps a therapist identify levels of positive and negative affect. In some aspects, the emotional state assessment provides a therapist with a baseline quantitative score of a patient’s positive and negative affect. However, aspects are not limited to using formal assessments, and step 702 may, in some aspects include one or more informal assessments, as discussed above. In some aspects, step 702 may include a combination of formal and informal assessments, or even only a single informal assessment without any formal assessments.

[0081] As shown in FIG. 7, after the conclusion of self-awareness assessment 804, step 702 of method 700 proceeds to step 704. FIG. 9 shows that step 704 of method 700 may begin with a process of initial virtual reality (VR) onboarding at step 902, which may be similar in some aspects to parts of step 502 in method 500 of FIG. 5. Such onboarding may familiarize the patient and / or caregiver with the VR environment, the VR tools to be used for the therapy session(s), any log-in credentials necessary for using the VR system, or the like. According to some aspects, step 902 may begin with a patient and / or caregiver activating a respective patient client system (e.g., a user client system 106) and / or caregiver client system 108, being given log-in credentials, and being asked to login to a VR application. In some aspects, step 902 may also include entering a session code or other identification to start a new virtual room or session using a VR application. Because a patient and / or caregiver may be unfamiliar with the tools and settings of the VR application being used, step 902 may also comprise the therapist demonstrating the tools and settings of the VR application to the patient and / or caregiver, to help familiarize the patient and / or caregiver with the VR environment.

[0082] After the VR onboarding is completed, or if onboarding is not necessary, step 704 proceeds to the creation of one or more pre-condition portraits at step 904, according to some aspects. The creation of artwork in step 904 may correspond in some aspects to the creation of artwork in step 504 in method 500 of FIG. 5.

[0083] In some aspects, once the patient and the caregiver, if present, complete their precondition portrait(s) of the patient during step 904, the therapist, patient, and caregiver (if present) may discuss the pre-condition portrait(s). In some aspects, the therapist may then conclude the current session and schedule a next session to start at step 706. In some aspects, the therapist may move immediately to step 706 as a part of the same session. The scheduling and duration of the sessions may be left to the discretion of the therapist, or may be dictated by the condition being treated, the patient’s stamina to participate in the session, or other relevant factors.

[0084] Method 700 may continue, or resume in the next session, with the creation of the post-condition portrait at step 706, according to some aspects. As shown in FIG. 10, step 706 may comprise step 1002 of the patient and the caregiver, if present, creating one or more portraits that represent(s) the patient after the onset of the condition and / or that represent the patient in the future. For example, in some aspects, the patient and caregiver may each create a portrait that represents the current physical, mental, and / or emotional state of the patient after the onset of the condition. In some aspects, the patient and caregiver may each create a portrait that represents the patient at some future time such as, for example, days, weeks, months, or years from the present time. According to some aspects, the patient and caregiver may create multiple post-condition portraits that represent the patient at a current time and at a future time. In some aspects, the patient and caregiver may create only one of these post-condition portraits.

[0085] In some aspects, step 1002 may be similar in structure and in function to step 904, as discussed above, except that the patient and caregiver may now be creating a postcondition portrait of the patient. That is, the patient and caregiver may still use a user client system 106 and a caregiver client system 108 to engage in a virtual environment, such as virtual reality (VR), which provides the user with a blank virtual canvas, such as the virtual canvas discussed above. The patient and caregiver may then use one or more tools or settings in the virtual environment, such as the coloring, drawing, painting, or collaging tools discussed with respect to step 904, or other similar tools, to create a virtualportrait that represents the patient after the onset of the condition (i.e., a post-condition portrait).

[0086] In addition, step 706 may comprise facial assessment and emotion tracking at step 1004, according to some aspects. In some aspects, step 1004 may be similar in structure and function to step 906 discussed above. Thus, the patient client system (e.g., user client system 106) and the caregiver client system 108 may collect biometric data about one or more of the motion, face, eyes, gestures, etc. of the patient and / or caregiver, respectively, throughout step 1002. In some aspect, the patient client system (e.g., user client system 106) and the caregiver client system 108 may analyze the collected data or may transmit the collected data to server 102 for analysis. The analyzed biometric data may be transmitted to therapist client system 104, patient client system (e.g., user client system 106), and / or caregiver client system 108, to help the therapist understand the emotional state(s) of the patient and / or the caregiver. Step 706 may then proceed to step 706, as shown in FIG. 7.

[0087] Step 706 may comprise analysis of the created portraits as well as follow-up on the therapy session(s), if desirable. Step 706 may begin in some aspects with the therapist comparing and discussing the various portraits with the patient and the caregiver, if present. For example, the therapist may compare the patient’s created post-condition portrait to the patient’s created pre-condition portrait. In some aspects, the therapist may compare the patient’s created post-condition portrait to the caregiver’s created postcondition portrait. In some aspects, during this phase, the patient and the caregiver, if present, may also complete another formal or informal assessment, which may be similar in structure and function to the assessment(s) completed during step 802. In some aspects, such an assessment may comprise a second administration of the Patient Competency Rating Scale (PCRS) by the patient, caregiver, and / or therapist. Likewise, another emotional state assessment, such as the PANAS described above, may be completed by the patient. However, the invention is not limited to these examples, and any satisfactory emotional state questionnaire or self-awareness assessment, or no emotional state questionnaire and / or or self-awareness assessment, may instead be used.

[0088] In some aspects, step 708 may conclude with any follow-up that is determined by the therapist and / or patient to be desirable. As noted above, step 708 may, according to some aspects, proceed with additional and / or regular recurring art therapy sessions. In some aspects, regardless of, or in addition to, additional sessions, referrals, or treatment,the patient and the caregiver, if present, may be asked to complete a final assessment. The final assessment may be similar in structure and function to the initial assessment in steps 802 and 804, according to some aspects. In some aspects, the final assessment may comprise a final administration of an emotional state questionnaire and / or a self- awareness assessment. However, the invention is not limited to this example, and any satisfactory final assessment, or no final assessment, may instead be used.

[0089] According to some aspects, the final assessment, if administered, may be completed by the patient and caregiver, if present, at a later time after the conclusion of the final therapy session. This time may be dictated by the scheduling of the therapy session(s), or may be determined by other relevant factors. In some aspects, the final assessment may be completed from one day up to one month after the conclusion of the final therapy session. In some aspects, it may be preferable to provide the final assessment one week (seven days) after the final therapy sessions, while in some aspects it may be preferable to provide the final assessment up to one month (thirty days) after the final therapy session. In some aspects, the same final assessment may be given two or more times after the final therapy session. For example, the final assessment may be given seven days after the final therapy session and thirty days, or more, according to some aspects, after the final therapy session.

[0090] According to one exemplary aspect, method 700 may be executed over the course of three weeks. For example, steps 702 and 704 may be conducted on the same day, or step 704 may be conducted the day after step 702. In this case, step 706 may be conducted one week (seven days) after step 704, and the final assessment in step 708 may be completed one week (seven days) after step 706. It should be understood that this timetable is merely one example, and may be adjusted by the therapist to achieve a satisfactory therapy course for the patient.

[0091] In addition, it should be understood that, although provided above as illustrative examples, the invention is in no way limited to the use of the PANAS and / or PCRS assessments. Instead, the invention encompasses the use of any similar assessment s). Similar assessments may include psychiatric, psychometric, cognitive, or other formal and informal assessments designed to assess a patient’s feelings and emotions. Some non- exhaustive lists of similar assessments may be found in the list of Scales provided by the Center for Outcome Measurement in Brain Injury (COMBI), which is maintained online at tbims.org / combi / list.html or by NovoPsych, which is maintained online atnovopsych.com.au / assessments / . However, these lists are merely representative of similar assessments to those described above, and should not be construed to limit the invention in any way. In some aspects, such assessments may be implemented as question-and- answer sessions between the user and the VR application. Natural Language Processing (NLP) may be used for voice recognition, generation, and for tracking a user’s answers to questions. Based on these answers, additional questions could be asked or interpreted. A voice may be created (e.g., via generative Al) to speak to the user, while a Large Language Model or similar NLP may be used to interpret the response, save the answer, or provide additional feedback to the user.

[0092] Measurements include cognitive assessments including the 5-pt test, letter fluency test, card sorting, raven test, spatial orientation, temporal orientation, and more. Such assessments may be delivered in VR along with algorithms (the means) for assessing results based on eye tracking, voice tracking, and other VR features.

[0093] As noted above, the foregoing therapy method should be limited to the use of visual artwork, but may be used for other forms of therapy. For example, music therapy is another form of creative therapy showing evidence of improved outcomes for patients. Music, similar to visual art, has an ability to stimulate sensory, motor, perceptive- cognitive, and emotional functions simultaneously within a patient’s brain. Thus, in some aspects, a therapist may offer a music therapy session instead of, or in addition to, an art therapy session. Music therapy may include one or more of melodic intonation therapy, to help with language difficulties; active music interventions, to improve cognitive functions; rhythmic auditory stimulation, to improve motor impairments; or helping patients monitor and modulate behavior through auditory queues and activities.

[0094] According to aspects, Artificial Intelligence (Al) may also be used in connection with one or more steps or devices of this disclosure. FIG. 11 shows an exemplary process for a method of using generative Al to analyze a user’ s artwork, according to some aspects. FIG. 11 shows that a user device may transmit user-created artwork to a model 1110. In some aspects, user device 1101 may be, for example, a user client system 106. In some aspects, user device 1101 may be, for example, a therapist client system 104 or a caregiver client system 108. Model 1110 may, according to aspects, be a machine learning (ML) model such as large language model (LLM), a processing algorithm, or the like. Model 1110 may, in some aspects, reside on a remote server (e.g., the cloud). In some aspects, model 1110 may reside on server 102. According to aspects, user device1101 may transmit the user-created artwork to model 1110 by one or more a broadband internet connection, a wireless internet connection, or the like. In some aspects, user device 1101 may transmit the user-created artwork to model 1110 using an encrypted connection such as a secured network connection, an encrypted network, a virtual private network (VPN), or the like.

[0095] According to some aspects, upon receiving the user-created artwork, model 1110 may evaluate the user-created artwork. In some aspects, model 1110 may evaluate the user-created artwork using a trained model. For example, a generative Al or machine learning algorithm may be trained to interpret user artwork based on the use of lines, colors, drawing patterns, photos, illustrations, and words selected, or the like, to analyze neurocognitive or psychological indications of the user. In some aspects, model 1110 may then pass this analysis to a guardrails / rules module 1115.

[0096] According to aspects, guardrails / rules module 1115 may process the analysis from model 1110. Guardrails / rules module 1115 may, in some aspects, be programmed to convert analysis from model 1110 into feedback appropriate for a user. In some aspects, guardrails / rules module 1115 may be trained, for example, based on comments from actual therapists. In some respects, guardrails / rules module 1115 may be trained on psychological frameworks such as art therapy, cognitive behavioral therapy (CBT), dialectic behavioral therapy (DBT), Acceptance and Commitment Therapy (ACT), Jungian analytical psychology, flow theory, and more. In some aspects, guardrails / rules module 1115 may be trained to reframe analysis of one or more clinical evaluations (e.g., depression, anxiety, anger, etc.) into comments that may be more helpful to a user. Thus, according to some aspects, guardrails / rules module 1115 may render the analysis from model 1110 in a form that is more compassionate of a user’s emotional and / or mental attitude. In some aspects, guardrails / rules module 1115 may convert the analysis from model 1110 into reflection analysis suitable for a user of user device 1101.

[0097] According to aspects, guardrails / rules module 1115 may transmit the reflection analysis to a processing module 1120. In some aspects, processing module 1120 may convert the reflection analysis into a reflection feedback for the user of user device 1101. In some aspects, processing module 1120 may use natural language processing (NLP) or similar processing to generate one or more responses for the user. In some aspects, processing module 1120 may generate one or more responses to be presented to the user. For example, processing module 1120 may generate a text, visual, or audio response thatprompts the user to reflect on the user-created artwork. In some aspects, processing module 1120 may analyze one or more of thematic analysis, potential meaning, visual element analysis, and other forms of analysis to prompt the user’s reflection on the user- created artwork. As a non-limiting example, based on analysis 1110 determining that the bold lines in a user-created artwork indicates that the user is experiencing anxiety, processing module 1120 may provide an audio or visual prompt asking the user to reflect on any feelings of unease or anxiety.

[0098] According to aspects, after creating a reflection feedback, processing module 1120 may transmit the reflection feedback to user device 1101. In some aspects, the reflection feedback may be transmitted to the user via the same or similar network (e.g., a secured network, an encrypted network, a VPN, or the like) as used to transmit the user-created artwork to model 1110.

[0099] In addition, in some aspects, user device 1101 may collect user feedback for improving the performance of one or more of the model 1110, guardrails / rules module 1115, and processing module 1120. User feedback may, in some aspects, comprises direct user feedback such as responses to survey questions about the system. User feedback may also or alternatively, in some aspects, include indirect user feedback such as measuring or collecting one or more types of biometric data, as discussed above. As a non-limiting example, a measurement showing that a user’s heart rate increased while viewing the reflection feedback may indicate that the reflection feedback is provocative and should be made more compassionate for the user. In a non-limiting example, as shown in FIG. 11, user feedback may be transmitted to guardrails / rules module 1115 to help the system understand if the analysis is being appropriately converted into compassionate feedback for the user. Aspects are not limited to this example, and user feedback may be transmitted to one, a plurality, or all of model 1110, guardrails / rules module 1115, and processing module 1120. Thus, in some aspects, user feedback may be used to reinforce the learning of one or more of model 1110, guardrails / rules module 1115, and processing module 1120. In some aspects, one or more of model 1110, guardrails / rules module 1115, and processing module 1120 may be programmed to adaptively learn from the user feedback. As a non-limiting example, guardrails / rules module 1115 may change the way that one or more clinical analyses are converted into reflection analysis.

[0100] According to aspects, model 1110, guardrails / rules module 1115, and processing module 1120 may be provided on the same or different devices. As a non-limitingexample, model 1110, guardrails / rules module 1115, and processing module 1120 may constitute separate processing modules on a single server device. In some aspects, server 200 may include multiple processors 202, with one processor being dedicated to each of model 1110, guardrails / rules module 1115, and processing module 1120, respectively. In some aspects, model 1110 may reside in a computing location that is remote from the computing location of guardrails / rules module 1115 and / or processing module 1120. As a non-limiting example, server 120 may receive the user-created artwork and transmit it to a cloud-based model. The cloud-based model may then transmit the analysis to server 120, where a processor functions as guardrails / rules module 1115. Server 120 may then transmit the reflection analysis to user device 1101, which includes a processing module 1120. In some aspects, model 1110 and guardrails / rules module may both be remote from server 120 or may both be provided at server 120 while processing module 1120 is provided at user device 1101. Aspects are not limited by the physical locations of model 1110, guardrails / rules module 1115, and processing module 1120.

[0101] Further, although the above description is provided in the context of a virtual environment provided through virtual reality (VR), it should be understood that the invention is not limited to VR. Instead, VR is merely provided as an illustrative example of mixed-reality environment capable of providing the virtual environment, tools, and canvas described above. Other similar mixed reality environments may be used instead of VR, including augmented reality (AR), extended reality, or cross reality (XR), or other similar mixed reality.

[0102] It is to be understood that the phraseology or terminology herein is for the purpose of description and not of limitation, such that the terminology or phraseology of the present disclosure is to be interpreted by those skilled in relevant art(s) in light of the teachings herein.

[0103] It is to be appreciated that the Detailed Description section, and not the Summary and Abstract sections, is intended to be used to interpret the claims. The Summary and Abstract sections may set forth one or more but not all exemplary embodiments of the present disclosure as contemplated by the inventor(s), and thus, are not intended to limit the present disclosure and the appended claims in any way.

[0104] The present disclosure has been described above with the aid of functional building blocks illustrating the implementation of specified functions and relationships thereof. The boundaries of these functional building blocks have been arbitrarily definedherein for the convenience of the description. Alternate boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed.

[0105] While specific embodiments of the disclosure have been described above, it will be appreciated that embodiments of the present disclosure may be practiced otherwise than as described. The descriptions are intended to be illustrative, not limiting. Thus, it will be apparent to one skilled in the art that modifications may be made to the disclosure as described without departing from the scope of the claims set out below.

[0106] The foregoing description of the specific embodiments will so fully reveal the general nature of the present disclosure that others can, by applying knowledge within the skill of the art, readily modify and / or adapt for various applications such specific embodiments, without undue experimentation, without departing from the general concept of the present disclosure. Therefore, such adaptations and modifications are intended to be within the meaning and range of equivalents of the disclosed embodiments, based on the teaching and guidance presented herein.

[0107] The breadth and scope of the protected subject matter should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.

Claims

CLAIMS1. A method comprising: generating, by a therapist, a baseline of a patient; creating, by the patient and / or a caregiver, one or more pre-condition portraits that represent the patient before an onset of a condition; creating, by the patient and / or the caregiver, one or more post-condition portraits that represent the patient after the onset of the condition; and performing analysis and follow-up based on a comparison between the precondition portraits and / or the post-condition portraits.

2. The method of claim 1, wherein establishing the baseline comprises completing a self- awareness questionnaire by the patient and / or the caregiver.

3. The method of claim 1, wherein establishing the baseline comprises conducting an emotional state assessment of the patient.

4. The method of claim 2, wherein completing the self-awareness questionnaire comprises determining a baseline quantitative score of one or more of the patient’s daily living activities, behavioral and emotional functions, cognitive abilities, and physical functions.

5. The method of claim 3, wherein conducting the emotional state assessment comprises completing a questionnaire relating to the relationship between certain personality traits of the patient and positive and negative affect.

6. The method of claim 1, wherein the creating the one or more pre-condition portraits comprises conducting an initial virtual reality (VR) onboarding.

7. The method of claim 1, wherein the creating the one or more pre-condition portraits comprises: using a virtual canvas and one or more virtual reality tools; and painting, drawing, and / or coloring the virtual canvas, orcovering the virtual canvas in a plurality of images to create a mosaic.

8. The method of claim 1, wherein the creating the one or more pre-condition portraits comprises monitoring the patient and / or the caregiver to collect biometric data.

9. The method of claim 8, wherein the monitoring the patient and / or the caregiver comprises tracking facial expressions of the patient and / or the caregiver.

10. The method of claim 9, further comprising analyzing the biometric data to determine an emotional state of the patient and / or an emotional state of the caregiver.

11. The method of claim 1, wherein the creating the one or more pre-condition portraits further comprises analyzing one or more of the pre-condition portraits along with any collected biometric data.

12. The method of claim 1, wherein the creating the one or more post-condition portraits comprises: using a virtual canvas and one or more virtual reality tools; and painting, drawing, and / or coloring the virtual canvas, or covering the virtual canvas in a plurality of images to create a mosaic.

13. The method of claim 1, wherein the creating the one or more post-condition portraits comprises: monitoring the patient and / or the caregiver and tracking facial expressions of the patient and / or the caregiver to collect biometric data; and analyzing the biometric data to determine an emotional state of the patient and / or an emotional state of the caregiver.

14. The method of claim 1, wherein the performing analysis and follow-up comprises analyzing one or more of the one or more pre-condition portraits and / or one or more of the one or more post-condition portraits along with any collected biometric data.

15. The method of claim 1, further comprising providing a final assessment after completing the performing analysis and follow-up.

16. The method of claim 15, wherein the final assessment is provided one day, one week, one month, or thirty or more days after completing the performing analysis and follow-up.

17. The method of claim 15, wherein providing the final assessment comprises providing a plurality of final assessments, such that one final assessment is provided at a respective time period after completing the performing analysis and follow-up, and the time period after completing the performing analysis and follow-up is one day, one week, one month, or thirty days after completing the performing analysis and follow-up.

18. The method of claim 1, wherein the creating the one or more pre-condition portraits and the creating the one or more post-condition portraits are carried out in different sessions.

19. The method of claim 1, wherein the creating the one or more pre-condition portraits and the creating the one or more post-condition portraits are carried out in a single session.

20. The method of claim 1, wherein: the establishing the baseline is conducted on a day before the creating the one or more pre-condition portraits; the creating the one or more post-condition portraits is conducted approximately one week after the creating the one or more pre-condition portraits; and a final assessment is conducted approximately one day, one week, or one month after the creating the one or more post-condition portraits.

21. A computing system comprising: a therapist client system configured to be used by a therapist; a patient client system configured to provide a patient with a virtual reality (VR) experience, and collect patient biometric data of the patient; and a server configured toreceive the collected patient biometric data from the patient client system, analyze the collected patient biometric data, and transmit analyzed patient biometric data to the therapist client system.

22. The computing system of claim 21, further comprising a caregiver client system configured to provide a caregiver with a VR experience, and collect caregiver biometric data of the caregiver.

23. The computing system of claim 22, wherein the server is further configured to receive the collected caregiver biometric data from the caregiver client system, analyze the collected caregiver biometric data, and transmit analyzed caregiver biometric data to the therapist client system.

24. The computing system of claim 23, wherein the patient client system and the caregiver client system are configured to provide a shared VR experience to both the patient and the caregiver simultaneously.

25. The computing system of claim 23, wherein the patient client system and the caregiver client system are configured to provide the patient and the caregiver with different respective VR experiences.

26. The computing system of claim 21, wherein the server communicates with the therapist client system and the patient client system using one or more networks.

27. The computing system of claim 21, wherein the server provides the therapist and the patient with access to an application that provides the patient with the VR experience.

28. The computing system of claim 21, wherein the patient client system contains a local application that provides the patient with the VR experience.

29. The computing system of claim 21, wherein the patient client system comprises a head mounted display device (HMD) configured to display a virtual environment.

30. The computing system of claim 29, wherein the patient client system further comprises at least one processor or graphic processing unit (GPU) provided in a processing unit that is separate from, but in communication with, the HMD configured to display the virtual environment.

31. The computing system of claim 21, wherein the server comprises a computing application provided in a cloud-based computing platform.

32. The computing system of claim 21, wherein the patient client system comprises one or more input / output devices for interacting with the VR experience.

33. The computing system of claim 22, wherein the caregiver client system comprises one or more input / output devices for interacting with the VR experience.

34. The computing system of claim 21, wherein: the patient client system further comprises at least one of a motion tracking device, a face tracking device, an eye tracking device, a gesture tracking device, and the at least one of a motion tracking device, a face tracking device, an eye tracking device, and a gesture tracking device is configured to collect the patient biometric data.

35. A computing system comprising: a therapist client system configured to be used by a therapist; a plurality of patient client systems configured to provide a respective patient with a virtual reality (VR) experience, and collect patient biometric data of the respective patient; and a server configured to receive collected patient biometric data from each patient client system, analyze the collected patient biometric data, and transmit analyzed patient biometric data to the therapist client system.

36. The computing system of claim 35, wherein the plurality of patient client systems are configured to provide a shared VR experience to each of the patients simultaneously.

37. The computing system of claim 35, wherein the plurality of patient client systems are configured to provide each patient with a different respective VR experience.

38. The computing system of claim 35, wherein the transmitting the analyzed patient biometric data comprises transmitting a single report to the therapist client system containing analyzed patient biometric data for each respective patient.

39. The computing system of claim 35, wherein the transmitting the analyzed patient biometric data comprises transmitting a respective report to the therapist client system containing analyzed patient biometric data for each patient.

40. The computing system of claim 35, wherein one or more of the plurality of patient client systems is configured to provide collected patient biometric data of the respective patients to other ones of the plurality of patient client systems.

Images