Apparatus, system, and method for real-time biocompatible stimulation environment

Abstract

An approach is provided for providing a real-time biocompatible stimulation environment with audio, visual, and olfactory components to enhance psychedelic therapy. A virtual biocompatible environment may be provided for experience by a user. Sensor data associated with the user may be received. The sensor data may be analyzed using at least one machine learning model to determine a change in user state. Modifications to be made to the virtual biocompatible environment may be determined based at least in part on the analyzed sensor data. The modified virtual biocompatible environment may be provided to the user.

Description

Technical Field

[0001] Cross - Reference to Related Applications

[0001] This PCT application claims priority to U.S. Provisional Patent Application No. 63 / 282,635, filed on November 23, 2021, entitled "APPARATUSES, SYSTEMS, AND METHODS FOR A REAL TIME BIOADAPTIVE STIMULUS ENVIRONMENT", which is incorporated herein by reference in its entirety for all purposes.

Background Art

[0002]

[0002] Since the advent of modern medicine, many treatments and drug schedules have been developed. However, while many such treatments can be effective, the initiation of some treatments can be unpleasant for some patients. For example, in the case of psychedelic - mediated treatments, many patients may not have had a psychedelic experience, and it can be found that the patient's initial experience is rather intense.

[0003]

[0003] It can be beneficial to prepare the patient for the upcoming treatment before the administration of the drug. Collected patient data can be analyzed to help determine how the patient is feeling at a given point in time. Further, the collected data can be processed using deep learning and machine learning techniques to help tailor the patient's experience both during and after dosing.

Summary of the Invention

[0004]

[0004] Various embodiments according to the present disclosure are described while referring to the drawings.

Brief Description of the Drawings

[0005] [Figure 1A]

[0005] An exemplary scene diagram that can be utilized according to one or more embodiments. [Figure 1B]An exemplary scene diagram that may be used according to one or more embodiments. [Figure 2A]

[0006] A figure showing exemplary sensor data that may be used according to one or more embodiments. [Figure 2B] A figure showing exemplary sensor data that may be used according to one or more embodiments. [Figure 3]

[0007] A diagram showing an exemplary system that may be used to implement one or more aspects of various embodiments. [Figure 4]

[0008] A diagram illustrating an exemplary method that may be used to implement one or more aspects of various embodiments. [Figure 5]

[0009] A diagram showing an example of an environment that may be used to implement one or more aspects of various embodiments. [Figure 6]

[0010] A diagram showing an example of an environment for implementing one or more aspects of various embodiments. [Figure 7]

[0011] An exemplary block diagram of an electronic device that can be used to implement one or more aspects of various embodiments. [Figure 8]

[0012] A diagram showing components of another exemplary environment in which various embodiments may be implemented. [Modes for carrying out the invention]

[0006]

[0013] Various embodiments are described below. For explanatory purposes, specific configurations and details are given to provide a complete understanding of the embodiments. However, it will be apparent to those skilled in the art that these embodiments may also be practiced without their specific details. Furthermore, well-known features may be omitted or simplified so as not to obscure the embodiments described.

[0007]

[0014] A real-time bioadaptive stimuli environment with audio, visual, and olfactory components is provided to enhance psychedelic therapy. The environment-associated system may be configured to provide a real-time bioadaptive sensory environment that adapts the psychedelic experience to the temporal evolution of the patient's subjective state during a medication session using low-latency and temporally synchronized objective psychophysiological measurements. The environment-associated biosensor suite may record measurements and adapt audio, visual, and olfactory stimuli to the patient's evolving subjective state in order to facilitate a positive psychedelic experience that may lead to a desired therapeutic outcome. According to one exemplary embodiment, the stimuli may be adapted using artificial intelligence and machine learning techniques.

[0008]

[0015] The system may also provide each patient with procedurally generated, real-time direct visual, olfactory, and auditory stimuli to help guide them through a unique psychedelic experience. For example, the psychedelic experience may be adapted and / or controlled to produce a desired therapeutic outcome. As a further example, if a machine learning model determines that a patient will be uncomfortable and would benefit from listening to a sedative sound, the system may play such a sedative sound for the patient to listen to. In this example at least, the system may operate in real time, and the patient's response to the sedative sound may be measured and interpreted by the system, which allows the system to further modify the sound output. The sound output may be modified in volume, or it may also be modified to play different types of sounds, such as melodies, single tones, or combinations of tones.

[0009]

[0016] Figures 1A and 1B show exemplary scene diagrams 100 and 110 that may be used according to one or more embodiments. According to one exemplary embodiment, virtual reality (VR) enabled settings may be used for preparation, administration, and integration sessions to help extend the psychedelic experience. For example, a VR setting may include either or both an environment setting, such as scene diagram 100, and an avatar guide 120 shown in scene diagram 110. While this example refers to the use of VR, augmented reality may also be used according to various embodiments. In an environment setting, according to one exemplary embodiment, the patient may be able to experience a three-dimensional world and environment (e.g., a forest or a beach), while in an avatar guide, the patient may interact with a persona that guides the patient through the experience. The system may utilize an environment setting, an avatar guide setting, and / or a combination of both settings. In one exemplary embodiment, extensions may be used for preparation for both the experience and / or post-experience review. In this example, the system may record which stimuli were presented and at what time those stimuli were presented, which enables an experience "playback". Furthermore, the system can record and store audio and / or visual outputs associated with the patient, so that the therapist or patient can later view the patient's experience from different perspectives, such as a perspective view of the patient. In some exemplary embodiments, the perspective view and the session's stimulus schedule may be superimposed or overlaid, so that during session review, the reviewer can observe the patient while also reading the stimuli.

[0010]

[0017] In at least one exemplary embodiment, the system may include a patient virtual profile. The patient virtual profile may be created using a priori settings, which can then be modified based on the patient's experience. The settings for the patient virtual profile may be initially populated when the user first registers. For example, the system may query various personal details during registration. In another example, a therapist, administrator, or other user may determine the settings. The patient may then interact with the system to prepare for a session, such as a medication session, by experiencing preparatory experiences, such as simulated psychedelic experiences with immersive video and audio stimuli, such as those provided by a VR headset. According to one exemplary embodiment, psychophysiological patient responses may be monitored and recorded. In this example, recorded responses may be used to calibrate the medication session and to construct a post-hoc profile of the optimal experience settings. In a non-limiting example, the experience may be modified by adjusting the person's environment, the music they listen to, or the story the patient is exposed to in the VR environment. These modifications can be used to alter the set and setting of psychedelic experiences and thus guide patients toward specific emotional responses, such as calmness, excitement, or curiosity. Since each person responds differently to different stimuli, calibration can be used to learn how individuals respond to different sensory inputs. In alternative embodiments, responses can be used to calibrate the system for any type of therapy and / or session.

[0011]

[0018] Figures 2A and 2B show exemplary sensor data 200, 210 that may be used according to one or more embodiments. According to one exemplary embodiment, the system may be configured to determine, among such measurements, photoplethysmogram (PPG) respiration, PPG heart rate, electrocardiogram (ECG) data, and electroencephalogram (EEG) data. The system may be further configured to determine the electrical activity of the brain, such as by using an EEG sensor. The EEG sensor may include, but is not limited to, a four-channel headband that measures the left and right temporoparietal lobes and the left and right anterior-frontal lobes.

[0012]

[0019] Furthermore, during medication administration, patients may be monitored through a variety of hardware systems and sensors, including, but not limited to, cameras (including, but not limited to, high-definition calibrated camera arrays capable of monitoring heart rate / pulse, respiration, body temperature, flushing response, facial expression, and / or pupillary response), microphones (including, but not limited to, beamforming microphone arrays for capturing spatially localized audio), electroencephalograms, wearables (including, but not limited to, wrist-based electromyogram wearables and electrocardiogram chest straps), and other suitable hardware components.

[0013]

[0020] In one exemplary embodiment, the system may include a computer in the same vicinity as the sensor, configured to locally record and process temporally synchronized signals. In this example, the recorded signals and / or results may be uploaded to a cloud infrastructure for later post-processing. A machine learning model, such as an at-the-edge machine learning model, may be trained to simultaneously process various pieces of information to adapt the psychedelic experience through the modification of the visual, audio, and olfactory stimulus environment presented to the patient. In one exemplary embodiment, the system may modify the immersive visual environment experienced by the patient. Using the analyzed sensor data, the system may use machine learning to determine which environmental changes should be made, so that those changes are made automatically in real time or near real time. For example, if a given data point in the sensor data falls below a determined threshold or score, the system may determine that a corrective action is needed. Depending on a particular data point, the system may determine which one or more stimuli should be modified. For example, a visual representation of a beach may be provided for presentation instead of a library or a river. Furthermore, the accompanying audio may also be modified. For example, classical music may be changed to jazz, or exciting music may be changed to calming music. Olfactory stimuli may also be altered. For example, the refreshing smell of a river may be offered in comparison to the musty smell of a library. Furthermore, audio pitch, audio volume, scene brightness, avatar type, scent type, or scent intensity may be adjusted manually or automatically, among such options. According to one exemplary embodiment, continuous psychophysiological data may be taken from the patient to further modulate the adapted stimulus environment, as well as to update a machine learning model that may be guiding the session.

[0014]

[0021] Following medication administration, patients may, under supervision and at appropriate intervals, recreate parts of their psychedelic experience by replaying the same sensory stimuli they experienced during medication administration, in order to facilitate integration. Group integration experiences may be virtually induced, depending on the appropriateness and treatment profile. For example, multiple patients may interact with multiple biosensor suites, or multiple patients may interact with the same biosensor suite.

[0015]

[0022] Figure 3 shows an exemplary system 300 that may be used to implement one or more aspects of various embodiments. According to one exemplary embodiment, system 300 may assist the entire treatment process. For example, system 300 may be able to assist the patient during the preparation, medication, and integration phases. Furthermore, the system may enhance the safety, efficacy, and accessibility profile of the treatment, for example, by better regulating the experience and / or deploying that experience on a larger scale.

[0016]

[0023] According to one exemplary embodiment, the system 300 may include a sensor suite 302 having associated sensor data. The sensor suite 302 may provide real-time monitoring of the patient 308 and / or therapist 310 within the therapy environment 306. In one exemplary embodiment, the therapist 310 may have a subset of sensors that are either visible to or invisible to the patient 308. For example, electromyography (EMG) may be used to help analyze nerve-versus-muscle signaling. Sensors specific to the therapist 310 may be configured so as not to affect the patient experience. In at least one exemplary embodiment, a camera suite 312 may also be utilized to help collect visual data about the patient 308 and / or therapist 310. The sensor suite devices may be wirelessly synchronized to a compact server, such as a single-board computer. According to one exemplary embodiment, one or more devices of the sensor suite 302 may be synchronized via a wired or wireless connection. Machine learning models may be employed to facilitate the adjustment of visual, audio, and / or olfactory stimuli using one or more stimulation devices 304. The adjustment of various stimuli may be facilitated, at least in part, using virtual reality devices, augmented reality devices, enhanced reality devices, or any other such presentation devices. Furthermore, stimuli may be adjusted using combinations of devices, such as speakers with audio output units, or devices capable of emitting various scents. During or after monitoring, data may be relayed to a cloud-based environment 314 for further analysis. Analysis may be carried out, for example, by using machine learning. Throughout or after the monitoring process, therapists may be able to review the biofeedback process on electronic devices, including, but not limited to, smartphones, personal computers, or tablets. The system may also maintain and / or facilitate a cloud-based infrastructure that allows various biocompatible software to be delivered and accessed from a centralized repository.Such a system may enable continuous virtual software updates for a given hardware profile.

[0017]

[0024] The system can be used for several applications. For example, the system can provide a biosensor suite at the edge that objectively measures patient psychophysiological biomarkers including, but not limited to, electroencephalogram recording, pulse, electrocardiogram, facial expression and blushing response, pupil response, muscle tension, and / or electrodermal response for both real-time processing and long-term cloud-enabled storage. Data correlated to individual metrics (e.g., pulse, facial expression, blushing response, etc.) can be stored locally and / or in cloud storage. The data can be stored in raw or processed format. In various embodiments, analysis of sensor information to identify biomarkers and provide continuous feedback can be performed in the cloud or at the edge depending on the complexity of the model.

[0018]

[0025] The sensor suite 302 can include, but is not limited to, electroencephalogram recording (EEG), electrocardiogram recording (ECG), photoplethysmography, pulse oximetry, electromyogram (EMG), spatial audio recording, and / or a camera array. The camera array can include high-resolution color (RGB), thermal, and / or depth sensors having a sufficient frame rate to measure in real-time general body movement that may indicate pulse, respiration, body temperature change, facial blushing response, facial expression, pupil measurement, eye movement, and body sway. Also, sensors can be embedded in hardware such as motion sensors in a VR headset.

[0019]

[0026] According to an exemplary embodiment, the sensor suite 302 may enable various flows of communication. By way of non-limiting example, communication may include person-to-person dialogue, the information flow of data from a person to a device, or a stimulus from a device to a person. In an exemplary embodiment, the sensor suite 302 may be configured to receive data from the patient 308. Stimulation hardware (e.g., visual, auditory, and olfactory measurements) may be configured to deliver an immersive stimulus 304 to the patient 308. The patient 308 and the therapist 310 may sometimes communicate person-to-person. The camera suite 312 may include one or more microphone arrays and may be configured to receive data from the patient 308 and / or the therapist 310. The patient 308, the therapist 310, the camera suite 312, and other sensor devices may sometimes communicate bi-directionally with a cloud-based environment 314. In various embodiments, any of the components may be configured to communicate with any of the other components and / or parties.

[0020]

[0027] According to an exemplary embodiment, the system may include a login portal configured for anonymity during a clinical trial setting. Further, the system may be configured for automated cross-platform or cross-operating system digital biomarker and sensor data collection, which may be incorporated into a single cloud-native database. The system may also provide a synchronized content database that may be remotely updated for new research and patients.

[0021]

[0028] According to one exemplary embodiment, the front-end application may be used across all operating systems, mobile devices, and personal computers. The front-end application may allow for easier verification of the application for regulatory purposes as a single codebase. The application may enable the display of custom biomarkers to care teams and patients, as well as custom alerts based on collected data. The application may enable "full-circle" machine learning, as the system may be capable of collecting data, uploading data, analyzing data, identifying triggers, and sending information to care teams.

[0022]

[0029] Figure 4 shows an exemplary method 400 that may be used to implement one or more aspects of various embodiments. It should be understood that for any process herein, unless otherwise stated, there may be additional, fewer, or alternative steps performed in a similar or alternative order or in parallel within the scope of various embodiments. According to one exemplary embodiment, a virtual biocompatible environment may be provided for user experience 410. The virtual biocompatible environment may, in at least some embodiments, be provided on a virtual reality device, an augmented reality device, an enhanced reality device, or any other such (one or more) presentation device or system. Sensor data associated with the user may be received, for example, through the (one or more) presentation device or system 420. The sensor data may be analyzed using at least one machine learning model to determine one or more changes in the user state 430. For example, it may be determined that at least a subset of the sensor data falls below a determined threshold level. Based at least in part on the analyzed sensor data, one or more modifications to be made to the virtual biocompatible environment may be determined 440. A modified virtual biocompatible environment may be provided on one or more presentation devices or systems.450

[0023]

[0030] Figure 5 shows an example of an environment 500 that may be used to implement one or more aspects of various embodiments. According to one exemplary embodiment, the environment may be a computing layer. A sensor suite may provide sensor data 502 and communicate with a computer or processor 504. The computer 504 may communicate with a user management node 506 so that a therapist, patient, or other party can be authenticated. According to one exemplary embodiment, a patient may subscribe to the system's digital infrastructure when the patient is prescribed treatment. Upon registration, a unique identifier may be assigned to the patient. The unique identifier may be used for future tracking and for potential integration with other components of the system or with tertiary systems such as companion applications. The unique identifier may be used as metadata that can be tagged on or with data correlated to that patient. For example, video files collected by a camera array or audio files collected by microphones may correlate with the unique identifier and metadata. Prior to medication administration, patients may be able to review their settings through system infrastructure (e.g., mobile application, web portal, or preferred alternative) to ensure they are adequately prepared for the medication experience.

[0024]

[0031] Furthermore, computer 504 may communicate with a cloud-based environment 508 via a secure application programming interface (API) gateway 510. The cloud-based environment 508 may include or communicate with an authentication database 512, which communicates with a user management node 506 and is configured to help manage users. The cloud-based environment 508 may include a session data upload 514, which can extract, transform, and load data into a structured data store 516. The structured data store 516 may communicate with a deep learning or machine learning optimization node 518. The deep learning or machine learning optimization node 518 may be configured to analyze both a priori patient data and patient-specific (post-model) data to create an optimal experience tailored to the patient. In one exemplary embodiment, the deep learning or machine learning model optimization node may receive information about the global population, as well as information about the patient's specific or particular preferences.

[0025]

[0032] As a non-limiting example, if ocean sounds are universally calming, and a patient prefers jazz music to classical music for relaxation, a deep learning or machine learning model optimization node could create or generate a custom experience that combines both ocean sounds and the jazz genre. Furthermore, the deep learning or machine learning model optimization node could also modulate the experience, for example, by selecting specific scenes or music. In such embodiments, each particular image or audio file could have varying intensities of different characteristics. For example, a first beach scene might be very calming, while a second beach scene might be somewhat calming. Thus, in such examples, the deep learning or machine learning model optimization node could discriminate specific instances of each class of stimulus and present each specific instance based on global population information and / or patient-specific information. The patient model store 520 could then receive the optimized data from the deep learning or machine learning model optimization node. In one exemplary embodiment, the patient model store might communicate with a "model as a service" (MaaS) 522 to provide real-time on-demand models for each patient. To provide a model for each patient, MaaS may communicate with computer 504 via secure API gateway 510.

[0026]

[0033] The system, as associated with the environment, may utilize a variety of deep learning, general machine learning, and / or statistical models, which are evaluated for optimal performance. For example, the system may employ any number or any combination thereof of the following models: perceptron, feedforward, radial basis network, deep feedforward, recurrent neural network, long / short-term memory, gated recurrent unit, autoencoder, variational autoencoder, sparse autoencoder, denoising autoencoder, Marcus chain, Hopfield network, Boltzmann machine, restricted Boltzmann machine, deep belief network, deep convolutional network, deep network, deep convolutional inverse graphics network, generative adversarial network, liquid state machine, extreme learning machine, echo network machine, Kohonen network, deep residual network, support vector machine, and neural Turing machine.

[0027]

[0034] The system may include a computational, edge layer. The sensor suite may be synchronized to a computer or computing device during a medication session. The computer may be preloaded with a global machine learning model that can be overwritten or updated from a cloud-based network configuration. The global machine learning model may not take patient preferences into account and may be used when prior information from the patient is unavailable or not required. A patient-specific machine learning model may incorporate information from the patient (either in real time or during training) via the deep learning or machine learning model optimization node described above. The model may run in real time and provide feedback to devices for the patient and / or therapist. User profiles may be downloaded from the cloud along with additional model parameters as needed. User biomarkers and sensor data for either the patient or the therapist, or both, may be uploaded to the cloud-based network for further updates and evaluation. In some exemplary embodiments, the system may develop a continuous feedback system that allows administrators, users, or healthcare professionals to improve the baseline psychedelic experience and develop specific patient-specific profiles that can be used for subsequent medication sessions. For example, patient-specific profiles may be stored in a cloud-based environment and may contain default values ​​or baselines that the system should use for the patient's next session. In this example, by leveraging historical data, the system may reduce the amount of time required to effectively adapt the patient to the medication. Furthermore, the system may also predict and adjust future baselines or default values ​​based on the current profile and historical data.

[0028]

[0035] The system may include and / or follow a patient treatment timeline. The preparation step may include providing a pre-medication “psychedelic experience” to prepare the patient for a medication session. The preparation step may also include measuring the patient’s response to the pre-medication in order to create a patient-specific digital experience. Furthermore, in this pre-medication step, the system may be configured to identify and / or flag early warning signs and attempt to mitigate potential problems.

[0029]

[0036] The medication step may include providing a customized digital experience by modulating visual, olfactory, and auditory stimuli. In this exemplary embodiment, a real-time biofeedback loop may use an edge model to modulate the experience to increase patient safety and improve treatment delivery. Furthermore, during the medication step, the system may record sensor information for the integrated session and for model updates. According to one exemplary embodiment, the medication session may involve administering some form of psilocybin to the patient.

[0030]

[0037] The integration step may include activating the memory of the experience by replaying sensory feedback experienced during the administration session, such as audio, olfactory, and visual. The integration step may enable group integration through a VR infrastructure. Furthermore, according to one exemplary embodiment, multiple self-guided integration sessions may be possible. In one embodiment, the system may update both the global model and the patient-specific model for future medication sessions.

[0031]

[0038] During medication, the environment may be used and adjusted to modulate both the intensity and emotional valence of the experience based directly on patient feedback and broader population-level data. In a further embodiment, the system may improve the integrated session by giving the patient a way to recreate any part of the patient's experience for further reflection. Such an environment may be used throughout the patient's journey to further enhance the treatment model.

[0032]

[0039] As described, different methods may be implemented in various environments according to the embodiments described. For example, Figure 6 shows an example of an environment 600 for implementing one or more aspects of various embodiments. As is understood, a web-based environment is used for explanatory purposes, but different environments may be used as appropriate to implement various embodiments. The system includes electronic client devices 602, 608, which may include any suitable device capable of sending and receiving requests, messages or information over a suitable network 604 and communicating information to the user of the device. Examples of such client devices include personal computers, (one or more) virtual reality devices, (one or more) augmented reality devices, (one or more) enhanced reality devices, cell phones, handheld messaging devices, laptop computers, set-top boxes, personal information terminals, e-book readers, etc. The network may include any suitable network, including intranets, the internet, cellular networks, local area networks or any other such networks, or combinations thereof. The components used in such a system may depend at least in part on the type of network and / or environment selected. Protocols and components for communication over such networks are well known and will not be described in detail herein. Communication over a network may be enabled via wired or wireless connections or combinations thereof. In this example, the network includes the Internet, since the environment includes one or more servers 606 for receiving requests and servicing content in response thereto; however, as will be apparent to those skilled in the art, other networks may use alternative devices serving similar purposes.

[0033]

[0040] An exemplary environment includes at least one application server 610 and a data store 612. It should be understood that there may be several application servers, layers, or other elements, processes, or components that are linked or otherwise configured and can interact to perform tasks, such as retrieving data from a suitable data store. As used herein, the term “data store” refers to any device or combination of devices capable of storing, accessing, and retrieving data, and such devices may include any combination of data servers, databases, data storage devices, and data storage media, as well as any number of such devices, in any standard, distributed, or clustered environment. The application server 610 may integrate with the data store 612 as needed to run one or more aspects of applications for client devices and may include any suitable hardware and software for handling the majority of the data access and business logic about the applications. The application server may work with the data store to provide access control services and generate content, such as text, graphics, audio, and / or video, to be delivered to the user, which in this example may be served to the user by one or more servers 606, including a web server, in the form of HTML, XML, or another suitable structured language. All handling of requests and responses, as well as the delivery of content between client devices 602, 608 and the application server 610, may be handled by the web server of server 606. The web server and application server are not required and are merely illustrative components, as the structured code described herein may run on any suitable device or host machine, as described elsewhere herein.

[0034]

[0041] The data store 612 may include several separate data tables, databases, or other data storage mechanisms and media for storing data relating to specific aspects. For example, the illustrated data store includes mechanisms for storing manufacturing data 614 and user information 618, which may be used to service content for the manufacturer. The data store is also shown to include mechanisms for storing log or application session data 616. There may be many other aspects that need to be stored in the data store, such as page image information and access rights information, and it should be understood that this information may be stored in any of the mechanisms listed above, or in additional mechanisms within the data store 612, as appropriate. The data store 612 is operable to receive commands from the application server 610 through the logic associated with it and to retrieve, update, or otherwise process data in response. In one example, a user may submit a request to transcribe, tag, and / or label media files. In this case, the data store may have access to user information to verify the user's identity and can provide a transcript including tags and / or labels, along with analysis associated with the media files. The information may then be returned to the user, for example, in a results listing on a webpage that the user can view via a browser on user devices 602, 608. Information about specific features of interest may be viewed in a dedicated page or window in the browser.

[0035]

[0042] Each server will generally include an operating system that provides executable program instructions for the general administration and operation of the server, and will generally include a computer-readable medium that stores instructions that, when executed by the server's processor, enable the server to perform its intended functions. Preferred implementations for the server's operating system and general functions are known or commercially available and can be readily implemented by those skilled in the art, particularly in light of the disclosure herein.

[0036]

[0043] The environment in one embodiment is a distributed computing environment that utilizes several computer systems and components interconnected via communication links using one or more computer networks or direct connections. However, it will be understood by those skilled in the art that such systems may function equally well with fewer or more components than those shown in Figure 6. Accordingly, the diagram of system 600 in Figure 6 should be taken as essentially illustrative and not limiting to the scope of this disclosure.

[0037]

[0044] Figure 7 shows an exemplary block diagram of an electronic device that may be used to implement one or more aspects of various embodiments. An instance of the electronic device 700 may include one or more servers and one or more client devices. Generally, the electronic device may include a processor / CPU 702, memory 704, a power supply 706, and input / output (I / O) components / devices 710 that may be capable of providing, for example, a graphical user interface or a text user interface, such as a microphone, speaker, display, touchscreen, keyboard, mouse, keypad, microscope, GPS component, camera, heart rate sensor, light sensor, accelerometer, target biometric sensor, neck wearable for detecting brain activity, etc.

[0038]

[0045] The user may provide input via the touchscreen of the electronic device 700. The touchscreen may determine whether the user is providing input, for example, by determining whether the user is touching the touchscreen with a part of the user's body, such as the user's finger. The electronic device 700 may also include a communication bus 712 connected to the aforementioned elements of the electronic device 700. The network interface 708 may include a receiver and transmitter (or transceiver) for wireless communication and one or more antennas.

[0039]

[0046] The processor 702 may include one or more processing devices of any type, such as a central processing unit (CPU) and a graphics processing unit (GPU). Furthermore, the processor may utilize central processing logic, or other logic, to perform one or more functions or actions, or to trigger one or more functions or actions from one or more other components, and may include hardware, firmware, software, or a combination thereof. Also, depending on the desired application or requirement, the central processing logic, or other logic, may include, for example, a software-controlled microprocessor, discrete logic, such as an application-specific integrated circuit (ASIC), a programmable / programmed logic device, a memory device containing instructions, or combinational logic embodied in hardware. Moreover, the logic may also be fully embodied as software.

[0040]

[0047] The memory 704, which may include random access memory (RAM) 714 and read-only memory (ROM) 716, can be enabled by one or more memory devices of any type, such as primary (directly accessible by the CPU) or secondary (indirectly accessible by the CPU) storage devices (e.g., flash memory, magnetic disks, optical disks, etc.). The RAM may include an operating system 718, data storage 720 which may include one or more databases, and a program and / or application 722 which may include, for example, a software aspect 724 of the program. The ROM 716 may also include a basic input / output system (BIOS) 726 of the electronic device 700.

[0041]

[0048] The software aspects of Program 722 broadly include or represent all programming, applications, algorithms, models, software, and other tools necessary to implement or facilitate the methods and systems according to embodiments of the present invention. These elements may reside on a single computer or be distributed among multiple computers, servers, devices, or entities.

[0042]

[0049] The power supply 706 may include one or more power components that can help facilitate the supply and management of power to the electronic device 700.

[0043]

[0050] An input / output (I / O) component including an input / output (I / O) interface 710 may include, for example, any interface to facilitate communication between components of the electronic device 700, components of an external device, and an end user. For example, such a component may include a network card that integrates a receiver, a transmitter, a transceiver, and one or more input / output interfaces. The network card may facilitate wired or wireless communication with other devices on the network, for example. In the case of wireless communication, an antenna may facilitate such communication. Also, some of the input / output interfaces 710 and the bus 712 may facilitate communication between components of the electronic device 700, and in one example, may simplify processing performed by the processor 702.

[0044]

[0051] If the electronic device 700 is a server, the server may include computing devices capable of sending or receiving signals, such as wired or wireless networks, or it may be capable of processing or storing signals in memory, for example, as a physical memory state. The server may be an application server, which includes a configuration for providing applications to one or more other devices over the network. The application server may also host a website, for example, which can provide a user interface for administration in an exemplary embodiment.

[0045]

[0052] Figure 8 shows an exemplary environment 800 in which various embodiments may be implemented. In this example, a user can utilize one or more client devices 802 to submit requests to a multi-tenant resource provider environment 806 across at least one network 804. A client device can include any suitable electronic device capable of sending and receiving requests, messages, or other such information over a suitable network and communicating information to the user of the device. Examples of such client devices include personal computers, (one or more) virtual reality devices, (one or more) augmented reality devices, (one or more) enhanced reality devices, tablet computers, smartphones, notebook computers, etc. At least one network 804 can include any suitable network, including an intranet, the Internet, a cellular network, a local area network (LAN), or any other such network, or a combination thereof, and communication on the network may be enabled via wired and / or wireless connections. The resource provider environment 806 can include any suitable components for receiving requests and returning information or performing actions in response to those requests. As an example, a provider environment may include web servers and / or application servers for receiving and processing requests and then returning data, web pages, videos, audio, or other such content or information in response to those requests.

[0046]

[0053] In various embodiments, the provider environment may include various types of resources that can be utilized by multiple users for various different purposes. As used herein, computing resources and other electronic resources utilized in a network environment may be referred to as “network resources.” These may include servers, databases, load balancers, routers, etc., that can perform tasks such as receiving, transmitting, and / or processing data and / or executable instructions. In at least some embodiments, all or part of a given resource or set of resources may be allocated to a particular user or for a particular task for at least a determined period of time. The sharing of these multitenant resources from the provider environment is often referred to as resource sharing, web services, or “cloud computing,” among such terms, and depending on the particular environment and / or implementation. In this example, the provider environment includes multiple resources 814 of one or more types. These types may include, for example, application servers capable of operating to process instructions provided by a user, or database servers capable of operating to process data stored in one or more data stores 816 in response to user requests. As is known for such purposes, a user can also reserve at least a portion of the data storage in a given data store. Methods for enabling a user to reserve various resources and resource instances are well known in the art, and therefore a detailed description of the entire process and all possible components will not be described in detail herein.

[0047]

[0054] In at least some embodiments, a user wishing to utilize a portion of resource 814 may submit an incoming request to interface layer 808 of the provider environment 806. The interface layer may include an application programming interface (API) or other exposed interfaces that enable users to submit requests to the provider environment. Interface layer 808 in this example may also include other components, such as at least one web server, routing components, and load balancers. When a request to provision a resource is received by interface layer 808, information about that request may be directed to a service manager 810, or other such system, service, or component configured to manage user accounts and information, resource provisioning and usage, and other such aspects. The service manager 810 that receives the request may perform tasks such as authenticating the identity of the user who submitted the request and determining whether the user has an existing account with the resource provider, provided that account data can be stored in at least one data store 812 in the provider environment. The user may provide the provider with one of various types of proof to authenticate their identity. These proofs may include, for example, username and password pairs, biometric data, digital signatures, QR code-based proofs, or other such information.

[0048]

[0055] The provider can verify this information against the information stored about the user. If the user has an account with appropriate permissions, status, etc., the resource manager can determine if there are sufficient resources available to suit the user's request, and if there are, it can provision those resources for the user's use in the amount specified by the request, or, in some cases, grant access to the corresponding portion of those resources. This amount could include, for example, the ability to process a single request or perform a single task, a specified time period, or a cyclical / renewable period, among other values. If the user does not have a valid account with the provider, or the user account does not allow access to the type of resource specified in the request, or for other such reasons, communication may be sent to the user to allow the user to create or modify an account, or to modify the resource specified in the request, among other options. In at least some exemplary embodiments, the user may be authenticated to access the entire fleet of services provided within the service provider environment. In other exemplary embodiments, the user's access may be restricted to specific services within the service provider environment using one or more access policies tied to the user's (one or more) credentials.

[0049]

[0056] Once a user is authenticated, their account is verified, and resources are allocated, the user can utilize one or more allocated resources for a specified capacity, amount of data transfer, duration, or other such value. In at least some embodiments, the user may provide a session token or other such proof with subsequent requests to enable those requests to be processed on that user session. The user may receive resource identifiers, specific addresses, or other such information that enables the client device 802 to communicate using the allocated resources without needing to communicate with the service manager 810, at least until a time has passed when the relevant aspect of the user account changes, the user is no longer granted access to the resources, or another such aspect changes.

[0050]

[0057] Furthermore, the service manager 810 (or another such system or service) in this example can function as a virtual layer of hardware and software components that handles control functions in addition to management actions, such as provisioning, scaling, and replication. The resource manager may utilize dedicated APIs in interface layer 808, where each API may be provided to receive requests for at least one specific action to be performed on the data environment, such as provisioning, scaling, cloning, or suspending instances. Upon receiving a request to one of the APIs, the web service portion of the interface layer may parse or otherwise analyze the request to determine the steps or actions required to act along with or process the call. For example, a web service call may be received that includes a request to create a data repository.

[0051]

[0058] In at least one embodiment, the interface layer 808 includes a scalable set of user-facing servers that provide various APIs and can return appropriate responses based on API specifications. In one embodiment, the interface layer may also include at least one API service layer consisting of stateless, replicated servers that handle external user-facing APIs. The interface layer may be responsible for web service frontend features such as authenticating users based on proof, authorizing users, throttling user requests to API servers, verifying user input, and marshalling or unmarshalling requests and responses. The API layer may also be responsible for reading and writing database configuration data to and from the administration data store in response to API calls. In many embodiments, the web service layer and / or API service layer will be either the sole externally visible component or the sole component that is visible to and accessible by users of the control service. The servers of the web service layer are stateless and can be scaled horizontally, as is known in the art. API servers and persistent data stores can be spread, for example, across multiple data centers in a region, so that these servers are resilient to a single data center failure.

[0052]

[0059] Various embodiments can be implemented in a wide variety of operating environments, which in some cases may include one or more user computers or computing devices that can be used to run any of several applications. User devices or client devices may include some general-purpose personal computers, such as desktop or laptop computers running standard operating systems, as well as some cellular, wireless, and handheld devices capable of running mobile software and supporting several networking and messaging protocols. Such systems may also include some workstations running any of various commercially available operating systems and other known applications for purposes such as development and database management. These devices may also include other electronic devices, such as dummy terminals, thin clients, gaming systems, and other devices capable of communicating over a network.

[0053]

[0060] Most embodiments utilize at least one network, which will be well known to those skilled in the art, for supporting communication using one of various commercially available protocols, such as TCP / IP, FTP, UPnP, NFS, and CIFS. The network may be, for example, a local area network, a wide area network, a virtual private network, the Internet, an intranet, an extranet, a public switched telephone network, an infrared network, a wireless network, and any combination thereof. In embodiments utilizing a web server, the web server may run any of various servers or mid-tier applications, including an HTTP server, an FTP server, a CGI server, a data server, a Java® server, and a business application server. The (one or more) servers may also be capable of executing programs or scripts in response requests from a user device, for example, by running one or more web applications, which may be implemented as one or more scripts or programs written in any programming language such as Java, C, C#, or C++, or any scripting language such as Perl, Python, or Tcl, or combinations thereof. The (one or more) servers may also include, but are not limited to, database servers, including commercially available ones from Oracle®, Microsoft®, Sybase®, and IBM®.

[0054]

[0061] The environment may include various data stores and other memory and storage media, as described above. These may reside in various locations, such as on storage media, local to one or more computers (and / or residing in one or more), or remote from any or all computers, across a network. In a particular set of embodiments, information may reside in a storage area network (SAN) as is well known to those skilled in the art. Similarly, files necessary for performing functions attributable to computers, servers, or other network devices may be stored locally and / or remotely, as appropriate. If the system includes computerized devices, each such device may include hardware elements that can be electrically coupled via a bus, such as, for example, at least one central processing unit (CPU), at least one input device (e.g., mouse, keyboard, controller, touch-sensitive display element, or keypad), and at least one output device (e.g., display device, printer, or speaker). Such a system may also include disk drives, optical storage devices, and solid-state storage devices such as random-access memory (RAM) or read-only memory (ROM), as well as one or more storage devices such as removable media devices, memory cards, and flash cards. Such devices may also include computer-readable storage medium readers, communication devices (e.g., modems, network cards (wireless or wired), infrared communication devices), and the working memory described above. A computer-readable storage medium reader may be connected to or configured to receive computer-readable storage mediums representing remote, local, fixed, and / or removable storage devices, as well as storage mediums for temporarily and / or more permanently containing, storing, transmitting, and retrieving computer-readable information.

[0055]

[0062] The system and various devices will generally include an operating system and several software applications, modules, services, or other elements located in at least one working memory device, including application programs such as client applications or web browsers. It should be understood that alternative embodiments may have numerous variations from the embodiments described above. For example, customized hardware may be used, and / or certain elements may be implemented in hardware, software (including portable software such as applets), or both. Furthermore, connections to other computing devices, such as network input / output devices, may be employed. Storage media and other non-temporary computer-readable media for containing code or portions of code may include, but are not limited to, any suitable media known or used in the art, such as volatile and non-volatile, removable and non-removable media, which are implemented in any way or technique for storing information, such as computer-readable instructions, data structures, program modules or other data, and which may be used to store desired information and may be accessed by system devices, including RAM, ROM, EEPROM®, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other media, which may include computer-readable instructions, data structures, program modules or other data, which may be implemented in any way or technique for storing information, which may include any suitable media known or used in the art, such as volatile and non-volatile, removable and non-removable media. Based on the disclosures and teachings provided herein, those skilled in the art will understand other ways and / or methods for implementing various embodiments.

[0056]

[0063] Therefore, this specification and the drawings should be considered illustrative rather than restrictive. However, it will be apparent that various modifications and changes can be made thereto without departing from the broader spirit and scope of the invention as described in the claims. The following is a direct reproduction of the claims as originally filed. [C1] Providing a virtual biocompatible environment for the user's experience from a presentation device, and receiving sensor data associated with the user from the presentation device, To determine one or more changes in the user state, the sensor data is analyzed using a machine learning model, Based at least partially on the analyzed sensor data, determine one or more modifications to be made to the virtual biocompatible environment. The presenting device provides a modified virtual biocompatible environment. A computer implementation method comprising the following features. [C2] The computer implementation method according to C1, wherein the virtual biocompatible environment includes at least one of an audio stimulus, a visual stimulus, and an olfactory stimulus. [C3] The computer implementation method according to C1, wherein the virtual biocompatible environment is provided using at least partially virtual reality, augmented reality, or enhanced reality. [C4] The computer implementation method according to C2, wherein the visual stimulus includes at least one of a scene image and an avatar guide. [C5] The computer implementation method according to C1, wherein the virtual biocompatible environment is automatically changed in real time or near real time. [C6] Store the modified virtual bio-adaptive environment in the user profile specific to the user. A computer implementation method described in C1, further comprising the features described above. [C7] A non-temporary computer-readable medium for storing instructions, wherein when an instruction is executed by at least one processor, the at least one processor is provided with The presentation system provides a virtual biocompatible environment for the user's experience, and the presentation system receives sensor data associated with the user. To determine one or more changes in the user state, the sensor data is analyzed using a machine learning model, To provide a modified virtual biocompatible environment on the presentation system based at least partially on the analyzed sensor data. A non-temporary computer-readable medium that enables the operation of [the process]. [C8] When the instruction is executed by the at least one processor, the at least one processor shall: Based at least partially on the analyzed sensor data, it is determined that at least a subset of the sensor data falls below a threshold level. The modified virtual biocompatible environment is provided, at least in part, based on the fact that the subset of the sensor data falls below the threshold level. A non-temporary computer-readable medium as described in C7, which further enables the following. [C9] The non-temporary computer-readable medium according to C7, wherein the virtual biocompatible environment includes at least one of an audio stimulus, a visual stimulus, and an olfactory stimulus. [C10] The non-temporary computer-readable medium described in C7, wherein the virtual biocompatible environment is provided using at least partially virtual reality, augmented reality, or enhanced reality. [C11] The non-temporary computer-readable medium according to C9, wherein the visual stimulus includes at least one of a scene image and an avatar guide. [C12] The non-temporary computer-readable medium described in C7, wherein the virtual biocompatible environment is automatically modified in real time or near real time. [C13] The non-temporary computer-readable medium according to C7, wherein changing the virtual biocompatible environment includes changing at least one of the audio type, audio pitch, audio volume, scene type, scene brightness, and scent. [C14] Presentation device and, At least one processor, memory and A system comprising: the memory stores instructions, and when an instruction is executed by the at least one processor, the at least one processor The presenting device provides a virtual biocompatible environment for the user's experience, The presenting device receives sensor data associated with the user, To determine one or more changes in the user state, the sensor data is analyzed using a machine learning model, Based at least partially on the analyzed sensor data, a modified virtual biocompatible environment is provided. A system that enables this to happen. [C15] When the instruction is executed by the at least one processor, the at least one processor shall: Based at least partially on the analyzed sensor data, it is determined that at least a subset of the sensor data falls below a threshold level. The modified virtual biocompatible environment is provided, at least in part, based on the fact that the subset of the sensor data falls below the threshold level. The system described in C14 further enables this process. [C16] The system according to C14, wherein the virtual biocompatible environment includes at least one of an audio stimulus, a visual stimulus, and an olfactory stimulus. [C17] The system according to C14, wherein the virtual biocompatible environment is provided using at least partially virtual reality, augmented reality, or enhanced reality. [C18] The system according to C16, wherein the visual stimulus includes at least one of a scene image and an avatar guide. [C19] The system described in C14, wherein the virtual biocompatible environment is automatically changed in real time or near real time. [C20] The system according to C14, wherein changing the virtual biocompatible environment includes changing at least one of the audio type, audio pitch, audio volume, scene type, scene brightness, and scent.

Claims

1. To provide a virtual biocompatible environment for the user's experience from the presenting device, The presenting device receives sensor data associated with the user, To determine one or more changes in the user state, the sensor data is analyzed using a machine learning model, Based at least partially on the analyzed sensor data, determine one or more modifications to be made to the virtual biocompatible environment. To enhance treatment by adapting the treatment experience to the temporal evolution of the user's subjective state during medication administration, a modified virtual biocompatible environment is provided on the presentation device. To reduce the amount of time required to effectively adapt the user to the drug, the modified virtual biofit environment is stored in the user's unique user profile, A computer implementation method for enhanced therapy, comprising the features described above.

2. The computer implementation method according to claim 1, wherein the virtual biocompatible environment includes at least one of an audio stimulus, a visual stimulus, and an olfactory stimulus.

3. The computer implementation method according to claim 1, wherein the virtual biocompatible environment is provided using at least partially virtual reality, augmented reality, or enhanced reality.

4. The computer implementation method according to claim 2, wherein the visual stimulus includes at least one of a scene image and an avatar guide.

5. The computer implementation method according to claim 1, wherein the virtual biocompatible environment is automatically changed in real time or near real time.

6. A non-temporary computer-readable medium for storing instructions for augmentation therapy, wherein when the instructions are executed by at least one processor, the at least one processor is configured to: The presentation system provides a virtual biocompatible environment for the user's experience, The system receives sensor data associated with the user from the aforementioned presentation system, To determine one or more changes in the user state, the sensor data is analyzed using a machine learning model, To enhance treatment by adapting the treatment experience to the temporal evolution of the user's subjective state during medication administration, a modified virtual biocompatible environment is provided on the presentation system based at least partially on the analyzed sensor data; To reduce the amount of time required to effectively adapt the user to the drug, the modified virtual biofit environment is stored in the user's unique user profile, A non-temporary computer-readable medium that enables the operation of [the process].

7. When the instruction is executed by the at least one processor, the at least one processor will: Based at least partially on the analyzed sensor data, it is determined that at least a subset of the sensor data falls below a threshold level. To provide a corrective action based at least in part on the fact that the subset of the sensor data falls below the threshold level, the modified virtual biocompatible environment is provided. A non-temporary computer-readable medium according to claim 6, which further enables the following.

8. The non-temporary computer-readable medium according to claim 6, wherein the virtual biocompatible environment includes at least one of an audio stimulus, a visual stimulus, and an olfactory stimulus.

9. The non-temporary computer-readable medium according to claim 6, wherein the virtual biocompatible environment is provided using at least partially virtual reality, augmented reality, or enhanced reality.

10. The non-temporary computer-readable medium according to claim 8, wherein the visual stimulus includes at least one of a scene image and an avatar guide.

11. The non-temporary computer-readable medium according to claim 6, wherein the virtual biocompatible environment is automatically changed in real time or near real time.

12. The non-temporary computer-readable medium according to claim 6, wherein changing the virtual biocompatible environment includes changing at least one of the audio type, audio pitch, audio volume, scene type, scene brightness, and scent.

13. The presenting device and, At least one processor, memory and A system for augmentation therapy comprising: the memory stores instructions, and when an instruction is executed by the at least one processor, the at least one processor The presenting device provides a virtual biocompatible environment for the user's experience, The presenting device receives sensor data associated with the user, To determine one or more changes in the user state, the sensor data is analyzed using a machine learning model, To enhance treatment by adapting the treatment experience to the temporal evolution of the user's subjective state during medication administration, a modified virtual biocompatible environment is provided, at least partially based on the analyzed sensor data. To reduce the amount of time required to effectively adapt the user to the drug, the modified virtual biofit environment is stored in the user's unique user profile, A system for intensified therapy that enables the following action.

14. When the instruction is executed by the at least one processor, the at least one processor will: Based at least partially on the analyzed sensor data, it is determined that at least a subset of the sensor data falls below a threshold level. To provide a corrective action based at least in part on the fact that the subset of the sensor data falls below the threshold level, the modified virtual biocompatible environment is provided. The system according to claim 13, which further performs the following.

15. The system according to claim 13, wherein the virtual biocompatible environment includes at least one of an audio stimulus, a visual stimulus, and an olfactory stimulus.

16. The system according to claim 13, wherein the virtual biocompatible environment is provided using at least partially virtual reality, augmented reality, or enhanced reality.

17. The system according to claim 15, wherein the visual stimulus includes at least one of a scene image and an avatar guide.

18. The system according to claim 13, wherein the virtual biocompatible environment is automatically changed in real time or near real time.

19. The system according to claim 13, wherein changing the virtual biocompatible environment includes changing at least one of the audio type, audio pitch, audio volume, scene type, scene brightness, and scent.

Images