Virtual reality-based apparatus for assisting a subject and corresponding computer-implemented method

Abstract

A virtual reality-based apparatus for assisting a subject and corresponding computer-implemented method, designed in particular for psychotherapeutic assistance, more specifically relieving anxiety, through an immersive experience in a virtual reality environment. There is provided an interactive graphic element that synchronizes with one or more of the subject's physiological data, gradually guiding them to a desired psychophysical state.

Description

[0001] “VIRTUAL REALITY-BASED APPARATUS FOR ASSISTING A SUBJECT AND CORRESPONDING COMPUTER-IMPLEMENTED METHOD”

[0002] FIELD OF THE INVENTION

[0003] The present invention concerns a virtual reality-based apparatus for assisting a subject and a corresponding computer-implemented method. In particular, some embodiments concern an apparatus and a computer-implemented method designed for psychotherapeutic assistance, more specifically to alleviate anxiety, through an immersive experience in a virtual reality (VR) environment. Even more in particular, example embodiments provide an interactive graphic element that dynamically synchronizes with one or more of the subject’s physiological data, gradually guiding them to a desired psychophysical state. The embodiments described here employ, for example, metaverse technology and virtual reality applications to provide a personalized and effective approach to assisting a subject.

[0004] BACKGROUND OF THE INVENTION

[0005] Anxiety is known to have a significant impact on people’s mental and physical health, leading over time, if chronic, to several problems even on the physical level, for example problems with the cardiovascular system, gastrointestinal disorders, sleep problems, depression and reduced efficiency of the immune system. The World Health Organization estimates that anxiety will be one of the main health problems of the coming years, so much so that experts predict it is one of the disorders with the highest incidence.

[0006] Treatment of anxiety usually involves the face-to-face presence of the patient and the therapist, who guides the therapy and identifies techniques and exercises on the basis of the patient’s needs.

[0007] Breathing is known to play an important role in managing and treating anxiety, and in reducing stress. In moments of anxiety, breathing becomes fast and shallow, leading to increased feelings of agitation and panic. This triggers a vicious circle that worsens the symptoms.

[0008] Acting on breathing is a way to reduce symptoms and resolve the problem. This occurs because breathing affects the autonomic nervous system; in fact, slow and deep breathing activates the parasympathetic autonomic system and reduces stress. Regulating breathing also means reducing levels of cortisone, the stress hormone circulating in the blood. Finally, slow and regulated breathing improves blood oxygenation and promotes better brain function.

[0009] However, patients struggle to manage their breathing in situations of anxiety and panic because when people are stressed, they tend to breathe more quickly and superficially.

[0010] Current techniques for solving the respiratory problem related to anxiety provide therapy sessions to learn deep breathing. However, current breathing management techniques are not always effective, therefore current techniques for treating anxiety with breathing have some treatment limitations.

[0011] Al-Mfarej Dalya et al. doi: 10.1109 / VRW58643.2023.00065 describes a virtual reality exercise game: physician-led breathing and relaxation for children with muscular dystrophy.

[0012] Van Room Marieke, doi: 10.1145 / 2851581.2892452 describes a virtual reality biofeedback game for children at risk of anxiety.

[0013] Agrawal Vasundhara, doi: 10.1145 / 3383668.3419876 describes a mobile device-based deep breathing game with biofeedback.

[0014] Nam Yunyoung et al, doi: 10.1109 / JBHI.2015.2480838 describes an estimation of the respiratory rate through a microphone integrated into a smartphone or headset.

[0015] Sra Misha et al, doi: 10.1145 / 3173574.317391 describes a virtual reality system to exploit breathing as a directly controlled interface for virtual reality games.

[0016] EP 2 277 437 Al describes a method and system for adaptive respiratory stimulation.

[0017] There is therefore the need to perfect a virtual reality-based apparatus for assisting a subject and corresponding computer-implemented method that can overcome at least one of the disadvantages of the state of the art.

[0018] The Applicant has devised, tested and embodied the present invention to overcome the shortcomings of the state of the art and to obtain these and other purposes and advantages.

[0019] SUMMARY OF THE INVENTION

[0020] The present invention is set forth and characterized in the independent claims, while the dependent claims describe other characteristics of the present invention or variants to the main inventive idea. In accordance with the above purposes, some embodiments described here concern a virtual reality-based apparatus for assisting a subject. In one embodiment, the apparatus comprises:

[0021] - a three-dimensional virtual reality environment configured to display an interactive graphic element;

[0022] - a virtual reality viewer connected to a user terminal with access to the three- dimensional virtual reality environment, the virtual reality viewer comprising an integrated sensor for the real-time detection of physiological data of a subject that interacts with the interactive graphic element;

[0023] - a control unit configured to modify the behavior of the interactive graphic element on the basis of the acquired physiological data, the control unit storing an algorithm to synchronize movements of portions of the interactive graphic element with an evolution of the physiological data over time.

[0024] According to some embodiments, the algorithm implements artificial intelligence routines, for example machine-learning.

[0025] According to some embodiments, the physiological data includes at least one parameter selected from the group consisting of the subject’s respiratory rate, heart rate and galvanic skin response.

[0026] According to possible embodiments, the interactive graphic element comprises a virtual object that represents a natural element, such as for example a plant or one or more parts thereof, for example the flower, leaves, branches. According to possible implementations, the virtual object is a lotus flower, and the portions of the graphic element comprise the lotus flower’s petals.

[0027] According to possible embodiments, the virtual reality viewer also comprises a communication unit that communicates, by connecting them, with the control unit on one side and with the user terminal on the other side.

[0028] According to possible embodiments, the control unit comprises a computer program with instructions to generate a therapeutic protocol on the basis of the acquired physiological data.

[0029] According to possible embodiments, the apparatus comprises a communication unit and the control unit comprises a computer program comprising instructions to transmit the physiological data acquired by the sensor of the virtual reality viewer to the control unit, and the control unit is configured to transmit, using the communication unit, control information to the user terminal in order to influence, dynamically and in a coordinated maimer, the behavior of the interactive graphic element in the three-dimensional virtual reality environment.

[0030] According to possible embodiments, the therapeutic protocol includes a scheme for the progressive synchronization between the movements of portions of the interactive graphic element and the development of the physiological data over time, and the control unit is configured, by means of a computer program, to execute the progressive synchronization scheme.

[0031] According to possible embodiments, the integrated sensor of the virtual reality viewer is a microphone configured to detect or capture the subject’s physiological sounds, in order to detect the physiological data. In this way, for example, the detected physiological data can be the subject’s respiratory rhythm.

[0032] According to possible embodiments, the control unit comprises a processing unit able to analyze and provide feedback on the acquired physiological data.

[0033] According to possible embodiments, the control unit is also configured to adjust the intensity of the assistance, for example of the psychophysical management, on the basis of the subject’s preferences.

[0034] According to possible embodiments, the algorithm to synchronize the movements of portions of the interactive graphic element with the development of the physiological data over time is adaptive and personalized for the subject.

[0035] According to possible embodiments, the control unit is configured to gradually guide the subject to a desired psychophysical state by adjusting the behavior of the interactive graphic element.

[0036] According to possible embodiments, the control unit is also configured to monitor and record the subject’s progress over multiple sessions of interaction with the interactive graphic element.

[0037] According to possible embodiments, the control unit is also configured to process the physiological data in real time to provide immediate feedback to the subject, in particular by dynamically modifying the movements of the portions of the graphic element.

[0038] According to possible embodiments, the control unit is also configured to analyze the physiological data to determine the subject’s level of psychophysical arousal. According to possible embodiments, the algorithm to synchronize the movements of portions of the graphic element with the development of the physiological data over time is dynamically adjusted on the basis of the subject’s responses and the physiological changes.

[0039] According to other embodiments, there is provided a computer-implemented method for assisting a subject in a virtual reality environment. In one embodiment, this method comprises:

[0040] - displaying, in a three-dimensional virtual reality environment, an interactive graphic element;

[0041] - providing a virtual reality viewer connected to a user terminal with access to the three-dimensional virtual reality environment, the virtual reality viewer comprising an integrated sensor which detects in real-time the physiological data of a subject that interacts with the interactive graphic element;

[0042] - modifying the behavior of the interactive graphic element on the basis of the acquired physiological data, using a control unit which stores an algorithm which synchronizes movements of portions of the graphic element with the evolution of the physiological data over time.

[0043] According to one aspect, modifying the behavior of the interactive graphic element includes adjusting the speed of the movements of the portions of the interactive graphic element on the basis of the physiological data.

[0044] In some embodiments, the subject interacts with the interactive graphic element by dynamically modifying their behavior to vary their physiological data in a maimer that is synchronized with the movements of portions of the graphic element.

[0045] According to some embodiments, the physiological data comprise data of the subject’s respiratory rhythm.

[0046] In possible embodiments, the physiological data comprises the subject’s heart rate data.

[0047] In other possible embodiments, the physiological data comprises the subject’s electrodermal activity data.

[0048] In other possible embodiments, the interactive graphic element comprises a visual representation of a natural element, such as a plant or a part of a plant, for example. An example is a flower, a particular example of a flower is a lotus flower. In these examples, the portions of the graphic element can be the flower’s petals. In other examples, the portions of the graphic element can be leaves, branches, or other.

[0049] In other possible embodiments, the physiological data is acquired using one or more non-invasive sensors integrated into a virtual reality viewer that is used by the subject.

[0050] In other possible embodiments, the method also comprises generating a personalized assistance or treatment plan for the subject on the basis of the acquired physiological data.

[0051] In other possible embodiments, the algorithm adjusts the synchronization of the movements of the portions of the graphic element in order to guide the subject to a desired psychophysical state.

[0052] In other possible embodiments, the control unit provides indications to the subject in order to guide them in managing their psychophysical aspects.

[0053] In other possible embodiments, the method also comprises providing feedback to the subject on the basis of the synchronized movements of the portions of the graphic element and of the physiological data.

[0054] In other possible embodiments, the physiological data is acquired continuously during the subject’s interaction with the interactive graphic element.

[0055] In other possible embodiments, the method provides that access to the three- dimensional virtual reality environment occurs through a headset, or virtual reality viewer, mounted on the patient’s head.

[0056] In other possible embodiments, the method also comprises monitoring the subject’ s progress over multiple sessions on the basis of the acquired physiological data.

[0057] In other possible embodiments, the physiological data is transmitted wirelessly from the integrated sensor to the control unit.

[0058] In other possible embodiments, the interactive graphic element provides the subject with a guided visualization exercise.

[0059] In other embodiments, the method comprises that the adjustment of the algorithm is carried out on the basis of the subject’s response to the modified behavior of the interactive graphic element.

[0060] In other embodiments, the physiological data is used to adapt the assistance or treatment plan for the subject over time.

[0061] Other embodiments described here concern a computer-readable non-transient storage medium which stores a computer program product for execution on a control unit of a virtual reality-based apparatus, the computer program product comprising instructions for executing the method according to the embodiments described here.

[0062] In some embodiments, which can be combined with all the embodiments described here, assisting a subject includes the psychophysical management of a subject. In particular, the psychophysical management of a subject can include psychotherapy, more in particular anxiety management.

[0063] In the embodiments described here, we refer to a three-dimensional virtual reality environment in which the interactive graphic element is displayed. This comprises, for example, metaverse technology, which refers to a collective virtual shared space, including augmented reality (AR) and / or virtual reality (VR) environments.

[0064] The presence of a communication unit connected to the control unit on one side and to the user terminal with access to a metaverse or three-dimensional virtual reality environment on the other side, concerns the integration of the apparatus and method described here with the metaverse or VR environment accessible via the user terminals.

[0065] In general, in the embodiments described here the provision of an apparatus and method in a virtual reality system inherently covers the concept of the metaverse. The embodiments described here are therefore applicable in the context of a metaverse or virtual reality environment, allowing the subject to access and interact with the graphic element in a three-dimensional virtual space.

[0066] In accordance with some embodiments, the apparatus and method described here can provide a breathing monitoring and regulation system that comprises a wearable device for monitoring vital signs and a virtual reality platform. The wearable device can be realized by, or associated with, or connected to, or integrated with, the virtual reality viewer.

[0067] In accordance with some embodiments, the apparatus and method described here can provide an adaptive and predictive algorithm that analyzes the collected data and proposes personalized synchronized breathing exercises. In accordance with some embodiments, the apparatus and method described here can provide to record the respiratory baseline and other vital signs through a microphone and wearable devices.

[0068] In accordance with some embodiments, the apparatus and method described here can provide dynamic virtual environments and progressive training programs that evolve on the basis of the subject’s progress.

[0069] In accordance with some embodiments, the apparatus and method described here can provide an immediate alert and response system that suggests and adapts exercises in real time in the event of abnormalities in the vital signs.

[0070] In accordance with some embodiments, the apparatus and method described here can provide to give detailed feedback to the subject at the end of each therapeutic session.

[0071] In accordance with some embodiments, the apparatus and method described here can provide a customizable virtual reality platform with procedurally generated natural scenarios and interactive avatars that give emotional support and guidance to the subject.

[0072] In accordance with some embodiments, the apparatus and method described here can provide devices with visual and auditory signals to improve breathing synchronization.

[0073] In accordance with some embodiments, the apparatus and method described here can provide to use facial recognition and voice analysis technologies to detect the subject’s emotional state and adapt the exercises in real time.

[0074] In accordance with some embodiments, the apparatus and method described here can provide advanced biofeedback techniques to provide real-time feedback on the subject’s physiological state during the exercises.

[0075] In accordance with some embodiments, the apparatus and method described here can provide to use deep learning algorithms that continuously improve the personalization of the breathing exercises.

[0076] DESCRIPTION OF THE DRAWINGS

[0077] These and other aspects, characteristics and advantages of the present invention will become apparent from the following description of some embodiments, given as a non-restrictive example with reference to the attached drawings wherein:

[0078] - fig. 1 is a schematic representation of a virtual reality-based apparatus for assisting a subject according to some embodiments described here;

[0079] - fig. 2 is another schematic representation of a virtual reality-based apparatus for assisting a subject according to some embodiments described here;

[0080] - fig. 3 is a schematic representation of a virtual reality-based method for assisting a subject according to some embodiments described here.

[0081] We must clarify that the phraseology and terminology used in the present description, as well as the figures in the attached drawings also in relation as to how described, have the sole function of better illustrating and explaining the present invention, their purpose being to provide a non-limiting example of the invention itself, since the scope of protection is defined by the claims.

[0082] To facilitate comprehension, the same reference numbers have been used, where possible, to identify identical common elements in the drawings. It is understood that elements and characteristics of one embodiment can be conveniently combined or incorporated into other embodiments without further clarifications.

[0083] DESCRIPTION OF SOME EMBODIMENTS

[0084] Some embodiments described here with reference to the attached drawings concern an apparatus and computer-implemented method designed to assist a subject, user or patient, for example for psychotherapy. One possible example is to address and alleviate anxiety in patients.

[0085] In particular, some embodiments provide a virtual reality-based apparatus 10 (figs. 1 and 2) for assisting a subject, comprising:

[0086] - a three-dimensional virtual reality environment 11 configured to display an interactive graphic element 12;

[0087] - a virtual reality viewer 13 connected to a user terminal 14 with access to the three- dimensional virtual reality environment 11, the virtual reality viewer 13 comprising an integrated sensor 15 for the real-time detection of physiological data of a subject 16, or user, which interacts with the interactive graphic element 12;

[0088] - a control unit 17 configured to modify the behavior of the interactive graphic element 12 on the basis of the acquired physiological data, the control unit 17 storing an algorithm to synchronize movements of portions 18 of the interactive graphic element 12 with an evolution of the physiological data over time.

[0089] Other embodiments provide a computer-implemented method for assisting a subject in a virtual reality environment, comprising: - displaying an interactive graphic element 12 in a three-dimensional virtual reality environment 11 ;

[0090] - providing a virtual reality viewer 13 connected to a user terminal 14 with access to the three-dimensional virtual reality environment 11, the virtual reality viewer 13 comprising an integrated sensor 15 which detects in real-time the physiological data of a subject 16 that interacts with the interactive graphic element 12;

[0091] - modifying the behavior of the interactive graphic element 12 on the basis of the acquired physiological data, using a control unit 17 which stores an algorithm that synchronizes movements of portions 18 of the interactive graphic element 12 with the evolution of the physiological data over time.

[0092] The sensor 15 communicates with the control unit 17 to provide the detected physiological data. For example, the data can be provided in real time.

[0093] According to some embodiments, the aforementioned algorithm implements artificial intelligence routines, for example machine-learning.

[0094] Some embodiments described here therefore provide to make available a virtual room that the subject 16 accesses, in which there is an interactive graphic element 12, in the non-limiting example given here it can be an interactive lotus flower, whose behavior, for example movements of some portions thereof, is dynamically coordinated with physiological data of the subject 16, for example breathing rate, and for which movements of its portions 18, for example, steps of opening and closing the petals in the case of the lotus flower, are adapted on the basis of the physiological data, encouraging a desired behavior of the subject 16, for example a slower and deeper breathing, which is known to be beneficial in reducing anxiety.

[0095] The embodiments described here use, for example, the metaverse and / or virtual reality for anxiety psychotherapy through a particular application in virtual reality (VR) that, starting first from the detection and then from the synchronization of the breathing, allows to rebalance anxiety states of different entities by regulating breathing using an interactive graphic element 12, such as an interactive lotus flower for example.

[0096] The embodiments described here are based on the fact that the human body is a complex biochemical system that responds physiologically to emotional stimuli, and vice versa. Acting at a physiological level, for example regulating breathing, in order to have psychological effects is an intent of the embodiments described here.

[0097] The subject, by means of the apparatus and computer-implemented method described here, begins for example to treat anxiety in an interactive maimer.

[0098] In the embodiments described here, for example, the above mentioned three- dimensional room in the metaverse is accessible through virtual reality or augmented reality devices, such as a virtual reality viewer 13 connected to a user terminal 14. The virtual room is designed to give the subject 16 an engaging and immersive experience.

[0099] In the room, for example in the center, there is an interactive graphic element 12 with mobile portions 18 able to adjust on the basis of the physiological data of the subject 16, for example the breathing of the subject 16 that is detected. As mentioned, the interactive graphic element 12 is for example a lotus flower with some petals.

[0100] The algorithm used in the embodiments described here is designed to detect and monitor, in a first step (step 1 of fig. 3), one or more physiological data of the subject 16, such as the subject’s breathing, or respiratory rhythm, and synchronize the movements of the portions 18 of the interactive graphic element 12 on the basis of the detected physiological data. For example, synchronize the opening of the petals in the inspiratory phase and the closing of the petals in the expiratory phase. In the first step, therefore, the opening and closing of the portions 18 of the interactive graphic element 12, for example the flower’s petals, are synchronized with the basal rhythm of the subject 16 and this can therefore allow to detect the level of severity of the anxious state as a function of the rate (respiratory rate on the one hand, and movement rate of the portions 18 of the interactive graphic element 12 on the other hand).

[0101] The subject 16 is equipped with a virtual reality viewer 13, inside which there is a sensor 15, which in the case of breathing detection can be for example a microphone that detects the patient’s breathing and allows to synchronize the movements of the portions 18 of the interactive graphic element 12, for example the opening and closing of the flower’s petals, with the subject’s respiratory rhythm in the first step.

[0102] In a second step (step 2 of fig. 3), starting from the physiological data, in particular from their development over time, recorded in the first step, and on the basis of this physiological data and after the movements of the portions 18 of the interactive graphic element 12 have synchronized with the trend of the physiological data over time, the algorithm causes a progressive variation of the movements of the portions 18 of the interactive graphic element 12, influencing the behavior of the subject 16 until they are lead to desired physiological data. For example, in the event that the patient’s breathing is detected and after the movement of the portions 18 of the interactive graphic element 12 (e.g. opening and closing of the lotus flower’s petals) has synchronized with that of the subject 16, the movement of the portions 18 begins to vary, progressively slowing down, until slowly leading the subject 16 to a slower and deeper breathing, on the basis of the correct protocol for the level of anxiety necessary to rebalance the subject’s emotional state. The portions 18 of the interactive graphic element 12 move more slowly, for example the petals open and close more slowly, until the patient’s breathing is synchronized with the dynamics of the interactive graphic element 12, until the normalization state. The subject 16 observing the interactive graphic element 12 synchronizes their breathing with the movement of the portions 18 of the interactive graphic element 12, and breathing progressively becomes natural and relaxed.

[0103] The algorithm used in the embodiments described here is able to adapt to the individual needs of each subject 16, both in faithfully reproducing, that is, duplicating, the subject’s breathing rhythms, and also in the timing to reach the synchronization between movement of the portions of the interactive graphic element 12 (e.g. opening and closing of the petals) and breathing of the subject 16.

[0104] Thanks to the embodiments described here, it is possible to solve the problem of managing anxiety in an interactive virtual reality environment. Anxiety is a widespread problem and the most commonly used techniques to manage it require the presence of a therapist, who supervises and teaches the techniques to be learned. The proposed solution, on the other hand, provides an apparatus and a computer-implemented method which, through the aforementioned algorithm, allow to adapt to the subject and to guide the subject to a correct exercise through which to achieve desired physiological data, for example a desired respiratory rhythm. The gradual synchronization of breathing allows the subject to gradually learn the technique and practice it several times. This solves the problem of accessing traditional anxiety management practices, while still being able to have a personalized and immersive treatment.

[0105] With the embodiments described here, it is possible to implement a psychotherapy model with an interactive graphic element that is personalized because it starts from the patients’ signals to adjust the psychological process. In addition, the patient actively participates in the therapy. The embodiments described here, in fact, provide an apparatus and method that allow a personalized and immersive psychotherapy that is based on the patient’s physiological states.

[0106] In possible embodiments, the apparatus 10 comprises a communication unit 19 (figs. 1 and 2) communicating with the control unit 17 on one side and with the user terminal 14 on the other.

[0107] In possible embodiments, the virtual reality viewer 13 and the integrated sensor 15 are comprised in an information acquisition unit 20 that acquires information on physiological data, for example on the subject’s breathing.

[0108] In possible embodiments, the control unit 17 is comprised in a supply unit 21 for providing a therapy based on respiratory control in virtual reality. The user terminal 14 and the supply unit 21 are connected through the communication unit 19, for example through a wired network or a wireless network.

[0109] The information acquisition unit 20 is connected with the control unit 17 to provide the physiological data detected by the sensor 15, for example in real time. In some embodiments, the information acquisition unit 20, which comprises the virtual reality viewer 13 with the sensor 15, for example a microphone, is able to detect the respiratory data of the subject 16 in real time, and supply it to the supply unit 21, and in particular to the control unit 17 thereof.

[0110] The data is therefore acquired non-invasively and transmitted to the control unit 17. The latter processes the data and communicates, through the communication unit 19, with the user terminal 14 in order to coordinate the dynamics of the interactive graphic element 12.

[0111] The interactive graphic element 12 is created using advanced three-dimensional graphics techniques, the graphics take into account the characteristics of the mobile portions 18, for example the petals and the symbolism associated with the flower, in particular the concept of rebirth.

[0112] In an example embodiment, the interactive graphic element 12 is a lotus flower which has a realistic three-dimensional shape and develops harmoniously with its petals opening and closing around a spherical center. The petals are disposed symmetrically, reflecting the typical geometry of lotus flowers. Thanks to advanced design and animation techniques, the lotus flower looks realistic and highly detailed. The petals are rendered with a soft and delicate texture, while the center of the flower has a soothing and relaxing appearance.

[0113] The portions 18 move relative to patient input or indications of the algorithm used.

[0114] The movement of the petal portions 18 is controlled by an animation system that responds to the data detected by the microphone integrated in the virtual reality viewer 13 of the subject. The microphone detects the patient’s respiratory rhythm, capturing the inspiratory and expiratory phases. The synchronization between the patient’s breathing and the movements of the portions 18 is programmed to take place initially in an adaptive maimer, and then implement and guide the subject to a slower and deeper breathing. The sensor 15, for example the microphone, records the respiratory rate.

[0115] The control unit 17 implements a visual generation module of the respiratory rate-based therapeutic program, which analyzes the respiratory rate data and intelligently generates a visual treatment plan that is coordinated with the dynamics of the interactive graphic element 12. For example, the microphone is integrated inside the virtual reality viewer 13 and receives the subject’s inspiratory and expiratory phases. The generation of the therapeutic program occurs by means of an advanced artificial intelligence (Al) system. The Al analyzes the patient’s respiration physiological data, possibly integrating with other symptoms and anamnestic data collected during access, in order to create a personalized treatment plan. In some cases, for example only for the first access to the three-dimensional virtual reality environment 11, a short card with opening questions is provided (e.g. to detect pre-existing respiratory conditions).

[0116] The therapeutic program is then displayed through the movements of the portions 18 of the interactive graphic element 12, for example the lotus flower’s petals, in the virtual room.

[0117] As mentioned, the apparatus 10 can comprise a communication unit 19 which communicates with the external user terminal 14. As stated, furthermore, the apparatus 10 can comprise a unit 20 for acquiring information on patient data, symptoms, associated diseases.

[0118] The control unit 17 can store the aforementioned algorithm, which as stated can implement artificial intelligence routines, for example machine-learning.

[0119] In some embodiments, the algorithm stored in the control unit 17 can be configured to implement a first step of breathing detection and synchronization, and a second step of breathing normalization.

[0120] In particular, in some embodiments it is provided that, in the first step, the algorithm performs a detection of the patient’s breathing in terms of rate, identification of the severity level of the anxious state (An) and synchronization with the dynamics of the interactive graphic element 12.

[0121] In the second step, starting from the rate recorded on the patient and on the basis of standard protocols for normalized breathing rate (Pn) recorded in the algorithm:

[0122] - the correct protocol for the level of anxiety is identified and activated to rebalance the patient’s emotional state;

[0123] - the synchronization of the dynamics of the interactive graphic element 12 is started progressively from the initial rate recorded on the patient to the normalized rate.

[0124] The algorithm, for example, calculates the speed of movement of the portions 18, for example opening and closing speed of the petals. The user terminal 14 allows to access the room in the metaverse and to interact with the interactive graphic element 12. The breathing detection and synchronization algorithm is based on signal analysis and machine learning techniques. It processes the respiratory data provided by the sensors, detects the breathing in the application and proceeds to the virtual representation of the rate with the interactive graphic element 12, for example with the lotus flower.

[0125] The algorithm processes the data coming from the subject 16 to calculate the respiratory rate, detect any irregular patterns and activate the next synchronization step.

[0126] Using the input of the subject’s 16 breathing, the algorithm synchronizes the movements of the portions 18 in the virtual room on the basis of the inspiratory and expiratory phase. During the initial step, the algorithm adapts the synchronization to follow the patient’s respiratory rhythm and gradually guides the patient to a slower and deeper breathing, thus helping to reduce anxiety.

[0127] Consequently, the embodiments described here provide the interactive respiratory synchronization by using the interactive graphic element 12 to synchronize the breathing of the subject 16 and bring it to a regular level, as an innovative and original approach to managing and treating anxiety.

[0128] The use of breathing as input according to the embodiments described here represents a direct interaction of the subject 16 in the virtual world, used for the treatment of anxiety.

[0129] In the embodiments described here, there is provided an initial synchronization and gradual modification of the movement of the portions 18, and consequently of the physiological data, such as breathing. In the case of breathing, the movement of the portions 18 is modified and gradually slows down in order to guide the subject 16 to a desired breathing rhythm.

[0130] Thanks to the use of the three-dimensional virtual reality environment 11, furthermore, the embodiments described here offer the possibility of having a personalized treatment even in the absence of a therapist.

[0131] Furthermore, the embodiments described here offer the possibility of having a system that monitors the subject’s data over time and also of recording data throughout the entire treatment period.

[0132] Favorably, the breathing tracking methodology is used to build an intelligent pathway for the patient and to be able to record results and progress.

[0133] A therapist can follow the progress of the patient’s therapy remotely and can monitor the treatment. For this purpose, the apparatus 10 can include an operator terminal 23, for example a dedicated computer with the therapist’s graphical interface, connected with the communication unit 19 so that it can be connected to the user terminal 14 and the control unit 17.

[0134] The subject 16 can have, even in the absence of the therapist, a personalized program based on their physiological data.

[0135] Using the embodiments described here, it is possible to implement a treatment for anxiety in virtual reality, in which the patient, by wearing a VR headset integrated with a microphone, can give their breathing as initial input. The microphone detects the respiratory rate.

[0136] The visual generation module of the treatment plan present in the control unit 17 analyzes the respiratory data through an Al model that generates a progressive treatment program visually represented by the opening and closing of the portions 18, for example of the lotus flower’s petals, in the three-dimensional virtual reality environment 11.

[0137] Through the technical solution described above, the visual generation module provides that, in the first step, the subject enters the context of the three- dimensional virtual reality environment 11, in which they encounter the visual image of the interactive graphic element 12 (e.g. lotus flower), the portions 18 of which move in a maimer that is coordinated with the breathing rhythm of the subject 16.

[0138] In the second step, instead, the portions 18 move according to the treatment program identified by the visual generation module of the treatment program.

[0139] For example, the input data that is used by the control unit 17 is physiological data, for example, patient breathing detection (e.g. inspiration time and expiration time, breathing rate), possibly other patient data, symptoms, medical history. In addition, the data provided by the algorithm that detects and synchronizes breathing is used as input.

[0140] The output data is obtained by the algorithm in the second step of breathing normalization.

[0141] In accordance with some embodiments, the apparatus and method described here can provide an initial screening of the subject’s psychophysical state and preferences. In particular, the subject can undergo an initial screening to assess their psychophysical state and individual preferences. This screening can include gathering data on visual, auditory, and kinesthetic stimuli that the subject finds relaxing.

[0142] In some embodiments, the preferences as above can include visual stimuli (for example a lotus flower in a natural environment), auditory stimuli (for example the music best suited to relaxation for the subject), and kinesthetic stimuli (for example the manipulation of objects in a virtual environment).

[0143] In accordance with some embodiments, the apparatus and method described here can provide a continuous monitoring of physiological parameters of the subject, for example acquired by an information acquisition unit that acquires information on the subject’s physiological data. For example, the information acquisition unit can be, or include or be connected to, a device worn by the patient, which is configured to monitor, for example continuously, vital signs, including breathing, blood pressure, oximetry and heart rate, during all daily activities.

[0144] The collected physiological data can be used by an algorithm, for example to periodically recalibrate on the basis of the patient’s individual variations.

[0145] In accordance with some embodiments, the apparatus and method described here can provide access to a metaverse virtual reality platform. For example, the subject initially accesses a virtual reality platform (metaverse) to gather essential data regarding their overall condition.

[0146] The platform enables advanced customization of the virtual environment, for example with natural scenarios generated procedurally on the basis of the patient’s tastes and emotional needs.

[0147] Interactive avatars that guide the subject, for example through the tests and therapeutic sessions, can possibly be implemented in the virtual reality platform, which adapt to the subject’s comfort level and offering, for example, emotional support.

[0148] In accordance with some embodiments, the apparatus and method described here can provide to record the respiratory baseline. In particular, a baseline of the patient’s respiratory state can be recorded through a sensor, for example a microphone device on the virtual reality viewer, and through a wearable device in the case of other vital signs. The latter can be realized by, or associated with, or connected to, or integrated with, the aforementioned virtual reality viewer.

[0149] In possible implementations, an advanced analysis of the respiratory patterns can use artificial intelligence techniques to detect micro -variations indicative of stress or other conditions.

[0150] Multi-functional sensors can possibly be provided, configured to detect other parameters, offering a more complete assessment of the physiological state.

[0151] In accordance with some embodiments, the apparatus and method described here can provide a synchronization of the respiratory rate. For example, the respiratory rate can be synchronized by adapting the movement of the interactive graphic element (for example lotus flower) and any other stimuli (visual and / or kinesthetic). Such an algorithm can gradually process a stimulus suitable for the subject to promote synchronization.

[0152] In accordance with some embodiments, the apparatus and method described here can provide to detect the emotional state and propose personalized exercises to bring the subject’s respiratory rate to a pattern level that is ideal for each subject.

[0153] For example, the algorithm can detect an emotional state of the subject using facial recognition and voice analysis technologies, adapting the exercises on the basis of the current mood.

[0154] In addition, an algorithm can select the most appropriate stimulus for each subject and build a suitable breathing exercise, using one of the sensory channels as visual stimuli (for example an opening and closing lotus flower), auditory stimuli (music associated with the lotus flower’s movement), and kinesthetic stimuli (the possibility of manipulating the elements of the lotus flower by lengthening or narrowing them) to promote the process of regulating breathing.

[0155] Moreover, a deep learning algorithm can be implemented, configured to analyze the collected data and learn from previous sessions in order to continuously improve the customization of the breathing exercises.

[0156] Additionally, advanced biofeedback techniques can be implemented, which are able to allow the subject to see how the breathing techniques affect physiological parameters, such as heart rate and respiratory rate, in real time.

[0157] In accordance with some embodiments, the apparatus and method described here can provide predictive analysis and environmental adaptation.

[0158] For example, predictive algorithms analyze historical models of the subject’s data to anticipate their future needs, further customizing the exercises and preventing episodes of anxiety or stress.

[0159] It is also possible to use artificial intelligence routines to dynamically change the virtual environment in response to sudden changes in the patient’s physiological parameters or emotional state. This allows for a real-time customization of the therapeutic experience.

[0160] In accordance with some embodiments, the apparatus and method described here can provide a real-time monitoring system that responds immediately to sudden changes in the physiological parameters, with immediate adjustments of the exercises or of the virtual environment in order to optimize the treatment.

[0161] In accordance with some embodiments, the apparatus and method described here can provide dynamic virtual settings and progressive training.

[0162] For example, the virtual settings adapt and evolve on the basis of the patient’s progress, offering more varied and engaging therapeutic experiences. The virtual environment changes progressively to reflect patient improvements and keep motivation high.

[0163] In addition, it is possible to implement progressive training programs that guide the subject through different stages of intensity and difficulty. This gradual approach improves breathing capacity and stress management over time.

[0164] In accordance with some embodiments, the apparatus and method described here can provide to monitor and notify of anomalies. The worn device can for example continuously monitor the subject’s blood pressure and heart rate. If anomalies are detected, the apparatus and method activate an alert suggesting the subject start a respiratory therapy session.

[0165] In accordance with some embodiments, the apparatus and method described here can provide a feedback response and results of the therapy. For example, at the end of the therapy, the apparatus and method provide the subject with an account of the results achieved in terms of time and respiratory rate.

[0166] In accordance with some embodiments, the apparatus and method described here can provide that the algorithm has the ability to adapt. For example, the algorithm continuously learns from the interactions with the subject, offering solutions that are increasingly suitable for the specific situations in which the subject finds themselves.

[0167] It is clear that modifications and / or additions of parts may be made to the virtual reality-based apparatus 10 for assisting a subject and corresponding computer- implemented method as described heretofore, without thereby departing from the field and scope of the present invention, as defined by the claims.

[0168] In the following claims, the sole purpose of the references in brackets is to facilitate their reading and they must not be considered as restrictive factors with regard to the field of protection defined by the claims.

Claims

CLAIMS1. Virtual reality-based apparatus (10) for assisting a subject, comprising:- a three-dimensional virtual reality environment (11) configured to display an interactive graphic element (12);- a virtual reality viewer (13) connected to a user terminal (14) with access to said three-dimensional virtual reality environment (11), the virtual reality viewer (13) comprising an integrated sensor (15) for the real-time detection of physiological data of a subject (16) that interacts with the interactive graphic element (12);- a control unit (17) configured to modify the behavior of the interactive graphic element (12) on the basis of the acquired physiological data, the control unit (17) storing an algorithm to synchronize movements of portions (18) of the interactive graphic element (12) with an evolution of said physiological data over time.

2. Apparatus (10) as in claim 1, characterized in that said physiological data include data of a respiratory rhythm of said subject (16) and said sensor (15) includes a microphone configured to detect physiological sounds of the subject(16) in order to detect said physiological data.

3. Apparatus (10) as in claim 1 or 2, characterized in that it comprises a communication unit (19) and the control unit (17) comprises a computer program comprising instructions to transmit the physiological data acquired by the sensor (15) of the virtual reality viewer (13) to the control unit (17), and the control unit(17) is configured to transmit, using said communication unit (19), control information to said user terminal (14) in order to influence, dynamically and in a coordinated maimer, the behavior of said interactive graphic element (12) in said three-dimensional virtual reality environment (11).

4. Apparatus (10) as in any claim from 1 to 3, characterized in that the control unit (17) is configured, by means of a computer program, to execute a scheme for the progressive synchronization between the movements of portions (18) of the interactive graphic element (12) and the development of the physiological data over time.

5. Apparatus (10) as in any claim from 1 to 4, characterized in that it comprises a device worn by the subject able to continuously monitor vital signs, including breathing, blood pressure, oximetry and heart rate, during all daily activities, wherein the collected data is used by an algorithm to periodically recalibrate itselfon the basis of the subject’s individual variations.

6. Apparatus (10) as in any claim from 1 to 5, characterized in that said control unit (17) is configured to perform a detection of the emotional state and proposal of personalized exercises to bring the respiratory rate to a pattern level that is ideal for each subject, wherein an algorithm detects the subject’s emotional state using facial recognition and voice analysis technologies, adapting the exercises on the basis of the current mood, wherein the algorithm selects the most appropriate stimulus for each subject and builds a suitable breathing exercise, using one of the sensory channels, such as visual stimuli, auditory stimuli and kinesthetic stimuli, to aid the breathing regulation process.

7. Apparatus (10) as in any claim from 1 to 6, characterized in that said control unit (17) is configured to perform predictive analysis and environmental adaptation, implementing predictive algorithms that analyze historical models of the subject’s data to anticipate their future needs, further personalizing exercises and preventing episodes of anxiety or stress.

8. Apparatus (10) as in any claim from 1 to 7, characterized in that said control unit (17) is configured to perform monitoring and notification of anomalies, wherein a wearable device continuously monitors the subject’s blood pressure and heart rate, wherein, in the event anomalies are detected, the wearable device activates an alert suggesting the subject start a respiratory therapy session.

9. Apparatus (10) as in any claim from 1 to 7, characterized in that said control unit (17) is configured to provide the subject with feedback and with a report of the results obtained in terms of time and respiratory rate.

10. Computer-implemented method for assisting a subject in a virtual reality environment, comprising:- displaying, in a three-dimensional virtual reality environment (11), an interactive graphic element (12);- providing a virtual reality viewer (13) connected to a user terminal (14) with access to said three-dimensional virtual reality environment (11), the virtual reality viewer (13) comprising an integrated sensor (15) which detects in real-time the physiological data of a subject (16) that interacts with the interactive graphic element (12);- modifying the behavior of the interactive graphic element (12) on the basis of theacquired physiological data, using a control unit (17) which stores an algorithm which synchronizes movements of portions (18) of the interactive graphic element (12) with the evolution of said physiological data over time.

11. Computer-implemented method as in claim 10, characterized in that modifying the behavior of the interactive graphic element (12) includes adjusting the speed of the movements of the portions (18) of the interactive graphic element (12) on the basis of the physiological data.

12. Computer-implemented method as in claim 10 or 11, characterized in that the interaction between the subject (16) and the interactive graphic element (12) causes the variation of the detected physiological data in a maimer which is synchronized with the movements of portions (18) of the interactive graphic element (12).

13. Computer-implemented method as in claim 11 or 12, characterized in that said physiological data include data of a respiratory rhythm of said subject (16).

14. Computer-implemented method as in claim 11, 12 or 13, characterized in that it comprises generating a personalized assistance or treatment plan for the subject on the basis of the acquired physiological data, in that the algorithm adjusts the synchronization of the movements of the portions (18) of the interactive graphic element (12) in order to guide the subject (16) to a desired psychophysical state, in that the adjustment of the algorithm is made according to the response of the subject (16) to the modified behavior of the interactive graphic element (12) and in that the physiological data are used to adapt the assistance or treatment plan for the subject over time.

15. Computer-implemented method as in any claim from 10 to 14, characterized in that it comprises:- a first step in which said algorithm detects and monitors one or more physiological data of the subject (16) and synchronizes the movements of the portions (18) of the interactive graphic element (12) on the basis of the detected physiological data,- a second step in which, starting from the development over time of the physiological data of the first step and on the basis of said physiological data, and after the movements of the portions (18) of the interactive graphic element (12) have been synchronized with the trend of said physiological data over time, thealgorithm causes a progressive variation of the movements of the portions (18) of the interactive graphic element (12), influencing the behavior of the subject (16) until it is taken to desired physiological data.

16. Computer-implemented method as in any claim from 10 to 15, characterized in that it comprises continuously monitoring vital signs, including breathing, blood pressure, oximetry and heart rate, during all daily activities, wherein the collected data is used by an algorithm to periodically recalibrate itself on the basis of the subject’s individual variations.

17. Computer-implemented method as in any claim from 10 to 16, characterized in that it comprises performing a detection of the emotional state and proposing personalized exercises to bring the respiratory rate to a pattern level that is ideal for each subject, wherein an algorithm detects the subject’s emotional state using facial recognition and voice analysis technologies, adapting the exercises on the basis of the current mood, wherein the algorithm selects the most appropriate stimulus for each subject and builds a suitable breathing exercise, using one of the sensory channels, such as visual stimuli, auditory stimuli and kinesthetic stimuli, to aid the breathing regulation process.

18. Computer-implemented method as in any claim from 10 to 17, characterized in that it comprises performing predictive analysis and environmental adaptation, implementing predictive algorithms that analyze historical models of the subject’s data to anticipate their future needs, further personalizing exercises and preventing episodes of anxiety or stress.

19. Computer-implemented method as in any claim from 10 to 18, characterized in that it comprises performing monitoring and notification of anomalies, wherein a wearable device continuously monitors the subject’s blood pressure and heart rate, wherein, in the event anomalies are detected, the wearable device activates an alert suggesting the subject start a respiratory therapy session.

20. Computer-implemented method as in any claim from 10 to 15, characterized in that it comprises providing the subject with feedback and with a report of the results obtained in terms of time and respiratory rate.

21. Computer-readable non-transient storage medium which stores a computer program product for the execution on a control unit of a virtual reality-based apparatus (10), the computer program product comprising instructions forexecuting a method as in any claim from 10 to 20.

Images