Mental health training method and system based on virtual reality and storage medium

Abstract

The invention discloses a virtual reality-based psychological health training method, which comprises the following steps of: after acquiring basic data information of a current user, constructing an initial virtual environment according to the acquired basic data information, and then acquiring initial physiological data information generated in an interaction process of the current user and the initial virtual environment; the initial physiological data information is sent to remote equipment to realize remote monitoring; furthermore, not only is the adaptability of the initial virtual environment and the basic data of the current user realized, effective interaction training of the current user and the initial virtual environment ensured, but also the initial physiological data information obtained in real time in the interaction process of the current user and the initial virtual environment is transmitted to the far-end equipment, and remote monitoring is realized; the technical problems that the training effect is low, the training scene is single and the training method is poor in applicability during mental health training in the prior art are solved.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a virtual reality-based mental health training method, system and storage medium. Background Art

[0002] With the rapid development of various industries in society, in order to ensure that practitioners are competent for current professional needs, each industry has corresponding requirements for the mental health and psychological stress resistance of practitioners. In related technologies, the training method for mental health is usually self-enhancement training or face-to-face training by relevant professionals. However, the above two training methods cannot monitor the mental state of the trainees in real time to ensure the effectiveness and accuracy of the training. In addition, the above two training methods also have the problems of single training scene, inefficient training results caused by the inability of relevant professionals to conduct remote monitoring, and training methods are limited by geographical location.

[0003] Therefore, how to overcome the technical problems of low efficiency of training effect, single training scenario and poor applicability of training methods in the above-mentioned related technologies when conducting mental health training for trainees has become a technical problem that technicians in this field need to solve. Summary of the invention

[0004] The embodiments of the present invention provide a virtual reality-based mental health training method, system and storage medium to solve the technical problems of low efficiency of training effect, single training scene and poor applicability of training method when trainers conduct mental health training in related technologies.

[0005] In a first aspect, an embodiment of the present invention provides a mental health training method based on virtual reality, which comprises:

[0006] Get the basic data information of the current user;

[0007] Constructing an initial virtual environment according to the basic data information;

[0008] Acquiring in real time initial physiological data information during the interaction between the current user and the initial virtual environment;

[0009] The initial physiological data information is sent to a remote device to achieve remote monitoring of the interaction process.

[0010] The virtual reality-based mental health training method of the embodiment of the present invention has at least the following beneficial effects:

[0011] A mental health training method based on virtual reality in an embodiment of the present invention obtains basic data information of the current user, constructs an initial virtual environment according to the obtained basic data information, and then obtains initial physiological data information generated during the interaction between the current user and the initial virtual environment, and sends the initial physiological data information to a remote device to achieve remote monitoring; thereby, not only the adaptability of the initial virtual environment to the basic data of the current user is achieved, ensuring effective interactive training between the current user and the initial virtual environment, but also the initial physiological data information obtained in real time during the interaction between the current user and the initial virtual environment is transmitted to the remote device to achieve remote monitoring; it solves the technical problems of low efficiency of training effect, single training scene and poor applicability of training method in related technologies when conducting mental health training; it provides an accurate and efficient mental health training method based on virtual reality that can overcome geographical area restrictions.

[0012] According to some other embodiments of the present invention, the mental health training method based on virtual reality further includes:

[0013] Adjusting parameters of the initial virtual environment according to the initial physiological data information to construct an enhanced virtual environment;

[0014] Acquiring target physiological data information in real time during the interaction between the current user and the enhanced virtual environment;

[0015] The target physiological data information is sent to the remote device to achieve remote monitoring of the interaction process.

[0016] According to some other embodiments of the mental health training method based on virtual reality, the basic data information includes: one or more of age information, gender information, mental health status information, and specific demand preference information;

[0017] The constructing of the initial virtual environment according to the basic data information includes: constructing the initial virtual environment according to one or more of the age information, the gender information, the mental health status information, and the specific demand preference information.

[0018] According to some other embodiments of the virtual reality-based mental health training method of the present invention, the initial physiological data information includes one or more of initial heart rate information, initial breathing frequency information, and initial skin electrical response information.

[0019] According to some other embodiments of the mental health training method based on virtual reality of the present invention, the initial physiological data information also includes initial facial expression information;

[0020] The adjusting the parameters of the initial virtual environment according to the initial physiological data information to construct an enhanced virtual environment includes:

[0021] The display content of the initial virtual environment and / or the difficulty of the current user interacting with the initial virtual environment are adjusted according to the initial facial expression information to obtain the enhanced virtual environment.

[0022] According to some other embodiments of the mental health training method based on virtual reality of the present invention, the real-time acquisition of target physiological data information during the interaction between the current user and the enhanced virtual environment includes:

[0023] One or more of target heart rate information, target respiratory rate information, target skin electrical response information, and target facial expression information during the interaction between the current user and the enhanced virtual environment is acquired in real time.

[0024] According to some other embodiments of the present invention, the mental health training method based on virtual reality further includes:

[0025] A training analysis report is generated according to the target heart rate information, target breathing frequency information, target skin electrical response information, and target facial expression information.

[0026] In a second aspect, an embodiment of the present invention provides a mental health training system based on virtual reality, comprising:

[0027] Information acquisition module, used to obtain basic data information of the current user;

[0028] A virtual environment construction module, used to construct an initial virtual environment according to the basic data information;

[0029] A physiological data information acquisition module, used for acquiring in real time the initial physiological data information of the current user in the process of interacting with the initial virtual environment;

[0030] The data transmission module is used to send the initial physiological data information to a remote device to achieve remote monitoring of the current user.

[0031] According to some other embodiments of the present invention, the virtual environment construction module is further used to adjust the parameters of the initial virtual environment according to the initial physiological data information to construct an enhanced virtual environment;

[0032] The physiological data information acquisition module is also used to obtain target physiological data information in real time during the interaction between the current user and the enhanced virtual environment;

[0033] The data transmission module is also used to send the target physiological data information to the remote device to achieve remote monitoring of the interaction process.

[0034] In a third aspect, an embodiment of the present invention provides a computer-readable storage medium having an executable program stored thereon, and when the executable program is executed, the above-mentioned virtual reality-based mental health training method is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is a flowchart of a specific embodiment of a mental health training method based on virtual reality according to an embodiment of the present invention;

[0036] Figure 2 It is a flowchart of another specific embodiment of a mental health training method based on virtual reality according to an embodiment of the present invention;

[0037] Figure 3 It is a flowchart of another specific embodiment of a mental health training method based on virtual reality in an embodiment of the present invention;

[0038] Figure 4 It is a module block diagram of a specific embodiment of a mental health training system based on virtual reality in an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The following will clearly and completely describe the concept of the invention and the technical effects produced in combination with the embodiments, so as to fully understand the purpose, characteristics and effects of the invention. Obviously, the described embodiments are only part of the embodiments of the invention, not all of them. Based on the embodiments of the invention, other embodiments obtained by those skilled in the art without creative work are all within the scope of protection of the invention.

[0040] In the description of the embodiments of the present invention, if "several" is involved, it means more than one, if "multiple" is involved, it means more than two, if "greater than", "less than" or "exceed" is involved, it should be understood as not including the number itself, if "above", "below" or "within" is involved, it should be understood as including the number itself. If "first" or "second" is involved, it should be understood as being used to distinguish technical features, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features.

[0041] Reference Figure 1 The embodiment of the present invention provides a virtual reality-based mental health training method, which includes the following steps:

[0042] S100, obtaining basic data information of the current user;

[0043] Among them, the current user is a person who needs mental health training. Since different current users have different environments and needs, it is necessary to obtain corresponding basic data information for subsequent targeted mental health training.

[0044] S200, constructing an initial virtual environment according to basic data information;

[0045] After obtaining the basic data information through the above step S100, in order to improve the effectiveness of mental health training, in this step, different initial virtual environments are constructed according to different basic data information through the VR head-mounted display, thereby effectively improving the correspondence between the constructed initial virtual environment and the current user, ensuring the effectiveness of the subsequent current user's interaction with the initial virtual environment for mental health training by wearing a VR head-mounted display.

[0046] S300, obtaining in real time initial physiological data information during the interaction between the current user and the initial virtual environment;

[0047] After the initial virtual environment is constructed through the above step S200, the current user wears a VR head-mounted display to perform interactive training with the initial virtual environment. In different stages of the interactive training process, the current user will have different initial physiological data information. The initial physiological data information is obtained in real time by wearing a VR head-mounted display, thereby realizing implementation status monitoring of the interaction process between the current user and the initial virtual environment.

[0048] S400: Sending initial physiological data information to a remote device to achieve remote monitoring of the interaction process.

[0049] The remote device is a device that is connected to the VR head mounted display for constructing the initial virtual environment in the above step S200, such as any one or more of a smart phone, a PC or a pad, etc. A data transmission module is integrated in the VR head mounted display to send the initial physiological data information of the current user interacting with the initial virtual environment to the remote device, and the relevant professionals at one end of the remote device can realize remote monitoring by reading the transmitted data.

[0050] The virtual reality-based mental health training method proposed in this embodiment not only achieves the adaptability of the initial virtual environment to the basic data of the current user, ensuring effective interactive training between the current user and the initial virtual environment, but also transmits the initial physiological data information of the current user in the process of interacting with the initial virtual environment in real time to a remote device, thereby realizing remote monitoring; it solves the technical problems of inefficient training effects, single training scenarios and poor applicability of training methods that exist in related technologies when conducting mental health training.

[0051] In some embodiments, the basic data information described in the above embodiments includes one or more of the current user's age information, gender information, mental health status information, and specific demand preference information. Then the above embodiment step S200 constructs the initial virtual environment according to the basic data information specifically includes: constructing the initial virtual environment according to one or more of the age information, gender information, mental health status information, and specific demand preference information. In a specific embodiment, in order to ensure that the initial virtual environment constructed by the VR head-mounted display is more adapted to the current user, its basic data information includes age information, gender information, mental health status information and specific demand preference information; wherein the specific demand preference information can determine the 3D scene of the initial virtual environment (including, for example: for social phobia mental health training, it corresponds to social dialogue scenes, educational personnel correspond to teaching scenes, pilots correspond to flight scenes, soldiers correspond to training or war scenes, etc.).

[0052] Reference Figure 2 In some embodiments, the initial virtual environment constructed in the above embodiments is constructed based on the basic data information of the current user. However, since the psychological qualities of the current personnel are different, simply constructing the initial virtual environment based on the basic data information cannot meet the personalized needs of training. Furthermore, in order to solve the personalized needs of different users and improve the training effect. Therefore, the mental health training method based on virtual reality proposed in the present invention also includes the steps of:

[0053] S500, adjusting parameters of the initial virtual environment according to the initial physiological data information to construct an enhanced virtual environment;

[0054] S510, obtaining target physiological data information in real time during the interaction between the current user and the enhanced virtual environment;

[0055] S530: Send the target physiological data information to a remote device to achieve remote monitoring of the interaction process.

[0056] In this embodiment, the initial physiological data information generated by the interaction between the current user and the initial virtual environment is obtained in real time, and then it is determined whether the initial environment is suitable for the current user. After adjusting the parameters of the initial virtual environment according to the physiological data information, an enhanced virtual environment is constructed, so that the current user can improve the training effect in the interaction with the enhanced virtual environment. At the same time, the target physiological data information obtained during the interaction between the current user and the enhanced virtual environment is sent to a remote device to realize remote monitoring of the psychological training of the current user.

[0057] In some embodiments, the initial physiological data information described in the above embodiments includes one or more of initial heart rate information, initial respiratory rate information, and initial skin electrical response information. Generally, in order to fully reflect the psychological state of the current user, the initial physiological data information usually includes initial heart rate information, initial respiratory rate information, and initial skin electrical response information. In this embodiment, the initial heart rate information is obtained by attaching a heart rate sensor to the current user, and is transmitted to the VR head-mounted display; the initial respiratory rate information is obtained by attaching a respiratory sensor to the current user, and is transmitted to the VR head-mounted display; the initial skin electrical response information is obtained by attaching a skin electrical response sensor to the current user, and is transmitted to the VR head-mounted display; and the VR head-mounted display sends the received data information to the remote device through the data transmission module to achieve remote monitoring.

[0058] In some embodiments, the initial physiological data information also includes initial facial expression information, and the initial facial expression information can reflect the emotional state and psychological state of the current user. Therefore, in order to ensure that the parameters of the initial virtual environment are adjusted, the enhanced virtual environment obtained is adapted to the current user. In this embodiment, the above-mentioned step S500 of the embodiment adjusts the parameters of the initial virtual environment according to the initial physiological data information to construct an enhanced virtual environment, specifically including: adjusting the display content of the initial virtual environment and / or adjusting the interaction difficulty of the initial virtual environment according to the initial facial expression information. In a specific example, the acquisition of the initial facial expression information is obtained by a facial recognition module integrated in a VR head-mounted display. The facial recognition module obtains the initial facial expression information of the current user. After the facial recognition module collects the facial image information of the current user, it identifies the emotional state of the current user through an existing facial recognition algorithm and divides it into the following four states:

[0059] The happy state corresponds to the facial expression of upturned eyes and upturned mouth corners;

[0060] Sadness, which corresponds to a facial expression with drooping eyebrows and drooping mouth corners;

[0061] The state of surprise, which corresponds to the facial expression of raised eyebrows and wide eyes;

[0062] The calm state, whose corresponding facial expression does not belong to any of the above expression states.

[0063] After obtaining the emotional state of the current user interacting with the initial virtual environment, the actual content of the initial virtual environment and / or the difficulty of interaction of the initial virtual environment are adjusted accordingly to obtain an enhanced virtual environment, so that the current user can achieve effective training effects after interacting with the enhanced virtual environment, avoiding, for example, socially anxious and introverted patients who make impromptu speeches in a scene with a large number of people in the initial virtual environment, and thus being too nervous and unable to interact normally with the initial virtual environment; for example, pilots conduct psychological training in a scene with too high or too low difficulty in the initial virtual environment, which cannot effectively provide effective psychological training for the current user. Therefore, the enhanced virtual environment obtained by adjusting the display content of the initial virtual environment and / or adjusting the difficulty of interaction of the initial virtual environment according to the initial facial expression information can effectively provide an adaptive mental health training scene for the current user.

[0064] In some embodiments, the number of adjustments to adjust the reality content of the initial virtual environment and / or the difficulty of interaction of the initial virtual environment to obtain the enhanced virtual environment in the above embodiments can be zero to multiple times, that is, when it is determined that the current user's emotional state is in a preset emotional state, the initial virtual environment is no longer adjusted, or when the number of adjustments is greater than the preset number, the process of the user interacting with the initial virtual environment / enhanced virtual environment is stopped. In addition, the adjustment of the initial virtual environment can also be adjusted in combination with initial physiological data information such as initial heart rate information and initial respiratory rate information. It should be noted that the initial virtual environment described in each embodiment of the present application is before it is determined to be adjusted to the enhanced virtual environment, and any virtual environment in the adjustment process is referred to as the initial virtual environment.

[0065] In some embodiments, the VR head-mounted display described in the above embodiments stores virtual environments of various difficulties. At the same time, after the VR head-mounted display is connected to an external device through communication, the external device can transmit the designed virtual environment to the VR head-mounted display for storage and / or display.

[0066] In some embodiments, after the enhanced virtual environment is constructed according to the initial physiological data information, the step S510 in the above embodiment real-time acquisition of target physiological data information during the interaction between the current user and the enhanced virtual environment includes: acquiring one or more of target heart rate information, target respiratory rate information, target skin point reaction information, and target facial expression information during the interaction between the current user and the enhanced virtual environment. In a specific example, in order to more comprehensively acquire the emotional state and psychological state of the current user during the interaction with the enhanced virtual environment, the target physiological data information acquired includes target heart rate information, target respiratory rate information, target skin point reaction information, and target facial expression information, and the device for acquiring each target physiological data information corresponds to the device for acquiring the initial physiological data information described in the above embodiment.

[0067] Reference Figure 3 In some embodiments, after obtaining the target physiological data information through the above embodiments, the mental health training method further includes the steps of:

[0068] S600: Generate a training analysis report based on the target heart rate information, the target breathing rate information, the target skin electrical response information, and the target facial expression information.

[0069] In this embodiment, the training analysis report can be completed on a VR head mounted display or a remote device. Usually, in order to avoid data transmission delay caused by data transmission, the training analysis report is generally completed in a data processing module set in a VR head mounted display. Specifically, after receiving each target physiological data information, the data processing module performs data cleaning operations such as removing noise and outliers on each target physiological data information, and then performs threshold judgment analysis on the target physiological data, as follows:

[0070] Threshold setting for target heart rate information:

[0071] Normal resting heart rate: 60-100 beats / minute;

[0072] Mild stress heart rate: 101-120 beats / minute;

[0073] Moderate stress heart rate: 121-140 beats / minute;

[0074] High stress heart rate: over 140 beats / minute.

[0075] The threshold for the target skin electrical response information is set as follows:

[0076] Normal emotions: 0.1-0.5 microsiemens;

[0077] Anxiety or excitement: more than 0.5 microsiemens.

[0078] Based on this, combined with the task completion degree and target facial expression information of the current user interacting with the enhanced virtual environment, a training analysis report is formed. Furthermore, relevant professionals can quickly and accurately obtain the training effect of the current user from the training analysis report, and can plan more effective training programs for subsequent mental health training. At the same time, the training analysis report can be sent to a remote device, so that relevant professionals can remotely provide training programs for the current user.

[0079] Reference Figure 4 An embodiment of the present invention provides a mental health training system based on virtual reality, including an information acquisition module, a virtual environment construction module, a physiological data information acquisition module and a data transmission module; wherein the information acquisition module is used to acquire basic data information of the current user, and transmit the basic data information to the virtual environment construction module; the virtual environment construction module is used to construct an initial virtual environment according to the received basic data information; the physiological data information acquisition module is used to acquire the initial physiological data information of the current user in the process of interaction with the initial virtual environment in real time, and send the collected initial physiological data information to a remote device through the data transmission module, so as to realize remote monitoring of the interaction process between the current user and the initial virtual environment.

[0080] In some embodiments, in order to meet the personalized training needs of the current user, an adaptive training scenario is provided for the user, thereby improving the training effect. The virtual environment construction module described above is also used to construct an enhanced virtual environment based on the initial physiological data information, the physiological data information acquisition module is also used to obtain the target physiological data information during the interaction between the current user and the enhanced virtual environment in real time, and the data transmission module is also used to send the target physiological data information to a remote device to achieve remote monitoring of the interaction process between the current user and the enhanced virtual environment.

[0081] In some embodiments, the basic data information described in the above embodiments includes one or more of the current user's age information, gender information, mental health status information, and specific demand preference information, the initial physiological data information includes initial heart rate information, initial breathing rate information, initial skin galvanic response information, and initial facial expression information, and the target physiological data information includes target heart rate information, target breathing rate information, target skin galvanic response information, and target facial expression information. In this embodiment, the virtual reality-based mental health training system includes a VR head-mounted display, a heart rate sensor, a breathing sensor, a skin galvanic response sensor, and a remote device that integrates a facial recognition module, a data processing module, and a data transmission module in the implementation of hardware equipment, wherein the remote device can be implemented by a computer, and the VR head-mounted display is used to implement the functions of the information acquisition module, the virtual environment construction module, and the data transmission module; the heart rate sensor, the breathing sensor, the skin galvanic response sensor, and the facial recognition module are used to implement the function of the physiological data information acquisition module. The working process principle of the mental health training system based on the virtual environment in the embodiment of the present invention corresponds to the working process principle of the mental health training method based on the virtual environment in the above embodiment, and will not be repeated here.

[0082] In addition, an embodiment of the present invention further provides a computer-readable storage medium, in which a computer-executable program is stored. When the computer-executable program is executed by a processor, the virtual reality-based mental health training method in the above embodiment is implemented.

[0083] The embodiments of the present invention are described in detail above in conjunction with the accompanying drawings, but the present invention is not limited to the above embodiments. Various changes can be made within the knowledge of ordinary technicians in the relevant technical field without departing from the purpose of the present invention. In addition, the embodiments of the present invention and the features in the embodiments can be combined with each other without conflict.

Claims

1. A mental health training method based on virtual reality, characterized in that: include: Get the basic data information of the current user; Constructing an initial virtual environment according to the basic data information; Acquiring in real time initial physiological data information during the interaction between the current user and the initial virtual environment; The initial physiological data information is sent to a remote device to achieve remote monitoring of the interaction process.

2. The virtual reality-based mental health training method according to claim 1, characterized in that: The mental health training method also includes: Adjusting parameters of the initial virtual environment according to the initial physiological data information to construct an enhanced virtual environment; Acquiring target physiological data information in real time during the interaction between the current user and the enhanced virtual environment; The target physiological data information is sent to the remote device to achieve remote monitoring of the interaction process.

3. The virtual reality-based mental health training method according to claim 1 or 2, characterized in that: The basic data information includes: one or more of age information, gender information, mental health status information, and specific demand preference information; The constructing of the initial virtual environment according to the basic data information includes: constructing the initial virtual environment according to one or more of the age information, the gender information, the mental health status information, and the specific demand preference information.

4. The virtual reality-based mental health training method according to claim 2, characterized in that: The initial physiological data information includes one or more of initial heart rate information, initial respiratory frequency information, and initial skin electrical response information.

5. The virtual reality-based mental health training method according to claim 4, characterized in that: The initial physiological data information also includes initial facial expression information; The adjusting the parameters of the initial virtual environment according to the initial physiological data information to construct an enhanced virtual environment includes: The display content of the initial virtual environment and / or the difficulty of the current user interacting with the initial virtual environment are adjusted according to the initial facial expression information to obtain the enhanced virtual environment.

6. The virtual reality-based mental health training method according to claim 5, characterized in that: The real-time acquisition of target physiological data information during the interaction between the current user and the enhanced virtual environment includes: One or more of target heart rate information, target respiratory rate information, target skin electrical response information, and target facial expression information during the interaction between the current user and the enhanced virtual environment is acquired in real time.

7. The virtual reality-based mental health training method according to claim 6, characterized in that: The mental health training method also includes: A training analysis report is generated according to the target heart rate information, target breathing frequency information, target skin electrical response information, and target facial expression information.

8. A mental health training system based on virtual reality, characterized in that: include: Information acquisition module, used to obtain basic data information of the current user; A virtual environment construction module, used to construct an initial virtual environment according to the basic data information; A physiological data information acquisition module, used for acquiring in real time the initial physiological data information of the current user in the process of interacting with the initial virtual environment; The data transmission module is used to send the initial physiological data information to a remote device to achieve remote monitoring.

9. The virtual reality-based mental health training system according to claim 8, characterized in that: The virtual environment construction module is further used to adjust the parameters of the initial virtual environment according to the initial physiological data information to construct an enhanced virtual environment; The physiological data information acquisition module is also used to obtain target physiological data information in real time during the interaction between the current user and the enhanced virtual environment; The data transmission module is also used to send the target physiological data information to the remote device to achieve remote monitoring of the interaction process.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an executable program, and when the executable program is executed, the virtual reality-based mental health training method as described in any one of claims 1 to 7 is implemented.

Images