A psychological catharsis interaction method and system based on virtual reality and artificial intelligence technology
By conducting preference tests and psychological assessments on users, customized virtual scenes are generated and real-time adjustments are made, the problem of inability to adaptively adjust in the existing technology is solved, and a personalized and real-time virtual reality psychological catharsis system is realized to effectively help users. Release stress and improve mental state.
Patent Information
- Application Number
- CN202410884339.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-03
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2044-07-03
AI Technical Summary
The existing psychological catharsis system based on virtual reality technology cannot adaptively according to the user's psychological status, and cannot meet the user's personalized and real-time adjustment needs, resulting in the inability to effectively release stress and improve the psychological state.
By conducting preference tests and psychological assessments on users, customized virtual scenes and interaction methods are generated, and users' physiological signals are monitored in real time to identify emotional states, and cathartic scenes and modes are adjusted in real time according to emotional changes, providing a personalized virtual environment To meet the emotional needs of users.
It realizes a virtual environment and interaction method based on users' personalized needs, effectively releases pressure and improves psychological state, meets users' emotional needs, and provides a personalized and real-time psychological catharsis experience.
Smart Images

Figure CN118412096B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of mental health technology, and in particular to a psychological catharsis interaction method and system based on virtual reality and artificial intelligence technology. Background Art
[0002] With the increasing pressure in modern society, people are increasingly in need of an effective way to release stress through psychological catharsis. Regarding the interactive method of psychological catharsis based on virtual reality and artificial intelligence technology, the Chinese patent with publication number: CN109949896A discloses a psychological detection and treatment system based on virtual reality, including a real detection system, a VR detection and treatment system and a background server system, wherein a VR locator is provided inside the real detection system, and the real detection system also includes VR helmet glasses and VR handles; the VR detection and treatment system includes a set simulation scene, a VR treatment island, and the VR treatment island includes multiple detection and treatment units; the background server system includes an information collection system, an information storage system and a control system. This patent establishes a virtual model that can detect and treat mental illnesses, forms a detection and treatment method, enables patients to have an interactive design in the virtual scene, and makes detection and treatment more targeted to meet the detection requirements of different patients.
[0003] In the existing technology, although an immersive experience environment can be provided based on virtual reality technology, it lacks the ability to adaptively adjust according to the user's psychological condition, cannot meet the user's emotional needs well, and cannot meet the user's needs for personalization and real-time adjustment. Summary of the invention
[0004] The purpose of the present invention is to provide a psychological catharsis interaction method and system based on virtual reality and artificial intelligence technology, provide a customized virtual environment according to the personalized needs of users, adjust the scene and interaction mode in real time to meet the emotional needs of users, thereby helping users to effectively release stress and improve their psychological state, so as to solve the problems raised in the above background technology.
[0005] To achieve the above object, the present invention provides the following technical solutions:
[0006] A psychological catharsis interaction method based on virtual reality and artificial intelligence technology, comprising the following steps:
[0007] Step 1: Conduct a preference test on the user, determine the user's preference according to the test result, conduct a psychological condition assessment based on the user's preference, and obtain the user's psychological condition assessment result;
[0008] The step 1 further includes performing a preference test on the user, and obtaining the test authenticity of the user during the preference test. The test authenticity includes:
[0009] According to the difference between blinking frequency, breathing frequency and true and false micro-expressions, the test authenticity function of the target person is constructed:
[0010] ;
[0011] in, It represents the error factor, and its value range is 0.05-0.1; Indicates the moment; express Blinking frequency at any time; express Respiratory rate at all times; express The expression coefficient of the moment; represents the test authenticity function;
[0012] Constructing a test authenticity evaluation map according to the test authenticity function, comparing the test authenticity evaluation map with a preset standard evaluation map, and determining the authenticity evaluation coefficient;
[0013] According to the authenticity evaluation coefficient, the evaluation value of the test authenticity is calculated. When the evaluation value of the test authenticity is greater than or equal to the first preset threshold, it indicates that the test result is false; when the evaluation value of the test authenticity is less than the first preset threshold and greater than the second preset threshold, it indicates that the test authenticity meets the basic authenticity requirements; when the evaluation value of the test authenticity is less than or equal to the second preset threshold, it indicates that the test result is true;
[0014] Step 2: generating at least one virtual scene based on the user's preference and psychological condition assessment results, and determining an initial virtual scene based on the user's selection;
[0015] Step 3: The scene mode selected by the user is superimposed on the initial virtual scene, and the user selects and adjusts the catharsis scene and catharsis mode according to his or her own preferences and needs;
[0016] Step 4: The user vents psychologically and releases stress based on the venting mode in the venting scene, obtains the user's physiological signals in real time, identifies the user's emotional state based on the physiological signals, and adjusts the venting scene and venting mode in real time based on the identification results;
[0017] Step 5: Provide feedback data after the user experience is over, evaluate the user's psychological condition based on the feedback data, and optimize the venting scene and venting mode based on the comparison of the user's psychological condition evaluation results with historical psychological condition evaluation results.
[0018] Furthermore, the step 1 of obtaining the user's psychological condition assessment result specifically includes:
[0019] Establish an evaluation model, extract key features based on the crawled psychological status data, and establish a psychological status evaluation model based on the characteristics of the data and evaluation requirements;
[0020] Preference tendency extraction: extracting target preference features from the user's preference tendency data, quantifying the extracted target preference features to obtain preference tendency features, and integrating the preference tendency features into the psychological status assessment model;
[0021] Psychological condition assessment, based on the integrated psychological condition assessment model, inputs the user's preference tendency data, generates the user's psychological condition assessment results, and performs numerical conversion based on the psychological condition assessment results.
[0022] Furthermore, in step 2, at least one virtual scene is generated, specifically:
[0023] Analyzing the psychological condition assessment results to determine psychological condition and preference data, and dividing the psychological condition and preference data into a plurality of scene blocks according to scene categories;
[0024] Obtaining the type of each scene block, and performing numerical processing to obtain a type value of each scene block, and determining the distance value between each scene block according to the type value;
[0025] Constructing a scene tree according to the distance values between each scene block and each scene block, wherein each scene block corresponds to a scene node;
[0026] Extracting features from the scene nodes included in the scene tree from top to bottom, and determining the area where the scene nodes match the psychological condition and preference tendency data according to the feature types of the scene nodes, and determining it as a virtual scene;
[0027] The scene blocks corresponding to the plurality of scene nodes corresponding to the virtual scene are obtained, virtual scene tags are generated based on the scene category integration of the scene blocks, and a queue is established for the virtual scene tags and displayed.
[0028] Furthermore, in step 3, selecting scene mode overlay specifically includes:
[0029] Catharsis scene loading: based on the selected initial virtual scene, the user selects and adjusts the catharsis elements in the initial virtual scene, and adjusts the initial virtual scene based on the selection instruction to generate the catharsis scene;
[0030] Response to hitting the object: In the catharsis scene, the catharsis method selected by the user is displayed. Based on the catharsis method of hitting the virtual object, the hitting object performs corresponding feedback and response according to the hitting force and frequency signal of the user;
[0031] Background music loading: Load background music according to the catharsis scene and striking object selected by the user, and adjust the background music based on the music attributes according to the user's striking strength and frequency signal.
[0032] Furthermore, the step 4 of identifying the user's emotional state is specifically as follows:
[0033] Acquiring physiological signals: Acquiring the user's physiological signals in real time through the physiological signal acquisition device worn by the user;
[0034] Identify emotional state: obtain corresponding text data based on the signal category of the user's physiological signal, map the text data to emotional tags for emotion recognition based on emotion recognition technology, and determine the user's emotional state based on the recognition results;
[0035] Adjust the venting scene and venting mode: adjust the elements in the venting scene and the parameters of the venting mode in real time according to the recognized emotional state of the user, predict the user's emotional change trend, and adjust the venting scene and mode in advance;
[0036] Provide feedback and guidance: Provide feedback and guidance to users while adjusting the venting scene and venting mode.
[0037] Furthermore, the step 4 of identifying the user's emotional state further includes:
[0038] Collecting the user's physiological signals in real time; wherein the physiological signals include skin electrical response information, breathing information and sound information;
[0039] Acquire first emotional state parameter information using the skin electrical response information and the breathing information;
[0040] Acquiring second emotional state parameter information using the sound information and the breathing information;
[0041] The emotional state fluctuation parameter is obtained by using the first emotional state parameter information and the second emotional state parameter information; wherein the emotional state fluctuation parameter is obtained by the following formula:
[0042] ;
[0043] Among them, K represents the emotional state fluctuation parameter; K 01 Represents the first emotional state parameter information; K 02 Indicates second emotional state parameter information;
[0044] When the emotional state fluctuation parameter exceeds a preset parameter threshold, it indicates that the user's emotional fluctuation is abnormal, and an abnormal alarm is issued.
[0045] Further, obtaining first emotional state parameter information using the skin electrical response information and the breathing information includes:
[0046] Extracting the skin electrical response information;
[0047] Extracting the breathing information, wherein the breathing information includes breathing depth information and breathing frequency information;
[0048] The respiration evaluation compensation coefficient is obtained by combining the skin electrical response information with the respiration depth information; wherein the respiration evaluation compensation coefficient is obtained by the following formula:
[0049] ;
[0050] Where k represents the breathing evaluation compensation coefficient; k 01 and k 02 represents the first parameter value and the second parameter value; m represents the number of unit times contained in the duration of physiological signal acquisition, and the unit time is 1 minute; D i represents the skin conductivity corresponding to the i-th unit time; D i-1 represents the skin conductivity corresponding to the i-1th unit time; n represents the total number of breaths of the user; D xi represents the skin conductivity corresponding to the i-th breath; D p Indicates the user's minimum skin conductivity; T i represents the duration of a single breath during the i-th breath; T p Indicates the breathing time corresponding to the lowest conductivity;
[0051] The first emotional state parameter information is obtained by using the breathing evaluation compensation coefficient in combination with the breathing frequency information, wherein the first emotional state parameter information is obtained by the following formula:
[0052] ;
[0053] Among them, K 01 represents the first emotional state parameter information; f i represents the respiratory frequency corresponding to the i-th unit time; f c Indicates the preset respiratory rate reference value.
[0054] Further, obtaining second emotional state parameter information using the sound information and the breathing information includes:
[0055] Extracting sound information, wherein the sound information includes volume information and speech rate change rate;
[0056] The sound compensation coefficient is obtained by using the volume information in the sound information and the breathing frequency information in the breathing information; wherein the sound compensation coefficient is obtained by the following formula:
[0057] ;
[0058] Where, s represents the sound compensation coefficient; s 01 and 02 represents the third parameter value and the fourth parameter value; m represents the number of unit times contained in the duration of physiological signal acquisition, and the unit time is 1 minute; B maxi and B mini Indicates the maximum and minimum volume values corresponding to the i-th unit time; B y Indicates the preset volume difference threshold; f i represents the respiratory frequency corresponding to the i-th unit time; f c Indicates the preset reference value of respiratory rate;
[0059] The second emotional state parameter information is obtained by using the sound compensation coefficient combined with the speech rate change rate in the sound information, wherein the second emotional state parameter information is obtained by the following formula:
[0060] ;
[0061] Among them, K 02 represents the second emotional state parameter information; P i Represents the rate of change of speech speed corresponding to the i-th unit time.
[0062] Furthermore, providing feedback data after the user experience in step 5 also includes:
[0063] User basic profile management: Based on the preference test, the user registration information is obtained, including basic information such as user name, gender, age, and occupation, to determine whether the user has established a profile, and the user's scene mode and venting method preference information is determined based on the user's historical selection data;
[0064] Catharsis process information management: record the start and end time of each user's catharsis, analyze the user's catharsis intensity based on the user's physiological signals and behavioral data during the catharsis process, evaluate the catharsis effect, and provide psychological advice to the user and obtain feedback based on the user's emotional changes during the catharsis process.
[0065] The present invention provides another technical solution, a psychological catharsis interactive system based on virtual reality and artificial intelligence technology, comprising:
[0066] User preference and psychological status assessment module: obtain the user's preference tendency and psychological status assessment results, and establish user profiles;
[0067] Virtual scene generation module: generates at least one virtual scene that meets the user's needs based on the user's preferences and psychological condition assessment results;
[0068] Scene mode selection module: obtains the selection instruction issued by the user to determine the initial virtual scene, and superimposes the catharsis element in the initial virtual scene based on the user's needs;
[0069] Physiological signal monitoring module: real-time monitoring of the user's physiological signals based on wearable devices;
[0070] Emotional state recognition module: performs emotional analysis on acquired physiological signals to identify the user's emotional state;
[0071] Real-time adjustment module: adjust the venting scene and interaction method in real time according to the emotional state recognition results. At the same time, adjust the background music of the venting scene according to the user's venting signal.
[0072] Compared with the prior art, the present invention has the following beneficial effects:
[0073] A virtual scene is generated based on the user's preferences and psychological condition assessment results. The user can choose different scene modes to superimpose on the virtual scene according to his or her needs and preferences. A customized virtual environment is provided according to the user's personalized needs. The user can vent his or her psychology in the customized virtual scene. The user's emotional state is identified by monitoring the user's physiological signals, and the virtual scene and interaction method are adjusted in real time according to the user's emotional state to better meet the user's emotional needs, thereby helping the user to effectively release stress and improve their psychological state. BRIEF DESCRIPTION OF THE DRAWINGS
[0074] Figure 1 A step diagram of the psychological catharsis interaction method based on virtual reality and artificial intelligence technology of the present invention;
[0075] Figure 2 A diagram showing the steps of obtaining a user's psychological status assessment result according to the present invention;
[0076] Figure 3 A diagram showing the steps of identifying the emotional state of a user according to the present invention;
[0077] Figure 4 This is a module diagram of the psychological catharsis interaction system based on virtual reality and artificial intelligence technology of the present invention. DETAILED DESCRIPTION
[0078] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0079] In order to solve the technical problems that the existing technology can provide an immersive experience environment based on virtual reality technology, but lacks the ability to adjust according to the user's psychological condition, cannot meet the user's emotional needs well, and cannot meet the user's needs for personalization and real-time adjustment, please refer to Figure 1-3 , this embodiment provides the following technical solutions:
[0080] A psychological catharsis interaction method based on virtual reality and artificial intelligence technology, comprising the following steps:
[0081] Step 1: Conduct a preference test on the user, determine the user's preference according to the test result, conduct a psychological condition assessment based on the user's preference, and obtain the user's psychological condition assessment result;
[0082] In this embodiment, the step 1 of performing a preference test on the user further includes obtaining the test authenticity of the user during the preference test, and the test authenticity includes:
[0083] According to the difference between blinking frequency, breathing frequency and true and false micro-expressions, the test authenticity function of the target person is constructed:
[0084] ;
[0085] in, It represents the error factor, and its value range is 0.05-0.1; Indicates the moment; express Blinking frequency at any time; express Respiratory rate at all times; express The expression coefficient of the moment; represents the test authenticity function;
[0086] Constructing a test authenticity evaluation map according to the test authenticity function, comparing the test authenticity evaluation map with a preset standard evaluation map, and determining the authenticity evaluation coefficient;
[0087] According to the authenticity evaluation coefficient, the evaluation value of the test authenticity is calculated. When the evaluation value of the test authenticity is greater than or equal to the first preset threshold, it indicates that the test result is false; when the evaluation value of the test authenticity is less than the first preset threshold and greater than the second preset threshold, it indicates that the test authenticity meets the basic authenticity requirements; when the evaluation value of the test authenticity is less than or equal to the second preset threshold, it indicates that the test result is true;
[0088] Step 2: generating at least one virtual scene based on the user's preference and psychological condition assessment results, and determining an initial virtual scene based on the user's selection;
[0089] In this embodiment, at least one virtual scene is generated in step 2, specifically:
[0090] Analyzing the psychological condition assessment results to determine psychological condition and preference data, and dividing the psychological condition and preference data into a plurality of scene blocks according to scene categories;
[0091] Obtaining the type of each scene block, and performing numerical processing to obtain a type value of each scene block, and determining the distance value between each scene block according to the type value;
[0092] Constructing a scene tree according to the distance values between each scene block and each scene block, wherein each scene block corresponds to a scene node;
[0093] Extracting features from the scene nodes included in the scene tree from top to bottom, and determining the area where the scene nodes match the psychological condition and preference tendency data according to the feature types of the scene nodes, and determining it as a virtual scene;
[0094] Obtaining scene blocks corresponding to a plurality of scene nodes corresponding to the virtual scene, integrating and generating virtual scene tags based on scene categories of the scene blocks, establishing a queue for the virtual scene tags and displaying them;
[0095] In this embodiment, through numerical processing and construction of scene tree, scene blocks can be efficiently organized and managed, so as to quickly generate virtual scenes that match user needs, and ensure that the generated virtual scenes are closely related to the user's psychological conditions and preferences. Users can intuitively select virtual scenes of their interest, which improves the user's convenience and experience, and provides users with an intuitive and easy-to-understand virtual scene selection method.
[0096] Step 3: The scene mode selected by the user is superimposed on the initial virtual scene, and the user selects and adjusts the catharsis scene and catharsis mode according to his or her own preferences and needs;
[0097] Step 4: The user performs psychological catharsis and releases stress based on the catharsis mode in the catharsis scene, obtains the user's physiological signals in real time, and identifies the user's emotional state based on the physiological signals, and adjusts the catharsis scene and catharsis mode in real time based on the identification results to meet the user's emotional needs;
[0098] Step 5: Provide feedback data after the user experience is over, evaluate the user's psychological condition based on the feedback data, and optimize the venting scene and venting mode based on the comparison of the user's psychological condition evaluation results with the historical psychological condition evaluation results;
[0099] In this embodiment, providing feedback data after the user experience in step 5 also includes:
[0100] User basic profile management: Based on the preference test, the user registration information is obtained, including basic information such as user name, gender, age, and occupation, to determine whether the user has established a profile, and based on the user's historical selection data, the user's scene mode and venting method preference information is determined, so as to provide the user with more personalized services in subsequent use;
[0101] Information management of the venting process: record the start and end time of each venting of the user in order to understand the frequency and duration of the user's venting, analyze the user's venting intensity based on the user's physiological signals and behavioral data during the venting process, evaluate the venting effect, and based on the user's emotional changes during the venting process, such as identifying the user's emotional state through physiological signals, so as to timely adjust the venting scene and mode, or provide users with targeted psychological advice, provide users with psychological advice and obtain feedback, such as satisfaction, suggestions, etc., in order to continuously optimize the system and services.
[0102] In this embodiment, a virtual scene is generated based on the user's preferences and psychological condition assessment results. The user can choose different scene modes to superimpose on the virtual scene according to his or her needs and preferences. A customized virtual environment is provided according to the user's personalized needs. The user can vent his or her psychology in the customized virtual scene. The user's emotional state is identified by monitoring the user's physiological signals, and the virtual scene and interaction method are adjusted in real time according to the user's emotional state to better meet the user's emotional needs, thereby helping the user to effectively release stress and improve their psychological state.
[0103] In this embodiment, the step 1 of obtaining the user's psychological status assessment result specifically includes:
[0104] Establish an evaluation model and extract key features based on the crawled psychological data. The psychological data includes the symptoms, diagnostic criteria and treatment methods of various mental illnesses. Key features include emotional state, social behavior, living habits, etc. Establish a psychological evaluation model based on the characteristics of the data and evaluation requirements, such as decision trees, neural networks, etc.;
[0105] Preference extraction: extract target preference features from the user's preference data, such as favorite color, favorite music type, social habits, etc., and quantify the extracted target preference features to obtain preference tendency features. For example, color preference is converted into RGB value, music type preference is converted into the preference degree of a specific music style, etc. The preference tendency features are integrated into the psychological status assessment model, so that the model can perform more accurate psychological status assessment based on the user's preference tendency.
[0106] Psychological status assessment: Based on the integrated psychological status assessment model, the user's preference data is input to generate the user's psychological status assessment results, and the psychological status assessment results are converted into numerical values to provide users with easy-to-understand explanations of the assessment results to help them understand their own psychological status;
[0107] In this embodiment, for users with mild depression, suggestions on how to adjust their mentality and seek support can be provided. Based on the evaluation results, targeted mental health suggestions and resource recommendations are provided to users, such as psychological counseling, meditation exercises, relaxation techniques, etc. Users are encouraged to repeat the test regularly to monitor changes in their mental condition and provide corresponding support.
[0108] In this embodiment, the step 3 of selecting scene mode overlay specifically includes:
[0109] Catharsis scene loading: Based on the selected initial virtual scene, the user selects and adjusts the catharsis elements in the initial virtual scene, including different environments, colors, lights and other factors, such as changing the background image, adjusting the light brightness, etc., and adjusts the initial virtual scene based on the selected instructions to generate a catharsis scene, so as to create a catharsis space that meets their mood and needs, and create an atmosphere suitable for the user's emotional catharsis;
[0110] Response to hitting an object: In the catharsis scene, the catharsis method selected by the user is displayed. Based on the catharsis method of hitting the virtual object, according to the user's hitting force and frequency signal, the hitting object performs corresponding feedback and response, including hitting sound, hitting force feedback, and object deformation after hitting, which increases the user's immersion and satisfaction;
[0111] Background music loading: Load background music according to the catharsis scene and striking object selected by the user, and adjust the background music based on the music attributes according to the user's striking strength and frequency signal. The music attributes include track, volume, rhythm and other attributes, to create a music atmosphere that suits your mood and needs, enhance the user's emotional experience and immersion, and help users better release their emotions.
[0112] In this embodiment, the step 4 of identifying the user's emotional state is specifically as follows:
[0113] Acquiring physiological signals: Acquiring the user's physiological signals in real time through physiological signal acquisition devices worn by the user, such as heart rate monitors, skin conductance response sensors, breathing monitors, etc.
[0114] In this embodiment, physiological signals can reflect key information such as the user's emotional state, tension level, and relaxation level. For example, an electrocardiogram can reflect the user's heart electrical activity, an electroencephalogram can reflect the user's brain electrical activity, and an electromyogram can reflect the user's muscle electrical activity. Respiration, heart rate, blood pressure, etc. are biophysical signals.
[0115] Identify emotional state: Obtain corresponding text data based on the signal category of the user's physiological signal, map the text data to emotional tags based on emotion recognition technology for emotion recognition, and determine the user's emotional state based on the recognition results. The text data includes calm, nervous, angry, sad, etc. The emotional state includes the intensity of emotion and the trend of emotion change.
[0116] Adjusting the venting scene and venting mode: According to the recognized emotional state of the user, the elements in the venting scene and the parameters of the venting mode are adjusted in real time, such as the feedback strength of the hitting object, the rhythm and volume of the background music, etc. According to the trend of the user's emotional changes, the venting scene and mode are adjusted in advance to prevent the user's emotions from further deteriorating or to trigger the user's relaxation response in advance;
[0117] For example, if the user is showing nervous and angry emotions, adjust the scene to a more calm and relaxing tone, while lowering the volume and tempo of the background music to help the user relieve tension;
[0118] Provide feedback and guidance: While adjusting the venting scene and venting mode, provide feedback and guidance to users. Guidance methods include voice prompts, text prompts or graphical interfaces, etc., which help users better understand and deal with their emotional state while enhancing users' sense of participation and self-control in the venting process.
[0119] In this embodiment, during the process of psychological catharsis and stress release, the user's physiological signals can be acquired in real time, their emotional state can be identified, and the catharsis scene and mode can be adjusted in real time according to the identification results, which helps to provide a more personalized and effective psychological catharsis experience and help users better manage their emotions and stress. At the same time, by providing feedback and guidance, the user's self-cognition and self-control ability can be enhanced, and the user's mental health development can be promoted.
[0120] Specifically, the step 4 of identifying the user's emotional state further includes:
[0121] Collecting the user's physiological signals in real time; wherein the physiological signals include skin electrical response information, breathing information and sound information;
[0122] Acquire first emotional state parameter information using the skin electrical response information and the breathing information;
[0123] Acquiring second emotional state parameter information using the sound information and the breathing information;
[0124] The emotional state fluctuation parameter is obtained by using the first emotional state parameter information and the second emotional state parameter information; wherein the emotional state fluctuation parameter is obtained by the following formula:
[0125] ;
[0126] Among them, K represents the emotional state fluctuation parameter; K 01 Represents the first emotional state parameter information; K 02 Indicates second emotional state parameter information;
[0127] When the emotional state fluctuation parameter exceeds a preset parameter threshold, it indicates that the user's emotional fluctuation is abnormal, and an abnormal alarm is issued.
[0128] The technical effect of the above technical solution is: by collecting skin electrical response information, breathing information and sound information in real time, the technical solution can realize emotional state assessment based on multi-source physiological signals. Different physiological signals reflect different aspects of emotional state. By fusing these signals, more comprehensive and accurate emotional state information can be obtained.
[0129] Extraction of emotional state parameters: Using specific algorithms and formulas, the first emotional state parameter information (K01) is extracted from the skin electrical response information and breathing information, and the second emotional state parameter information (K02) is extracted from the sound information and breathing information. This parameterized processing method facilitates subsequent analysis and comparison. By combining the first emotional state parameter information and the second emotional state parameter information, the emotional state fluctuation parameter (K) is calculated. This parameter reflects the changes in the user's emotional state in a quantitative way, making the evaluation of emotional fluctuations more objective and comparable.
[0130] When the emotional state fluctuation parameter exceeds the preset parameter threshold, the system can immediately issue an abnormal alarm. This timely feedback helps to promptly detect and deal with the user's emotional fluctuation problems and avoid further deterioration of emotional problems. This technical solution can be applied to various scenarios that require emotional monitoring and management, such as medical health, psychological counseling, human-computer interaction, etc. By real-time monitoring and evaluation of the user's emotional state, personalized emotional management advice and support can be provided to the user. Through automated and intelligent emotional monitoring and evaluation, this technical solution can significantly improve the efficiency of emotional management. Compared with traditional manual evaluation methods, it can identify the user's emotional fluctuations more quickly and accurately, providing strong support for subsequent intervention and processing.
[0131] In summary, this technical solution realizes comprehensive, accurate and timely monitoring and evaluation of the user's emotional state by real-time collection of multi-source physiological signals, extraction of emotional state parameter information, calculation of emotional state fluctuation parameters and abnormal alarm. It has broad application prospects and important practical value.
[0132] Specifically, obtaining the first emotional state parameter information using the skin electrical response information and the breathing information includes:
[0133] Extracting the skin electrical response information;
[0134] Extracting the breathing information, wherein the breathing information includes breathing depth information and breathing frequency information;
[0135] The respiration evaluation compensation coefficient is obtained by combining the skin electrical response information with the respiration depth information; wherein the respiration evaluation compensation coefficient is obtained by the following formula:
[0136] ;
[0137] Where k represents the breathing evaluation compensation coefficient; k 01 and k 02 represents the first parameter value and the second parameter value; m represents the number of unit times contained in the duration of physiological signal acquisition, and the unit time is 1 minute; D irepresents the skin conductivity corresponding to the i-th unit time; D i-1 represents the skin conductivity corresponding to the i-1th unit time; n represents the total number of breaths of the user; D xi represents the skin conductivity corresponding to the i-th breath; D p Indicates the user's minimum skin conductivity; T i represents the duration of a single breath during the i-th breath; T p Indicates the breathing time corresponding to the lowest conductivity;
[0138] The first emotional state parameter information is obtained by using the breathing evaluation compensation coefficient in combination with the breathing frequency information, wherein the first emotional state parameter information is obtained by the following formula:
[0139] ;
[0140] Among them, K 01 represents the first emotional state parameter information; f i represents the respiratory frequency corresponding to the i-th unit time; f c Indicates the preset respiratory rate reference value.
[0141] The technical effect of the above technical solution is: the technical solution combines skin electrical response information and breathing information to evaluate emotional state, taking into account two different types of physiological signals. Skin electrical response (also known as skin conductivity or skin electrical activity) and breathing information (including breathing depth and breathing frequency) are common physiological reactions of the human body when emotions change. Their combined use can provide a more comprehensive and accurate assessment of emotional state. By calculating the breathing evaluation compensation coefficient (k), the technical solution takes into account the relationship between changes in skin conductivity and breathing depth. This compensation coefficient can adjust the weight of breathing information in emotional assessment, especially when there is a significant change in skin conductivity, it can more accurately reflect changes in emotional state.
[0142] The first emotional state parameter information (K01) is a quantitative value, which is calculated based on the breathing evaluation compensation coefficient and the breathing rate information. This makes the evaluation results comparable and analyzable, which is convenient for subsequent emotional analysis, processing and feedback. The technical solution allows real-time monitoring of emotional state within the duration of physiological signal acquisition (in minutes). By calculating the skin conductivity, breathing depth and breathing rate per unit time (for example, per minute), and performing emotional evaluation based on these data, continuous tracking and evaluation of emotional state can be achieved. By introducing user-specific parameters (such as the minimum skin conductivity Dp, the breathing time Tp corresponding to the minimum conductivity, etc.), the technical solution can realize personalized emotional state evaluation for different users. This helps to improve the accuracy and applicability of the evaluation. Since the technical solution can monitor and evaluate the user's emotional state in real time, and the evaluation results are quantitative, it can be widely used in various fields that require emotion recognition and analysis, such as human-computer interaction, medical health, psychological counseling, etc.
[0143] In summary, this technical solution improves the accuracy and real-time performance of emotional state assessment by combining skin electrical response information and respiratory information and introducing a respiratory evaluation compensation coefficient and a quantitative assessment method, and has broad application prospects.
[0144] Specifically, obtaining the second emotional state parameter information by using the sound information and the breathing information includes:
[0145] Extracting sound information, wherein the sound information includes volume information and speech rate change rate;
[0146] The sound compensation coefficient is obtained by using the volume information in the sound information and the breathing frequency information in the breathing information; wherein the sound compensation coefficient is obtained by the following formula:
[0147] ;
[0148] Where, s represents the sound compensation coefficient; s 01 and 02 represents the third parameter value and the fourth parameter value; m represents the number of unit times contained in the duration of physiological signal acquisition, and the unit time is 1 minute; B maxi and B mini Indicates the maximum and minimum volume values corresponding to the i-th unit time; B y Indicates the preset volume difference threshold; f i represents the respiratory frequency corresponding to the i-th unit time; f c Indicates the preset reference value of respiratory rate;
[0149] The second emotional state parameter information is obtained by using the sound compensation coefficient combined with the speech rate change rate in the sound information, wherein the second emotional state parameter information is obtained by the following formula:
[0150] ;
[0151] Among them, K 02 represents the second emotional state parameter information; P i Represents the rate of change of speech speed corresponding to the i-th unit time.
[0152] The technical effect of the above technical solution is: by comprehensively considering sound information (including volume and speech rate change rate) and breathing information (especially breathing frequency), the technical solution can more accurately capture the user's emotional state. Sound and breathing are both important physiological indicators of emotional expression, and their combined use can provide more comprehensive emotional assessment data. The technical solution allows real-time monitoring of emotional state within the duration of physiological signal acquisition (in minutes). By calculating the maximum volume, minimum volume, breathing frequency, etc. per unit time (for example, per minute), and performing emotional assessment based on these data, continuous tracking and evaluation of emotional state can be achieved.
[0153] The introduction of the sound compensation coefficient (s) takes into account the impact of volume and breathing rate on emotion assessment. By setting the third parameter value (s01), the fourth parameter value (s02), the preset volume difference threshold (By) and the preset breathing rate reference value (fc), the coefficient can be dynamically adjusted according to the actual collected volume and breathing rate data, so as to more accurately reflect the user's emotional state. The final second emotional state parameter information (K02) is a quantitative value, which is calculated based on the rate of change of speech rate per unit time and the sound compensation coefficient. This makes the evaluation results more comparable and analyzable, which facilitates subsequent emotion analysis, processing and feedback. Since the technical solution can monitor and evaluate the user's emotional state in real time, and the evaluation results are quantitative, it can be widely used in various fields that require emotion recognition and analysis, such as human-computer interaction, medical health, psychological counseling, etc.
[0154] In summary, this technical solution improves the accuracy and real-time performance of emotional state assessment by combining sound information and breathing information and introducing sound compensation coefficients and quantitative evaluation methods, and has broad application prospects.
[0155] In order to better demonstrate the realization of the psychological catharsis interaction method based on virtual reality and artificial intelligence technology, please refer to Figure 4 The present invention provides a psychological catharsis interactive system based on virtual reality and artificial intelligence technology, comprising:
[0156] User preference and psychological status assessment module: obtain the user's preference tendency and psychological status assessment results, and establish user profiles to provide basic data for the subsequent generation of virtual scenes and interaction methods;
[0157] Virtual scene generation module: Generates at least one virtual scene that meets the user's needs, such as natural environment, city scenery, animation world, etc., based on the user's preferences and psychological condition assessment results;
[0158] Scene mode selection module: obtains the selection instruction issued by the user to determine the initial virtual scene, and superimposes the catharsis elements in the initial virtual scene based on the user's needs to enrich the experience of psychological catharsis;
[0159] Physiological signal monitoring module: Based on wearable devices such as heart rate monitors and brain wave monitors, it monitors the user's physiological signals in real time, such as heart rate, blood pressure, brain waves, etc.;
[0160] Emotional state recognition module: performs emotional analysis on acquired physiological signals to identify the user's emotional state, such as tension, anxiety, relaxation, etc.
[0161] Real-time adjustment module: adjusts the venting scene and interaction method in real time according to the emotional state recognition results. At the same time, adjusts the background music of the venting scene according to the user's venting signal to meet the user's emotional needs; for example, when the user is in a nervous state, add natural elements in the virtual scene, such as the sound of waves, birdsong, etc., to reduce the user's tension.
[0162] In this embodiment, the virtual scene generation module achieves accurate satisfaction of the user's personalized needs and improves the user's experience and satisfaction. Through emotional state recognition, the emotional state recognition module can more accurately understand the user's current emotions and provide decision-making basis for the subsequent real-time adjustment module. The real-time adjustment module enables the user to receive appropriate support and help in different emotional states, which helps to improve the user's mental health level.
[0163] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.
Claims
1. A psychological catharsis interaction method based on virtual reality and artificial intelligence technology, characterized by: The following steps are involved: Step 1: Conduct a preference test on the user, determine the user's preference according to the test result, conduct a psychological condition assessment based on the user's preference, and obtain the user's psychological condition assessment result; The step 1 further includes performing a preference test on the user, and obtaining the test authenticity of the user during the preference test. The test authenticity includes: According to the difference between blinking frequency, breathing frequency and true and false micro-expressions, the test authenticity function of the target person is constructed: Where ρ represents the error factor, and its value range is 0.05-0.1; t represents the time; z t represents the blinking frequency at time t; h t represents the respiratory rate at time t; b t represents the expression coefficient at time t; S(t) represents the test authenticity function; Constructing a test authenticity evaluation map according to the test authenticity function, comparing the test authenticity evaluation map with a preset standard evaluation map, and determining the authenticity evaluation coefficient; According to the authenticity evaluation coefficient, the evaluation value of the test authenticity is calculated. When the evaluation value of the test authenticity is greater than or equal to the first preset threshold, it indicates that the test result is false; when the evaluation value of the test authenticity is less than the first preset threshold and greater than the second preset threshold, it indicates that the test authenticity meets the basic authenticity requirements; when the evaluation value of the test authenticity is less than or equal to the second preset threshold, it indicates that the test result is true; Step 2: generating at least one virtual scene based on the user's preference and psychological condition assessment results, and determining an initial virtual scene based on the user's selection; Step 3: The scene mode selected by the user is superimposed on the initial virtual scene, and the user selects and adjusts the catharsis scene and catharsis mode according to his or her own preferences and needs; Step 4: The user vents psychologically and releases stress based on the venting mode in the venting scene, obtains the user's physiological signals in real time, identifies the user's emotional state based on the physiological signals, and adjusts the venting scene and venting mode in real time based on the identification results; The step 4 of identifying the user's emotional state also includes: Collecting the user's physiological signals in real time; wherein the physiological signals include skin electrical response information, breathing information and sound information; Acquire first emotional state parameter information using the skin electrical response information and the breathing information; Acquiring second emotional state parameter information using the sound information and the breathing information; The emotional state fluctuation parameter is obtained by using the first emotional state parameter information and the second emotional state parameter information; wherein the emotional state fluctuation parameter is obtained by the following formula: Among them, K represents the emotional state fluctuation parameter; K 01 Represents the first emotional state parameter information; K 02 Indicates second emotional state parameter information; When the emotional state fluctuation parameter exceeds the preset parameter threshold, it indicates that the user's emotional fluctuation is abnormal, and an abnormal alarm is issued; Acquiring first emotional state parameter information using the skin electrical response information and the breathing information includes: Extracting the skin electrical response information; Extracting the breathing information, wherein the breathing information includes breathing depth information and breathing frequency information; The respiration evaluation compensation coefficient is obtained by combining the skin electrical response information with the respiration depth information; wherein the respiration evaluation compensation coefficient is obtained by the following formula: k=1-lnk 01 +link 02 Where k represents the breathing evaluation compensation coefficient; k 01 and k 02 represents the first parameter value and the second parameter value; m represents the number of unit times contained in the duration of physiological signal acquisition, and the unit time is 1 minute; D i represents the skin conductivity corresponding to the i-th unit time; D i-1 represents the skin conductivity corresponding to the i-1th unit time; n represents the total number of breaths of the user; D xi represents the skin conductivity corresponding to the i-th breath; D p Indicates the user's minimum skin conductivity; T i represents the duration of a single breath during the i-th breath; T p Indicates the breathing time corresponding to the lowest conductivity; The first emotional state parameter information is obtained by using the breathing evaluation compensation coefficient in combination with the breathing frequency information, wherein the first emotional state parameter information is obtained by the following formula: Among them, K 01 represents the first emotional state parameter information; f i represents the respiratory frequency corresponding to the i-th unit time; f c Indicates the preset reference value of respiratory rate; Step 5: Provide feedback data after the user experience is over, evaluate the user's psychological condition based on the feedback data, and optimize the venting scene and venting mode based on the comparison of the user's psychological condition evaluation results with historical psychological condition evaluation results.
2. A psychological catharsis interaction method based on virtual reality and artificial intelligence technology as claimed in claim 1, characterized in that: The step 1 of obtaining the user's psychological status assessment result specifically includes: Establish an evaluation model, extract key features based on the crawled psychological status data, and establish a psychological status evaluation model based on the characteristics of the data and evaluation requirements; Preference tendency extraction: extracting target preference features from user preference tendency data, quantifying the extracted target preference features to obtain preference tendency features, and integrating the preference tendency features into the psychological status assessment model; Psychological condition assessment, based on the integrated psychological condition assessment model, inputs the user's preference tendency data, generates the user's psychological condition assessment results, and performs numerical conversion based on the psychological condition assessment results.
3. A psychological catharsis interaction method based on virtual reality and artificial intelligence technology as claimed in claim 2, characterized in that: In the step 2, at least one virtual scene is generated, specifically: Analyzing the psychological condition assessment results to determine psychological condition and preference data, and dividing the psychological condition and preference data into a plurality of scene blocks according to scene categories; Obtaining the type of each scene block, and performing numerical processing to obtain a type value of each scene block, and determining the distance value between each scene block according to the type value; Constructing a scene tree according to the distance values between each scene block and each scene block, wherein each scene block corresponds to a scene node; Extracting features from the scene nodes included in the scene tree from top to bottom, and determining the area where the scene nodes match the psychological condition and preference tendency data according to the feature types of the scene nodes, and determining it as a virtual scene; The scene blocks corresponding to the plurality of scene nodes corresponding to the virtual scene are obtained, virtual scene tags are generated based on the scene category integration of the scene blocks, and a queue is established for the virtual scene tags and displayed.
4. A psychological catharsis interaction method based on virtual reality and artificial intelligence technology as claimed in claim 3, characterized in that: The step 3 of selecting scene mode overlay specifically includes: Based on the selected initial virtual scene, the user selects and adjusts the catharsis elements in the initial virtual scene, and adjusts the initial virtual scene based on the selection instruction to generate a catharsis scene; In the catharsis scene, the catharsis mode selected by the user is displayed, and based on the catharsis mode of hitting the virtual object, the hitting virtual object performs corresponding feedback and response according to the hitting strength and frequency signal of the user; Background music is loaded according to the catharsis scene and striking object selected by the user, and the background music is adjusted based on the music attributes according to the striking strength and frequency signal of the user.
5. A psychological catharsis interaction method based on virtual reality and artificial intelligence technology as claimed in claim 4, characterized in that: The step 4 of identifying the user's emotional state is specifically as follows: Acquire the user's physiological signals in real time through the physiological signal acquisition device worn by the user; Acquire corresponding text data based on the signal category of the acquired user's physiological signal, map the text data to an emotion tag for emotion recognition based on emotion recognition technology, and determine the user's emotional state based on the recognition result; Adjust the elements in the venting scene and the parameters of the venting mode in real time according to the recognized user's emotional state, and make predictions based on the user's emotional change trends to adjust the venting scene and mode in advance; Provide feedback and guidance to users while adjusting the venting scenes and venting modes.
6. A psychological catharsis interaction method based on virtual reality and artificial intelligence technology as claimed in claim 5, characterized in that: Acquiring second emotional state parameter information using the sound information and the breathing information includes: Extracting sound information, wherein the sound information includes volume information and speech rate change rate; The sound compensation coefficient is obtained by using the volume information in the sound information and the breathing frequency information in the breathing information; wherein the sound compensation coefficient is obtained by the following formula: s=1-ln s 01 -ln s 02 Where, s represents the sound compensation coefficient; s 01 and 02 represents the third parameter value and the fourth parameter value; m represents the number of unit times contained in the duration of physiological signal acquisition, and the unit time is 1 minute; B maxi and B mini Indicates the maximum and minimum volume values corresponding to the i-th unit time; B y Indicates the preset volume difference threshold; f i represents the respiratory frequency corresponding to the i-th unit time; f c Indicates the preset reference value of respiratory rate; The second emotional state parameter information is obtained by using the sound compensation coefficient combined with the speech rate change rate in the sound information, wherein the second emotional state parameter information is obtained by the following formula: Among them, K 02 represents the second emotional state parameter information; P i Represents the rate of change of speech speed corresponding to the i-th unit time.
7. A psychological catharsis interaction method based on virtual reality and artificial intelligence technology as claimed in claim 6, characterized in that: Providing feedback data after the user experience is completed in step 5 also includes: User basic profile management: obtaining user registration information based on preference testing, including basic information such as user name, gender, age, and occupation, determining whether to create a profile for the user, and determining the user's preference information for scene mode and venting method based on the user's historical selection data; Catharsis process information management, recording the start and end time of each user's catharsis, analyzing the user's catharsis intensity based on the user's physiological signals and behavioral data during the catharsis process, evaluating the catharsis effect, and providing psychological advice to the user and obtaining feedback based on the user's emotional changes during the catharsis process.
8. A psychological catharsis interaction system based on virtual reality and artificial intelligence technology, applied in the psychological catharsis interaction method based on virtual reality and artificial intelligence technology as claimed in claim 7, characterized in that: include: User preference and psychological status assessment module Obtain user preferences and psychological status assessment results, and establish user profiles; Virtual scene generation module Generate at least one virtual scene that meets the user's needs based on the user's preferences and psychological condition assessment results; Scene mode selection module Obtaining a selection instruction issued by a user to determine an initial virtual scene, and superimposing a catharsis element in the initial virtual scene based on the needs of the user; Physiological signal monitoring module Real-time monitoring of users’ physiological signals based on wearable devices; Emotional state recognition module Perform emotional analysis on the acquired physiological signals to identify the user's emotional state; Real-time adjustment module The venting scene and interaction method are adjusted in real time according to the emotional state recognition results. At the same time, the background music of the venting scene is adjusted according to the user's venting signal.
Citation Information
Patent Citations
Psychological testing treatment system based on virtual reality
CN109949896A
Self-adaptive virtual reality intervention system based on user background and emotion, and method
CN113053492A
Biphase obstacle virtual reality training system
CN117292788A
Psychological disorder evaluation method and system for psychiatric patient
CN117438048A
Classroom live-action reproduction interactive teaching system and method based on virtual reality
CN118038722A
Cited By
Psychotherapy system and method fused with virtual reality scene
CN122091104A
