Multi-dimensional immersive space virtual-reality interaction method

Through a multi-directional immersive spatial virtual and real interaction method, sensor arrays and physiological sensors are used to monitor the user's physiological status and dynamically adjust the virtual environment, solving the problem of neglecting physiological status monitoring in traditional virtual reality, and achieving the safety and comfort of the user experience.

CN118689316BActive Publication Date: 2024-11-19XIXIAN TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411174965.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-26
Publication Date
2024-11-19
Estimated Expiration
2044-08-26

AI Technical Summary

Technical Problem

Traditional virtual reality interaction methods ignore the monitoring and evaluation of users' physiological status during the experience process, resulting in discomfort in the long-term immersive experience. The existing technology only considers changes in a single physiological indicator, and the evaluation accuracy and comprehensiveness are evaluated. Poor.

Method used

Using a multi-directional immersive spatial virtual and real interaction method, the user's action and position information is captured in real time by presetting multiple sensor arrays, combining three-dimensional modeling and real-time rendering technology to dynamically adjust the virtual environment, and using physiological sensors to monitor heart rate, skin conductance, body temperature and breathing state, build a comprehensive, real-time and personalized physiological state evaluation index, and adjust virtual scenes in a timely manner to ensure the security of the user experience.

Benefits of technology

It realizes comprehensive, real-time and personalized monitoring and evaluation of the user's physiological status, avoiding the user's discomfort in a long-term immersive experience, and ensuring the experience and safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118689316B_ABST
    Figure CN118689316B_ABST
Patent Text Reader

Abstract

The present invention discloses a multi-directional immersive space virtual-reality interaction method. The present invention sets a time period for monitoring the user's physiological indicators during the user experience process. When the set monitoring time period is reached, the integrated physiological sensor collects the user's heart rate, skin conductance, body temperature and respiratory state physiological indicators within the set monitoring time period, and thereby obtains the user's state evaluation index within the set monitoring time period. By comprehensively evaluating the heart rate, skin conductance, body temperature and respiratory state, a more comprehensive user state evaluation is provided. Based on the state evaluation index obtained during the user experience process, the user's state level during the experience process is determined, thereby solving the problem that the prior art ignores the monitoring and evaluation of the user's physiological state during the experience process, which causes the user to feel uncomfortable during a long period of immersive experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a multi-directional immersive space virtual-reality interaction method. Background Art

[0002] With the rapid development of science and technology, virtual reality technology has become a frontier field of multidisciplinary integration and is widely used in entertainment, education, medical and other industries. Virtual reality technology creates an immersive three-dimensional environment, allowing users to experience the feeling of being in the scene, which not only greatly enriches the user's sensory experience, but also brings technical changes to traditional interaction methods.

[0003] Although virtual reality technology has shown great potential in many fields, it still faces some problems in practical application:

[0004] Traditional VR interaction methods mainly focus on visual and auditory simulation, often ignoring the monitoring and evaluation of the user's physiological state during the experience, which causes users to feel uncomfortable during long-term immersive experience, and even induces adverse reactions such as motion sickness;

[0005] At the same time, when monitoring and evaluating physiological status, people often only consider the changes in a single indicator, without integrating multiple physiological indicators for comprehensive evaluation, resulting in poor evaluation accuracy and comprehensiveness.

[0006] To this end, a multi-dimensional immersive space virtual-reality interaction method is introduced. Summary of the invention

[0007] In view of this, the present invention provides a multi-directional immersive space virtual-reality interaction method to solve the problems raised by the above background technology.

[0008] The purpose of the present invention can be achieved by the following technical solution: a multi-directional immersive space virtual-reality interaction method, comprising:

[0009] Real-time capture: Use multiple sets of pre-deployed sensor arrays to capture the user's movements and position information in real space in real time;

[0010] Arrange multiple high-precision sensors in a specific interactive space, including but not limited to cameras, motion capture devices, pressure sensors, etc.;

[0011] Building the environment: Integrate 3D modeling technology to build a virtual environment that corresponds to the real space, and use real-time rendering technology to dynamically adjust the elements in the virtual environment based on the user's actions and position information;

[0012] Based on the processed data, the system dynamically adjusts elements in the virtual environment, such as the position and behavior of virtual characters and objects;

[0013] The user sees the virtual scene synchronized with the real action through the head-mounted display, hears the corresponding sound effects through the audio system, and feels the corresponding tactile feedback through the tactile feedback device;

[0014] Process monitoring: During the user experience, the user's physiological indicators are monitored through integrated physiological sensors; the physiological indicators include heart rate indicators, skin conductance indicators, body temperature indicators and respiratory status indicators; the user's monitored heart rate indicators, skin conductance indicators, body temperature indicators and respiratory status indicators are analyzed respectively to obtain the heart rate evaluation index ma, skin conductance evaluation index mb, body temperature evaluation index mc and respiratory evaluation index md; the analysis results of the physiological indicators monitored by the user are comprehensively processed to obtain the user's state evaluation index Ysf; the physiological sensors include heart rate sensors, skin conductance sensors, body temperature sensors and respiratory monitoring belts;

[0015] Specifically:

[0016] Mark the time point when the user starts the experience as the starting point, start timing from the starting point, set a time period for monitoring the user's physiological indicators, and extract the user's physiological indicators in the current monitoring time period when the set monitoring time period is reached;

[0017] Using a heart rate sensor to collect the heart rate values ​​of the user at each time point within a set monitoring period, thereby constructing a line graph of the user's heart rate changes within the set monitoring period; plotting the value points in the line graph corresponding to the user's heart rate values ​​at each time point, and connecting adjacent value points to obtain a heart rate line;

[0018] Determine the baseline heart rate of the current user, where the baseline heart rate is measured when the user is in a quiet and relaxed state, and this is used as the baseline heart rate;

[0019] Draw a threshold line corresponding to the user's baseline heart rate in the line graph, mark the numerical points above the threshold line as over-threshold points, and use each group of over-threshold points as the starting point to construct vertical line segments between each group of over-threshold points and the threshold line, calculate the length of each group of vertical line segments and add them up as the user's heart rate over-value;

[0020] At the same time, the slope of each heart rate line and the angle with the horizontal line are calculated. If the angle between a heart rate line and the horizontal line is an acute angle, the slope of the heart rate line is marked as a descending slope. If the angle between a heart rate line and the horizontal line is an obtuse angle, the slope of the heart rate line is marked as an ascending slope. Each group of ascending slopes and descending slopes are accumulated to obtain the ascending heart value and the descending heart value, and the ratio between the ascending heart value and the descending heart value is calculated to obtain the heart rate ratio; that is, the ascending heart value / descending heart value;

[0021] Obtain the user's age and gender, extract the age value ranges corresponding to the user's gender from the database, set each age value range to correspond to a heart rate data packet of the user, wherein the heart rate data packet includes the maximum allowable values ​​of the heart rate overvalue and the heart rate ratio; match the user's age with each age value range, thereby obtaining the user's heart rate data packet;

[0022] The user's heart rate excess and heart rate ratio are marked as ga and gb respectively; the maximum allowable values ​​corresponding to the heart rate excess and heart rate ratio are marked as and ;

[0023] According to the formula The above parameters are weighted to obtain the user's heart rate assessment index ma, where e1 and e2 are the influence weight factors of the user's heart rate excess value ga and heart rate ratio gb respectively;

[0024] In summary, by comprehensively analyzing the user's heart rate data, a comprehensive, real-time and personalized physiological state monitoring and evaluation method is provided;

[0025] Determine the baseline skin conductance of the current user, where the baseline skin conductance is measured when the user is in a quiet and relaxed state, and the baseline skin conductance is used as the baseline skin conductance;

[0026] The skin conductance sensor is used to collect the user's skin conductance data within the set monitoring time period, the collected skin conductance data is filtered, and according to the baseline skin conductance, the time period during which the user's skin conductance data is higher than the baseline skin conductance within the set monitoring time period is identified, and the identified time period is accumulated to obtain the duration of the user's skin conductance exceeding the limit;

[0027] Based on the skin conductance data of the user within the set monitoring time period, the highest value of the skin conductance data is extracted to obtain the conductance peak value exceeded by the user's skin conductance; the ratio between the user's conductance peak value and the baseline skin conductance is calculated as the user's conductance ratio;

[0028] Preset weight coefficients of the user's duration and conductance ratio respectively, multiply the user's duration and conductance ratio by the corresponding preset weight coefficients respectively, and then sum them to obtain the user's skin conductance assessment index mb;

[0029] By weighted calculation of duration and conductance ratio, the skin conductance assessment index mb was constructed, which comprehensively reflects the user's emotional arousal or stress state;

[0030] Obtain the temperature value of the user's current experience environment at each time point within the set monitoring time period, and calculate the average value, thereby obtaining the temperature evaluation value of the user's current experience environment within the set monitoring time period;

[0031] According to the temperature evaluation value of the user's current experience environment within the set monitoring time period, the user's reference body temperature value is obtained; each group of evaluation value ranges corresponding to the preset temperature evaluation value is set, and each group of evaluation value ranges is set to correspond to a user's reference body temperature value; the temperature evaluation value of the user's current experience environment within the set monitoring time period is matched with each preset group of evaluation value ranges, thereby obtaining the user's reference body temperature value;

[0032] The temperature sensor is used to collect the temperature data of the user at each time point within the set monitoring time period, and the temperature data of the user at each time point is calculated using the standard deviation formula to obtain the temperature fluctuation value of the user; at the same time, the highest temperature data is extracted from the temperature data of the user at each time point as the user's temperature peak value;

[0033] Calculate the ratio between the user's body temperature peak value and the reference body temperature value to obtain the body temperature ratio;

[0034] Preset the weight coefficients of the body temperature ratio and the body temperature fluctuation value respectively, multiply the body temperature ratio and the body temperature fluctuation value of the user in the set monitoring time period by the corresponding weight coefficients respectively, and then sum them up to obtain the user's body temperature assessment index mc;

[0035] When the ambient temperature rises, the human body may dissipate heat by dilating blood vessels and increasing sweat secretion, resulting in an increase in body surface temperature. Conversely, when the ambient temperature drops, the human body will reduce heat loss by constricting blood vessels and reducing sweat secretion, which may result in a decrease in body surface temperature. Adding an assessment of the experienced ambient temperature improves the accuracy of the analysis.

[0036] By constructing the body temperature assessment index mc, taking into account the body temperature ratio and body temperature fluctuation value, a comprehensive body temperature status indicator is provided to the user;

[0037] Determine the current user's baseline respiratory rate, where the baseline respiratory rate measures the number of breaths per minute when the user is in a quiet and relaxed state, and uses this as the baseline respiratory rate;

[0038] The respiratory frequency of the user per minute in the set monitoring time period is collected by using a respiratory monitoring belt, and the ratio of the respiratory frequency of the user per minute in the set monitoring time period is calculated with the baseline respiratory frequency, thereby obtaining the frequency ratio of the user per minute in the set monitoring time period;

[0039] Calculate the mean of the frequency ratios of each group, thereby obtaining the user's respiratory assessment index md within the set monitoring time period;

[0040] By accumulating the frequency ratios and calculating the average value, the respiratory evaluation index md is obtained, which comprehensively reflects the user's respiratory status during the monitoring period;

[0041] Extract the user's heart rate assessment index ma, skin conductance assessment index mb, body temperature assessment index mc and respiration assessment index md within the set monitoring time period and substitute them into the formula Perform weighted calculation to obtain the user's status evaluation index Ysf within the set monitoring time period; , , as well as They represent the maximum allowable indexes corresponding to the heart rate assessment index ma, the skin conductance assessment index mb, the body temperature assessment index mc and the respiration assessment index md, respectively, and are set specifically according to the user's gender and age; , , as well as They are the influencing weight factors of heart rate assessment index ma, skin conductance assessment index mb, body temperature assessment index mc and respiration assessment index md;

[0042] Provide a more comprehensive user status assessment by comprehensively evaluating heart rate, skin conductance, body temperature and respiratory status;

[0043] Monitoring and evaluation: Based on the state evaluation index Ysf obtained during the user experience process, the user's state level during the experience process is determined; the state level is divided into relaxation state, tension state and discomfort state;

[0044] Specifically:

[0045] Preset the value range of each group of indexes of the state evaluation index Ysf, and set each group of index value range to correspond to a state level;

[0046] Match the user's status evaluation index Ysf within the set monitoring time period with the preset index value ranges of each group, so as to obtain the user's status level within the set monitoring time period;

[0047] When the state evaluation index is low, the corresponding matching state level is a relaxed state;

[0048] When the state evaluation index is high, the corresponding matched state level is tense;

[0049] When the state evaluation index is high, the corresponding matching state level is an uncomfortable state;

[0050] Timely adjustment: perform corresponding operations based on the user's status level during the experience process;

[0051] Specifically:

[0052] If the state level matched by the user during the set monitoring time period is a relaxed state, a dynamic enhancement signaling is first sent to the user, and the user is prompted to operate through the interactive device. If the user confirms the sent dynamic enhancement signaling, the dynamics of the virtual scene is improved based on the preset settings, and interactive elements are added; if the user rejects the sent dynamic enhancement signaling, the status quo is maintained; interactive elements such as virtual pets or natural landscapes;

[0053] If the state level matched by the user in the set monitoring time period is a tense state, first reduce the intensity of the sound effect, and change the visual elements in the virtual scene to provide visual elements corresponding to natural scenery. The visual elements corresponding to natural scenery include forests, beaches and lakes. At the same time, monitor and analyze the user's state evaluation index Ysf in the next set monitoring time period in real time. If the matched state level is still a tense state, send a stop application signal to the user, and the user will operate through the prompt of the interactive device. If the user confirms the sent stop application signal, the current immersive experience will be suspended immediately. If the user rejects the sent stop application signal, the current immersive experience will continue.

[0054] If the user's status level matched within the set monitoring time period is an uncomfortable state, the warning will be triggered and the current immersive experience will be suspended immediately to avoid further deterioration of the discomfort state. At the same time, the user's discomfort time and physiological data will be recorded for subsequent analysis and formulation of preventive measures;

[0055] User feedback: After the user experience is completed, a detailed experience data table is provided; the experience data table includes the user's status evaluation index Ysf and experience adjustment history; the user can optimize the settings for the next experience based on the feedback from the experience data table.

[0056] Compared with the prior art, the present invention has the following beneficial effects:

[0057] The present invention sets a time period for monitoring the physiological indicators of the user during the user experience. When the set monitoring time period is reached, the integrated physiological sensor collects the user's heart rate, skin conductance, body temperature and respiratory state physiological indicators within the set monitoring time period, and thereby obtains the user's state evaluation index within the set monitoring time period. By comprehensively evaluating the heart rate, skin conductance, body temperature and respiratory state, a more comprehensive user state evaluation is provided. Based on the state evaluation index obtained during the user experience, the state level of the user during the experience is determined, thereby solving the problem that the prior art ignores the monitoring and evaluation of the user's physiological state during the experience, causing the user to feel uncomfortable during a long-term immersive experience.

[0058] The present invention presets each group of index value ranges of the status evaluation index, sets each group of index value ranges to correspond to a status level, matches the status evaluation index of the user within the set monitoring time period with the preset groups of index value ranges, thereby obtaining the status level of the user within the set monitoring time period, and performs corresponding operations based on the user's status level, thereby ensuring the user's experience and safety during the experience process. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Further details, features and advantages of the present application are disclosed in the following description of exemplary embodiments in conjunction with the accompanying drawings, in which:

[0060] Figure 1 is a flow chart of the present invention;

[0061] Figure 2 It is a line graph of the heart rate change in the present invention. DETAILED DESCRIPTION

[0062] Several embodiments of the present application will be described in more detail below with reference to the accompanying drawings so that those skilled in the art can implement the present application. The present application can be embodied in many different forms and purposes and should not be limited to the embodiments described herein. These embodiments are provided to make the present application comprehensive and complete, and to fully convey the scope of the present application to those skilled in the art. The embodiments do not limit the present application.

[0063] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by those of ordinary skill in the art to which this application belongs. It will be further understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the relevant art and / or the context of this specification, and will not be interpreted in an idealized or overly formal sense unless explicitly defined as such herein.

[0064] See also Figure 1-Figure 2 As shown, the multi-directional immersive space virtual-reality interaction method includes:

[0065] Real-time capture: Use multiple sets of pre-deployed sensor arrays to capture the user's movements and position information in real space in real time;

[0066] Arrange multiple high-precision sensors in a specific interactive space, including but not limited to cameras, motion capture devices, pressure sensors, etc.;

[0067] Building the environment: Integrate 3D modeling technology to build a virtual environment that corresponds to the real space, and use real-time rendering technology to dynamically adjust the elements in the virtual environment based on the user's actions and position information;

[0068] Based on the processed data, the system dynamically adjusts elements in the virtual environment, such as the position and behavior of virtual characters and objects;

[0069] The user sees the virtual scene synchronized with the real action through the head-mounted display, hears the corresponding sound effects through the audio system, and feels the corresponding tactile feedback through the tactile feedback device;

[0070] Process monitoring: During the user experience, the user's physiological indicators are monitored through integrated physiological sensors; the physiological indicators include heart rate indicators, skin conductance indicators, body temperature indicators and respiratory status indicators; the user's monitored heart rate indicators, skin conductance indicators, body temperature indicators and respiratory status indicators are analyzed respectively to obtain the heart rate evaluation index ma, skin conductance evaluation index mb, body temperature evaluation index mc and respiratory evaluation index md; the analysis results of the physiological indicators monitored by the user are comprehensively processed to obtain the user's state evaluation index Ysf; the physiological sensors include heart rate sensors, skin conductance sensors, body temperature sensors and respiratory monitoring belts;

[0071] Specifically:

[0072] Mark the time point when the user starts the experience as the starting point, start timing from the starting point, set a time period for monitoring the user's physiological indicators, and extract the user's physiological indicators in the current monitoring time period when the set monitoring time period is reached;

[0073] Using a heart rate sensor to collect the heart rate values ​​of the user at each time point within a set monitoring period, thereby constructing a line graph of the user's heart rate changes within the set monitoring period; plotting the value points in the line graph corresponding to the user's heart rate values ​​at each time point, and connecting adjacent value points to obtain a heart rate line;

[0074] Determine the baseline heart rate of the current user, where the baseline heart rate is measured when the user is in a quiet and relaxed state, and this is used as the baseline heart rate;

[0075] Draw a threshold line corresponding to the user's baseline heart rate in the line graph, mark the numerical points above the threshold line as over-threshold points, and use each group of over-threshold points as the starting point to construct vertical line segments between each group of over-threshold points and the threshold line, calculate the length of each group of vertical line segments and add them up as the user's heart rate over-value;

[0076] At the same time, the slope of each heart rate line and the angle with the horizontal line are calculated. If the angle between a heart rate line and the horizontal line is an acute angle, the slope of the heart rate line is marked as a descending slope. If the angle between a heart rate line and the horizontal line is an obtuse angle, the slope of the heart rate line is marked as an ascending slope. Each group of ascending slopes and descending slopes are accumulated to obtain the ascending heart value and the descending heart value, and the ratio between the ascending heart value and the descending heart value is calculated to obtain the heart rate ratio; that is, the ascending heart value / descending heart value;

[0077] Obtain the user's age and gender, extract the age value ranges corresponding to the user's gender from the database, set each age value range to correspond to a heart rate data packet of the user, wherein the heart rate data packet includes the maximum allowable values ​​of the heart rate overvalue and the heart rate ratio; match the user's age with each age value range, thereby obtaining the user's heart rate data packet;

[0078] The user's heart rate excess and heart rate ratio are marked as ga and gb respectively; the maximum allowable values ​​corresponding to the heart rate excess and heart rate ratio are marked as and ;

[0079] According to the formula The above parameters are weighted to obtain the user's heart rate assessment index ma, where e1 and e2 are the influence weight factors of the user's heart rate excess value ga and heart rate ratio gb respectively;

[0080] In summary, by comprehensively analyzing the user's heart rate data, a comprehensive, real-time and personalized physiological state monitoring and evaluation method is provided;

[0081] Determine the baseline skin conductance of the current user, where the baseline skin conductance is measured when the user is in a quiet and relaxed state, and the baseline skin conductance is used as the baseline skin conductance;

[0082] The skin conductance sensor is used to collect the user's skin conductance data within the set monitoring time period, the collected skin conductance data is filtered, and according to the baseline skin conductance, the time period during which the user's skin conductance data is higher than the baseline skin conductance within the set monitoring time period is identified, and the identified time period is accumulated to obtain the duration of the user's skin conductance exceeding the limit;

[0083] Based on the skin conductance data of the user within the set monitoring time period, the highest value of the skin conductance data is extracted to obtain the conductance peak value exceeded by the user's skin conductance; the ratio between the user's conductance peak value and the baseline skin conductance is calculated as the user's conductance ratio;

[0084] Preset weight coefficients of the user's duration and conductance ratio respectively, multiply the user's duration and conductance ratio by the corresponding preset weight coefficients respectively, and then sum them to obtain the user's skin conductance assessment index mb;

[0085] By weighted calculation of duration and conductance ratio, the skin conductance assessment index mb was constructed, which comprehensively reflects the user's emotional arousal or stress state;

[0086] Obtain the temperature value of the user's current experience environment at each time point within the set monitoring time period, and calculate the average value, thereby obtaining the temperature evaluation value of the user's current experience environment within the set monitoring time period;

[0087] According to the temperature evaluation value of the user's current experience environment within the set monitoring time period, the user's reference body temperature value is obtained; each group of evaluation value ranges corresponding to the preset temperature evaluation value is set, and each group of evaluation value ranges is set to correspond to a user's reference body temperature value; the temperature evaluation value of the user's current experience environment within the set monitoring time period is matched with each preset group of evaluation value ranges, thereby obtaining the user's reference body temperature value;

[0088] The temperature sensor is used to collect the temperature data of the user at each time point within the set monitoring time period, and the temperature data of the user at each time point is calculated using the standard deviation formula to obtain the temperature fluctuation value of the user; at the same time, the highest temperature data is extracted from the temperature data of the user at each time point as the user's temperature peak value;

[0089] Calculate the ratio between the user's body temperature peak value and the reference body temperature value to obtain the body temperature ratio;

[0090] Preset the weight coefficients of the body temperature ratio and the body temperature fluctuation value respectively, multiply the body temperature ratio and the body temperature fluctuation value of the user in the set monitoring time period by the corresponding weight coefficients respectively, and then sum them up to obtain the user's body temperature assessment index mc;

[0091] When the ambient temperature rises, the human body may dissipate heat by dilating blood vessels and increasing sweat secretion, resulting in an increase in body surface temperature. Conversely, when the ambient temperature drops, the human body will reduce heat loss by constricting blood vessels and reducing sweat secretion, which may result in a decrease in body surface temperature. Adding an assessment of the experienced ambient temperature improves the accuracy of the analysis.

[0092] By constructing the body temperature assessment index mc, taking into account the body temperature ratio and body temperature fluctuation value, a comprehensive body temperature status indicator is provided to the user;

[0093] Determine the current user's baseline respiratory rate, where the baseline respiratory rate measures the number of breaths per minute when the user is in a quiet and relaxed state, and uses this as the baseline respiratory rate;

[0094] The respiratory frequency of the user per minute in the set monitoring time period is collected by using a respiratory monitoring belt, and the ratio of the respiratory frequency of the user per minute in the set monitoring time period is calculated with the baseline respiratory frequency, thereby obtaining the frequency ratio of the user per minute in the set monitoring time period;

[0095] Calculate the mean of the frequency ratios of each group, thereby obtaining the user's respiratory assessment index md within the set monitoring time period;

[0096] By accumulating the frequency ratios and calculating the average value, the respiratory evaluation index md is obtained, which comprehensively reflects the user's respiratory status during the monitoring period;

[0097] Extract the user's heart rate assessment index ma, skin conductance assessment index mb, body temperature assessment index mc and respiration assessment index md within the set monitoring time period and substitute them into the formula Perform weighted calculation to obtain the user's status evaluation index Ysf within the set monitoring time period; , , as well as They respectively represent the maximum allowable indexes corresponding to the heart rate assessment index ma, the skin conductance assessment index mb, the body temperature assessment index mc and the respiration assessment index md, and are specifically set according to the user's gender and age; , as well as They are the influencing weight factors of heart rate assessment index ma, skin conductance assessment index mb, body temperature assessment index mc and respiration assessment index md;

[0098] Provide a more comprehensive user status assessment by comprehensively evaluating heart rate, skin conductance, body temperature and respiratory status;

[0099] Monitoring and evaluation: Based on the state evaluation index Ysf obtained during the user experience process, the user's state level during the experience process is determined; the state level is divided into relaxation state, tension state and discomfort state;

[0100] Specifically:

[0101] Preset the value range of each group of indexes of the state evaluation index Ysf, and set each group of index value range to correspond to a state level;

[0102] Match the user's status evaluation index Ysf within the set monitoring time period with the preset index value ranges of each group, so as to obtain the user's status level within the set monitoring time period;

[0103] When the state evaluation index is low, the corresponding matching state level is a relaxed state;

[0104] When the state evaluation index is high, the corresponding matched state level is tense;

[0105] When the state evaluation index is high, the corresponding matching state level is an uncomfortable state;

[0106] Timely adjustment: perform corresponding operations based on the user's status level during the experience process;

[0107] Specifically:

[0108] If the state level matched by the user during the set monitoring time period is a relaxed state, a dynamic enhancement signaling is first sent to the user, and the user is prompted to operate through the interactive device. If the user confirms the sent dynamic enhancement signaling, the dynamics of the virtual scene is improved based on the preset settings, and interactive elements are added; if the user rejects the sent dynamic enhancement signaling, the status quo is maintained; interactive elements such as virtual pets or natural landscapes;

[0109] If the state level matched by the user in the set monitoring time period is a tense state, first reduce the intensity of the sound effect, change the visual elements in the virtual scene, and monitor and analyze the user's state evaluation index Ysf in the next set monitoring time period in real time. If the matched state level is still a tense state, send a stop application signal to the user, and the user will operate through the prompt of the interactive device. If the user confirms the sent stop application signal, the current immersive experience will be suspended immediately. If the user rejects the sent stop application signal, the current immersive experience will continue;

[0110] It should be noted that the changed visual elements include "showing natural scenery such as forests, beaches, mountains or calm lakes, which often bring a sense of peace; avoiding rapid or drastic visual changes, and using slowly moving or gradual images to reduce visual stimulation."

[0111] If the user's status level matched within the set monitoring time period is an uncomfortable state, the warning will be triggered and the current immersive experience will be suspended immediately to avoid further deterioration of the discomfort state. At the same time, the user's discomfort time and physiological data will be recorded for subsequent analysis and formulation of preventive measures;

[0112] User feedback: After the user experience is over, a detailed experience data table is provided; the experience data table includes the user's status evaluation index Ysf and experience adjustment history; users can optimize the settings for the next experience based on the feedback from the experience data table;

[0113] After the user experience is over, an encryption request may be popped up to the user through the interactive device, asking the user whether to encrypt the parameter analysis process of the current experience. If the user confirms the encryption, the relevant parameter analysis process of the user in the experience is extracted. The relevant parameters are the heart rate assessment index ma, the skin conductance assessment index mb, the body temperature assessment index mc and the respiration assessment index md.

[0114] Each group of analysis processes is integrated into a user's data packet, and the date corresponding to the current time point of the data packet is marked. Then, a string of digital codes is randomly generated for the group of data packets through computer selection; the digital code range is set to 12 bits, and all are positive integers;

[0115] The 12-digit code is divided into 4 groups based on the order of precedence, that is, every three groups of digital codes form a code group;

[0116] Extract each group of numbers in the code group and use the preset encryption formula for calculation. The preset encryption formula is q=(s+y) / rt; where s represents the corresponding number of the code group, y, r, and t are all preset values ​​and positive integers, where y>t;

[0117] After calculating each group of numbers in the code group using a preset encryption formula, a new string of code groups is obtained, and each group of numbers is set to correspond to a letter or symbol, such as 1=g, 15=@, etc.;

[0118] Draw a square and divide the drawn square into four equal parts. Convert each group of numbers in the code group into letters or symbols based on the set rules. After the conversion is completed, fill them into the corresponding divided equal parts. After the filling is completed, the filled square is used as the encrypted figure in the corresponding parameter analysis process;

[0119] Based on the above rules, the four groups of codes are grouped in turn to construct encryption graphics, and the analysis process of each group of parameters is encrypted using the four groups of encryption graphics and stored in the database.

[0120] The above formulas are obtained by collecting a large amount of data and performing software simulation, and a formula close to the actual value is selected. The influencing weight factor and specific coefficient value in the formula are set by technical personnel in this field according to actual conditions, and can be adjusted and modified later.

[0121] The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to only specific implementation methods. Obviously, many modifications and changes can be made according to the content of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can understand and use the present invention well. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. Multi-dimensional immersive space virtual-reality interaction method, It is characterized in that include: Process monitoring: During the user experience, the user's physiological indicators are monitored through integrated physiological sensors; the physiological indicators include heart rate indicators, skin conductance indicators, body temperature indicators and respiratory status indicators; the user's monitored heart rate indicators, skin conductance indicators, body temperature indicators and respiratory status indicators are analyzed respectively to obtain the heart rate evaluation index ma, skin conductance evaluation index mb, body temperature evaluation index mc and respiratory evaluation index md; the analysis results of the user's monitored physiological indicators are comprehensively processed to obtain the user's state evaluation index Ysf; The specific steps to obtain the heart rate assessment index ma are: The user's heart rate index is monitored by the integrated physiological sensor, and the user's heart rate excess value and heart rate ratio during the experience are obtained, which are recorded as ga and gb. At the same time, based on the user's age and gender, the maximum allowable values ​​of the user's corresponding heart rate excess value ga and heart rate ratio gb are obtained and marked as ga respectively. 允许 and gb 允许 ; According to the formula Perform weighted calculation on the user's heart rate excess value ga and heart rate ratio gb, thereby obtaining the user's heart rate assessment index ma; wherein e1 and e2 are respectively the influence weight factors of the user's heart rate excess value ga and heart rate ratio gb; The specific steps for monitoring the user's heart rate indicators through the integrated physiological sensor and analyzing them are as follows: Mark the time point when the user starts the experience as the starting point, start timing from the starting point, set a time period for monitoring the user's physiological indicators, and extract the user's physiological indicators in the current monitoring time period when the set monitoring time period is reached; Using a heart rate sensor to collect the user's heart rate values ​​at each time point within a set monitoring period, thereby constructing a line graph of the user's heart rate changes within the set monitoring period; Draw the user's heart rate value at each time point corresponding to the numerical point in the line graph, and connect adjacent numerical points to obtain a heart rate line; Determine the baseline heart rate of the current user, where the baseline heart rate is measured when the user is in a quiet and relaxed state, and this is used as the baseline heart rate; Draw a threshold line corresponding to the user's baseline heart rate in the line graph, mark the numerical points above the threshold line as over-threshold points, and use each group of over-threshold points as the starting point to construct vertical line segments between each group of over-threshold points and the threshold line, calculate the length of each group of vertical line segments and add them up as the user's heart rate over-value; The specific steps to obtain the user's heart rate excess value ga, heart rate ratio gb and the corresponding maximum allowable value during the experience are: Calculate the slope of each heart rate line and the angle between it and the horizontal line. If the angle between a heart rate line and the horizontal line is an acute angle, mark the slope of the heart rate line as a descending slope. If the angle between a heart rate line and the horizontal line is an obtuse angle, mark the slope of the heart rate line as an ascending slope. Accumulate each group of ascending slopes and descending slopes to obtain ascending heart values ​​and descending heart values, and calculate the ratio between the ascending heart values ​​and the descending heart values ​​to obtain the heart rate ratio. That is, rising heart value / falling heart value; Obtain the user's age and gender, extract the age value ranges corresponding to the user's gender from the database, set each age value range to correspond to a heart rate data packet of the user, wherein the heart rate data packet includes the maximum allowable values ​​of the heart rate overvalue and the heart rate ratio; match the user's age with each age value range, thereby obtaining the user's heart rate data packet; The user's heart rate excess and heart rate ratio are marked as ga and gb respectively; The maximum allowable values ​​corresponding to the heart rate excess and heart rate ratio are marked as ga 允许 and gb 允许 ; The specific steps of monitoring the user's skin conductance index through the integrated physiological sensor and analyzing it to obtain the skin conductance evaluation index mb are as follows: Determine the baseline skin conductance of the current user, where the baseline skin conductance is measured when the user is in a quiet and relaxed state, and the baseline skin conductance is used as the baseline skin conductance; The skin conductance sensor is used to collect the user's skin conductance data within the set monitoring time period, the collected skin conductance data is filtered, and according to the baseline skin conductance, the time period during which the user's skin conductance data is higher than the baseline skin conductance within the set monitoring time period is identified, and the identified time period is accumulated to obtain the duration of the user's skin conductance exceeding the limit; Based on the skin conductance data of the user within the set monitoring time period, the highest value of the skin conductance data is extracted to obtain the conductance peak value exceeded by the user's skin conductance; Calculate the ratio between the user's peak conductance and the baseline skin conductance as the user's conductance ratio; Preset weight coefficients of the user's duration and conductance ratio respectively, multiply the user's duration and conductance ratio by the corresponding preset weight coefficients respectively, and then sum them to obtain the user's skin conductance assessment index mb; The specific steps of monitoring the user's body temperature index through the integrated physiological sensor and analyzing it to obtain the body temperature assessment index mc are as follows: Obtain the temperature value of the user's current experience environment at each time point within the set monitoring time period, and calculate the average value, thereby obtaining the temperature evaluation value of the user's current experience environment within the set monitoring time period; According to the temperature evaluation value of the user's current experience environment within the set monitoring time period, the user's reference body temperature value is obtained; Preset each group of evaluation value ranges corresponding to the temperature evaluation value, and set each group of evaluation value ranges to correspond to a user's reference body temperature value; match the temperature evaluation value of the user's current experience environment within the set monitoring time period with each group of preset evaluation value ranges, thereby obtaining the user's reference body temperature value; The temperature sensor is used to collect the temperature data of the user at each time point within the set monitoring time period, and the temperature data of the user at each time point is calculated using the standard deviation formula to obtain the temperature fluctuation value of the user; At the same time, the highest body temperature data is extracted from the user's body temperature data at each time point as the user's body temperature peak value; Calculate the ratio between the user's body temperature peak value and the reference body temperature value to obtain the body temperature ratio; Preset the weight coefficients of the body temperature ratio and the body temperature fluctuation value respectively, multiply the body temperature ratio and the body temperature fluctuation value of the user in the set monitoring time period by the corresponding weight coefficients respectively, and then sum them up to obtain the user's body temperature assessment index mc; The specific steps of monitoring the user's respiratory status indicators through the integrated physiological sensor and analyzing them to obtain the respiratory assessment index md are as follows: Determine the current user's baseline respiratory rate, where the baseline respiratory rate measures the number of breaths per minute when the user is in a quiet and relaxed state, and uses this as the baseline respiratory rate; The respiratory frequency of the user per minute in the set monitoring time period is collected by using a respiratory monitoring belt, and the ratio of the respiratory frequency of the user per minute in the set monitoring time period is calculated with the baseline respiratory frequency, thereby obtaining the frequency ratio of the user per minute in the set monitoring time period; Calculate the mean of the frequency ratios of each group, thereby obtaining the user's respiratory assessment index md within the set monitoring time period; The analysis results of the physiological indicators monitored by the user are comprehensively processed to obtain the user's state evaluation index Ysf, which is specifically: Extract the user's heart rate assessment index ma, skin conductance assessment index mb, body temperature assessment index mc and respiration assessment index md within the set monitoring time period and substitute them into the formula Perform weighted calculation to obtain the user's status evaluation index Ysf within the set monitoring time period; where ma 参考 mb 参考 、mc 参考 and md 参考 They represent the maximum allowable indexes corresponding to the heart rate assessment index ma, the skin conductance assessment index mb, the body temperature assessment index mc and the respiration assessment index md respectively; α, β, χ and η are the influencing weight factors of the heart rate assessment index ma, the skin conductance assessment index mb, the body temperature assessment index mc and the respiration assessment index md respectively; Monitoring and evaluation: Based on the state evaluation index Ysf obtained during the user experience process, the user's state level during the experience process is determined; the state level is divided into relaxation state, tension state and discomfort state; Timely adjustment: Based on the user's state level during the experience, corresponding to the state of relaxation, tension and discomfort, corresponding operations are performed; It also includes user feedback, specifically: After the user experience is over, a detailed experience data table is provided; the experience data table includes the user's state evaluation index Ysf and experience adjustment history; the user can optimize the settings for the next experience based on the feedback from the experience data table; After the user experience is over, an encryption request may be popped up to the user through the interactive device, asking the user whether to encrypt the parameter analysis process of the current experience. If the user confirms the encryption, the relevant parameter analysis process of the user in the experience is extracted. The relevant parameters are the heart rate assessment index ma, the skin conductance assessment index mb, the body temperature assessment index mc and the respiration assessment index md. Each group of analysis processes is integrated into a user's data packet, and the date corresponding to the current time point of the data packet is marked. Then, a string of digital codes is randomly generated for the data packet through computer selection; the digital code range is set to 12 bits, and all are positive integers; The 12-digit code is divided into 4 groups based on the order of precedence, that is, every three groups of digital codes form a code group; Extract each group of numbers in the code group and calculate using a preset encryption formula, the preset encryption formula is q=(s+y) / rt; where s represents the corresponding number of the code group, y, r, t are all preset values ​​and are positive integers, where y>t; After calculating each group of numbers in the code group using a preset encryption formula, a new string of code groups is obtained, and each group of numbers is set to correspond to a letter or symbol; Draw a square and divide the drawn square into four equal parts. Convert each group of numbers in the code group into letters or symbols based on the set rules. After the conversion is completed, fill them into the corresponding divided equal parts. After the filling is completed, the filled square is used as the encrypted figure in the corresponding parameter analysis process; Based on the above rules, the four groups of codes are grouped in turn to construct encryption graphics, and the analysis process of each group of parameters is encrypted using the four groups of encryption graphics and stored in the database.

2. The multi-directional immersive space virtual-reality interaction method according to claim 1, It is characterized in that Determine the user's status level during the experience process, specifically: Preset the value range of each group of indexes of the state evaluation index Ysf, and set each group of index value range to correspond to a state level; The user's status evaluation index Ysf within the set monitoring time period is matched with the preset index value ranges of each group, so as to obtain the user's status level within the set monitoring time period.

3. The multi-directional immersive space virtual-reality interaction method according to claim 1, It is characterized in that Based on the user's status level during the experience process, corresponding operations are performed, specifically: If the state level matched by the user during the set monitoring time period is a relaxed state, a dynamic enhancement signaling is first sent to the user, and the user performs operations through the prompts of the interactive device. If the user confirms the sent dynamic enhancement signaling, the dynamics of the virtual scene is improved based on the preset settings, and interactive elements are added; if the user rejects the sent dynamic enhancement signaling, the status quo is maintained; If the state level matched by the user in the set monitoring time period is a tense state, first reduce the intensity of the sound effect, and change the visual elements in the virtual scene to provide visual elements corresponding to natural scenery. The visual elements corresponding to natural scenery include forests, beaches and lakes. At the same time, monitor and analyze the user's state evaluation index Ysf in the next set monitoring time period in real time. If the matched state level is still a tense state, send a stop application signal to the user, and the user will operate through the prompt of the interactive device. If the user confirms the sent stop application signal, the current immersive experience will be suspended immediately. If the user rejects the sent stop application signal, the current immersive experience will continue. If the user's status level matched within the set monitoring time period is an uncomfortable state, the warning will be triggered and the current immersive experience will be immediately suspended, and the user's discomfort time and physiological data will be recorded.