Virtual reality motion sickness monitoring and relieving system guided by text narration

Abstract

The invention discloses a text narrative-guided virtual reality motion sickness monitoring and relieving system, and relates to the technical field of virtual reality, the text narrative-guided virtual reality motion sickness monitoring and relieving system comprises an adaptability monitoring module, the adaptability monitoring module comprises a data acquisition unit, and the data acquisition unit is used for acquiring physiological information of a user in virtual reality training in real time; the data is transmitted to the adaptability evaluation unit; the dynamic adjustment module is used for receiving the sensing data acquired by the data acquisition unit and dynamically adjusting parameters of the virtual reality equipment according to the received data; by monitoring physiological information and perception data of a user in real time, signs of motion sickness can be rapidly recognized, the real-time monitoring is combined with dynamic adjustment of visual and vestibular stimulation in a VR environment, the risk of motion sickness caused by mismatching of sensory input and actual body movement can be effectively reduced, and the motion sickness can be rapidly recognized through the dynamic adjustment. The system can preventively adapt to individual differences of users and reduce motion sickness.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and more particularly to a virtual reality motion sickness monitoring and relief system guided by text narrative. Background Art

[0002] It should be noted that VR motion sickness refers to a series of symptoms caused by the inconsistency between the visual and vestibular systems when using VR devices. This phenomenon is similar to traditional motion sickness, such as seasickness, carsickness or airplane sickness, but VR motion sickness specifically related to VR experience is the main reason for the reduction of user VR experience comfort.

[0003] The occurrence of virtual reality motion sickness is usually related to the following factors: the movement seen by the user in VR is inconsistent with the actual movement perceived by the inner ear, the position seen by the user in VR is inconsistent with the actual position of the body, the display in the VR device may not provide enough visual focus changes, making it difficult for the eyes to adapt, and long-term immersion in the VR environment may increase the risk of motion sickness;

[0004] Among them, military training is usually conducted in a high-pressure and high-demand environment, which increases the risk of motion sickness, because users need to adapt and react quickly in tense situations. Military training uses VR equipment for a long time, which increases the possibility of motion sickness in users, especially in training for multiple consecutive days. Military simulations often require highly realistic virtual environments, which may stimulate the user's senses more intensely, thereby increasing the risk of motion sickness. The VR experience in military training may be accompanied by high-intensity physical movement and psychological pressure, both of which may aggravate the symptoms of motion sickness.

[0005] Therefore, in actual use, the VR experience in military training often pursues a high degree of immersion to improve the authenticity and effectiveness of the training. A highly immersive virtual environment may aggravate the user's motion sickness symptoms because there is a mismatch between the user's sensory input and actual body movements. Existing virtual reality motion sickness relief methods are difficult to apply to military training and need to rely more on individual adaptability.

[0006] Military training requires VR systems to be able to monitor the user's physiological and psychological state in real time to quickly identify signs of motion sickness. This involves accurately capturing and analyzing physiological signals (such as heart rate, skin galvanic response, etc.), and processing this data in real time to provide timely feedback. Due to differences in motion sickness susceptibility and experience among different users, the system needs to be able to provide personalized mitigation measures based on the specific circumstances of each user. Existing monitoring technologies are difficult to adapt to this high degree of precision and flexibility, and the rapidly changing environment and task requirements in military training. Summary of the invention

[0007] In order to solve the above problems, the present invention provides a virtual reality motion sickness monitoring and relief system guided by text narrative.

[0008] The present invention provides a text narrative guided virtual reality motion sickness monitoring and relief system, comprising an adaptability monitoring module, wherein the adaptability monitoring module comprises a data acquisition unit, wherein the data acquisition unit is used to collect physiological information of a user in virtual reality training in real time and transmit the information to the adaptability evaluation unit;

[0009] The data acquisition unit is also used to obtain the user's perception data in the virtual reality device and transmit it;

[0010] A dynamic adjustment module, the dynamic adjustment module receives the perception data collected by the data collection unit and dynamically adjusts the parameters of the virtual reality device according to the received data;

[0011] a mitigation module, the mitigation module comprising a judgment unit and a mitigation unit, the judgment unit being used to judge whether the user has motion sickness symptoms according to the physiological information collected by the data collection unit, and if it is judged that the user has motion sickness symptoms, a signal is generated and transmitted to the mitigation unit, and the mitigation unit adjusts the parameters of the virtual reality device;

[0012] A text narrative guidance module, the text narrative guidance module includes a personalization unit and a text narrative guidance unit, the personalization unit receives the user's usage results and provides a personalized solution;

[0013] The text narrative guidance unit is used to perform text narrative guidance on the adaptability monitoring module, the dynamic adjustment module and the mitigation module according to the personalized solution provided by the personalized unit.

[0014] Preferably, the specific working mode of the dynamic adjustment module is as follows:

[0015] The user's actual motion data is obtained based on the user's perception data in the virtual reality device, including the user's actual movement direction Q1 and movement duration W1, and then the user's line of sight direction Q2 and gaze duration W2 are obtained;

[0016] According to the formula D = [β*|Q1-Q2|] + [γ*|W1-W2|], the inconsistency score D between the user's movement in the virtual reality device and the actual movement perceived by the inner ear is calculated, where β and γ are preset weight coefficients;

[0017] Then, according to the inconsistency score D, the user perspective of the virtual reality device is adjusted.

[0018] Preferably, the specific method of adjusting the user viewing angle of the virtual reality device is as follows:

[0019] A threshold R of the inconsistency score is set in advance; it should be noted that, in this embodiment, the smaller the threshold of the inconsistency score is, the more accurate the requirement of the device is. In this embodiment, the value of the threshold of the inconsistency score can be 0.2;

[0020] The inconsistency score D is compared with the threshold R of the inconsistency score. If the inconsistency score D is greater than the threshold R of the inconsistency score, further adjustment is performed. If not, no adjustment is required.

[0021] Preferably, if the inconsistency score D is greater than the threshold R of the inconsistency score, the specific steps of further adjustment are as follows:

[0022] If the inconsistency score D is greater than the inconsistency score threshold R, the inconsistency difference T is obtained by subtracting the inconsistency score threshold R from the inconsistency score D;

[0023] According to the formula F1=F-δ*T, the adjusted user perspective F1 is calculated, where F is the perspective of the virtual reality device before the user adjustment, and δ is the preset adjustment coefficient. The adjusted user perspective F1 is transmitted to the virtual reality device for adjustment.

[0024] Preferably, the specific working mode of the judgment unit is as follows:

[0025] First, the user's physiological information is collected, including heart rate, galvanic skin response, eye movement, blood oxygen saturation, body temperature and blood pressure;

[0026] Then, key features are extracted from the physiological information, including heart rate variability Y, skin electrical response intensity U, and blood oxygen saturation change P;

[0027] Finally, the extracted key features are used to determine whether the user has motion sickness symptoms.

[0028] Preferably, the specific steps of extracting key features from physiological information are as follows:

[0029] The heart rate variability Y is obtained by calculating the sum of all heartbeat intervals of the user in a fixed time period and then dividing it by the total number of heartbeat intervals;

[0030] The skin galvanic response intensity U is obtained by calculating the sum of all skin galvanic response amplitudes of the user within a fixed time period and dividing it by the total number of skin galvanic responses;

[0031] The blood oxygen saturation change P is obtained by calculating the sum of all blood oxygen saturation measurement values ​​of the user within a fixed time period and dividing it by the total number of blood oxygen saturation measurements.

[0032] Preferably, the specific steps of judging whether the user has motion sickness symptoms according to the extracted key features are as follows:

[0033] According to the formula M=(ω1*Y)+(ω2*U)+(ω3*P), the user's motion sickness symptom score M is calculated and obtained;

[0034] A threshold value of the motion sickness symptom score is set in advance, and if the user's motion sickness symptom score M is greater than the threshold value, it is determined that the user has motion sickness symptoms.

[0035] Preferably, the specific working steps of the mitigation unit are:

[0036] ensuring the user's head is stable;

[0037] Set the brightness and contrast of the VR environment to the lowest values.

[0038] Pause or slow down motion elements in a VR experience.

[0039] Preferably, the specific working mode of the personalization unit is as follows:

[0040] All users are classified according to their usage performance, and those who have never experienced motion sickness are classified into the first category;

[0041] Users who experienced motion sickness during the first three uses were classified into the second category;

[0042] The remaining users are divided into the third category;

[0043] The classification result is used as a personalized solution and transmitted to the text narrative guidance unit.

[0044] Preferably, the specific working method of the text narrative guiding unit is as follows:

[0045] For the first type of users, basic guidance is provided in the adaptability monitoring module;

[0046] In the dynamic adjustment module, the user is notified that the system is fine-tuning the environment settings to optimize the experience;

[0047] In the mitigation module, preventive suggestions are provided;

[0048] For the second type of users, general guidance is provided in the adaptability monitoring module;

[0049] In the dynamic adjustment module, the user is notified that the system is undergoing routine adjustments;

[0050] In the mitigation module, general recommendations are provided;

[0051] For the third type of users, advanced guidance is provided in the adaptability monitoring module;

[0052] In the dynamic adjustment module, clearly inform users that the system will be adjusted based on their feedback;

[0053] In the Mitigation module, specific strategies for alleviating motion sickness are provided.

[0054] Beneficial effects: By real-time monitoring of the user's physiological information and sensory data, signs of motion sickness can be quickly identified. This real-time monitoring combined with dynamic adjustment of visual and vestibular stimulation in the VR environment can effectively reduce the risk of motion sickness caused by the mismatch between sensory input and actual body movement. Through this dynamic adjustment, the system can preventively adapt to individual differences in users, reduce the occurrence of motion sickness, and improve the safety and effectiveness of training;

[0055] Since the high immersion of VR experience in military training may aggravate the symptoms of motion sickness, a personalized solution is provided by the personalized unit according to the evaluation results of the adaptability evaluation unit. This personalized solution can adjust the VR device parameters according to the specific situation of the user to adapt to the physiological and psychological state of each user, thereby effectively alleviating the symptoms of motion sickness;

[0056] Through real-time feedback and data monitoring, timely adjustments and support can be provided to users. This real-time nature is particularly important for military training, allowing the system to quickly respond to the user's physiological and psychological changes and provide necessary intervention to maintain the continuity and effectiveness of training. This real-time monitoring and feedback mechanism enables the VR system to adapt to the individual differences of users and provide a more accurate and personalized training experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 It is a flow chart of the present invention. DETAILED DESCRIPTION

[0058] Application scenarios: In actual applications, VR experience in military training often pursues a high sense of immersion to improve the authenticity and effectiveness of training. A highly immersive virtual environment may aggravate the user's motion sickness symptoms because there is a mismatch between the user's sensory input and actual body movements. Existing virtual reality motion sickness relief methods are difficult to apply to military training and need to rely more on individual adaptability.

[0059] Military training requires VR systems to be able to monitor the user's physiological and psychological state in real time to quickly identify signs of motion sickness. This involves accurately capturing and analyzing physiological signals (such as heart rate, skin galvanic response, etc.), and processing this data in real time to provide timely feedback. Due to differences in motion sickness susceptibility and experience among different users, the system needs to be able to provide personalized mitigation measures based on the specific circumstances of each user. Existing monitoring technologies are difficult to adapt to this high degree of precision and flexibility, and the rapidly changing environment and task requirements in military training.

[0060] like Figure 1 As shown: A text narrative guided virtual reality motion sickness monitoring and relief system, comprising: an adaptability monitoring module, the adaptability monitoring module comprising a data acquisition unit, the data acquisition unit is used to collect the user's physiological information in virtual reality training in real time, and transmit it to the adaptability evaluation unit; it should be noted that the physiological information specifically includes heart rate, which is used to evaluate the user's stress level and adaptability; skin electrical response: reflects the user's stress and emotional state; eye movement: analyzes the user's line of sight and gaze duration to evaluate his adaptability to the VR environment; blood oxygen saturation: reflects the user's respiratory and circulatory system status;

[0061] Body temperature: may be used to assess the user's metabolic activity and possible infection status; Blood pressure: assesses the health of the cardiovascular system; Vestibular function: directly related to the occurrence of motion sickness, assesses the user's peripheral vestibular function characteristics; Blinking frequency: may be related to the impact of visually induced motion sickness, the above data is obtained through various wearable sensors;

[0062] The data acquisition unit is also used to obtain the user's perception data in the virtual reality device and transmit it; it should be noted that the perception data includes the user's actual motion data and the user's visual perception data. The specific actual motion data uses a speed sensor and a direction sensor (such as an MTX module) to obtain the object's rotation Euler angle and speed information in real time. The magnetic field sensor made according to the Hall effect, through the combination of a strong magnet, obtains a speed pulse signal during the rotation of the wheel, which is then converted into a speed signal and transmitted;

[0063] Visual perception data is obtained by displaying a virtual scene consistent with the actual movement through a VR head mounted display (HMD);

[0064] A dynamic adjustment module, wherein the dynamic adjustment module receives the perception data collected by the data collection unit and dynamically adjusts the parameters of the virtual reality device according to the received data. It should be noted that the risk of motion sickness is reduced by dynamically adjusting the visual and vestibular stimulation in the VR environment. The adjustment is mainly based on the inconsistency between the user's movement in VR and the actual movement perceived by the inner ear, that is, the difference between the user's actual movement data and the user's visual perception data. Preventive adjustments are made based on the user's real-time monitoring perception data. This adjustment process is dynamic and changes in real time based on the user's perception data.

[0065] A relief module, the relief module includes a judgment unit and a relief unit, the judgment unit is used to judge whether the user has motion sickness symptoms according to the physiological information collected by the data collection unit, if it is judged that the user has motion sickness symptoms, a signal is generated and transmitted to the relief unit, and the relief unit adjusts the parameters of the virtual reality device; it should be noted that the main purpose is to provide immediate relief when the user has motion sickness symptoms, and the adjustment is mainly based on the user's immediate physiological information and the severity of the motion sickness symptoms;

[0066] A text narrative guidance module, the text narrative guidance module includes a personalization unit and a text narrative guidance unit, the personalization unit receives the user's usage results and provides a personalized solution;

[0067] The text narrative guidance unit is used to perform text narrative guidance on the adaptability monitoring module, the dynamic adjustment module and the mitigation module according to the personalized solution provided by the personalized unit.

[0068] It should be noted that this module creates and adjusts personalized training plans for each user based on the evaluation results and training performance provided by the personalized unit. Through text narrative guidance, the module can provide customized training content in the form of storytelling, making the training more attractive and improving user participation and training results;

[0069] Through text narrative guidance, the module can help users psychologically adapt to the virtual reality environment and training tasks. The narrative can simulate real battlefield situations, help users psychologically rehearse the challenges they will face, and reduce the psychological pressure and risk of motion sickness in actual training.

[0070] The text narrative guidance module can guide users' behaviors and reactions in the VR environment. Through story-based instructions and feedback, it teaches users how to make correct decisions and actions in the virtual environment, thereby improving their adaptability and responsiveness.

[0071] By monitoring the user's physiological information and sensory data in real time, it is possible to quickly identify signs of motion sickness. This real-time monitoring combined with dynamic adjustment of visual and vestibular stimulation in the VR environment can effectively reduce the risk of motion sickness caused by the mismatch between sensory input and actual body movement. Through this dynamic adjustment, the system can preventively adapt to the individual differences of users, reduce the occurrence of motion sickness, and improve the safety and effectiveness of training.

[0072] Since the high immersion of VR experience in military training may aggravate the symptoms of motion sickness, a personalized solution is provided by the personalized unit according to the evaluation results of the adaptability evaluation unit. This personalized solution can adjust the VR device parameters according to the specific situation of the user to adapt to the physiological and psychological state of each user, thereby effectively alleviating the symptoms of motion sickness;

[0073] Through real-time feedback and data monitoring, timely adjustments and support can be provided to users. This real-time nature is particularly important for military training, allowing the system to quickly respond to the user's physiological and psychological changes and provide necessary intervention to maintain the continuity and effectiveness of training. This real-time monitoring and feedback mechanism enables the VR system to adapt to the individual differences of users and provide a more accurate and personalized training experience.

[0074] As an optional embodiment: the specific working mode of the dynamic adjustment module is as follows:

[0075] The user's actual motion data is obtained according to the user's perception data in the virtual reality device, including the user's actual movement direction Q1 and movement duration W1, and then the user's sight direction Q2 and gaze duration W2 are obtained; it should be noted that the actual movement direction and movement duration can be obtained through the sensor of the virtual reality device (such as imu), and the user's sight direction and gaze duration can be obtained through the built-in camera;

[0076] According to the formula D=[β*|Q1-Q2|]+[γ*|W1-W2|], the inconsistency score D between the user's movement in the virtual reality device and the actual movement perceived by the inner ear is calculated, where β and γ are preset weight coefficients; it should be noted that in this embodiment, the initial values ​​of β and γ are both 0.5, because the moving direction and moving duration can represent the inconsistency between the movement in the virtual reality device and the actual movement perceived by the inner ear, and can be adjusted as needed in actual use. In this embodiment, the values ​​of β and γ can be 0.483 and 0.517;

[0077] It should also be noted that the user's actual movement direction Q1 and movement duration W1 are the user's movement data in real life, and the user's sight direction Q2 and gaze duration W2 can represent the user's movement data in the virtual reality device. Comprehensive calculation can obtain the inconsistency score D between the user's movement in the virtual reality device and the actual movement perceived by the inner ear; the smaller the inconsistency score D, the higher the consistency between the user's sensory system (visual, vestibular) and the virtual environment, the smaller the sensory conflict for the user, and the lower the probability of motion sickness for the user;

[0078] When the inconsistency between actual motion data and visual perception data is reduced, the user's sense of immersion is enhanced because the consistency between the user's sensory system (visual, vestibular) and the virtual environment is improved, reducing sensory conflict;

[0079] Then, the user's viewing angle of the virtual reality device is adjusted according to the inconsistency score D. It should also be noted that the inconsistency score D is obtained in real time and is updated according to the user's real-time data.

[0080] As an optional embodiment: the specific method of adjusting the user viewing angle of the virtual reality device is as follows:

[0081] A threshold R of the inconsistency score is set in advance; it should be noted that, in this embodiment, the smaller the threshold of the inconsistency score is, the more accurate the requirement of the device is. In this embodiment, the value of the threshold of the inconsistency score can be 0.2;

[0082] The inconsistency score D is compared with the threshold R of the inconsistency score. If the inconsistency score D is greater than the threshold R of the inconsistency score, further adjustment is performed. If not, no adjustment is required. It should be noted that because the inconsistency score D is obtained in real time and updated according to the real-time data of the user, the step of adjusting the user's perspective of the virtual reality device is also performed in real time, which can increase the user's adaptability to the device and reduce the occurrence of motion sickness.

[0083] As an optional embodiment: if the inconsistency score D is greater than the threshold R of the inconsistency score, the specific steps of further adjustment are as follows;

[0084] If the inconsistency score D is greater than the inconsistency score threshold R, the inconsistency difference T is obtained by subtracting the inconsistency score threshold R from the inconsistency score D;

[0085] According to the formula F1=F-δ*T, the adjusted user perspective F1 is calculated, where F is the perspective of the virtual reality device before the user adjusts it, and δ is the preset adjustment coefficient. The adjusted user perspective F1 is transmitted to the virtual reality device for adjustment. It should be noted that the coefficient δ can be adjusted according to the user's motion sickness sensitivity and actual experience, and in this embodiment, the value is 1.023.

[0086] As an optional embodiment: the specific working mode of the judgment unit is as follows:

[0087] First, the user's physiological information is collected, including heart rate, galvanic skin response, eye movement, blood oxygen saturation, body temperature and blood pressure;

[0088] Then, key features are extracted from the physiological information, including heart rate variability Y, skin electrical response intensity U, and blood oxygen saturation change P;

[0089] Finally, the extracted key features are used to determine whether the user has motion sickness symptoms.

[0090] As an optional embodiment: the specific steps of extracting key features from physiological information are as follows:

[0091] The heart rate variability Y is obtained by calculating the sum of all heartbeat intervals of the user in a fixed time period and then dividing it by the total number of heartbeat intervals;

[0092] The skin galvanic response intensity U is obtained by calculating the sum of all skin galvanic response amplitudes of the user within a fixed time period and dividing it by the total number of skin galvanic responses;

[0093] The blood oxygen saturation change P is obtained by calculating the sum of all blood oxygen saturation measurement values ​​of the user within a fixed time period and dividing it by the total number of blood oxygen saturation measurements.

[0094] It should be noted that the fixed time period can be any value, and in this embodiment, it is one minute;

[0095] It should be noted that we assess the user's health status by calculating the average and variation of heart rate, skin electrical response and blood oxygen saturation. If these values ​​are outside the normal range, it may indicate that the user has symptoms of motion sickness.

[0096] As an optional embodiment: the specific steps of judging whether the user has motion sickness symptoms according to the extracted key features are as follows:

[0097] According to the formula M=(ω1*Y)+(ω2*U)+(ω3*P), the user's motion sickness symptom score M is calculated and obtained;

[0098] A threshold value of the motion sickness symptom score is set in advance, and if the user's motion sickness symptom score M is greater than the threshold value, it is determined that the user has motion sickness symptoms. It should be noted that, in this embodiment, the threshold value of the motion sickness symptom score can determine the susceptibility degree according to the percentile of the MSSQ score, and the historical average value of all users is determined as the threshold value of the motion sickness symptom score.

[0099] As an optional embodiment: the specific working steps of the mitigation unit are:

[0100] Ensuring that the user's head is stable; to reduce symptoms of motion sickness caused by head movement;

[0101] Minimize the brightness and contrast of the VR environment to reduce visual stimulation and slow down dynamic changes and depth changes;

[0102] Pause or slow down the motion elements in the VR experience to reduce the induction of motion sickness.

[0103] As an optional embodiment: the specific working mode of the personalization unit is as follows:

[0104] All users are classified according to their usage performance, and those who have never experienced motion sickness are classified into the first category;

[0105] Users who experienced motion sickness during the first three uses were classified into the second category;

[0106] The remaining users are divided into the third category;

[0107] The classification result is used as a personalized solution and transmitted to the text narrative guidance unit.

[0108] It should be noted that through classification, targeted intervention measures can be implemented for different categories of users. For users who have never experienced motion sickness symptoms (the first category), the current VR training program can be maintained or slightly adjusted; for users who experience motion sickness after the first three uses (the second category), more detailed adjustments may be required, such as reducing the intensity of stimulation or providing adaptive training; for the remaining users (the third category), more personalized interventions may be required, such as mental rehearsal or more frequent physiological monitoring.

[0109] As an optional embodiment: the specific working mode of the text narrative guiding unit is as follows:

[0110] For the first type of users, basic guidance is provided in the adaptability monitoring module; for example: "We noticed that you were a little uncomfortable before, and we will pay special attention to your comfort this time."

[0111] Purpose: To make users feel cared for and reduce anxiety;

[0112] In the dynamic adjustment module, inform the user that the system is fine-tuning the environment settings to optimize the experience; for example: "Based on your feedback, we are reducing the speed of visual movement to reduce discomfort;

[0113] Purpose: To let users understand the purpose of the adjustment and increase trust;

[0114] In the relief module, preventive advice is provided; for example: "If you feel sick, try focusing on a static point, which can help reduce motion sickness symptoms;

[0115] Purpose: To provide practical tips to help users self-regulate;

[0116] For the second type of users, provide general guidance in the adaptability monitoring module; for example: "You are making progress, keep it up."

[0117] Purpose: To encourage the user without giving too much attention, so as not to cause unnecessary stress;

[0118] In the dynamic adjustment module, inform the user that the system is undergoing routine adjustments; for example: "We are performing routine environmental adjustments to ensure everyone's comfort."

[0119] Purpose: To let users understand the routine operation of the system and reduce excessive attention to adjustments;

[0120] In the relief module, provide general advice; for example: "If you feel unwell, please pause your training and let us know so we can help."

[0121] Purpose: To let users know that support is available and to encourage them to proactively seek help;

[0122] For the third type of users, advanced guidance is provided in the adaptability monitoring module; for example: "We noticed that you were a little uncomfortable before, and we will pay special attention to your comfort this time."

[0123] Purpose: To make users feel cared for and reduce anxiety;

[0124] In the dynamic adjustment module, clearly inform users that the system will adjust based on their feedback; for example: "Based on your feedback, we are reducing the speed of visual movement to reduce discomfort."

[0125] Purpose: To let users understand the purpose of the adjustment and increase trust;

[0126] In the relief module, provide specific strategies for alleviating motion sickness. For example: "If you are experiencing discomfort, try focusing on a static point, which can help reduce motion sickness symptoms."

[0127] Purpose: To provide practical tips to help users self-regulate.

[0128] How it works

[0129] By monitoring the user's physiological information and sensory data in real time, it is possible to quickly identify signs of motion sickness. This real-time monitoring combined with dynamic adjustment of visual and vestibular stimulation in the VR environment can effectively reduce the risk of motion sickness caused by the mismatch between sensory input and actual body movement. Through this dynamic adjustment, the system can preventively adapt to the individual differences of users, reduce the occurrence of motion sickness, and improve the safety and effectiveness of training.

[0130] Since the high immersion of VR experience in military training may aggravate the symptoms of motion sickness, a personalized solution is provided by the personalized unit according to the evaluation results of the adaptability evaluation unit. This personalized solution can adjust the VR device parameters according to the specific situation of the user to adapt to the physiological and psychological state of each user, thereby effectively alleviating the symptoms of motion sickness;

[0131] Through real-time feedback and data monitoring, timely adjustments and support can be provided to users. This real-time nature is particularly important for military training, allowing the system to quickly respond to the user's physiological and psychological changes and provide necessary intervention to maintain the continuity and effectiveness of training. This real-time monitoring and feedback mechanism enables the VR system to adapt to the individual differences of users and provide a more accurate and personalized training experience.

[0132] The above are only preferred implementations of the present invention. The protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technical staff in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of this template.

Claims

1. A text narrative-guided virtual reality motion sickness monitoring and relief system, characterized in that: It includes an adaptability monitoring module, which includes a data acquisition unit, and the data acquisition unit is used to collect the physiological information of the user in the virtual reality training in real time and transmit it to the adaptability evaluation unit; The data acquisition unit is also used to obtain the user's perception data in the virtual reality device and transmit it; A dynamic adjustment module, the dynamic adjustment module receives the perception data collected by the data collection unit and dynamically adjusts the parameters of the virtual reality device according to the received data; a mitigation module, the mitigation module comprising a judgment unit and a mitigation unit, the judgment unit being used to judge whether the user has motion sickness symptoms according to the physiological information collected by the data collection unit, and if it is judged that the user has motion sickness symptoms, a signal is generated and transmitted to the mitigation unit, and the mitigation unit adjusts the parameters of the virtual reality device; A text narrative guidance module, the text narrative guidance module includes a personalization unit and a text narrative guidance unit, the personalization unit receives the user's usage results and provides a personalized solution; The text narrative guidance unit is used to perform text narrative guidance on the adaptability monitoring module, the dynamic adjustment module and the mitigation module according to the personalized solution provided by the personalized unit.

2. The text narrative guided virtual reality motion sickness monitoring and relief system according to claim 1, characterized in that: The specific working mode of the dynamic adjustment module is as follows: The user's actual motion data is obtained based on the user's perception data in the virtual reality device, including the user's actual movement direction Q1 and movement duration W1, and then the user's line of sight direction Q2 and gaze duration W2 are obtained; According to the formula D = [β*|Q1-Q2|] + [γ*|W1-W2|], the inconsistency score D between the user's movement in the virtual reality device and the actual movement perceived by the inner ear is calculated, where β and γ are preset weight coefficients; Then, according to the inconsistency score D, the user perspective of the virtual reality device is adjusted.

3. The text narrative guided virtual reality motion sickness monitoring and relief system according to claim 2, characterized in that: The specific method of adjusting the user viewing angle of the virtual reality device is as follows: A threshold R of the inconsistency score is set in advance; it should be noted that, in this embodiment, the smaller the threshold of the inconsistency score is, the more accurate the requirement of the device is. In this embodiment, the value of the threshold of the inconsistency score can be 0.2; The inconsistency score D is compared with the threshold R of the inconsistency score. If the inconsistency score D is greater than the threshold R of the inconsistency score, further adjustment is performed. If not, no adjustment is required.

4. The text narrative guided virtual reality motion sickness monitoring and relief system according to claim 3, characterized in that: If the inconsistency score D is greater than the threshold R of the inconsistency score, the specific steps of further adjustment are as follows: If the inconsistency score D is greater than the inconsistency score threshold R, the inconsistency difference T is obtained by subtracting the inconsistency score threshold R from the inconsistency score D; According to the formula F1=F-δ*T, the adjusted user perspective F1 is calculated, where F is the perspective of the virtual reality device before the user adjustment, and δ is a preset adjustment coefficient. The adjusted user perspective F1 is transmitted to the virtual reality device for adjustment.

5. The text narrative guided virtual reality motion sickness monitoring and relief system according to claim 1, characterized in that: The specific working mode of the judgment unit is as follows: First, the user's physiological information is collected, including heart rate, galvanic skin response, eye movement, blood oxygen saturation, body temperature and blood pressure; Then, key features are extracted from the physiological information, including heart rate variability Y, skin electrical response intensity U, and blood oxygen saturation change P; Finally, the extracted key features are used to determine whether the user has motion sickness symptoms.

6. The text narrative guided virtual reality motion sickness monitoring and relief system according to claim 5, characterized in that: The specific steps of extracting key features from physiological information are as follows: The heart rate variability Y is obtained by calculating the sum of all heartbeat intervals of the user in a fixed time period and then dividing it by the total number of heartbeat intervals; The skin galvanic response intensity U is obtained by calculating the sum of all skin galvanic response amplitudes of the user within a fixed time period and dividing it by the total number of skin galvanic responses; The blood oxygen saturation change P is obtained by calculating the sum of all blood oxygen saturation measurement values ​​of the user within a fixed time period and dividing it by the total number of blood oxygen saturation measurements.

7. The text narrative guided virtual reality motion sickness monitoring and relief system according to claim 6, characterized in that: The specific steps of judging whether the user has motion sickness symptoms according to the extracted key features are as follows: According to the formula M=(ω1*Y)+(ω2*U)+(ω3*P), the user's motion sickness symptom score M is calculated and obtained; A threshold value of the motion sickness symptom score is set in advance, and if the user's motion sickness symptom score M is greater than the threshold value, it is determined that the user has motion sickness symptoms.

8. The text narrative guided virtual reality motion sickness monitoring and relief system according to claim 7, characterized in that: The specific working steps of the mitigation unit are: ensuring the user's head is stable; Set the brightness and contrast of the VR environment to the lowest values. Pause or slow down motion elements in a VR experience.

9. The text narrative guided virtual reality motion sickness monitoring and relief system according to claim 1, characterized in that: The specific working mode of the personalization unit is as follows: All users are classified according to their usage performance, and those who have never experienced motion sickness are classified into the first category; Users who experienced motion sickness during the first three uses were classified into the second category; The remaining users are divided into the third category; The classification result is used as a personalized solution and transmitted to the text narrative guidance unit.

10. The text narrative guided virtual reality motion sickness monitoring and relief system according to claim 9, characterized in that: The specific working method of the text narrative guidance unit is as follows: For the first type of users, basic guidance is provided in the adaptability monitoring module; In the dynamic adjustment module, the user is notified that the system is fine-tuning the environment settings to optimize the experience; In the mitigation module, preventive suggestions are provided; For the second type of users, general guidance is provided in the adaptability monitoring module; In the dynamic adjustment module, the user is notified that the system is undergoing routine adjustments; In the mitigation module, general recommendations are provided; For the third type of users, advanced guidance is provided in the adaptability monitoring module; In the dynamic adjustment module, clearly inform users that the system will be adjusted based on their feedback; In the Mitigation module, specific strategies for alleviating motion sickness are provided.

Images