A Multisensory Stimulation VR Anti-Motion Sickness Method and Device Based on Physiological Data Monitoring

Abstract

This invention provides a multi-sensory stimulation VR anti-motion sickness method based on physiological data monitoring. The method involves: wearing monitoring and stimulation components to monitor the user's physiological data in real time, and determining the current user state using a personalized motion sickness assessment model / general motion sickness assessment model; calculating the trend of changes in the user's physiological data, and determining whether the user is showing signs of motion sickness based on the current user state and the trend of changes in the user's physiological data; if it is determined that the user is about to experience motion sickness, applying aromatherapy and electronic acupuncture at the Neiguan acupoint with corresponding stimulation intensity to remind the user to stop the VR device experience, and outputting a forced termination message for the VR device experience until the device is shut down; otherwise, applying aromatherapy and electronic acupuncture at the Neiguan acupoint with corresponding stimulation intensity. This invention can effectively alleviate discomfort and extend the user's comfortable experience time without affecting the VR user experience, thus avoiding motion sickness symptoms.

Description

Technical Field

[0001] This invention relates to the field of biosensing and human-computer interaction technology, and more specifically, to a multi-sensory stimulation VR anti-motion sickness method and device based on physiological data monitoring. Background Technology

[0002] Virtual reality motion sickness is one of the key bottlenecks affecting user immersion and the widespread adoption of VR devices. Currently, assessment models based on VR visual content and those based on physiological signals (EEG, ductal electroencephalography, etc.) are the two mainstream methods for assessing VR motion sickness. Among them, the assessment process based on physiological signals requires wearing numerous monitoring devices and restricts the user's limb movements, which seriously affects the user's VR experience. At the same time, existing assessment methods mostly focus on the assessment effect itself, neglecting the issue of how to alleviate motion sickness symptoms after the assessment.

[0003] In terms of alleviating motion sickness, visual interventions are the primary method for reducing VR motion sickness. These interventions include field-of-view manipulation, edge blurring, and gradual transition interactions, all aimed at disrupting the user's line of sight and thus reducing sensory conflict. However, such interventions significantly reduce the user's image quality and visual range, severely impacting the user experience, which contradicts the "immersive" nature of virtual reality.

[0004] Furthermore, statistics show that VR motion sickness has a high incidence rate and causes significant discomfort. The probability of motion sickness occurring in first-time users is approximately 68%, and the proportion experiencing discomfort after 15 minutes of use is 67%, with 50% reaching moderate to severe vertigo. Once a user interrupts their experience due to motion sickness, it typically takes 10 minutes or even several hours for the symptoms to subside. However, current VR applications lack a function to promptly remind users to exit the experience. Users are often forced to stop only when they experience severe dizziness and nausea, and then still need to wait a long time for the symptoms to subside, which greatly affects the usability and user experience of VR. Summary of the Invention

[0005] The purpose of this invention is to overcome the shortcomings and deficiencies of the prior art and provide a multi-sensory stimulation VR anti-motion sickness method and device based on physiological data monitoring. This invention can effectively alleviate discomfort without affecting the VR user experience, effectively prolong the user's comfortable experience time, and promptly remind the user and VR device before the VR user experiences motion sickness, thus avoiding motion sickness symptoms, which is conducive to the application and promotion of various anti-motion sickness scenarios.

[0006] To achieve the above objectives, the present invention is implemented through the following technical solution: a multi-sensory stimulation VR anti-motion sickness method based on physiological data monitoring, characterized in that: In the control system, a user-specific motion sickness assessment model and a general motion sickness assessment model are established. Both the user-specific motion sickness assessment model and the general motion sickness assessment model output the user's status. Wearable monitoring and stimulation components monitor users' physiological data in real time and determine the current user status using a personalized motion sickness assessment model / general motion sickness assessment model. The system calculates the trend of changes in user physiological data and, based on the current user status and the trend of changes in user physiological data, determines whether the user is showing signs of motion sickness. If it is determined that the user is about to experience motion sickness, it applies aromatherapy and Neiguan acupoint electronic acupuncture with corresponding stimulation intensity to remind the user to stop the VR device experience and outputs a forced termination message for the VR device experience until the monitoring and stimulation components are shut down. Otherwise, it applies aromatherapy and Neiguan acupoint electronic acupuncture with corresponding stimulation intensity to extend the user's comfortable experience time while using the VR device as much as possible.

[0007] Specifically, it includes the following steps: The first step is to establish a personalized motion sickness assessment model and a general motion sickness assessment model. Both models use four levels to divide the user's experience zone, outputting: extremely comfortable zone, comfortable zone, mild discomfort zone, or motion sickness occurrence zone. Simultaneously, both models output the user's VR device experience status: static VR device experience or dynamic VR device experience. Each personalized motion sickness assessment model is associated with a corresponding user skin conductance characteristic value tuple. The second step involves wearing monitoring and stimulation components to acquire real-time user skin conductance data and real-time user pulse data, and calculating the user's skin conductance characteristic value. Based on this characteristic value, user information is confirmed: if the characteristic value exists within a user skin conductance characteristic value tuple, the personalized motion sickness assessment model corresponding to that tuple is used to execute the third step; otherwise, a general motion sickness assessment model is used. After the user's VR device experience ends, a personalized motion sickness assessment model is established for the new user, and the third step is executed. The third step is to input the real-time user skin conductance data and real-time user pulse data into the user's personalized motion sickness assessment model / general motion sickness assessment model to determine whether the current user is experiencing a static VR device or a dynamic VR device, and then determine the experience zone in which the current user is located. The fourth step is to calculate the real-time changes in user skin conductance data to determine the current trend of user status. Fifth, determine whether there is a jump in the current user status based on the current user status's experience zone: if the current user status crosses experience zones, it is determined that the current user status has jumped, and the current user status's experience zone is further determined by the real-time user skin charge data over subsequent time, and then proceed to the sixth step; otherwise, proceed to the sixth step. Step 6: Implement anti-motion sickness stimulation based on the user's current experience zone and the current trend of the user's status. If the user is currently in the extremely comfortable zone, the comfortable zone, or the slightly uncomfortable zone, apply aromatherapy and electronic acupuncture at the Neiguan acupoint with the corresponding stimulation intensity to the user to prolong the comfortable experience time when using the VR device; and then return to step three. If the current user's experience zone is a motion sickness zone, then aromatherapy and electronic acupuncture at the Neiguan acupoint with corresponding stimulation intensity will be applied to the user to relieve motion sickness symptoms and remind the user to force disconnection; at the same time, a message to force termination of the VR device experience will be output until the monitoring and stimulation components are shut down. If the set experience time is reached, the system will use aromatherapy with corresponding stimulation intensity and electronic acupuncture at the Neiguan acupoint to remind the user to log off; at the same time, it will output a message to force the termination of the VR device experience until the monitoring and stimulation components are shut down.

[0008] Furthermore, in the second step, the real-time user skin conductance data is obtained as follows: minimum skin conductance response per second (SCR_min), maximum skin conductance response per second (SCR_max), average skin conductance response per second (SCR_mean), standard deviation of skin conductance response per second (SCR_std), minimum skin conductance level per second (SCL_min), maximum skin conductance level per second (SCL_max), average skin conductance level per second (SCL_mean), and standard deviation of skin conductance level per second (SCL_std). The term "obtaining the user's skin conductance characteristic value through calculation" refers to: Starting from the 30th second, for the current second n, with a smoothing window of 10 seconds, calculate the arithmetic mean of the average skin conductance level SCL_mean within the window, and use it as the user's skin conductance characteristic value at second n: Char_SCL_n=(SCL_mean_n-9+SCL_mean_n-8+…+ SCL_mean_n) / 10; where, n ≥ 30; The system monitors five Char_SCL values ​​calculated over five consecutive seconds in real time and determines whether these five values ​​fluctuate within three standard deviations. If so, it calculates the average of the five consecutive Char_SCL values, uses this average as the user's skin conductance characteristic value, and terminates the subsequent Char_SCL calculation and judgment process. Otherwise, it continues to slide to the next second and repeats the above calculation until the user's skin conductance characteristic value is obtained.

[0009] Furthermore, in the second step, when confirming user information based on the user's skin conductance characteristic value, if the user's skin conductance characteristic value exists in at least one user skin conductance characteristic value tuple, then it is further determined whether the user's skin conductance characteristic value exists in only one user skin conductance characteristic value tuple: if so, then the user-personalized motion sickness assessment model corresponding to the user skin conductance characteristic value tuple is used to execute the third step; if not, then the user-personalized motion sickness assessment model corresponding to the user skin conductance characteristic value tuple that is closest to the user's skin conductance characteristic value is selected to execute the third step.

[0010] Furthermore, in the fourth step, calculating the real-time user skin conductance data change value to determine the current user status trend means: using the SCR amplitude SCR_scop_n at the time n when the Char_SCL user skin conductance characteristic value is determined as the baseline SCR_scop_base; Wherein, SCR_scop_n = SCR_max_n - SCR_min_n; If the SCR amplitude at the current time t is SCR_scop_t / SCR_scop_base ≥ 1.5, then the current user state is determined to be characterized by intense fluctuations; otherwise, the current user state is determined to be characterized by relatively stable fluctuations.

[0011] To elaborate further, in step five, the current user state exhibiting a cross-experience zone phenomenon refers to one of the following situations: Upgrade directly from the extremely comfortable zone to the slightly uncomfortable zone or the zone where motion sickness occurs; From the comfort zone to the motion sickness zone; Downgrade directly from the mild discomfort zone to the comfort zone or extreme comfort zone.

[0012] Furthermore, in the fifth step, if it is determined that there is a change in the current user state, then the experience zone of the current user state is further determined by the real-time user skin conductance data in the subsequent time. This means: wait for 2 seconds, obtain three user skin conductance data points for the current second and the next two seconds, and take the user skin conductance data that appears at least twice and compare it with the pre-recorded user physiological data of the user personalized motion sickness assessment model to determine the experience zone of the current user state.

[0013] Furthermore, after the monitoring and stimulation components are shut down, the SSQ questionnaire is used to obtain the user's feedback data on the VR device experience and / or personal preference data. Based on the user's feedback data and / or personal preference data, the personalized motion sickness assessment model for the user is updated.

[0014] Furthermore, in the second step, after the monitoring and stimulation components are worn, a power-on test is performed on the components and the control system. If any abnormality is detected, an alarm is issued and operation is terminated.

[0015] A multi-sensory stimulation VR anti-motion sickness device based on physiological data monitoring is characterized by comprising a wearable monitoring and stimulation component, an edge computing and control module, and a central computing module; the wearable monitoring and stimulation component includes a hand skin conductance and electronic acupuncture module and an aromatherapy ear hook module; the hand skin conductance and electronic acupuncture module and the aromatherapy ear hook module are respectively connected to the edge computing and control module, and the edge computing and control module is connected to the central computing module; The hand skin conductance and electronic acupuncture module includes a system detection and control submodule 1, and skin conductance detection submodule, electronic acupuncture submodule, storage submodule 1, power supply submodule 1, communication submodule 1, alarm submodule 1 and pulse detection submodule 1, which are respectively connected to the system detection and control submodule 1. The aromatherapy ear hook module includes a system detection and control submodule 2, as well as an aromatherapy control submodule, a power supply submodule 2, and a communication submodule 2, which are respectively connected to the system detection and control submodule 2. The edge computing and control module includes a computing and control submodule, as well as a power supply submodule III, a communication submodule III, an alarm submodule III, a storage submodule III, and a user feedback submodule, all of which are connected to the computing and control submodule.

[0016] This invention designs a multi-sensory stimulation VR anti-motion sickness device based on physiological data monitoring. The anti-motion sickness method of this device is to determine the user's current experience zone by monitoring the user's skin conductance data in real time, and based on the trend of the user's skin conductance data and the experience zone, it uses aromatherapy release and Neiguan acupoint electronic acupuncture with corresponding stimulation intensities to extend the time the user is in the extremely comfortable zone, comfortable zone and slightly uncomfortable zone when experiencing VR equipment. Moreover, when it is determined that the customer has entered the motion sickness zone, the device will notify the user and VR equipment immediately to terminate the VR experience.

[0017] The advantages of this invention are: This invention addresses VR motion sickness. Based on the traditional Chinese medicine concept of "prevention is better than cure," a personalized motion sickness assessment model is established. Using the user's skin conductance data, corresponding stimulation methods—aromatherapy and electronic acupuncture—are employed without affecting the user's VR device experience, effectively extending the comfortable VR device experience duration. Simultaneously, before motion sickness symptoms occur, strong stimulation (current and frequency) is used to remind the user to exit the VR device, or a signal to terminate the VR device experience is provided through a third-party interface. This both extends the comfortable VR device experience time and effectively prevents severe motion sickness.

[0018] Meanwhile, from the perspective of user experience, the product conforms to user habits, does not affect the wearing of VR devices, and does not restrict the user's posture and movements. Moreover, it relies on intelligent control throughout the interaction process to minimize user operations and avoid disturbing the user's immersive experience on the VR device.

[0019] Compared with the prior art, the present invention has the following advantages and beneficial effects: The multi-sensory stimulation VR anti-motion sickness method and device based on physiological data monitoring can effectively alleviate discomfort without affecting the VR user experience, effectively prolong the user's comfortable experience time, and promptly remind the user and VR device before the VR user experiences motion sickness, thus avoiding motion sickness symptoms, which is conducive to the application and promotion of various anti-motion sickness scenarios. Attached Figure Description

[0020] Figure 1 This is a system architecture diagram of the device used in the multi-sensory stimulation VR anti-motion sickness method based on physiological data monitoring according to the present invention; Figure 2 This is a diagram illustrating the use of a hand-based electrodermal transfer and electronic acupuncture module. Figure 1 ; Figure 3 This is a diagram illustrating the use of a hand-based electrodermal transfer and electronic acupuncture module. Figure 2 ; Figure 4 This is a diagram illustrating how the aromatherapy ear hook module is clipped onto the headband of VR glasses. Figure 5 This is a diagram illustrating how the aromatherapy ear hook module is worn directly on the ear. Figure 6 This is a flowchart of the operation during the equipment startup preparation phase; Figure 7 This is a flowchart for confirming user information; Figure 8 It is an operation flowchart of the device during its operation phase; Figure 9 This is a flowchart of the operation during the post-shutdown processing phase of the device; Among them, 1 is the hand skin conductance and electronic acupuncture module, 1-1 is the skin conductance detection submodule, 1-2 is the electronic acupuncture submodule, 1-3 is the storage submodule one, 1-4 is the power supply submodule one, 1-5 is the system detection and control submodule one, 1-6 is the communication submodule one, 1-7 is the alarm submodule one, 1-8 is the pulse detection submodule, 2 is the aromatherapy ear hook module, 2-1 is the aromatherapy control submodule, 2-2 is the system detection and control submodule two, 2-3 is the power supply submodule two, 2-4 is the communication submodule two, 3 is the edge computing and control module, 3-1 is the power supply submodule three, 3-2 is the computing and control submodule, 3-3 is the communication submodule three, 3-4 is the alarm submodule three, 3-5 is the storage submodule three, and 3-6 is the user feedback submodule. Detailed Implementation

[0021] The present invention will now be described in further detail with reference to the accompanying drawings and specific embodiments.

[0022] Example

[0023] like Figures 1 to 9 As shown, the device used in the multi-sensory stimulation VR anti-motion sickness method based on physiological data monitoring of the present invention includes a wearable monitoring and stimulation component, an edge computing and control module 3, and a central computing module 4. The wearable monitoring and stimulation component includes a hand skin conductance and electronic acupuncture module 1 and an aromatherapy ear hook module 2. These two modules are connected to the edge computing and control module 3, which in turn is connected to the central computing module 4. Specifically, the hand skin conductance and electronic acupuncture module 1 includes a system detection and control submodule 1-5, and skin conductance detection submodule 1-1, electronic acupuncture submodule 1-2, storage submodule 1-3, power supply submodule 1-4, communication submodule 1-6, alarm submodule 1-7, and pulse detection submodule 1-8, all connected to the system detection and control submodule 1-5. The aromatherapy ear hook module 2 includes a system detection and control submodule 2-2, and aromatherapy control submodule 2-1, power supply submodule 2-3, and communication submodule 2-4, which are respectively connected to the system detection and control submodule 2-2. The edge computing and control module 3 includes a computing and control submodule 3-2, and power supply submodule 3-1, communication submodule 3-3, alarm submodule 3-4, storage submodule 3-5, and user feedback submodule 3-6, which are respectively connected to the computing and control submodule 3-2.

[0024] Specifically: (1) The hand skin conductance and electronic acupuncture module 1 can monitor the user's physiological data (real-time user skin conductance data and real-time user pulse data) in real time and upload them to the edge computing and control module 3. At the same time, it can receive control commands issued by the edge computing and control module 3, adjust the current, frequency, pulse width and other parameters of the electronic acupuncture sub-modules 1-2, and complete the real-time adjustment of stimulation intensity according to the user's skin conductance data.

[0025] (2) The aromatherapy ear hook module 2 receives control commands from the edge computing and control module 3 to control the heating intensity and adjust the aroma diffusion speed; such as Figure 4 and Figure 5 As shown, the aromatherapy ear hook module 2 has two wearing modes: one is to physically clip it onto the headband of the VR glasses, and the other is to hang it directly on the ear. The latter method can also be used in non-VR scenarios such as motion sickness prevention, where the user simply hangs the aromatherapy ear hook module on their ear.

[0026] (3) The edge computing and control module 3 can be integrated into a smartphone or tablet in the form of an APP, or a hardware terminal can be customized in the form of a microcontroller + storage + battery + Bluetooth (or WiFi). However, since the edge computing and control module 3 has a large amount of computing power, it is necessary to judge the user's experience range in real time. It also involves the user's experience feedback survey after the VR device experience is completed and the update and learning of the user's personalized motion sickness judgment model. Therefore, the APP form is the preferred choice.

[0027] (4) Remote data center server: mainly deploys the central computing module, which receives user samples and updates the general motion sickness assessment model through a deep learning model. It should be noted that if the user authorizes it, it is more appropriate to place the update learning of the user's personalized motion sickness assessment model in the central computing module. If the user does not authorize it, the update learning of the user's personalized motion sickness assessment model is carried out on the APP.

[0028] The present invention provides a multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring, as follows: In the edge computing and control module 3, a user-personalized motion sickness assessment model and a general motion sickness assessment model are established. Both the user-personalized motion sickness assessment model and the general motion sickness assessment model output the user's status. Wearing the hand skin conductance and electronic acupuncture module 1 and the aromatherapy ear hook module 2, the system monitors the user's physiological data in real time and determines the current user status through a personalized motion sickness assessment model / general motion sickness assessment model. It calculates the trend of changes in the user's physiological data and, based on the current user status and the trend of changes in the user's physiological data, determines whether the user is showing signs of motion sickness. If motion sickness is detected as imminent, the system applies aromatherapy release and Neiguan acupoint electronic acupuncture with corresponding stimulation intensity to remind the user to stop the VR device experience and outputs a forced termination message for the VR device experience until the monitoring and stimulation components are shut down. Otherwise, the system applies aromatherapy release and Neiguan acupoint electronic acupuncture with corresponding stimulation intensity to extend the user's comfortable experience time while using the VR device.

[0029] Specifically, it includes the following steps: The first step is to establish a personalized motion sickness assessment model and a general motion sickness assessment model. Both models use four levels to divide the user's experience zone, outputting: extremely comfortable zone, comfortable zone, mild discomfort zone, or motion sickness occurrence zone. Simultaneously, both models output the user's VR device experience status: static VR device experience or dynamic VR device experience. Each personalized motion sickness assessment model is associated with a corresponding user skin conductance characteristic value tuple.

[0030] The second step involves wearing the hand skin conductance and electronic acupuncture module 1 and the aromatherapy ear hook module 2 to acquire real-time user skin conductance data and real-time user pulse data, and calculating the user's skin conductance characteristic value. Based on the user's skin conductance characteristic value, the user information is confirmed: if the user's skin conductance characteristic value exists in the user skin conductance characteristic value tuple, then the user's personalized motion sickness assessment model corresponding to the user's skin conductance characteristic value tuple is used to execute the third step; otherwise, a general motion sickness assessment model is used, and a user's personalized motion sickness assessment model is established after the user's VR device experience ends, and the third step is executed.

[0031] This invention performs power-on checks on the hand skin conductance and electronic acupuncture module 1 and the aromatherapy ear hook module 2, as well as the edge computing and control module 3. If any abnormality is detected, an alarm is issued and operation is terminated. Specifically, as follows... Figure 6 As shown: I. Operational procedures during the equipment startup preparation phase: I-1: Wear the hand skin conductance and electronic acupuncture module 1 and the aromatherapy ear hook module 2. Only in this way can the data of the skin conductance detection submodule 1-1 be obtained, and whether the data is normal be determined. Based on the data, the user's identity can be further determined: whether the user is a new user or an old user.

[0032] I-3: System anomalies include: Hardware status anomalies: abnormal feedback from related modules, abnormal system interruptions, etc.; Abnormal hardware usage status: Power submodule 1-4 or power submodule 2-3 has insufficient power, skin conductance detection submodule 1-1 or storage submodule 1-3 has no detection data, aromatherapy liquid in aromatherapy control submodule 2-1 is insufficient, etc. I-6: The recommended frequency range for using skin conductance data is 1Hz-10Hz. Generally, a frequency of 5Hz is used.

[0033] The real-time user skin conductance data obtained includes: minimum skin conductance response per second (SCR_min), maximum skin conductance response per second (SCR_max), average skin conductance response per second (SCR_mean), standard deviation of skin conductance response per second (SCR_std), minimum skin conductance level per second (SCL_min), maximum skin conductance level per second (SCL_max), average skin conductance level per second (SCL_mean), and standard deviation of skin conductance level per second (SCL_std).

[0034] Edge computing and control module 3 uses the following algorithm to obtain the user's skin conductance characteristic value: Starting from the 30th second, for the current second n, with a smoothing window of 10 seconds, calculate the arithmetic mean of the average skin conductance level SCL_mean within the window, and use it as the user's skin conductance characteristic value at second n: Char_SCL_n=(SCL_mean_n-9+SCL_mean_n-8+…+ SCL_mean_n) / 10; where, n ≥ 30; The system monitors five Char_SCL values ​​calculated over five consecutive seconds in real time and determines whether these five values ​​fluctuate within three standard deviations. If so, it calculates the average of the five consecutive Char_SCL values, uses this average as the user's skin conductance characteristic value, and terminates the subsequent Char_SCL calculation and judgment process. Otherwise, it continues to slide to the next second and repeats the above calculation until the user's skin conductance characteristic value is obtained.

[0035] The I-8 confirmation of user information is determined according to the following logic: Figure 8 As shown: If the user's skin conductance characteristic value exists in at least one user skin conductance characteristic value tuple, then it is further determined whether the user's skin conductance characteristic value exists in only one user skin conductance characteristic value tuple: if yes, then the user-personalized motion sickness assessment model corresponding to the user skin conductance characteristic value tuple is used to execute the third step; if no, then the user-personalized motion sickness assessment model corresponding to the user skin conductance characteristic value tuple that is closest to the user's skin conductance characteristic value is selected to execute the third step.

[0036] The third step involves inputting real-time user skin conductance data and real-time user pulse data into the user's personalized motion sickness assessment model / general motion sickness assessment model, respectively, to determine whether the current user is experiencing a static or dynamic VR device, and then to determine the current user's experience zone.

[0037] The fourth step is to calculate the real-time changes in user skin charge data to determine the current trend of user status.

[0038] The fifth step is to determine whether there is a jump in the current user status based on the current user status's experience zone: if the current user status crosses experience zones, it is determined that there is a jump in the current user status, and the current user status's experience zone is further determined by the real-time user skin charge data over subsequent time, and then proceed to the sixth step; otherwise, proceed to the sixth step.

[0039] Step 6: Implement anti-motion sickness stimulation based on the user's current experience zone and the current trend of the user's status. If the user is currently in the extremely comfortable zone, the comfortable zone, or the slightly uncomfortable zone, apply aromatherapy and electronic acupuncture at the Neiguan acupoint with the corresponding stimulation intensity to the user to prolong the comfortable experience time when using the VR device; and then return to step three. If the current user's experience zone is a motion sickness zone, then aromatherapy and electronic acupuncture at the Neiguan acupoint with corresponding stimulation intensity will be applied to the user to relieve motion sickness symptoms and remind the user to force disconnection; at the same time, a message to force termination of the VR device experience will be output until the monitoring and stimulation components are shut down. If the set experience time is reached, the system will use aromatherapy with corresponding stimulation intensity and electronic acupuncture at the Neiguan acupoint to remind the user to log off; at the same time, it will output a message to force the termination of the VR device experience until the monitoring and stimulation components are shut down.

[0040] Specifically, such as Figure 8 As shown, the operation flow of Phase II is as follows: II-1: Send real-time user skin conductance data and real-time user pulse data to the user's personalized motion sickness assessment model / general motion sickness assessment model. The model will output the user's current state in real time. Because the user's pulse data is available, it is more helpful to determine whether the user is experiencing a static or dynamic VR device, which can improve the accuracy of the assessment model.

[0041] II-2: Calculate the real-time user skin conductance data change value to determine the current user status trend: use the SCR amplitude SCR_scop_n at the time n to determine the Char_SCL user skin conductance characteristic value as the benchmark SCR_scop_base; Wherein, SCR_scop_n = SCR_max_n - SCR_min_n; If the SCR amplitude at the current time t is SCR_scop_t / SCR_scop_base ≥ 1.5, then the current user state is determined to be characterized by intense fluctuations; otherwise, the current user state is determined to be characterized by relatively stable fluctuations.

[0042] The internal logic is that when the value is greater than 1.5, it means that the current moment has been subjected to a large amount of motion sickness stimulation, and the body will accumulate corresponding motion sickness symptoms in the next 1-3 seconds.

[0043] II-3: Does the user's state change abruptly? From the perspective of the user's VR device experience, each user state gradually accumulates from the "extremely comfortable zone" to the "comfort zone," then to the "slight discomfort zone," and finally to the "motion sickness zone." Therefore, when a user directly upgrades from the "extremely comfortable zone" to the "slight discomfort zone" or "motion sickness zone"; or directly upgrades from the "comfort zone" to the "motion sickness zone"; or directly downgrades from the "slight discomfort zone" to the "comfort zone" or "extremely comfortable zone," these scenarios all constitute a user state change. The main reasons for user state changes are: Users may make physical movements when using VR devices, which can affect the accuracy of the skin conductance sensor. The motion sickness assessment model for users also has an assessment error of about 10%; Therefore, it is determined that there is a change in the current user state, and the process enters II-9. The user state is determined by the user state data for 3 consecutive seconds. Specifically, wait for 2 seconds, obtain three user skin conductance data points for the current second and the next two seconds, and take the user skin conductance data that appears at least twice. Compare it with the pre-recorded user physiological data of the user's personalized motion sickness judgment model to determine the experience zone in which the current user state is located.

[0044] II-4: The low, medium, and high-end aromatherapy products mainly control the evaporation rate of the aromatherapy. Since aromatherapy ear loops are sensitive to weight, based on practice, it is recommended to use essential oils with a content of more than 40%.

[0045] The parameters for electroacupuncture are as follows: 0.2-second stimulation, 0.3-second interval, pulse width of 0.5 milliseconds, pulse frequency of 100Hz, and current amplitude of 2-10 mA. Low setting: 2 mA; Medium setting: 4 mA; High setting: 8 mA; Extra-high setting: 10 mA, 0.3-second stimulation, 0.2-second interval. When using the extra-high electroacupuncture setting, the increased stimulation current and duration effectively remind the user to terminate the VR experience as soon as possible.

[0046]

[0047] II-5: The t0 time in the process is the default maximum experience time for a VR device. The system default is 15 minutes, which users can adjust according to their actual situation. It is recommended not to exceed 20 minutes.

[0048] II-6: It should be noted that while reminding users to force offline, it is recommended that users continue to use this system. That is to say, after the customer terminates the VR device experience, continue to use this system to alleviate motion sickness symptoms until the customer enters the "comfort zone" or "extreme comfort zone" before proceeding to the subsequent III shutdown post-processing stage.

[0049] After the monitoring and stimulation components are turned off, this invention uses an SSQ questionnaire to obtain the user's feedback data on the VR device experience and / or personal preference data, and updates the user-personalized motion sickness assessment model based on the user's feedback data and / or personal preference data.

[0050] The specific operation flow of the III post-shutdown processing stage is as follows: Figure 9 As shown: III-2: Based on the SSQ questionnaire, user personal preference data can be added, such as personal favorite aromatherapy fragrances, feelings about the intensity of electroacupuncture current, and the longest personal T0 VR experience duration.

[0051] III-4: Data upload to the central computing module 4 is only permitted with user authorization. Optionally, once user authorization is obtained, III-3 will be suggested to be completed by the central computing module 4. Otherwise, III-3 will be completed by the edge computing and control module 3 (APP).

[0052] The establishment of the general motion sickness assessment model and the user-personalized motion sickness assessment model of this invention is as follows: In the initial application phase, users were divided into six age groups: 11-20 years old, 21-30 years old, 31-40 years old, 41-50 years old, 51-60 years old, and over 60 years old. Real-time skin conductance data was monitored using VR devices, and motion sickness experience data from over 100 people in each age group was immediately obtained using the SSQ (Simulated Disease Questionnaire). A general motion sickness assessment model was trained using ALSTM-FCN deep learning, resulting in well-trained general motion sickness assessment models for each age group. Personalized motion sickness assessment models for individual users were also trained using the ALSTM-FCN deep learning model.

[0053] During user usage, after each user completes the VR device experience using the device of this invention, the APP will promptly use the SSQ (Simulator Sickness Questionnaire) to obtain the user's feedback on the VR device experience. Based on the user's feedback data, the APP will update the user's personalized motion sickness assessment model using the ALSTM-FCN model. Optionally, with the user's authorization and consent, the user's feedback data can also be combined with skin conductance data and pulse data and fed back to the data center where the central computing module 4 is deployed for unified sample training, and the general motion sickness assessment model can be updated using the ALSTM-FCN model.

[0054] The above embodiments are preferred embodiments of the present invention, but the embodiments of the present invention are not limited to the above embodiments. Any changes, modifications, substitutions, combinations, or simplifications made without departing from the spirit and principle of the present invention shall be considered equivalent substitutions and shall be included within the protection scope of the present invention.

Claims

1. A multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring, characterized in that: In the control system, a user-specific motion sickness assessment model and a general motion sickness assessment model are established. Both the user-specific motion sickness assessment model and the general motion sickness assessment model output the user's status. Wearable monitoring and stimulation components monitor users' physiological data in real time and determine the current user status through a personalized motion sickness assessment model / general motion sickness assessment model; Calculate the trend of changes in the user's physiological data, and determine whether the user is prone to motion sickness based on the current user status and the trend of changes in the user's physiological data: if it is determined that the user is about to experience motion sickness, apply aromatherapy release and Neiguan acupoint electronic acupuncture with corresponding stimulation intensity to remind the user to stop the VR device experience, and output a forced termination message for the VR device experience until the monitoring and stimulation components are shut down; otherwise, apply aromatherapy release and Neiguan acupoint electronic acupuncture with corresponding stimulation intensity to extend the user's comfortable experience time when using the VR device as much as possible.

2. The multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring according to claim 1, characterized in that: Includes the following steps: The first step is to establish a personalized motion sickness assessment model and a general motion sickness assessment model. Both models use four levels to divide the user's experience zone, outputting: extremely comfortable zone, comfortable zone, mild discomfort zone, or motion sickness occurrence zone. Simultaneously, both models output the user's VR device experience status: static VR device experience or dynamic VR device experience. Each personalized motion sickness assessment model is associated with a corresponding user skin conductance characteristic value tuple. The second step involves wearing monitoring and stimulation components to acquire real-time user skin conductance data and real-time user pulse data, and calculating the user's skin conductance characteristic value. Based on this characteristic value, user information is confirmed: if the characteristic value exists within a user skin conductance characteristic value tuple, the personalized motion sickness assessment model corresponding to that tuple is used to execute the third step; otherwise, a general motion sickness assessment model is used, and a personalized motion sickness assessment model is established for the new user after the VR device experience ends, before executing the third step. The third step is to input the real-time user skin conductance data and real-time user pulse data into the user's personalized motion sickness assessment model / general motion sickness assessment model to determine whether the current user is experiencing a static VR device or a dynamic VR device, and then determine the experience zone in which the current user is located. The fourth step is to calculate the real-time changes in user skin conductance data to determine the current trend of user status. Fifth, determine whether there is a jump in the current user status based on the current user status's experience zone: if the current user status crosses experience zones, it is determined that the current user status has jumped, and the current user status's experience zone is further determined by the real-time user skin charge data over subsequent time, and then proceed to the sixth step; otherwise, proceed to the sixth step. Step 6: Implement anti-motion sickness stimulation based on the user's current experience zone and the current trend of the user's status. If the user is currently in the extremely comfortable zone, the comfortable zone, or the slightly uncomfortable zone, apply aromatherapy and electronic acupuncture at the Neiguan acupoint with the corresponding stimulation intensity to the user to prolong the comfortable experience time when using the VR device; and then return to step three. If the current user's experience zone is a motion sickness zone, then aromatherapy and electronic acupuncture at the Neiguan acupoint with corresponding stimulation intensity will be applied to the user to relieve motion sickness symptoms and remind the user to force disconnection; at the same time, a message to force termination of the VR device experience will be output until the monitoring and stimulation components are shut down. If the set experience time is reached, the system will use aromatherapy with corresponding stimulation intensity and electronic acupuncture at the Neiguan acupoint to remind the user to log off; at the same time, it will output a message to force the termination of the VR device experience until the monitoring and stimulation components are shut down.

3. The multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring according to claim 2, characterized in that: In the second step, the real-time user skin conductance data are obtained as follows: minimum skin conductance response per second (SCR_min), maximum skin conductance response per second (SCR_max), average skin conductance response per second (SCR_mean), standard deviation of skin conductance response per second (SCR_std), minimum skin conductance level per second (SCL_min), maximum skin conductance level per second (SCL_max), average skin conductance level per second (SCL_mean), and standard deviation of skin conductance level per second (SCL_std). The term "obtaining the user's skin conductance characteristic value through calculation" refers to: Starting from the 30th second, for the current second n, with a smoothing window of 10 seconds, calculate the arithmetic mean of the average skin conductance level SCL_mean within the window, and use it as the user's skin conductance characteristic value at second n: Char_SCL_n=(SCL_mean_n-9+SCL_mean_n-8+…+ SCL_mean_n) / 10; where, n ≥ 30; The system monitors five Char_SCL values ​​calculated over five consecutive seconds in real time. If the five values ​​fluctuate within three standard deviations, the system calculates the average of the five consecutive Char_SCL values ​​and uses this average as the user's skin conductance characteristic value, then terminates the subsequent Char_SCL calculation and judgment process. Otherwise, the system continues to slide to the next second and repeats the above calculation until the user's skin conductance characteristic value is obtained.

4. The multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring according to claim 2, characterized in that: In the second step, when confirming user information based on the user's skin conductance characteristic value, if the user's skin conductance characteristic value exists in at least one user skin conductance characteristic value tuple, then it is further determined whether the user's skin conductance characteristic value exists in only one user skin conductance characteristic value tuple: if yes, then the user-personalized motion sickness assessment model corresponding to the user skin conductance characteristic value tuple is used to execute the third step; if no, then the user-personalized motion sickness assessment model corresponding to the user skin conductance characteristic value tuple that is closest to the user's skin conductance characteristic value is selected to execute the third step.

5. The multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring according to claim 3, characterized in that: In the fourth step, calculating the real-time user skin conductance data change value to determine the current user status trend means: using the SCR amplitude SCR_scop_n at the time n when the Char_SCL user skin conductance characteristic value is determined as the benchmark SCR_scop_base; Wherein, SCR_scop_n = SCR_max_n - SCR_min_n; If the SCR amplitude at the current time t is SCR_scop_t / SCR_scop_base ≥ 1.5, then the current user state is determined to be characterized by intense fluctuations; otherwise, the current user state is determined to be characterized by relatively stable fluctuations.

6. The multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring according to claim 2, characterized in that: In step five, the current user state exhibiting a cross-experience zone phenomenon refers to one of the following situations: Upgrade directly from the extremely comfortable zone to the mild discomfort zone or the zone where motion sickness occurs; From the comfort zone to the motion sickness zone; Downgrade directly from the mild discomfort zone to the comfort zone or extreme comfort zone.

7. The multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring according to claim 2, characterized in that: In the fifth step, if it is determined that there is a change in the current user state, the experience zone of the current user state is further determined by the real-time user skin conductance data in the following time. This means: wait for 2 seconds, obtain three user skin conductance data points for the current second and the next two seconds, and take the user skin conductance data that appears at least twice and compare it with the pre-recorded user physiological data of the user personalized motion sickness assessment model to determine the experience zone of the current user state.

8. The multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring according to claim 2, characterized in that: After the monitoring and stimulation components are shut down, the SSQ questionnaire is used to obtain the user's feedback data on the VR device experience and / or personal preference data. Based on the user's feedback data and / or personal preference data, the personalized motion sickness assessment model for the user is updated.

9. The multi-sensory stimulation VR motion sickness prevention method based on physiological data monitoring according to claim 2, characterized in that: In the second step, after the monitoring and stimulation components are worn, a power-on test is performed on the components and the control system. If any abnormality is detected, an alarm is issued and operation is terminated.

10. A multi-sensory stimulation VR motion sickness prevention device based on physiological data monitoring, characterized in that: It includes a wearable monitoring and stimulation component, an edge computing and control module, and a central computing module; the wearable monitoring and stimulation component includes a hand skin conductance and electronic acupuncture module and an aromatherapy ear hook module; the hand skin conductance and electronic acupuncture module and the aromatherapy ear hook module are respectively connected to the edge computing and control module, and the edge computing and control module is connected to the central computing module; The hand skin conductance and electronic acupuncture module includes a system detection and control submodule 1, and skin conductance detection submodule, electronic acupuncture submodule, storage submodule 1, power supply submodule 1, communication submodule 1, alarm submodule 1 and pulse detection submodule 1, which are respectively connected to the system detection and control submodule 1. The aromatherapy ear hook module includes a system detection and control submodule 2, as well as an aromatherapy control submodule, a power supply submodule 2, and a communication submodule 2, which are respectively connected to the system detection and control submodule 2. The edge computing and control module includes a computing and control submodule, as well as a power supply submodule III, a communication submodule III, an alarm submodule III, a storage submodule III, and a user feedback submodule, all of which are connected to the computing and control submodule.

Images