VR simulation experience operation and maintenance system for theme park

Abstract

The invention discloses a VR simulation experience operation and maintenance system for a theme park, and relates to the technical field of virtual simulation, in particular to a theme park simulation system composed of VR head display equipment, a motion capture sensor, a physiological monitoring module, a central processing unit and a scene database. Through identity verification of multi-modal biological feature fusion, it is ensured that only authorized tourists can participate, meanwhile, the difficulty is dynamically adjusted according to the performance of the tourists, each tourist can obtain personalized experience suitable for the level and interest of the tourist, the physiological data of the tourists are monitored in real time, and if the heart rate is abnormal, gradual load reduction measures are adopted in time, and the user experience is improved. Comprising the steps of reducing rendering complexity, starting an optical filter and a tactile feedback prompt, forcibly exiting when necessary, ensuring physical and psychological safety of tourists to the greatest extent, improving data reading and processing speed through a hierarchical storage architecture of a scene database and a heterogeneous computing architecture of a central processing unit, optimizing system resource utilization, and improving system performance. And smooth operation in a complex scene can be ensured.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of virtual simulation, in particular to a VR simulation experience operation and maintenance system for theme parks. BACKGROUND

[0002] Virtual reality technology is a computer-simulated interactive three-dimensional virtual environment that users can experience by wearing VR headsets. It uses computers to generate realistic three-dimensional scenes and objects, making users feel as if they are there. In the field of operation and maintenance, VR technology can be used to create virtual operation and maintenance scenarios, allowing operators to perform remote monitoring, fault diagnosis and maintenance operations. Its key technologies include digital twin modeling technology, immersive virtual reality technology, multi-person collaboration technology and remote control technology.

[0003] The existing technology has the following problems:

[0004] 1. Each visitor has different preferences and needs, and meeting the individual experience needs of visitors of different ages and cultural backgrounds is a major challenge for VR technology in theme parks.

[0005] 2. To provide visitors with a more realistic immersive experience, the interactivity of VR technology needs to be continuously improved. SUMMARY

[0006] The present application provides a VR simulation experience operation and maintenance system for theme parks to solve the problems raised in the background technology.

[0007] To solve the above technical problems, the technical solution adopted by the present application is:

[0008] A VR simulation experience operation and maintenance system for theme parks, comprising a VR headset device, a motion capture sensor, a physiological monitoring module, a central processing unit and a scene database theme park simulation system, characterized by the following steps:

[0009] The visitor wears a VR device, wherein the VR device is equipped with high-precision sensors that can collect the visitor's position, posture, motion and physiological data such as heart rate and pupil changes in real time;

[0010] Identity recognition and permission verification, which includes at least one of fingerprint recognition, facial recognition or password verification, to ensure the legality and security of the visitor's identity;

[0011] If the verification is passed, load the theme scene library, wherein the scene data matching the theme park scene selected by the visitor is loaded from the pre-stored theme scene library;

[0012] Physical space calibration is performed, wherein the position and posture of the visitor in the real physical space are accurately determined by using the positioning system and environmental perception technology of the VR device, so as to realize accurate matching of the virtual scene and the real space;

[0013] Multi-modal interaction is started, wherein the visitor can interact with the virtual scene through gestures, voice, touch and other modes, thereby enhancing the immersive experience;

[0014] Rendering is performed through a real-time rendering engine, wherein a view frustum culling algorithm based on WebGL is used to improve the frame rate;

[0015] Dynamic difficulty algorithm is used to adjust the experience, including collecting user behavior data, calculating performance scores, updating difficulty parameters, reorganizing scene elements and optimizing frame rate compensation;

[0016] Visitor physiological data is monitored, and an emergency exit protocol is started if an abnormality occurs, which is used to monitor the physiological data of the visitor in real time, and if an abnormal condition such as high heart rate or rapid pupil change is detected, the emergency exit protocol is immediately started to ensure the safety of the visitor.

[0017] The further improvement of the technical scheme of the present application is that the dynamic difficulty algorithm is used to adjust the experience, including the following steps:

[0018] Visitor behavior data such as task completion time, error rate and operation frequency is collected;

[0019] The performance score of the visitor is calculated according to the preset rules;

[0020] The difficulty parameter is updated according to the performance score, and the adjustment of the difficulty parameter uses a smoothing coefficient for control, and the range of the smoothing coefficient is 0.8-0.95;

[0021] Scene elements are reorganized according to the updated difficulty parameter, including the complexity of the scene and the difficulty of the task;

[0022] Frame rate is optimized and compensated to ensure stable frame rate under different device performance. The further improvement of the technical scheme of the present application is that the calculation formula of the performance score is: Wherein, W i is the index weight, X i is the i th behavior index, a is the smoothing coefficient, and S t-1 is the performance score at the last moment.

[0023] The further improvement of the technical scheme of the present application is that the calculation formula of the difficulty coefficient is: Wherein, D t is the difficulty coefficient at the current moment, β is the adjustment coefficient, and St Performance score for the current moment, T is the target difficulty threshold.

[0024] The further improvement of the technical scheme of the present application is that the physiological data of the tourists are monitored in real time, the physiological data include heart rate, pupil change, Fourier transform is used for analysis, the calculation formula of Fourier transform is:

[0025] Wherein, f(t) is the change function of physiological data with time, and ω is frequency.

[0026] The further improvement of the technical scheme of the present application is that the experience adjustment of the dynamic difficulty algorithm further includes a scene element reorganization module, which reorganizes scene elements according to the difficulty coefficient α t The following parameters are dynamically adjusted,

[0027] The number of NPCs

[0028] The further improvement of the technical scheme of the present application is that the hierarchical storage architecture of the scene database further includes a basic layer and a dynamic layer metadata layer,

[0029] The basic layer stores the static scene model format;

[0030] The dynamic layer stores the parameterized editable object format;

[0031] The metadata layer stores physical properties and interaction rules.

[0032] Due to the adoption of the above technical scheme, the present application has the following technical progress compared with the prior art:

[0033] 1、The present application provides a VR simulation experience operation and maintenance system for theme park, through the tourists wearing VR equipment with high-precision sensors, physiological data such as position, posture, action, heart rate and pupil change can be collected in real time, the system creates a realistic three-dimensional virtual environment through digital twin modeling technology, so that the tourists feel as if they are in the real scene of the theme park, the system can identify the identity and check the permission according to the interests, age, physical condition and other conditions of the tourists, load the matching scene data from the pre-stored theme scene library, and also can provide personalized VR game recommendation and customized experience for the tourists by analyzing their performance in the VR game.

[0034] 2、The VR simulation experience operation and maintenance system for theme parks combines virtual games with real landscapes, such as taking tourists into a virtual forest world through VR technology, and combining with real natural landscapes to make tourists feel double stimulation, like combining VR technology with traditional roller coasters to bring tourists a new sensory enjoyment, improving the fun of playing, collecting real-time data such as tourist behavior, traffic patterns and device utilization through sensors and cameras equipped with VR / AR devices, which can be used to monitor tourist queuing time, track tourist traffic, and evaluate device utilization.

[0035] 3、Through multi-modal biometric fusion identity verification, only authorized tourists can participate, and the difficulty is dynamically adjusted according to the performance of the tourists, so that each tourist can obtain personalized experience suitable for their own level and interest.

[0036] 4、The VR simulation experience operation and maintenance system for theme parks provided by the present application can monitor the physiological data of tourists in real time, such as heart rate abnormalities, and take gradual load reduction measures in a timely manner, including reducing rendering complexity, starting light filters and tactile feedback prompts, and forcibly exiting if necessary, to maximize the safety of tourists' bodies and minds.

[0037] 5、The VR simulation experience operation and maintenance system for theme parks provided by the present application improves data reading and processing speed through the hierarchical storage architecture of the scene database and the heterogeneous computing architecture of the central processor, optimizes system resource utilization, ensures smooth operation in complex scenarios, and dynamically adjusts the difficulty to make the experience challenging but not too difficult, avoiding boredom or excessive nervousness for tourists, thereby improving the satisfaction and repeat willingness of tourists. BRIEF DESCRIPTION OF DRAWINGS

[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the present application, and those skilled in the art can obtain other drawings according to these drawings without creative labor. Among them:

[0039] Fig. 1 It is a system flow module schematic diagram of the present application;

[0040] Fig. 2 It is a use flow schematic diagram of the present application;

[0041] Fig. 3 It is a dynamic difficulty adjustment flow schematic diagram of the present application. DETAILED DESCRIPTION

[0042] The present application will be further described in detail below in combination with embodiments:

[0043] Example 1

[0044] like Figs. 1-3 As shown, the present invention provides a VR simulation experience operation and maintenance system for a theme park, which is mainly composed of a VR head display device, a motion capture sensor, a physiological monitoring module, a central processing unit and a scene database, and includes the following steps:

[0045] S1. Visitors wear VR equipment;

[0046] S2. Perform identity identification and authority verification;

[0047] S3. If verification passes, load the theme scene library;

[0048] S4. Perform physical space calibration;

[0049] S5. Start multimodal interaction;

[0050] S6. Rendering using a real-time rendering engine;

[0051] S7. Use dynamic difficulty algorithm to adjust the experience;

[0052] S8. Monitor the physiological data of tourists and initiate emergency exit protocol if any abnormality is found.

[0053] Among them, the central processing unit adopts a heterogeneous computing architecture. The main CPU processes logical threads (x64 architecture), the coprocessor is responsible for sensor data fusion (ARMCortex-M7), and the GPU cluster contains at least 2 RTX6000 graphics cards, which are interconnected through NVLink. The scene database adopts a layered storage architecture. The basic layer stores static scene models (format .glb), the dynamic layer stores parameterized editable objects (format .USDZ), and the metadata layer stores physical properties and interaction rules (JSON format).

[0054] According to the above technical solution, the corresponding sensors and equipment are deployed in the VR simulation experience scene of the theme park to start real-time data collection, ensure the accuracy and completeness of the data collection, perform preliminary cleaning and preprocessing on the collected data to remove noise and abnormal data, and store the collected data in a database. Distributed storage systems such as Hadoop or cloud storage services are used to cope with the storage needs of large amounts of data.

[0055] Secondly, the stored data is classified and labeled to facilitate subsequent data analysis and processing. In-depth analysis of the stored data is conducted to mine potential rules and values in the data. For example, analyze the relationship between the behavior patterns of tourists and the physiological responses of VR scenes, evaluate the performance and stability of the system, etc. Machine learning, deep learning, and other algorithms are used to model and predict data to provide a basis for system optimization and improvement.

[0056] The theme park VR simulation experience operation and maintenance system can provide a more secure, immersive, and dynamically adjustable VR experience for tourists.

[0057] Further, the theme park VR simulation experience operation and maintenance system specifically includes the following steps:

[0058] The tourist wears a VR device, which has high-precision sensors that can collect the tourist's position, posture, motion, and physiological data such as heart rate, pupil changes, etc. in real time;

[0059] Identity recognition and permission verification are performed, which includes at least one of fingerprint recognition, facial recognition, or password verification to ensure the legitimacy and security of the tourist's identity;

[0060] If the verification is passed, load the theme scene library, which loads the scene data matching the tourist's selected theme park scene from the pre-stored theme scene library;

[0061] Physical space calibration is performed, which uses the positioning system of the VR device and environmental perception technology to accurately determine the tourist's position and posture in the real physical space to achieve precise matching of virtual scenes and real spaces;

[0062] Start multi-modal interaction, which supports tourists to interact with virtual scenes through gestures, voice, touch, and other ways to enhance immersive experience;

[0063] Render through a real-time rendering engine, which uses a WebGL-based view frustum culling algorithm to improve frame rate;

[0064] Adjust the experience using dynamic difficulty algorithms, including collecting user behavior data, calculating performance scores, updating difficulty parameters, reorganizing scene elements, and optimizing frame rate compensation;

[0065] Monitor the physiological data of the tourist, and if an abnormality occurs, start the emergency exit protocol, which is used to monitor the physiological data of the tourist in real time. If an abnormal situation is detected, such as high heart rate or rapid pupil changes, the emergency exit protocol is immediately started to ensure the safety of the tourist.

[0066] Embodiment 2

[0067] AsFigs. 1-3 As shown, based on Example 1, the present invention provides another technical solution:

[0068] The authentication subsystem integrates a fingerprint recognition unit, a facial recognition camera, and an iris scanner. User identity is verified using a multimodal biometric fusion algorithm that employs a weighted voting mechanism, with fingerprints weighted 0.4, facial features weighted 0.3, and iris features weighted 0.3. It also includes a liveness detection module that uses a convolutional neural network for micro-expression recognition. The network architecture consists of three convolutional layers and two fully connected layers, with an input image size of 128×128 pixels.

[0069] The spatial calibration subsystem includes a lidar and a sensor. The lidar uses the TOF ranging principle, and its distance calculation formula is: Where c is the speed of light, Δt is the flight time, and n is the refractive index of air. Sub-centimeter positioning is achieved by using the extended Kalman filter algorithm, and its state equation is expressed as: X K =f(X K-1 ,U K )+W K , where X K is the state vector at time K, U K is the control input, W K is the process noise.

[0070] The dynamic difficulty control subsystem collects user operation delays, task completion rates, and error rates in real time, and calculates the dynamic adjustment coefficient using the following formula: Among them S t is the standardized performance score at time t, T is the difficulty threshold, K is the adjustment factor, and the scene element reorganization module is based on the difficulty coefficient α t Dynamically adjust the following parameters: The number of NPCs is The item refresh rate is times / minute.

[0071] Safety protection system, when the heart rate monitoring module detects a heart rate value HR>120 beats / minute and lasts for more than 5 seconds, it triggers the progressive load reduction protocol and executes the following steps:

[0072] a) Reduce scene rendering complexity by 50%, where 50A = 0.5 + 0.05 (HR - 80);

[0073] b) Activate the blue light filter;

[0074] c) If the VR scene is not restored within 10 seconds, it will be forced to exit.

[0075] Example 3

[0076] like Figs. 1-3Based on the embodiments 1 and 2, the application further provides a technical solution: a VR simulation experience operation and maintenance system for theme parks, further comprising the following steps:

[0077] The identity recognition and permission verification module adopts multi-modal biometric recognition technology, combining fingerprint recognition, facial recognition, iris recognition and other biological characteristics to improve the accuracy and security of identity recognition.

[0078] The physical space calibration adopts a method combining laser radar scanning and inertial measurement unit (IMU) to realize accurate position and posture measurement of tourists in real space.

[0079] The multi-modal interaction function includes gesture recognition interaction, voice interaction and tactile feedback interaction. The gesture recognition interaction adopts an algorithm based on deep learning, which can accurately recognize various gesture actions of tourists. The voice interaction supports natural language processing and can understand voice instructions of tourists and make corresponding responses. The tactile feedback interaction provides more realistic tactile sensation for tourists through devices such as vibration motors.

[0080] The real-time rendering engine adopts distributed rendering technology to distribute rendering tasks to multiple computing nodes for processing to improve rendering speed and performance.

[0081] The performance score calculation method in the dynamic difficulty algorithm adopts a weighted average method, which gives corresponding weights according to the importance of different behavior indicators to more accurately evaluate the performance level of tourists.

[0082] The emergency exit protocol includes the following steps:

[0083] 1) Immediately stop rendering and interaction functions of the virtual scene;

[0084] 2) Send an emergency prompt message to the tourist to inform him / her to exit safely;

[0085] 3) Guide the tourist to safely remove the VR device and provide necessary help and guidance.

[0086] The above general description of the application is detailed, but some modifications or improvements can be made on the basis of the application, which is obvious to those skilled in the art. Therefore, the modifications or improvements without departing from the spirit of the application are within the protection scope of the application.

Claims

1. A VR simulation experience operation and maintenance system for a theme park, comprising a VR head-mounted display device, a motion capture sensor, a physiological monitoring module, a central processing unit, and a scene database, characterized in that: The following steps are involved: Visitors wear VR devices, which are equipped with high-precision sensors that can collect real-time information about their location, posture, movements, and physiological data, such as heart rate and pupil changes. Perform identity recognition and permission verification, which includes at least one of fingerprint recognition, facial recognition, or password verification to ensure the legitimacy and security of the visitor's identity; If the verification passes, the theme scene library is loaded, wherein the scene data matching the theme park scene selected by the visitor is loaded from the pre-stored theme scene library; Perform physical space calibration, which uses the VR device's positioning system and environmental perception technology to accurately determine the visitor's position and posture in the real physical space, so as to achieve a precise match between the virtual scene and the real space; Enable multimodal interaction, which allows visitors to interact with virtual scenes through gestures, voice, touch, and other methods to enhance the immersive experience; Rendering is done through a real-time rendering engine, using a WebGL-based frustum culling algorithm to improve frame rate; Use dynamic difficulty algorithms to adjust the experience, including collecting user behavior data, calculating performance scores, updating difficulty parameters, reorganizing scene elements, and optimizing frame rate compensation; Monitor tourists' physiological data and activate the emergency exit protocol if any abnormality is detected. It is used to monitor tourists' physiological data in real time. If any abnormality is detected, such as high heart rate, drastic pupil changes, etc., the emergency exit protocol will be activated immediately to ensure the safety of tourists.

2. The VR simulation experience operation and maintenance system for theme parks according to claim 1, characterized in that: The use of a dynamic difficulty algorithm to adjust the experience includes the following steps: Collect tourist behavior data, such as task completion time, error rate, operation frequency, etc.; Calculate visitors’ performance scores based on pre-set rules; The difficulty parameter is updated based on the performance score. The adjustment of the difficulty parameter is controlled by a smoothing coefficient, which ranges from 0.8 to 0.

95. Reorganize scene elements according to updated difficulty parameters, including scene complexity, task difficulty, etc. Optimize and compensate the frame rate to ensure a stable frame rate under different device performance.

3. The VR simulation experience operation and maintenance system for theme parks according to claim 1, characterized in that: The performance score is calculated as follows: Among them, W i is the indicator weight, X i is the i-th behavior indicator, α is the smoothing coefficient, S t-1 Rate your performance for the last moment.

4. The VR simulation experience operation and maintenance system for theme parks according to claim 1, characterized in that: The calculation formula of the difficulty coefficient is: Among them, D t is the difficulty coefficient at the current moment, β is the adjustment coefficient, S t Score the performance at the current moment, and T is the target difficulty threshold.

5. The VR simulation experience operation and maintenance system for theme parks according to claim 1, characterized in that: It also includes real-time monitoring of tourists' physiological data, including heart rate and pupil changes, which are analyzed through Fourier transform. The calculation formula of Fourier transform is: Where f(t) is the function of physiological data changing over time, and ω is the frequency.

6. The VR simulation experience operation and maintenance system for theme parks according to claim 1, characterized in that: The physical space calibration includes laser radar and sensors. The laser radar adopts the TOF ranging principle, and its distance calculation formula is: Where c is the speed of light, Δt is the time of flight, and n is the refractive index of air.

7. The VR simulation experience operation and maintenance system for theme parks according to claim 1, characterized in that: The dynamic difficulty algorithm adjustment experience also includes: a scene element reorganization module, which adjusts the difficulty coefficient α t Dynamically adjust the following parameters, Number of NPCs Item refresh rate:

8. The VR simulation experience operation and maintenance system for theme parks according to claim 1, characterized in that: The scene database adopts a layered storage architecture and also includes a basic layer and a dynamic layer metadata layer.

Images