Immersive virtual space interactive system
By integrating perception, data processing, graphic rendering and interaction modules in the virtual interaction system, capturing user actions and expressions, providing personalized interaction methods and optimizing immersion, the problem of single interaction methods and insufficient immersion in the existing technology is solved. Achieve an efficient and natural user experience.
Patent Information
- Application Number
- CN202410663039.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-27
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2044-05-27
AI Technical Summary
The existing virtual interaction system has problems such as single interaction mode, insufficient immersion, large error in user intention recognition, and lack of interaction optimization, resulting in poor user experience.
An immersive virtual space interaction system including perception module, data processing module, graphics rendering module and interaction module was designed. By capturing user body movements and facial expressions, data is processed in real time, personalized interaction methods are provided, and improved through optimization modules. Immersive experience.
It realizes natural and efficient interaction of the user experience, improves immersion, improves user satisfaction through dynamic adjustment of interaction methods and optimizes feedback, and optimizes rendering efficiency through multi-resolution technology and asynchronous calculations.
Smart Images

Figure CN118394219B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of virtual interaction technology, and in particular to an immersive virtual space interaction system. Background Art
[0002] With the rapid development of information technology, virtual interaction technology has become an active research field, which provides users with an immersive experience by simulating the interaction mode of the real world. The immersive virtual space interaction system aims to achieve natural interaction between users and the virtual world through a highly simulated virtual environment, thereby enhancing the user experience.
[0003] However, the existing virtual interaction system has some limitations and shortcomings, which are mainly manifested in the following aspects:
[0004] Single interaction method: Many systems only support limited interaction methods, such as keyboard, mouse or simple gesture recognition, which limits the user's natural interaction with the virtual space;
[0005] Insufficient immersive experience: Due to the limitations of the interaction method, it is difficult for users to obtain a deep immersive experience, which affects the user's perception of the virtual environment and the naturalness of the interaction;
[0006] Accuracy of user intent recognition: Existing systems often have errors when recognizing user intent, resulting in inefficient interaction and poor user experience;
[0007] Lack of interaction optimization: Lack of in-depth analysis and optimization of user interaction behaviors, resulting in the inability to provide personalized interaction experience based on users' specific needs and preferences;
[0008] In order to solve the above defects, a technical solution is now provided. Summary of the invention
[0009] The purpose of the present invention is to solve the problem that the existing virtual interaction technology has obvious deficiencies in providing a natural, efficient and personalized immersive experience, and to propose an immersive virtual space interaction system.
[0010] The purpose of the present invention can be achieved through the following technical solutions:
[0011] Immersive virtual space interactive system, including:
[0012] A perception module, used to capture the user's body movements and facial expressions through a perception device;
[0013] The data processing module is used to process the data collected by the perception module in real time, including data fusion and user intention recognition;
[0014] A graphics rendering module, used for rendering graphics of the virtual space in real time according to the processed data;
[0015] The interaction module is used to provide an interface for users to interact with the virtual space and provide users with the best interaction method. The specific steps are as follows:
[0016] First, analyze the user's needs and expectations through the user's historical interaction data and the popularity data of the interaction method, determine the user's interaction method, provide different interaction methods for different steps in the interaction process, and prioritize the several interaction methods provided in each step;
[0017] Specifically, by collecting the evaluation factors of different interaction modes in each step and conducting a comprehensive analysis, we can obtain the usage frequency, interaction time, error rate, user satisfaction score, learning hours and consumption value, which are calibrated as sp, js, wl, mp, xs and hs respectively. After normalization, they are entered into the following formula: The optimal judgment value YPZ is obtained, and the optimal judgment value YPZ is used as a priority judgment standard for measuring different optimization methods provided by each step in the interaction process;
[0018] Sort the optimal judgment values YPZ obtained by different optimization methods by size, and select the optimization method with the highest optimal judgment value YPZ as the optimization method used in this step;
[0019] Then, based on user research and application scenarios, determine the interaction technology;
[0020] The optimization module is used to optimize the immersive experience of user interaction.
[0021] Furthermore, the evaluation factors in the interaction module include usage frequency, interaction time, error rate, user satisfaction score, learning curve and resource consumption;
[0022] The usage frequency is the frequency with which the user selects the interaction mode;
[0023] The interaction time is the total time to complete the interaction of this step through this interaction method;
[0024] The error rate is the ratio of the number of errors made by users through this interaction method to the total number of times used;
[0025] The user satisfaction score is the user's satisfaction score for the interaction method. When there are two or more user ratings, the average score is calculated;
[0026] The learning curve is the average time taken by all first-time users to master the interaction mode, and is recorded as the learning hour value;
[0027] Resource consumption is the effect of the interaction mode on system resources, including CPU, memory and battery consumption. After normalization, they are multiplied by preset weight coefficients and summed to obtain a consumption value, which is used as a standard for measuring resource consumption of the interaction mode.
[0028] Furthermore, the specific operation steps of the optimization module for optimizing the immersive experience of user interaction are as follows:
[0029] First, the user's interactive feedback is evaluated to determine whether the current interactive immersion meets the user's expectations. If the interactive immersion does not meet the user's expectations, the interaction is optimized. The specific optimization steps are as follows:
[0030] First, hidden feedback is adopted, using subtle feedback, including sound or tactile changes below a preset volume;
[0031] By predicting the user's interaction intention and preparing interaction feedback in advance, the waiting time during user interaction is reduced, and the prompt intensity of the interaction is automatically adjusted according to the user's behavior;
[0032] Then, the interaction prompts are naturally integrated with the context of the virtual environment to make them inconspicuous. At the same time, guidance is provided when the user uses it for the first time. As the number of times the user uses it reaches several levels, the user prompts are gradually reduced to let the user get used to the interaction method;
[0033] Design a transparent interactive interface to reduce interference with user immersion, and adopt intuitive interaction logic to allow users to naturally understand how to interact with the virtual space, and provide users with their own preference adjustments, including hiding or canceling prompts and adjusting visibility and intensity.
[0034] Furthermore, the specific operation steps of the optimization module to determine whether the current interactive immersion meets the user's expectations are as follows:
[0035] By collecting user feedback parameters for comprehensive analysis, the user engagement score, user retention rate, user recommendation rate, interactive learnability score and judgment value are obtained through feedback parameters, and are calibrated as , after normalization, enter the following formula: To get the sedimentation judgment value CPZ, where They are the preset weight coefficients for user engagement score, user retention rate, user recommendation rate, interactive learnability score and biometric value;
[0036] The calculated immersion judgment value CPZ is then compared with the preset immersion judgment threshold. When the immersion judgment value CPZ is lower than the preset immersion judgment threshold, it is determined that the immersion of the interaction does not meet the user's expectations.
[0037] Furthermore, the specific operation steps of the user engagement score, user retention rate, user recommendation rate, interactive learnability score and bio-judgment value analysis in the optimization module are as follows:
[0038] User engagement score: The depth and breadth of the user's interaction with the system is given a comprehensive score of 1-10, which reflects the degree of user immersion;
[0039] User retention rate: the time a user continues to interact with the system, which is used to reflect the user's experience with the system interaction;
[0040] User recommendation rate: the total number of users recommending to others, reflecting the positive effect of the user's immersive experience;
[0041] Interaction learnability score: users give a score of 1-10 for the initial learning speed of system interaction, which is used to reflect whether the interactive user can quickly integrate;
[0042] User physiological data: by obtaining the user's heart rate and respiratory rate data, and setting the standard heart rate and respiratory rate, the value of the user's heart rate and respiratory rate exceeding the standard heart rate and respiratory rate is calculated and recorded as the super-heart value and super-respiratory value respectively;
[0043] After normalizing the supercenter value and the supercall value, a cone model is established with the supercenter value as the base circle radius and the supercall value as the height. The surface area of the cone model is calculated and multiplied by the weight factor to obtain the bio-judgment value, which is used to measure whether the user has stress or excitement when using the system or interacting.
[0044] Furthermore, the specific operation steps of the perception module to capture the user's body movements and facial expressions are as follows:
[0045] First, check the user's sensory equipment to determine whether there is any missing or incorrectly worn sensory equipment;
[0046] When it is determined that there is a perception device that is moved or worn incorrectly, a voice prompt or text display is made through the interactive module to remind the user to wear or correct the perception device;
[0047] Then calibrate all the sensing equipment to ensure that it can accurately capture the user's body movements and facial expressions;
[0048] Verify the wearing position of all sensor equipment to determine whether there is any inaccurate wearing position of the sensor equipment, and provide correction prompts for any inaccurate situation;
[0049] Then, correct the position according to the correction prompts, adjust the sensor position, ensure that the sensor is aligned with the user's body parts, and perform initial tests to verify the accuracy of the data;
[0050] Then the sensing device is activated to capture the user's body movements, facial expressions and eye movements in real time, and the motion capture camera is used to capture the user's full body movements;
[0051] The movement of various parts of the body is recorded through marking or optical tracking technology, and the data from different sensors are synchronized to maintain data consistency and time accuracy, and then the data is pre-processed, including filtering and denoising.
[0052] Furthermore, the specific operation steps of the data processing module for real-time processing of the data collected by the perception module are as follows:
[0053] First, the data from different sensing devices are fused to form a comprehensive user posture and expression model, and the Kalman filter or particle filter algorithm is used to integrate and optimize the data;
[0054] Extract key features from the integrated data. Key features are features that represent user intentions and behaviors, including changes in limb joint angles, speeds, accelerations, and facial expressions.
[0055] Apply machine learning models to analyze the extracted features, identify user intent, and train classifiers or regression models to predict user actions or commands;
[0056] And optimize the accuracy of intent recognition based on the contextual information of user behavior.
[0057] Furthermore, the process of the graphics rendering module rendering the graphics of the virtual space in real time according to the processed data is as follows:
[0058] First, based on the user's interactions and intentions, the scene is built or updated in the virtual space. The user's body movements and position data are used to position and transform the model in the virtual environment. The perspective and viewpoint are calculated based on the user's head and eye tracking data.
[0059] Apply lighting models and texture mapping to ensure lighting effects and material realism in the virtual environment, and then configure rendering parameters, including shadows, reflections, and transparency;
[0060] Performing rendering through the graphics API, rendering the left and right eye images separately for stereoscopic vision or VR headsets to create a sense of depth;
[0061] Then apply image post-processing effects, including anti-aliasing, tone mapping, and depth of field, and set up a frame rate stabilization mechanism during the rendering process to maintain smooth animation and interaction, and improve rendering efficiency and performance through the asynchronous computing capabilities of the GPU;
[0062] Then, according to the user's gaze point and visual importance, multi-resolution technology is implemented. The specific steps are as follows:
[0063] Determine the user's gaze point through eye tracking, evaluate the visual importance of different areas based on scene content and user interaction, and then define one or more gaze areas based on the gaze point;
[0064] Design the resolution hierarchy, gradually reduce the resolution from the gaze point outward, and dynamically adjust the rendering resolution of different gaze areas according to the user's gaze point, while keeping the gaze point at the highest resolution.
[0065] The scene is then divided into multiple areas or layers, and each area is rendered independently according to its visual importance. For objects outside the gaze area, lower resolution textures and simplified models are used, and objects outside the gaze area are culled. Only the content within the user's field of vision is rendered, and parts blocked by other objects are culled to reduce unnecessary rendering calculations.
[0066] Then, through asynchronous computing technology, content outside the gaze area is rendered in advance, and accurate depth and template tests are performed on the gaze area to reduce over-drawing and limit resource-intensive post-processing effects to the gaze area.
[0067] Then, based on the user’s interaction and line of sight, the gaze area and resolution are dynamically adjusted, while balancing rendering performance and resource effects while maintaining image quality, and providing users with customized gaze point rendering settings.
[0068] Compared with the prior art, the present invention has the following beneficial effects:
[0069] The present invention provides personalized interaction methods by analyzing the user's historical interaction data and the popularity of the interaction methods. It can dynamically adjust the priority of the interaction methods according to evaluation factors such as the user's usage frequency, interaction time, error rate, satisfaction score, etc., thereby providing users with a more natural and efficient interaction experience.
[0070] The present invention significantly improves the user's sense of immersion through hidden feedback, prediction of user intentions, natural integration of interactive prompts, and design of transparent interactive interfaces. In addition, the system also evaluates and optimizes the immersive experience by collecting user feedback parameters, such as engagement scores, retention rates, and recommendation rates, to ensure that users can obtain a more satisfactory virtual space interactive experience.
[0071] The present invention utilizes multi-resolution technology and asynchronous computing technology through a graphics rendering module to dynamically adjust the rendering resolution according to the user's gaze point and visual importance, thereby reducing unnecessary rendering calculations and improving rendering efficiency and performance. At the same time, through intelligent allocation of resources, the consumption of CPU, memory and battery is optimized, thereby achieving efficient management and utilization of resources. BRIEF DESCRIPTION OF THE DRAWINGS
[0072] In order to facilitate understanding by those skilled in the art, the present invention is further described below in conjunction with the accompanying drawings;
[0073] Figure 1 This is the overall system block diagram of the present invention. DETAILED DESCRIPTION
[0074] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0075] It should be understood that the terms "include" and "comprising" used in the specification and claims of the present disclosure indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.
[0076] It should also be understood that the terms used in this disclosure are only for the purpose of describing specific embodiments and are not intended to limit the disclosure. As used in this disclosure and claims, the singular forms of "a", "an", and "the" are intended to include the plural forms unless the context clearly indicates otherwise. It should also be further understood that the term "and / or" used in this disclosure and claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.
[0077] like Figure 1 As shown, the immersive virtual space interactive system includes a perception module, a data processing module, a graphics rendering module, an interaction module and an optimization module;
[0078] The perception module is used to capture the user's body movements and facial expressions, including but not limited to motion capture cameras, inertial sensors, eye trackers, etc. The specific steps are as follows:
[0079] First, check the user's perception equipment to determine whether there is any missing or incorrectly worn perception equipment, including motion capture suits, inertial sensors, eye trackers, etc.; when it is determined that there is any perception equipment that is moved or worn incorrectly, voice prompts or text displays are given in the interactive module to remind the user to wear or correct the perception equipment; then calibrate all perception equipment to ensure that the perception equipment can accurately capture the user's body movements and facial expressions; verify the wearing position of all perception equipment to determine whether there is any inaccurate wearing position of the perception equipment, and provide correction prompts for inaccurate situations, and correct the position according to the correction prompts; at the same time, adjust the sensor position to ensure that the sensor is aligned with the user's body part, and perform initial tests to verify the accuracy of the data;
[0080] Start the sensing device to capture the user's body movements, facial expressions and eye movements in real time, cooperate with the motion capture camera to capture the user's full body movements, record the movements of various parts of the body through marking or optical tracking technology, and synchronize data from different sensors to maintain data consistency and time accuracy, and then pre-process the data, including filtering and denoising, to improve data quality.
[0081] The data processing module is used to process the data collected by the perception module in real time, including data fusion, user intention recognition, etc.
[0082] Fuse data from different sensing devices to form a comprehensive user posture and expression model, and use Kalman filter or particle filter algorithm to integrate and optimize data; extract key features from the integrated data, which can represent user intentions and behaviors, including limb joint angles, speeds, accelerations, and changes in facial expressions;
[0083] Apply machine learning models to analyze the extracted features, identify user intent, and train classifiers or regression models to predict user behavior or commands; and optimize the accuracy of intent recognition based on the contextual information of user behavior.
[0084] The graphics rendering module is used to render the graphics of the virtual space in real time according to the processed data to ensure the smoothness and realism of the image;
[0085] Based on the user's interactions and intentions, build or update scenes in the virtual space, use the user's body movements and position data to position and transform models in the virtual environment, and calculate the perspective and viewpoint based on the user's head and eye tracking data; apply lighting models and texture mapping to ensure the lighting effects and material realism in the virtual environment, and then configure rendering parameters, including shadows, reflections, and transparency, to improve the realism of the image, and perform the rendering process through a graphics API, where the graphics API includes OpenGL, DirectX, or Vulkan, and for stereoscopic vision or VR headsets, render the left and right eye images separately to create a sense of depth;
[0086] Then apply image post-processing effects, including anti-aliasing, tone mapping, and depth of field, to enhance visual effects. At the same time, set a frame rate stabilization mechanism during the rendering process to maintain smooth animation and interaction, and improve rendering efficiency and performance through the asynchronous computing capabilities of the GPU. Then, implement multi-resolution technology to improve efficiency based on the user's gaze point and visual importance. The specific steps are as follows:
[0087] Determine the user's gaze point through eye tracking, evaluate the visual importance of different areas based on scene content and user interaction, and then define one or more gaze areas based on the gaze point; design resolution hierarchy results, gradually reduce the resolution from the gaze point outward, and dynamically adjust the rendering resolution of different gaze areas based on the user's gaze point, and keep the gaze point position at the highest resolution;
[0088] The scene is then divided into multiple areas or layers, and each area is rendered independently according to its visual importance. For objects outside the gaze area, lower resolution textures and simplified models are used, and objects outside the gaze area are eliminated. Only the content within the user's field of vision is rendered, and the parts blocked by other objects are eliminated to reduce unnecessary rendering calculations. Then, through asynchronous computing technology, the content outside the gaze area is rendered in advance, and the gaze area is accurately tested for depth and template to reduce over-painting, and resource-intensive post-processing effects are limited to the gaze area. The gaze area and resolution are dynamically adjusted according to the user's interaction and line of sight, while maintaining image quality, balancing rendering performance and resource effects, and providing users with customized gaze point rendering settings to meet the needs of different users.
[0089] The interaction module is used to provide an interface for users to interact with the virtual space and provide users with the best interaction method;
[0090] First, we analyze the user's needs and expectations through the user's historical interaction data and the popularity data of the interaction method, determine the user's interaction method, provide different interaction methods for different steps in the interaction process, and prioritize the several interaction methods provided in each step. Specifically, we collect the evaluation factors of different interaction methods in each step for comprehensive analysis, where the evaluation factors include: usage frequency, interaction time, error rate, user satisfaction score, learning curve and resource consumption. The usage frequency is the frequency of users selecting this interaction method, and a high frequency indicates that this interaction method is preferred by users; the interaction time is the total time it takes to complete the interaction of this step through this interaction method. There is time, and a shorter time indicates a more efficient interaction method; the error rate is the ratio of the number of errors made by users through this interaction method to the total number of times used; the user satisfaction score is the user's satisfaction score for this interaction method. When there are two or more user ratings, the average score is calculated; the learning curve is the average time for all first-time users to master this interaction method, and is recorded as the learning hour value; resource consumption is the effect of this interaction method on system resources, including CPU, memory and battery consumption. After normalization, they are multiplied by the preset weight coefficients and summed to obtain the consumption value, and this consumption value is used as the standard for measuring the resource consumption of this interaction method;
[0091] The obtained usage frequency, interaction time, error rate, user satisfaction score, learning time value and consumption value are calibrated as sp, js, wl, mp, xs and hs respectively, and then normalized and entered into the following formula: In order to obtain the optimal judgment value YPZ, this optimal judgment value YPZ is used as the priority judgment standard for measuring the different optimization methods provided in each step of the interaction process; the optimal judgment values YPZ obtained by different optimization methods are sorted according to size, and the optimization method with the highest optimal judgment value YPZ is selected as the optimization method used in this step; then, based on user research and application scenarios, the interaction technology is determined, including handheld controllers, gesture recognition, speech recognition or brain-computer interfaces.
[0092] The optimization module is used to optimize the immersive experience of user interaction;
[0093] First, the user's interactive feedback is evaluated to determine whether the current interactive immersion meets the user's expectations. Specifically, a comprehensive analysis is performed by collecting the user's feedback parameters, where the feedback parameters include:
[0094] User engagement score: The depth and breadth of the user's interaction with the system is given a comprehensive score of 1-10, and this score reflects the degree of user immersion; User retention rate: The time that users continue to use the system to interact, which is used to reflect the user's experience of system interaction; User recommendation rate: The total number of users recommending to others, reflecting the positive effect of user immersion experience; Interaction learnability score: The user's first learning speed for system interaction is given a score of 1-10, which is used to reflect whether the interactive user can quickly integrate; User physiological data: By obtaining the user's heart rate and breathing rate The heart rate data is collected, and the standard heart rate and respiratory rate are set. The values of the user's heart rate and respiratory rate exceeding the standard heart rate and respiratory rate are calculated and recorded as the super-heart value and the super-respiration value respectively. After normalization, the super-heart value is used as the bottom circle radius, and the super-respiration value is used as the height to establish a cone model. The surface area of the cone model is calculated and multiplied by the weight factor to obtain the bio-judgment value, and this bio-judgment value is used to measure whether the user has stress or excitement in the process of using the system or interacting. Stress or excitement will reduce the user's immersion. The weight factor is set between 0.66-0.85;
[0095] Then, the obtained user engagement score, user retention rate, user recommendation rate, interactive learnability score and judgment value are calibrated as After normalization, the following formula is entered: To get the sedimentation judgment value CPZ, where The preset weight coefficients are respectively user engagement score, user retention rate, user recommendation rate, interactive learnability score and student judgment value, and the values are set between 1-1.06, 0.95-0.99, 1.1-1.17, 0.92-0.97 and 1.13-1.19;
[0096] The calculated immersion judgment value CPZ is then compared with the preset immersion judgment threshold. When the immersion judgment value CPZ is lower than the preset immersion judgment threshold, it is determined that the immersion of the interaction does not meet the user's expectations, and the interaction is optimized. The specific optimization steps are as follows:
[0097] Use hidden feedback, use subtle feedback, including sound or tactile changes below the preset volume, and avoid using more conspicuous visual cues; predict the user's interaction intention and prepare interaction feedback in advance, thereby reducing the waiting time during user interaction, and automatically adjust the intensity of interaction prompts according to user behavior; then naturally integrate the interaction prompts with the context of the virtual environment to make the interaction prompts inconspicuous, and provide guidance when the user uses it for the first time. As the user's usage reaches several levels, the user prompts are gradually reduced to allow the user to get used to the interaction method; design a transparent interaction interface to reduce interference with the user's immersion, and use intuitive interaction logic to allow users to naturally understand how to interact with the virtual space, and provide users with their own preference adjustments, including hiding or canceling prompts and adjusting visibility and intensity.
[0098] The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to only specific implementation methods. Obviously, many modifications and changes can be made according to the content of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can understand and use the present invention well. The present invention is limited only by the claims and their full scope and equivalents.
Claims
1. Immersive virtual space interactive system, It is characterized in that include: A perception module, used to capture the user's body movements and facial expressions through a perception device; The data processing module is used to process the data collected by the perception module in real time, including data fusion and user intention recognition; A graphics rendering module, used for rendering graphics of the virtual space in real time according to the processed data; The interaction module is used to provide an interface for users to interact with the virtual space and provide users with the best interaction method. The specific steps are as follows: First, analyze the user's needs and expectations through the user's historical interaction data and the popularity data of the interaction method, determine the user's interaction method, provide different interaction methods for different steps in the interaction process, and prioritize the several interaction methods provided in each step; Specifically, by collecting the evaluation factors of different interaction modes in each step and conducting a comprehensive analysis, we can obtain the usage frequency, interaction time, error rate, user satisfaction score, learning hours and consumption value, which are calibrated as sp, js, wl, mp, xs and hs respectively. After normalization, they are entered into the following formula: The optimal judgment value YPZ is obtained, and the optimal judgment value YPZ is used as a priority judgment standard for measuring different optimization methods provided by each step in the interaction process; Sort the optimal judgment values YPZ obtained by different optimization methods by size, and select the optimization method with the highest optimal judgment value YPZ as the optimization method used in this step; Then, based on user research and application scenarios, determine the interaction technology; The optimization module is used to optimize the immersive experience of user interaction. The specific steps are as follows: First, the user's interactive feedback is evaluated to determine whether the current interactive immersion meets the user's expectations. If the interactive immersion does not meet the user's expectations, the interaction is optimized. The specific optimization steps are as follows: First, hidden feedback is adopted, using subtle feedback, including sound or tactile changes below a preset volume; By predicting the user's interaction intention and preparing interaction feedback in advance, the waiting time during user interaction is reduced, and the prompt intensity of the interaction is automatically adjusted according to the user's behavior; Then, the interaction prompts are naturally integrated with the context of the virtual environment to make them inconspicuous. At the same time, guidance is provided when the user uses it for the first time. As the number of times the user uses it reaches several levels, the user prompts are gradually reduced to let the user get used to the interaction method; Design a transparent interactive interface to reduce interference with user immersion, and adopt intuitive interaction logic to allow users to naturally understand how to interact with the virtual space, and provide users with their own preference adjustments, including hiding or canceling prompts and adjusting visibility and intensity; The specific steps for judging whether the current interactive immersion meets the user's expectations are as follows: By collecting user feedback parameters for comprehensive analysis, the user engagement score, user retention rate, user recommendation rate, interactive learnability score and judgment value are obtained through feedback parameters, and are calibrated as σ, τ, υ, ω, after normalization, are entered into the following formula: To obtain the sedimentation judgment value CPZ, where ψ 1 , 2 , 3 , 4 , 5 They are the preset weight coefficients for user engagement score, user retention rate, user recommendation rate, interactive learnability score and biometric value; The calculated immersion judgment value CPZ is then compared with the preset immersion judgment threshold. When the immersion judgment value CPZ is lower than the preset immersion judgment threshold, it is determined that the immersion of the interaction does not meet the user's expectations.
2. The immersive virtual space interactive system according to claim 1, It is characterized in that The evaluation factors in the interaction module include usage frequency, interaction time, error rate, user satisfaction score, learning curve and resource consumption; The usage frequency is the frequency with which the user selects the interaction mode; The interaction time is the total time to complete the interaction of this step through this interaction method; The error rate is the ratio of the number of errors made by users through this interaction method to the total number of times used; The user satisfaction score is the user's satisfaction score for the interaction method. When there are two or more user ratings, the average score is calculated; The learning curve is the average time taken by all first-time users to master the interaction mode, and is recorded as the learning hour value; Resource consumption is the effect of the interaction mode on system resources, including CPU, memory and battery consumption. After normalization, they are multiplied by preset weight coefficients and summed to obtain a consumption value, which is used as a standard for measuring resource consumption of the interaction mode.
3. The immersive virtual space interactive system according to claim 1, It is characterized in that The specific operation steps of user engagement score, user retention rate, user recommendation rate, interactive learnability score and judgment value analysis in the optimization module are as follows: User engagement score: The depth and breadth of the user's interaction with the system is given a comprehensive score of 1-10, which reflects the degree of user immersion; User retention rate: the time a user continues to interact with the system, which is used to reflect the user's experience with the system interaction; User recommendation rate: the total number of users recommending to others, reflecting the positive effect of the user's immersive experience; Interaction learnability score: users rate the initial learning speed of system interaction on a scale of 1-10; User physiological data: by obtaining the user's heart rate and respiratory rate data, and setting the standard heart rate and respiratory rate, the value of the user's heart rate and respiratory rate exceeding the standard heart rate and respiratory rate is calculated and recorded as the super-heart value and super-respiratory value respectively; After normalizing the supercenter value and the supercall value, a cone model is established with the supercenter value as the base circle radius and the supercall value as the height. The surface area of the cone model is calculated and multiplied by the weight factor to obtain the bio-judgment value, which is used to measure whether the user has stress or excitement when using the system or interacting.
4. The immersive virtual space interactive system according to claim 1, It is characterized in that The specific operation steps of the perception module to capture the user's body movements and facial expressions are as follows: First, check the user's sensory equipment to determine whether there is any missing or incorrectly worn sensory equipment; When it is determined that there is a perception device that is moved or worn incorrectly, a voice prompt or text display is made through the interactive module to remind the user to wear or correct the perception device; Then calibrate all sensor equipment; Verify the wearing position of all sensor equipment to determine whether there is any inaccurate wearing position of the sensor equipment, and provide correction prompts for any inaccurate situation; Then, correct the position according to the correction prompts, adjust the sensor position, ensure that the sensor is aligned with the user's body parts, and perform initial tests to verify the accuracy of the data; Then the sensing device is activated to capture the user's body movements, facial expressions and eye movements in real time, and the motion capture camera is used to capture the user's full body movements; The movement of various parts of the body is recorded through marking or optical tracking technology, and the data from different sensors are synchronized to maintain data consistency and time accuracy, and then the data is pre-processed, including filtering and denoising.
5. The immersive virtual space interactive system according to claim 1, It is characterized in that The specific operation steps of the data processing module for real-time processing of the data collected by the perception module are as follows: First, the data from different sensing devices are fused to form a comprehensive user posture and expression model, and the Kalman filter or particle filter algorithm is used to integrate and optimize the data; Extract key features from the integrated data. Key features are features that represent user intentions and behaviors, including changes in limb joint angles, speeds, accelerations, and facial expressions. Apply machine learning models to analyze the extracted features, identify user intent, and train classifiers or regression models to predict user actions or commands; And optimize the accuracy of intent recognition based on the contextual information of user behavior.
6. The immersive virtual space interactive system according to claim 1, It is characterized in that The process of the graphics rendering module rendering the graphics of the virtual space in real time according to the processed data is as follows: First, based on the user's interactions and intentions, the scene is built or updated in the virtual space. The user's body movements and position data are used to position and transform the model in the virtual environment. The perspective and viewpoint are calculated based on the user's head and eye tracking data. Apply lighting models and texture mapping to ensure lighting effects and material realism in the virtual environment, and then configure rendering parameters, including shadows, reflections, and transparency; Performing rendering through the graphics API, rendering the left and right eye images separately for stereoscopic vision or VR headsets to create a sense of depth; Then apply image post-processing effects, including anti-aliasing, tone mapping, and depth of field, and set up a frame rate stabilization mechanism during the rendering process to maintain smooth animation and interaction, and improve rendering efficiency and performance through the asynchronous computing capabilities of the GPU; Then, according to the user's gaze point and visual importance, multi-resolution technology is implemented. The specific steps are as follows: Determine the user's gaze point through eye tracking, evaluate the visual importance of different areas based on scene content and user interaction, and then define one or more gaze areas based on the gaze point; Design the resolution hierarchy, gradually reduce the resolution from the gaze point outward, and dynamically adjust the rendering resolution of different gaze areas according to the user's gaze point, while keeping the gaze point at the highest resolution. The scene is then divided into multiple areas or layers, and each area is rendered independently according to its visual importance. For objects outside the gaze area, lower resolution textures and simplified models are used, and objects outside the gaze area are culled. Only the content within the user's field of vision is rendered, and parts blocked by other objects are culled to reduce unnecessary rendering calculations. Then, through asynchronous computing technology, content outside the gaze area is rendered in advance, and accurate depth and template tests are performed on the gaze area to reduce over-drawing and limit resource-intensive post-processing effects to the gaze area. Then, based on the user’s interaction and line of sight, the gaze area and resolution are dynamically adjusted, while balancing rendering performance and resource effects while maintaining image quality, and providing users with customized gaze point rendering settings.
