Metacosmic application starting method and device, equipment, storage medium and program product

Abstract

The invention provides a meta-universe application starting method and device, equipment, a storage medium and a program product, and belongs to the technical field of meta-universe, the method is applied to a user terminal provided with a meta-universe application, and the method comprises the steps that in the initialization loading process of a capacity component of a 3D space of the meta-universe application, data is analyzed in real time based on the software and hardware environment of the user terminal, and the capacity component of the 3D space of the meta-universe application is obtained; determining an optimal configuration scheme of the 3D space; configuring a service quality parameter of the 3D space based on a configuration operation of a user about the application optimization configuration scheme; and under the condition that initialization loading of the audio and video room and the instant messaging room of the meta-universe application is completed in the 3D space, the meta-universe application is started. According to the method, when the meta-universe application is started every time, the optimal configuration scheme is automatically determined based on real-time analysis data of dynamic software and hardware environments of the user terminal in the initialization loading process of the 3D space capability component, and accurate, automatic and self-adaptive real-time adjustment of meta-universe application starting configuration is achieved to the maximum extent.

Description

Technical Field

[0001] The present invention relates to the technical field of the metaverse, and in particular, to a method, device, equipment, storage medium and program product for starting a metaverse application. Background Art

[0002] The operation of a metaverse application requires self-checking the environment, that is, the user needs to detect whether the user terminal installed with the metaverse application meets the basic hardware requirements, and manually adjust the relevant configurations by the user to match the performance requirements of the metaverse application.

[0003] However, the actual performance of the user terminal when running complex metaverse applications is difficult to accurately judge through basic system hardware detection before starting the metaverse. Moreover, for non-technical users, manually adjusting the configuration is a complex and error-prone unfriendly process, and improper configuration will affect the performance and experience of the metaverse application. Summary of the Invention

[0004] The present invention provides a method, device, equipment, storage medium and program product for starting a metaverse application, which is used to solve the defects that users in the prior art cannot accurately judge the application performance and are prone to errors in manually adjusting the application configuration, and realizes a metaverse startup solution that can automatically and accurately adjust the metaverse application configuration to the greatest extent.

[0005] The present invention provides a method for starting a metaverse application, which is applied to a user terminal installed with the metaverse application, and includes: During the initialization and loading process of the capability components in the 3D space of the metaverse application, analyzing data in real time based on the software and hardware environment of the user terminal to determine an optimization configuration plan for the 3D space; Configuring the quality of service parameters of the 3D space based on the user's configuration operation for applying the optimization configuration plan; When the initialization and loading of the 3D space, the audio-visual room of the metaverse application, and the instant messaging room of the metaverse application are all completed, the startup of the metaverse application is completed.

[0006] According to the method for starting a metaverse application provided by the present invention, the step of analyzing data in real time based on the software and hardware environment of the user terminal to determine an optimization configuration plan for the 3D space includes: When it is determined that there is a bottleneck item in the user terminal based on the throughput data of the metaverse application and the response time data of the metaverse application, comparing the hardware configuration parameters of the user terminal with the recommended hardware configuration parameters of the metaverse application to determine the bottleneck item; and determining the optimization configuration plan based on the bottleneck item.

[0007] A method for starting a metaverse application provided by the present invention, determining the optimization configuration scheme based on the bottleneck item includes: Determine the optimization configuration scheme based on the hardware performance parameters of the user terminal, the requirement evaluation data of the metaverse application, the version compatibility check data between the user terminal and the metaverse application, the process resource occupancy data of other application software, the bottleneck item, and the risk assessment data of the bottleneck item; the other application software is the application software deployed on the user terminal except the metaverse application.

[0008] A method for starting a metaverse application provided by the present invention, determining the optimization configuration scheme based on the hardware performance parameters of the user terminal, the requirement evaluation data of the metaverse application, the version compatibility check data between the user terminal and the metaverse application, the process resource occupancy data of other application software, the bottleneck item, and the risk assessment data of the bottleneck item includes: Determine the real-time analysis data of the software and hardware environment based on the hardware performance parameters, the requirement evaluation data, the version compatibility check data, the process resource occupancy data, the bottleneck item, and the risk assessment data; input the real-time analysis data of the software and hardware environment into a pre-trained feature extraction model to obtain the feature vector output by the feature extraction model; input the feature vector into a pre-trained optimization configuration scheme determination model to obtain the optimization configuration scheme output by the optimization configuration scheme determination model; the optimization configuration scheme determination model is constructed based on a reinforcement algorithm.

[0009] A method for starting a metaverse application provided by the present invention, the optimization configuration scheme determination model follows the following constraints: When the spatial frame rate in the 3D space in the hardware performance parameters is lower than the preset frame rate threshold, or when the version compatibility check data is that the user terminal and the metaverse application are incompatible, the metaverse space dimension in the optimization configuration scheme is 2D; and, the 3D space picture quality in the optimization configuration scheme is determined based on the frame rate gradient interval where the spatial frame rate is located; different frame rate gradient intervals are pre-associated with different 3D space picture qualities.

[0010] A method for starting a metaverse application provided by the present invention, after the metaverse application is started, it further includes: Determine the network connection quality based on the network bandwidth, packet loss rate, and data transmission rate of the real-time audio and video data transmitted by the metaverse application; adjust the encoding bit rate or resolution of the audio and video data based on the network connection quality.

[0011] A method for starting a metaverse application provided by the present invention, after the metaverse application is started successfully, further includes: In the case where an exception event is thrown by the audio-video SDK or the number of failed calls to the heartbeat request of the audio-video room exceeds a preset threshold, re-enter the 3D space.

[0012] A method for starting a metaverse application provided by the present invention, the re-entering the 3D space in the case where an exception event is thrown by the audio-video SDK or the number of failed calls to the heartbeat request of the audio-video room exceeds a preset threshold, includes: In the case where the exception event occurs or the number of failed calls to the heartbeat request of the audio-video room exceeds a preset threshold, an input box pops up on the human-computer interaction interface of the user terminal; the input box is used to receive an input instruction for the user to indicate re-entering the 3D space; in response to the input instruction, re-enter the 3D space.

[0013] The present invention also provides a metaverse application startup device, deployed on a user terminal installed with a metaverse application, including: An optimization scheme determination module, configured to, during the initialization and loading process of the capability components of the 3D space of the metaverse application, analyze data in real time based on the software and hardware environment of the user terminal, and determine an optimization configuration scheme for the 3D space; A service quality configuration module, configured to configure service quality parameters of the 3D space based on a configuration operation of the user for applying the optimization configuration scheme; An application startup module, configured to complete the startup of the metaverse application when the initialization and loading of the 3D space, the audio-video room of the metaverse application, and the instant messaging room of the metaverse application are all completed.

[0014] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and running on the processor, and when the processor executes the computer program, it implements the metaverse application startup method as described in any one of the above.

[0015] The present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the metaverse application startup method as described in any one of the above.

[0016] The present invention also provides a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the metaverse application startup method as described in any one of the above.

[0017] The method, device, equipment, storage medium and program product for starting a metaverse application provided by the present invention analyze real-time data of the dynamic software and hardware environment of the user terminal during the initialization and loading process of the capability components in the 3D space of the metaverse application each time the metaverse application is started, rather than just the static hardware analysis data of the user terminal, so as to automatically determine an optimized configuration plan for the 3D space, thereby avoiding ignoring the requirements of key performance indicators such as real-time rendering, network latency, and data processing during the actual operation of the metaverse application, enabling the optimized configuration plan to meet the performance requirements of the metaverse application with high operating requirements during actual operation on the user terminal, and avoiding unexpected performance problems during the actual use of the metaverse application; at the same time, configure the quality of service parameters of the 3D space based on the user's configuration operation on the application optimization configuration plan, achieving accurate, automatic, and adaptive real-time adjustment of the metaverse application startup configuration to the greatest extent, being very user-friendly, and being able to improve the user experience during the operation after the metaverse application is started. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0019] Figure 1 is one of the flow diagrams of the method for starting a metaverse application provided by the present invention.

[0020] Figure 2 is the second flow diagram of the method for starting a metaverse application provided by the present invention.

[0021] Figure 3 is the structural diagram of the device for starting a metaverse application provided by the present invention.

[0022] Figure 4 is the structural diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0023] To make the objectives, technical solutions, and advantages of the present invention clearer, the following will clearly and completely describe the technical solutions in the present invention in conjunction with the drawings in the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art without creative efforts based on the embodiments in the present invention belong to the scope of protection of the present invention.

[0024] It should be noted that in the description of the present invention, the term "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such process, method, article or device. For those of ordinary skill in the art, the specific meaning of the above terms in the present invention can be understood according to specific circumstances. In addition, "and / or" means at least one of the connected objects, and the character " / " generally indicates an "or" relationship between the associated objects before and after.

[0025] The following will Figures 1-4 describe the metaverse application startup method, device, equipment, storage medium and program product provided by the present invention.

[0026] Figure 1 is one of the flow diagrams of the metaverse application startup method provided by the present invention. As Figure 1 shown, the metaverse application startup method is applied to a user terminal installed with a metaverse application, including but not limited to steps 101 to 103.

[0027] It should be noted that the user terminal to which the metaverse application startup method provided by the present invention is applied can specifically be a server or a computer device, such as a mobile phone, a tablet computer, a laptop computer, a handheld computer, a vehicle-mounted electronic device, a wearable device, an Ultra-Mobile Personal Computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc.

[0028] Step 101: During the initialization and loading process of the capability components in the 3D space of the metaverse application, analyze data in real time based on the software and hardware environment of the user terminal, and determine an optimized configuration scheme for the 3D space.

[0029] The metaverse application mainly includes three parts: a 3D space, an instant messaging room, and an audio and video room.

[0030] Figure 2 is the second flow diagram of the metaverse application startup method provided by the present invention. As Figure 2 shown, after the user terminal passes the login authentication of the metaverse application, the 3D space will perform the step of initializing and loading each capability component.

[0031] During the initialization and loading process, first, the integrity and correctness of the 3D space scene resource package are checked. After the integrity and correctness checks are completed, the 3D space scene is pre-loaded, that is, the initialization and loading of each capability component in the 3D space are performed. After the initialization and loading of the 3D space scene are completed, the metaverse application will synchronously join the instant messaging room and the audio-video room.

[0032] Generally speaking, the three parts of the 3D space, the instant messaging room, and the audio-video room will be in one-to-one correspondence through a unique identifier. Only when all three are successfully initialized and loaded can the user normally use the application function menu in the metaverse space through the user terminal, such as using functions like audio calls and local signal source screen mirroring.

[0033] Specifically, during the initialization and loading of the capability components in the 3D space of the metaverse application, the software and hardware environment of the user terminal installed with the metaverse application is automatically analyzed to obtain real-time analysis data of the software and hardware environment of the user terminal, and an optimized configuration plan for the 3D space is automatically generated and determined based on the real-time analysis data of the software and hardware environment.

[0034] It can be understood that the optimized configuration plan includes the configuration values of multiple service quality parameters in the 3D space of the metaverse application (such as graphics option parameters, audio setting parameters, network configuration parameters, etc.), which are used to optimize and adjust the default service quality parameters in the 3D space of the metaverse application.

[0035] Step 102: Configure the service quality parameters of the 3D space based on the user's configuration operation regarding the application of the optimized configuration plan.

[0036] Among them, the user's configuration operation regarding the application of the optimized configuration plan can either be a preset default operation or an input operation received by the user terminal through the human-computer interaction interface after the optimized configuration plan for the 3D space is determined.

[0037] For example, the user can pre-configure to default to use the optimized configuration plan determined by the user terminal based on the real-time analysis data of the software and hardware environment to configure the service quality parameters of the 3D space. In this case, after the user terminal automatically determines the optimized configuration plan, it will automatically use the optimized configuration plan to configure the service quality parameters of the 3D space, without any input operation required from the user during this period.

[0038] For another example, after automatically determining the optimized configuration plan, the user terminal pops up a window through the human-computer interaction interface. The detailed content or summary of the optimized configuration plan can be displayed in the window. At the same time, the window provides an approval option to approve the application of the optimized configuration plan and a negative option to disapprove the application of the optimized configuration plan. The user performs an input operation by clicking the approval option or the negative option. In this case, the user terminal automatically configures the quality of service parameters of the 3D space by using the optimized configuration plan according to the input operation of the user clicking the approval option; or, the user terminal configures the quality of service parameters of the 3D space according to the default quality of service parameters of the 3D space of the pre-set metaverse application according to the input operation of the user clicking the negative option, without optimizing and adjusting the default quality of service parameters of the 3D space.

[0039] For yet another example, after automatically determining the optimized configuration plan, the user terminal splits the optimized configuration plan into several configuration steps and gradually guides the user to configure the quality of service parameters of the 3D space through operations such as click operations and input operations through the human-computer interaction interface. Even users with unskilled techniques can accurately configure the quality of service parameters of the 3D space.

[0040] Step 103: When the initialization loading of the 3D space, the audio-video room of the metaverse application, and the instant messaging room of the metaverse application are all completed, the metaverse application starts up successfully.

[0041] Specifically, after configuring the quality of service parameters of the 3D space based on the user's configuration operation regarding the application of the optimized configuration plan, the initialization loading of the 3D space scene is completed, and the metaverse application synchronously joins the instant messaging room and the audio-video room, and the initialization loading of the instant messaging room and the audio-video room is completed. When the initialization loading of the 3D space, the instant messaging room, and the audio-video room of the metaverse application are all completed, the metaverse application starts up successfully, and the user can normally use the application function menu of the metaverse space through the human-computer interaction interface of the user terminal.

[0042] The metaverse startup method provided by the present invention automatically determines an optimized configuration plan for the 3D space by analyzing in real time the dynamic software and hardware environment data of the user terminal during the initialization and loading process of the capability components in the 3D space of the metaverse application each time it is started, rather than just the static hardware analysis data of the user terminal. This can avoid ignoring the requirements of key performance indicators such as real-time rendering, network latency, and data processing during the actual operation of the metaverse application, enabling the optimized configuration plan to meet the performance requirements of the metaverse application with high operating requirements during actual operation on the user terminal and avoiding unexpected performance problems during the actual use of the metaverse application. At the same time, based on the user's configuration operations on the application optimized configuration plan, the quality of service parameters of the 3D space are configured, achieving accurate, automatic, and adaptive real-time adjustment of the metaverse application startup configuration to a great extent, which is very user-friendly and can improve the user experience during the operation of the metaverse application after startup.

[0043] Based on the above embodiments, as an alternative embodiment, the determining of the optimized configuration plan for the 3D space based on the real-time analysis data of the software and hardware environment of the user terminal includes: When it is determined that there is a bottleneck item in the user terminal based on the throughput data of the metaverse application and the response time data of the metaverse application, compare the hardware configuration parameters of the user terminal with the recommended hardware configuration parameters of the metaverse application to determine the bottleneck item; Based on the bottleneck item, determine the optimized configuration plan.

[0044] The throughput data of the metaverse application is the number of requests processed and completed by the metaverse application per unit time; the response time data of the metaverse application is the time required for the metaverse application to process requests.

[0045] The throughput data and response time data of the metaverse application are used to jointly characterize the performance of the current user terminal in running the metaverse application, and then to determine whether there is a bottleneck item in the user terminal.

[0046] Specifically, when automatically determining the optimized configuration plan for the 3D space using the real-time analysis data of the software and hardware environment of the user terminal, first, according to some software operation performance data in the real-time analysis data of the software and hardware environment, specifically, the throughput data and response time data of the metaverse application during the initialization and loading process of the 3D space capability components, judge whether there is a bottleneck item in the user terminal according to the ratio between the throughput data and the response time data. When it is determined that there is a bottleneck item in the user terminal, compare the hardware configuration parameters of the user terminal with the recommended hardware configuration parameters of the metaverse application one by one to identify the hardware configuration of the user terminal that may affect the operation performance of the metaverse application as the bottleneck item. After automatically identifying the bottleneck item, further determine the optimized configuration plan according to the bottleneck item.

[0047] Among them, the recommended hardware configuration parameters for the metaverse application are determined based on the hardware configuration parameters recorded in the usage instructions of the metaverse application published on the Internet and are pre-stored on the user terminal.

[0048] The metaverse startup method provided by the present invention first preliminarily determines whether there are bottleneck items in the user terminal based on some software operation performance parameters of the metaverse application, that is, based on the throughput data and response time data of the metaverse application. And when it is determined that there are bottleneck items in the user terminal, the bottleneck items of the user terminal are accurately diagnosed by comparing with the hardware configuration parameters one by one, so as to further automatically determine an optimization configuration plan for the bottleneck items faced by the user terminal when running the metaverse application. At the same time, it can also improve the detection speed of the bottleneck items of the user terminal, and then improve the efficiency of determining the optimization configuration plan.

[0049] Based on the above embodiments, as an alternative embodiment, determining the optimization configuration plan based on the bottleneck items includes: Determining the optimization configuration plan based on the hardware performance parameters of the user terminal, the demand assessment data of the metaverse application, the version compatibility check data between the user terminal and the metaverse application, the process resource occupancy data of other application software, the bottleneck items, and the risk assessment data of the bottleneck items; The other application software is application software deployed on the user terminal and other than the metaverse application.

[0050] Among them, the hardware performance parameters of the user terminal are data obtained by comprehensively evaluating the hardware performance of the user terminal. The hardware performance of the user terminal includes, but is not limited to, several performance indicators such as the processing speed of the central processing unit (CPU), the processing speed of the graphics processing unit (GPU), the size of the random access memory (RAM), the type of RAM, the read and write speed of the storage device, and the data transmission rate of the network card.

[0051] The demand assessment data of the metaverse application is data obtained by evaluating the hardware of the user terminal based on the specific requirements of the metaverse application such as 3D rendering and real-time data processing.

[0052] The version compatibility check data between the user terminal and the metaverse application is data obtained by analyzing the operating system version of the user terminal and its compatibility, security, stability, and the latest application update status with the metaverse application.

[0053] The process resource occupancy data of other application software is data obtained by identifying the resource occupancy of other application software deployed on the user terminal (excluding the metaverse application) on the user terminal (such as CPU occupancy, memory occupancy, etc.).

[0054] The risk assessment data of the bottleneck items is obtained by performing a risk assessment on the identified bottleneck items of the user terminal, that is, by performing a risk assessment on the possible impact of the bottleneck items on the performance and stability of the metaverse application.

[0055] Specifically, when automatically determining the optimization configuration plan after detecting the bottleneck items of the user terminal, analysis is simultaneously performed based on the bottleneck items of the user terminal, the risk assessment data of the bottleneck items, the hardware performance parameters of the user terminal, the demand assessment data of the metaverse application, the version compatibility check data between the user terminal and the metaverse application, and the process resource occupancy data of other application software, and the optimization configuration plan is automatically determined.

[0056] The metaverse startup method provided by the present invention comprehensively, synthetically, and real-time analyzes the software and hardware environments among the user terminal, the metaverse application, and other application software, covering all aspects such as real-time graphics processing capabilities, data processing speeds, and system resource management. Therefore, during the automatic determination process of the optimization configuration plan, the performance bottlenecks and optimization potentials of the software and hardware are considered, and a more applicable optimization configuration plan is provided for the metaverse application deployed on the user terminal, so as to improve the running performance and stability of the metaverse application after startup, thereby providing a more smooth and immersive usage experience of the metaverse application for users.

[0057] Based on the above embodiments, as an alternative embodiment, determining the optimization configuration plan based on the hardware performance parameters of the user terminal, the demand assessment data of the metaverse application, the version compatibility check data between the user terminal and the metaverse application, the process resource occupancy data of other application software, the bottleneck items, and the risk assessment data of the bottleneck items includes:[[]] Based on the hardware performance parameters, the demand assessment data, the version compatibility check data, the process resource occupancy data, the bottleneck items, and the risk assessment data, determining the real-time analysis data of the software and hardware environment; Inputting the real-time analysis data of the software and hardware environment into a pre-trained feature extraction model to obtain a feature vector output by the feature extraction model; Inputting the feature vector into a pre-trained optimization configuration plan determination model to obtain the optimization configuration plan output by the optimization configuration plan determination model; The optimization configuration plan determination model is constructed based on a reinforcement algorithm.

[0058] Among them, the optimized configuration scheme determination model is trained based on the feature vector samples of historical environment analysis data and the corresponding configuration parameter tags of metaverse applications.

[0059] Optionally, the feature extraction model is constructed based on Deep Convolutional Neural Networks (DCNN).

[0060] Specifically, a feature extraction model is pre-constructed based on neural networks such as DCNN, and the pre-training of the feature extraction model is completed. An optimized configuration scheme determination model is pre-constructed based on a reinforcement algorithm, and the optimized configuration scheme determination model is pre-trained based on the feature vector samples of historical environment analysis data and the corresponding configuration parameter tags of metaverse applications.

[0061] When automatically determining the optimized configuration scheme, the real-time analysis data of the software and hardware environment is determined according to the hardware performance parameters of the user terminal, the requirement evaluation data of the metaverse application, the version compatibility check data between the user terminal and the metaverse application, the process resource occupancy data of other application software, the bottleneck items of the user terminal, and the risk assessment data of the bottleneck items.

[0062] The real-time analysis data of the software and hardware environment is input into the pre-trained feature extraction model to obtain the feature vector output by the feature extraction model. The feature vector is input into the pre-trained optimized configuration scheme determination model to obtain the optimized configuration scheme output by the optimized configuration scheme determination model.

[0063] The metaverse startup method provided by the present invention comprehensively, synthetically, and real-timely analyzes the software and hardware environment among the user terminal, the metaverse application, and other application software by using a reinforcement intelligent algorithm, deeply and fully evaluates the environmental adaptability, performance bottleneck, optimization potential, etc. of the metaverse application on the current user terminal, so as to automatically provide a more accurate and targeted optimized configuration scheme for the user for the in-depth analysis of the metaverse application running environment, and can be configured based on the user's configuration operation on the application optimized configuration scheme, greatly simplifying the user's manual configuration process, overcoming the complexity and fault tolerance problems of manual configuration, and being particularly suitable for non-technical users, so as to improve the operation efficiency after the metaverse application is started through optimized configuration and significantly improve the user's usage experience.

[0064] Optionally, the reinforcement algorithm includes the deep Q-learning algorithm and the competitive Q-learning algorithm, that is, the optimized configuration scheme determination model is constructed based on the deep Q-learning algorithm and the competitive Q-learning algorithm, and the obtained optimized configuration scheme determination model is a Markov process model.

[0065] In this case, after the feature vector is input into the optimization configuration scheme determination model, the deep Q-learning algorithm makes action selections and evaluates the effects of the selected actions. According to the quality-of-service parameters before and after optimization, the return value for training the optimization configuration scheme determination model is determined. The return value is divided into a running environment return value and an action return value, and the competitive Q-learning algorithm is used to calculate the Q value.

[0066] Among them, the return value is divided into a running environment return value and an action return value, and the formula for calculating the Q value using the competitive Q-learning algorithm is as follows: ; Among them, is the Q value, that is, the return value; is the running environment return value; is the action return value.

[0067] By continuously calculating and comparing the magnitudes of the Q values, the optimization suggestion recommendation result is obtained. The running environment information will change accordingly under different operating modes. The competitive Q-learning algorithm can obtain different running environment return values for different operating modes, enhancing the generalization ability of the model, improving the algorithm performance, and making the model more accurate and reasonable.

[0068] Based on the above embodiments, as an alternative embodiment, the optimization configuration scheme determination model follows the following constraints: In the case where the spatial frame rate (Frames Per Second, FPS) of the 3D space in the hardware performance parameters is lower than the preset frame rate threshold, or in the case where the version compatibility check data indicates incompatibility between the user terminal and the metaverse application, the metaverse space dimension in the optimization configuration scheme is 2D; And, the 3D space image quality in the optimization configuration scheme is determined based on the frame rate gradient interval where the spatial frame rate is located; different frame rate gradient intervals are pre-associated with different 3D space image qualities.

[0069] Specifically, as shown in Figure 2 , when obtaining the optimization configuration scheme based on the optimization configuration scheme determination model, two constraints need to be followed. On the one hand, the optimization configuration scheme determination model will determine that the metaverse space dimension in the quality-of-service parameters is 2D when any one of the following two situations occurs. One is when, through environmental analysis, it is obtained that the spatial frame rate of the 3D space in the hardware performance parameters of the user terminal is lower than the preset frame rate threshold (such as 10 frames), the metaverse space dimension is determined to be 2D. The other is when, through environmental analysis, it is obtained that the version compatibility check data indicates incompatibility between the user terminal and the metaverse application, the metaverse space dimension is determined to be 2D.

[0070] On the other hand, the 3D spatial picture quality among the service quality parameters of the optimized configuration scheme is determined according to the frame rate gradient interval where the spatial frame rate is located in the hardware performance parameters. That is, according to the frame rate gradient interval where the spatial frame rate is located, the 3D spatial picture quality pre-associated with the frame rate gradient interval where the spatial frame rate is located is determined as the 3D spatial picture quality in the optimized configuration scheme.

[0071] For example, the frame rate gradient intervals are 10 - 30 frames, 31 - 60 frames, and above 61 frames respectively. Correspondingly, when the spatial frame rate is in the frame rate gradient interval of 10 - 30 frames, the 3D spatial picture quality in the optimized configuration scheme is low; when the spatial frame rate is in the frame rate gradient interval of 31 - 60 frames, the 3D spatial picture quality in the optimized configuration scheme is medium; when the spatial frame rate is in the frame rate gradient interval of above 61 frames, the 3D spatial picture quality in the optimized configuration scheme is high.

[0072] The metaverse startup method provided by the present invention automatically determines that the metaverse space dimension in the optimized configuration scheme is 2D during the initialization and loading process of the ability components in the 3D space when the spatial frame rate is lower than a certain degree, or when it is detected that the user terminal belongs to an incompatible terminal device, so as to prompt and guide the user to switch the metaverse application to the 2D version, ensuring the running compatibility and smoothness of the metaverse application; meanwhile, when the metaverse space dimension is 3D, the 3D spatial picture quality is determined according to the frame rate gradient interval where the spatial frame rate is located, realizing the adaptive dynamic adjustment of the 3D spatial picture quality of the metaverse application within the range of spatial frame rate changes during the startup process, enabling the metaverse application to adapt to different user terminals, ensuring the smoothness of the space, and improving the user experience.

[0073] Optionally, after the metaverse application is started successfully, it further includes: automatically adjusting the 3D spatial picture quality according to the frame rate gradient interval where the spatial average frame rate is located within a preset period.

[0074] For example, the preset period is set to 5 minutes, and it is judged every 5 minutes whether the 3D spatial picture quality needs to be adjusted. According to the spatial frame rate detected in the recent 5 minutes, the spatial average frame rate is determined, and then according to the frame rate gradient interval where the spatial average frame rate is located, the 3D spatial picture quality is adjusted to the 3D spatial picture quality pre-associated with the frame rate gradient interval.

[0075] By continuously monitoring the spatial frame rate during the operation of the metaverse application and automatically and dynamically adjusting the 3D spatial picture quality according to the spatial frame rate, the operation of the metaverse application can adapt to the real-time resource occupancy of user terminals with different configurations, which can further improve the user experience.

[0076] Based on the above embodiments, as an optional embodiment, after the metaverse application is started successfully, it further includes: Determine the network connection quality based on the network bandwidth, packet loss rate, and data transmission rate of the real-time audio and video data transmitted by the metaverse application; Adjust the encoding bit rate or resolution of the audio and video data based on the network connection quality.

[0077] Specifically, after the metaverse application is started, when using functions such as audio calls and local signal source screen mirroring of the metaverse application, continuously and real-time monitor the network quality index data of the real-time audio and video data transmitted by the metaverse application based on technologies such as Web Real-Time Communication (WebRTC), including but not limited to network bandwidth, packet loss rate, and data transmission rate. Further determine the current network connection quality of the metaverse application based on the network bandwidth, packet loss rate, and data transmission rate, and adjust the encoding bit rate and resolution of the audio and video data according to the network connection quality.

[0078] For example, in the case of poor network connection quality, reduce the encoding bit rate and / or resolution of the audio and video data to reduce the transmission volume of the audio and video data, thereby reducing network congestion and latency; in the case of good network connection quality, increase the encoding bit rate and / or resolution of the audio and video data, thereby providing higher audio and video quality for users.

[0079] Optionally, the adjusting the encoding bit rate or resolution of the audio and video data based on the network connection quality includes: determining the target encoding bit rate and target resolution pre-associated with the target network quality interval based on the target network quality interval where the network connection quality is located, and adjusting the encoding bit rate of the audio and video data to the target encoding bit rate and the resolution to the target resolution.

[0080] For example, when the network connection quality is converted to a percentage value between 80% and 100%, the network connection quality is "excellent", and the encoding bit rate and resolution of the audio and video data are adjusted based on the target encoding bit rate and target resolution pre-associated with the target network quality interval of 80% to 100%. Similarly, when the network connection quality is converted to a percentage value between 60% and 80%, the network connection quality is "good"; when the network connection quality is converted to a percentage value between 40% and 60%, the network connection quality is "average"; when the network connection quality is converted to a percentage value between 20% and 40%, the network connection quality is "poor"; when the network connection quality is converted to a percentage value between 0% and 20%, the network connection quality is "very poor".

[0081] The metaverse startup method provided by the present invention can continuously and real-time monitor the network bandwidth, packet loss rate, and data transmission rate during the operation of the metaverse through an adaptive bitrate and resolution adjustment mechanism to evaluate the network connection quality, and automatically adjust the encoding bitrate and resolution of audio and video data according to the network connection quality, providing the best audio and video quality experience for users while ensuring the stability of the call to the greatest extent.

[0082] Based on the above embodiments, as an optional embodiment, after the metaverse application is started successfully, the following steps are further included: In the case where an exception event is thrown by the audio and video SDK or the number of failed heartbeat request calls in the audio and video room exceeds a preset threshold, re-enter the 3D space.

[0083] Specifically, after the metaverse application is started successfully, in the case where an exception event is thrown by the audio and video SDK, execute the re-entry space logic to re-enter the 3D space of the metaverse application. Alternatively, in the case where the number of failed heartbeat request calls in the audio and video room exceeds a preset threshold (such as 3 times, 5 times, etc.), execute the re-entry space logic to re-enter the 3D space of the metaverse application and reload the 3D scene resources.

[0084] Compared with re-entering the 3D space when an exception event is thrown by the audio and video SDK once, the reason for executing the re-entry space logic only when the number of failed heartbeat request calls in the audio and video room exceeds the preset threshold is that it is considered that there are many cases where the heartbeat request failure will probably return to normal in a short time. Therefore, time when the number of failed heartbeat request calls does not exceed the preset threshold is reserved for fault tolerance to avoid frequent re-entry into the 3D space.

[0085] Optionally, during the process of re-entering the 3D space, ignore the exception events thrown by the audio and video SDK again and the situation where the number of failed heartbeat request calls in the audio and video room exceeds the preset threshold until the process of re-entering the 3D space is completed.

[0086] Optionally, after re-entering the 3D space, if an exception event is thrown by the audio and video SDK again or the number of failed heartbeat request calls in the audio and video room exceeds the preset threshold within a preset duration, send the exception information to the calling end, and the calling end will make further processing according to the exception information.

[0087] The metaverse startup method provided by the present invention relies on audio-video components to obtain clear error information given when an error or exception occurs, automatically checks the quality of the audio-video service of the metaverse application to identify abnormalities, and when an exception event is thrown by the audio-video SDK or the number of failed heartbeat request calls in the audio-video room exceeds a preset number threshold, re-enters the 3D space of the metaverse application in a timely manner, automatically resumes normal services as much as possible, maintains the good operation of the metaverse application, and provides a good user experience.

[0088] Based on the above embodiments, as an alternative embodiment, the re-entry into the 3D space when an exception event is thrown by the audio-video SDK or the number of failed heartbeat request calls in the audio-video room exceeds a preset number threshold includes: When an exception event occurs or the number of failed heartbeat request calls in the audio-video room exceeds a preset number threshold, an input box pops up on the human-computer interaction interface of the user terminal; the input box is used to receive an input instruction from the user indicating re-entry into the 3D space; In response to the input instruction, re-enter the 3D space.

[0089] Specifically, when an exception event occurs or the number of failed heartbeat request calls in the audio-video room exceeds a preset number threshold, an input box pops up on the human-computer interaction interface of the user terminal. The input box includes information prompting the user that the current network has changed or is unstable and suggesting re-entry into the 3D space, and also includes a cancel button and a re-enter button to indicate whether the user decides to re-enter the 3D space. If the input box receives an operation where the user clicks the re-enter button, an input instruction from the user indicating re-entry into the 3D space is further generated, and the user terminal and the metaverse application respond to this input instruction and execute the re-entry space logic, forcibly exiting the 3D space of the metaverse application and re-entering.

[0090] During the process of re-entering the 3D space, a re-entering prompt message is continuously displayed at the top of the human-computer interaction interface. After successfully re-entering the 3D space, the re-entering prompt message disappears and is replaced by a re-entry successful prompt message.

[0091] The metaverse startup method provided by the present invention re-enters the 3D space only when an input instruction from the user indicating re-entry into the 3D space is received, avoiding the situation where the user does not want to re-enter the 3D space but the system automatically forces re-entry into the 3D space, thus improving the user experience.

[0092] In one embodiment, the human-computer interaction interface is a user-friendly interface for presenting performance analysis results and optimization suggestions and collecting user feedback; the human-computer interaction interface also provides personalized user interface adjustment suggestions according to user preferences and device performance; adjusts the interface layout, icon size, and color theme to provide a more comfortable and friendly user interface; takes into account that different users may have different interaction habits and can automatically adjust the interaction method, such as touch control, voice control, or traditional keyboard and mouse control, based on the user's historical interaction data, to enhance the intuitiveness and convenience of operation.

[0093] Figure 3 is a schematic structural diagram of the metaverse application startup device provided by the present invention, as Figure 3 shown, the metaverse application startup device includes, but is not limited to, an optimization solution determination module 301, a service quality configuration module 302, and an application startup module 303.

[0094] The optimization solution determination module 301 is configured to determine an optimization configuration solution for the 3D space based on real-time analysis data of the software and hardware environment of the user terminal during the initialization and loading process of the capability components in the 3D space of the metaverse application.

[0095] The service quality configuration module 302 is configured to configure the service quality parameters of the 3D space based on the user's configuration operation for applying the optimization configuration solution.

[0096] The application startup module 303 is configured to complete the startup of the metaverse application when the initialization and loading of the 3D space, the audio-video room of the metaverse application, and the instant messaging room of the metaverse application are all completed.

[0097] It should be noted that the metaverse application startup device provided by the present invention can execute the metaverse application startup method described in any of the above embodiments during specific operation, and this embodiment will not be elaborated herein.

[0098] The metaverse application startup device provided by the present invention automatically determines an optimized configuration solution for the 3D space by analyzing in real time the dynamic software and hardware environment data of the user terminal during the initialization and loading process of the capability components in the 3D space of the metaverse application each time it starts, rather than just the static hardware analysis data of the user terminal. This can avoid overlooking the requirements for key performance indicators such as real-time rendering, network latency, and data processing during the actual operation of the metaverse application, enabling the optimized configuration solution to meet the performance requirements of high-running metaverse applications when actually running on the user terminal and avoiding unexpected performance problems during the actual use of the metaverse application. At the same time, based on the user's configuration operations regarding the application optimization configuration solution, the quality of service parameters of the 3D space are configured, achieving accurate, automatic, and adaptive real-time adjustment of the metaverse application startup configuration to a great extent. It is very user-friendly and can improve the user experience of the metaverse application after startup.

[0099] Figure 4 is a schematic structural diagram of the electronic device provided by the present invention, as Figure 4 shown, the electronic device may include: a processor (Processor) 410, a communication interface (Communications Interface) 410, a memory (Memory) 430, and a communication bus 440. Among them, the processor 410, the communication interface 410, and the memory 430 complete mutual communication through the communication bus 440. The processor 410 can call the logical instructions in the memory 430 to execute the metaverse application startup method provided in any of the above embodiments. The metaverse application startup method includes, but is not limited to, the following steps: during the initialization and loading process of the capability components in the 3D space of the metaverse application, determining an optimized configuration solution for the 3D space based on the real-time analysis data of the software and hardware environment of the user terminal; configuring the quality of service parameters of the 3D space based on the user's configuration operations regarding the application of the optimized configuration solution; when the initialization and loading of the 3D space, the audio-video room of the metaverse application, and the instant messaging room of the metaverse application are all completed, the metaverse application startup is completed.

[0100] In addition, when the logical instructions in the above-mentioned memory 430 are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs that can store program codes.

[0101] On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the metaverse application startup method provided in any of the above embodiments. The metaverse application startup method includes, but is not limited to, the following steps: during the initialization and loading process of the capability components of the 3D space of the metaverse application, analyzing data in real time based on the software and hardware environment of the user terminal to determine an optimized configuration plan for the 3D space; configuring the quality of service parameters of the 3D space based on the user's configuration operation for applying the optimized configuration plan; when the initialization and loading of the 3D space, the audio-video room of the metaverse application, and the instant messaging room of the metaverse application are all completed, the startup of the metaverse application is completed.

[0102] On another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the metaverse application startup method provided in any of the above embodiments. The metaverse application startup method includes, but is not limited to, the following steps: during the initialization and loading process of the capability components of the 3D space of the metaverse application, analyzing data in real time based on the software and hardware environment of the user terminal to determine an optimized configuration plan for the 3D space; configuring the quality of service parameters of the 3D space based on the user's configuration operation for applying the optimized configuration plan; when the initialization and loading of the 3D space, the audio-video room of the metaverse application, and the instant messaging room of the metaverse application are all completed, the startup of the metaverse application is completed.

[0103] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement it without creative work.

[0104] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0105] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for starting a metaverse application, characterized in that, Applied to a user terminal installed with a metaverse application, including: During the initialization and loading process of the capability components in the 3D space of the metaverse application, analyze data in real time based on the software and hardware environment of the user terminal to determine an optimization configuration plan for the 3D space; Configure the quality of service parameters of the 3D space based on the user's configuration operation for applying the optimization configuration plan; When the initialization and loading of the 3D space, the audio and video room of the metaverse application, and the instant messaging room of the metaverse application are all completed, the metaverse application starts up successfully.

2. The method for starting a metaverse application according to claim 1, wherein, The step of analyzing data in real time based on the software and hardware environment of the user terminal to determine an optimization configuration plan for the 3D space includes: When it is determined that there is a bottleneck item in the user terminal based on the throughput data of the metaverse application and the response time data of the metaverse application, compare the hardware configuration parameters of the user terminal with the recommended hardware configuration parameters of the metaverse application to determine the bottleneck item; Determine the optimization configuration plan based on the bottleneck item.

3. The method for starting a metaverse application according to claim 2, wherein The step of determining the optimization configuration plan based on the bottleneck item includes: Determine the optimization configuration plan based on the hardware performance parameters of the user terminal, the requirement assessment data of the metaverse application, the version compatibility check data between the user terminal and the metaverse application, the process resource occupancy data of other application software, the bottleneck item, and the risk assessment data of the bottleneck item; The other application software is the application software deployed on the user terminal except the metaverse application.

4. The method for starting a metaverse application according to claim 3, wherein The step of determining the optimization configuration plan based on the hardware performance parameters of the user terminal, the requirement assessment data of the metaverse application, the version compatibility check data between the user terminal and the metaverse application, the process resource occupancy data of other application software, the bottleneck item, and the risk assessment data of the bottleneck item includes: Determine the real-time analysis data of the software and hardware environment based on the hardware performance parameters, the requirement assessment data, the version compatibility check data, the process resource occupancy data, the bottleneck item, and the risk assessment data; Input the real-time analysis data of the software and hardware environment into a pre-trained feature extraction model to obtain a feature vector output by the feature extraction model; Input the feature vector into a pre-trained optimization configuration plan determination model to obtain the optimization configuration plan output by the optimization configuration plan determination model; The optimization configuration plan determination model is constructed based on a reinforcement algorithm.

5. The method for starting a metaverse application according to claim 4, wherein, The optimization configuration plan determination model follows the following constraints: When the spatial frame rate of the 3D space in the hardware performance parameters is lower than a preset frame rate threshold, or when the version compatibility check data indicates incompatibility between the user terminal and the metaverse application, the metaverse space dimension in the optimization configuration plan is 2D; And, the 3D space image quality in the optimization configuration plan is determined based on the frame rate gradient interval where the spatial frame rate is located; different frame rate gradient intervals are pre-associated with different 3D space image qualities.

6. The method for starting a metaverse application according to claim 1, wherein After the metaverse application is successfully launched, the following steps are also included: Determine the network connection quality based on the network bandwidth, packet loss rate, and data transmission rate of the real-time audio and video data transmitted by the metaverse application; Adjust the encoding bit rate or resolution of the audio and video data based on the network connection quality.

7. The method for starting a metaverse application according to claim 1, wherein After the metaverse application is successfully launched, the following steps are also included: Re-enter the 3D space when an exception event is thrown by the audio and video SDK or the number of failed heartbeat request calls in the audio and video room exceeds a preset threshold.

8. The method for starting a metaverse application according to claim 7, wherein The step of re-entering the 3D space when an exception event is thrown by the audio and video SDK or the number of failed heartbeat request calls in the audio and video room exceeds a preset threshold includes: When the exception event occurs or the number of failed heartbeat request calls in the audio and video room exceeds the preset threshold, an input box pops up on the human-computer interaction interface of the user terminal; the input box is used to receive an input instruction from the user indicating to re-enter the 3D space; Respond to the input instruction and re-enter the 3D space.

9. A metaverse application startup device, characterized in that, Deployed on a user terminal installed with a metaverse application, it includes: An optimization plan determination module, which is used to analyze data in real time based on the software and hardware environment of the user terminal during the initialization and loading process of the capability components in the 3D space of the metaverse application, and determine the optimization configuration plan for the 3D space; A service quality configuration module, which is used to configure the service quality parameters of the 3D space based on the user's configuration operation for applying the optimization configuration plan; An application launch module, which is used to launch the metaverse application when the initialization and loading of the 3D space, the audio and video room of the metaverse application, and the instant messaging room of the metaverse application are all completed.

10. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, characterized in that, When the processor executes the computer program, it implements the metaverse application launch method according to any one of claims 1 to 8.

11. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the metaverse application launch method according to any one of claims 1 to 8.

12. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the metaverse application launch method according to any one of claims 1 to 8.

Images