Visual development engine loading method and device of mixed reality display equipment, equipment and storage medium

By creating workspaces in the development project package of mixed reality display equipment and establishing mapping information between native engineering and visual development engines, the problem of low loading efficiency of visual development engines in the existing technology is solved, and the operation efficiency and user experience are improved.

CN119065742APending Publication Date: 2024-12-03GUANGZHOU HUYA INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411153248.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-21
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

Existing mixed reality display devices are less efficient when loading third-party vision development engines, resulting in reduced operational efficiency.

Method used

Create a workspace in the development project package and establish a native project. Based on the application project content exported by the visual development engine, the mapping information between the native project and the visual development engine is established, so that the native project can be loaded into the visual development engine according to the mapping information at any time after startup. Avoid loading and initialization immediately.

Benefits of technology

Improve the operation efficiency of mixed reality display devices based on vision development engine, ensure efficient resource management, full utilization of functions, optimize user experience and expand the capabilities of vision development engine.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119065742A_ABST
    Figure CN119065742A_ABST
Patent Text Reader

Abstract

The invention provides a visual development engine loading method, device and equipment of mixed reality display equipment and a storage medium, and relates to the technical field of Internet. According to the method, a working area is created in a development project package, and a native project corresponding to a visual development engine is created in the working area; and based on the project content of the application project exported by the visual development engine, establishing mapping information of the native project and the visual development engine in the project content of the native project, so that the native project loads the visual development engine according to the mapping information at any moment after being started, according to the method, related codes of a native project written in project content of an application project are avoided, the visual development engine does not need to be loaded and initialized immediately once the native project is started, the native project can respond to business needs at any moment after starting, the visual development engine is loaded according to mapping information, and the visual development efficiency is improved. Therefore, the operation efficiency of the mixed reality display device based on the visual development engine is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of Internet technology, and in particular to a method, device, equipment and storage medium for loading a visual development engine of a mixed reality display device. Background Art

[0002] With the development of Virtual Reality (VR) and Augmented Reality (AR) technologies, more and more companies are launching mixed reality display device products based on their own operating platforms. These products are usually highly integrated in software design and hardware design.

[0003] Therefore, if a third-party visual development engine is used based on a mixed reality display device product with its own operating platform, such as a game development engine, a real-time 3D content creation platform, a cross-platform game and graphic design environment, etc., it is often necessary to first complete the adaptation of the visual development engine and the operating platform. The current adaptation solution is inefficient during the loading process, which in turn reduces the efficiency of operations based on the visual development engine. Summary of the invention

[0004] The present invention provides a method, device, equipment and storage medium for loading a visual development engine of a mixed reality display device, which can improve the operating efficiency of the mixed reality display device based on the visual development engine.

[0005] The embodiments of the present invention can be implemented as follows:

[0006] In a first aspect, the present invention provides a method for loading a visual development engine of a mixed reality display device, which is applied to a mixed reality display device, wherein a development project package and a visual development engine are deployed on the mixed reality display device, and the method comprises:

[0007] Create a workspace in the development project package, and create a native project in the workspace;

[0008] Based on the engineering content of the application project exported by the visual development engine, mapping information between the native project and the visual development engine is established in the engineering content of the native project, so that the native project can load the visual development engine according to the mapping information at any time after it is started.

[0009] Optionally, the engineering content of the application engineering includes resource content and function content, the engineering content of the native engineering includes engineering target content and source file content, the mapping information includes resource mapping and function mapping, and the step of establishing mapping information between the native engineering and the visual development engine in the engineering content of the native engineering based on the engineering content of the application engineering exported by the visual development engine includes:

[0010] Using the resource content of the application project to establish a resource mapping in the project target content of the native project;

[0011] The functional content of the application project is used to establish a functional mapping in the source file content of the native project.

[0012] Optionally, the resource content of the application project includes an engine framework, a simulator library, resource files, and an engine framework library, the project target content of the native project includes a compilation target, and the step of using the resource content of the application project to establish a resource mapping in the project target content of the native project includes:

[0013] The engine framework, simulator library, resource files and engine framework library are used to edit each construction phase of the compilation target to establish the resource mapping.

[0014] Optionally, the construction phase of the compilation target includes a construction target dependency phase, a link binary file phase, a copy resource phase and an embed framework phase, and the step of editing each construction phase of the compilation target using the engine framework, the simulator library, the resource file and the engine framework library includes:

[0015] Editing the target dependency phase using the engine framework;

[0016] Editing the linked binary file stage using the simulator library;

[0017] Editing the copied resource stage using the resource file;

[0018] The embedded framework stage is edited using the engine framework library.

[0019] Optionally, the functional content of the application project includes a visual system configuration source file, the multi-space application proxy source file, an engine library source file, and a compute shader source file, and the step of using the functional content of the application project to establish a functional mapping in the source file content of the native project includes:

[0020] The visual system configuration source file, the multi-space application proxy source file, the library source file, and the compute shader source file are all added to the source file content of the Vision native project to establish the function mapping.

[0021] Optionally, the step of establishing a function mapping in the source file content of the native project using the function content of the application project further includes:

[0022] Adding a first preset code snippet to the multi-space application proxy source file in the source file content of the native project, so that the native project loads the visual development engine by calling the first preset code snippet;

[0023] A second preset code snippet is added to the multi-space application proxy source file in the source file content of the native project, so that the native project uninstalls the visual development engine by calling the second preset code snippet.

[0024] Optionally, the method further comprises:

[0025] The application project is saved to a dependent directory of the native project, so that the native project can use the functions provided by the application project while being in code isolation from the application project.

[0026] In a second aspect, the present invention provides a visual development engine loading device for a mixed reality display device, which is applied to a mixed reality display device, wherein a development project package and a visual development engine are deployed on the mixed reality display device, and the device comprises:

[0027] A creation module, used to create a workspace in the development project package, and create a native project corresponding to the visual development engine in the workspace, wherein the project development package corresponds to the operating platform of the mixed reality display device;

[0028] A processing module is used to establish mapping information between the native project and the visual development engine in the engineering content of the native project based on the engineering content of the application project exported by the visual development engine, so that the native project can load the visual development engine according to the mapping information at any time after it is started.

[0029] In a third aspect, the present invention provides a mixed reality display device, comprising a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the visual development engine loading method of the mixed reality display device as described in the first aspect above is implemented.

[0030] In a fourth aspect, the present invention provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the visual development engine loading method of the mixed reality display device as described in the first aspect above.

[0031] Compared with the prior art, the visual development engine loading method of the mixed reality display device provided by the present invention is as follows: a workspace is created in the development project package, and a native project corresponding to the visual development engine is created in the workspace, wherein the project development package corresponds to the operating platform of the mixed reality display device; based on the engineering content of the application project exported by the visual development engine, mapping information between the native project and the visual development engine is established in the engineering content of the native project, so that the native project can load the visual development engine according to the mapping information at any time after startup. Since the present invention establishes mapping information between the native project and the visual development engine in the engineering content of the native project based on the engineering content of the application project, the relevant code of the native project written in the engineering content of the application project is avoided, and the visual development engine does not need to be loaded and initialized immediately upon startup of the native project. The native project can respond to business needs at any time after startup and load the visual development engine according to the mapping information, thereby improving the operating efficiency of the mixed reality display device based on the visual development engine. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0033] Figure 1 A flow chart of a method for loading a visual development engine of a mixed reality display device provided by an embodiment of the present invention Figure 1 ;

[0034] Figure 2 A schematic diagram of a process for implementing a resource mapping provided by an embodiment of the present invention;

[0035] Figure 3 A schematic diagram of a process flow of implementing step S202 provided in an embodiment of the present invention;

[0036] Figure 4 A flow chart of a method for loading a visual development engine of a mixed reality display device provided by an embodiment of the present invention Figure 2 ;

[0037] Figure 5 A functional unit block diagram of a visual development engine loading device for a mixed reality display device provided by an embodiment of the present invention;

[0038] Figure 6 A schematic block diagram of the structure of a mixed reality display device provided in an embodiment of the present invention.

[0039] Icons: 100 - visual development engine loading device of mixed reality display device; 101 - creation module; 102 - processing module; 103 - adding module; 200 - mixed reality display device; 210 - memory; 220 - processor; 230 - display; 240 - positioning system; 250 - input device; 260 - audio device; 270 - battery. DETAILED DESCRIPTION

[0040] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.

[0041] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0043] In addition, the terms “first”, “second”, etc., if used, are merely used to distinguish between the descriptions and should not be understood as indicating or implying relative importance.

[0044] It should be noted that, in the absence of conflict, the features in the embodiments of the present invention may be combined with each other.

[0045] In order to improve the operating efficiency of a mixed reality display device based on a visual development engine, the present invention provides a method for loading a visual development engine of a mixed reality display device, which will be introduced in detail below.

[0046] Please refer to Figure 1 The visual development engine loading method of the mixed reality display device includes steps S101 to S102.

[0047] S101, create a workspace in the development project package, and create a native project corresponding to the visual development engine in the workspace.

[0048] Among them, the project development kit is an IDE (Integrated Development Environment) that is compatible with the operating platform of the mixed reality display device and is used to develop applications suitable for the operating platform of the mixed reality display device.

[0049] Native projects created in the development kit can work in conjunction with the visual development engine, enabling the visual development engine to utilize the computer vision capabilities of mixed reality display devices.

[0050] S102, based on the engineering content of the application project exported by the visual development engine, establish mapping information between the native project and the visual development engine in the engineering content of the native project, so that the native project can load the visual development engine according to the mapping information at any time after it is started.

[0051] The application project is generated by the visual development engine and contains the source code, resources, and build scripts of the game or application. The mapping information between the native project and the visual development engine includes resource mapping and function mapping.

[0052] Resource mapping refers to the mapping and conversion of resources in the visual development engine (such as images, models, audio, etc.) with resources in the native project.

[0053] Function mapping refers to the matching and integration of functions in the visual development engine (such as rendering, physics, animation, etc.) with functions in the native project.

[0054] By establishing resource mapping and function mapping, effective collaboration between the visual development engine and the native project is ensured, so that the resources of the visual development engine and the native project are efficiently managed and the functions are fully utilized, thereby improving development efficiency, optimizing user experience, and expanding the capabilities of the visual development engine.

[0055] Optionally, the implementation process of "establishing mapping information between the native project and the visual development engine in the engineering content of the native project based on the engineering content of the application project exported by the visual development engine" may include the following steps: Figure 2 Steps S201 to S202 are shown.

[0056] S201, using the resource content of the application project to establish a resource mapping in the project target content of the native project.

[0057] The resource content of the application project includes the engine framework, simulator library, resource files, and engine framework library. The project target content of the native project includes the compilation target.

[0058] In a possible implementation, each build phase of the compilation target is edited using the engine framework, the simulator library, the resource files, and the engine framework library.

[0059] The various construction phases of the compilation target include the target dependency phase, the link binary file phase, the copy resource phase, and the embed framework phase.

[0060] Use the engine framework to edit the target dependency phase to ensure that the code and resources in the engine framework can be included in the final build product of the compilation target, so that the native project can use the functions and resources provided by the engine framework.

[0061] Using the simulator library to edit the link binary file stage, the code and resources in the simulator library can be included in the final build product of the compilation target, so that the native project can use the functions and resources provided by the simulator library;

[0062] Use the resource file editing and copying stage to include the data, pictures, sounds, and configuration information in the resource file in the final build product of the compilation target, so that the native project can use the data, pictures, sounds, and configuration information provided by the resource file;

[0063] Use the engine framework library to edit the embedded framework stage so that the code and resources in the engine framework library can be included in the final build product of the compilation target, allowing the native project to use the functions and resources provided by the engine framework library.

[0064] The following is an introduction to step S202.

[0065] S202, using the functional content of the application project to establish a functional mapping in the source file content of the native project.

[0066] Among them, the functional content of the application project includes visual system configuration source files, multi-space application agent source files, library source files, and compute shader source files.

[0067] For possible implementations, see Figure 3 , step S202 includes sub-steps S202-1 to S202-3.

[0068] S202-1, add the visual system configuration source file, the multi-space application proxy source file, the library source file and the compute shader source file into the source file content of the native project.

[0069] Among them, the visual system configuration source file refers to the source file used to configure or set up the application, which may contain application-specific settings, such as API keys, service endpoints, user default settings, etc.

[0070] The multi-space application proxy source file refers to the implementation of the application's application proxy class. The application proxy class is a key class for application life cycle management and is responsible for handling events such as application startup, shutdown, and memory warnings. The multi-space application proxy extends the default application proxy to add custom behaviors related to the visual development engine or a specific project.

[0071] A library source file is a set of functions, classes, or structures that can be used in an application. It encapsulates specific functionality related to application logic or provides an interface for interacting with native code.

[0072] Compute shader source files contain shader code used to perform compute-intensive tasks, such as image processing, physics simulations, or other calculations that require GPU acceleration.

[0073] S202-2, adding a first preset code snippet to the multi-space application proxy source file in the source file content of the native project, so that the native project loads the visual development engine by calling the first preset code snippet.

[0074] Among them, the first preset code snippet corresponds to the engine loading method. The engine loading method can be called according to business needs after the native project is started. It is used to initialize the visual development engine, including setting the initial parameters of the visual development engine, loading the visual development engine scene, and initializing the visual development engine game logic.

[0075] The native project calls the first preset code snippet and loads the visual development engine according to business requirements through the engine loading method.

[0076] S202-3, adding a second preset code snippet to the multi-space application proxy source file in the source file content of the native project, so that the native project uninstalls the visual development engine by calling the second preset code snippet.

[0077] Among them, the second preset code snippet corresponds to the engine uninstall method, which is usually called when the native project is closed or the visual development engine resources need to be released. It is used to clean up the visual development engine, including uninstalling scenes, releasing resources occupied by game logic, cleaning up engine settings, and other operations.

[0078] Please refer to Figure 4 The visual development engine loading method of the mixed reality display device also includes step S103.

[0079] S103, saving the application project to a dependency directory of the native project, so that the native project can use functions provided by the application project while being in code isolation from the application project.

[0080] Each time the visual development engine is modified, the newly exported application project must be saved to the dependency directory of the native project so that the native project can use the functions provided by the latest application project.

[0081] The following takes Vision pro, a mixed reality display device, and Unity, a visual development engine, as examples to illustrate the implementation process of the visual development engine loading method of the above mixed reality display device.

[0082] Among them, the operating platform of Vision pro is visionOS, and the project development kit compatible with visionOS can be developed based on Xcode. As an integrated development environment, Xcode can be used for program development on multiple operating platforms. Xcode provides a series of software development tools such as code analysis, interface design, debugging, version control, etc.

[0083] For the process of the above example of this application, combined with the development process of Xcode, a specific implementation example is provided below:

[0084] First, create a new workspace Vision.xcworkspace in Xcode, and add a new native project Vision.xcodeproj in the new workspace. For the application project described in the above embodiment, in this example, it is the Xcode project UnityVisionOS.xcodeproj exported by Unity.

[0085] The resource contents of the application project described in the foregoing embodiments include the engine framework, simulator library, resource files, and engine framework library, which may be UnityFramework, libPolySpatial_xrsimulator.a, Data folder, and UnityFramework.framework, respectively, in this example.

[0086] The compilation target included in the project target content of the native project described in the above embodiment is Target Vision in this example.

[0087] Then, the process of establishing resource mapping between the native project Vision.xcodeproj and Unity is:

[0088] With Target Vision selected, switch to the “Build Phases” tab. In the “Build Phases” area, find the “Target Dependencies” section and add UnityFramework. Find the “Link Binary WithLibraries” section and add libPolySpatial_xrsimulator.a. Find the Copy Bundle Resources section and add the Data folder. Find the “Embed Frameworks” section and add “UnityFramework.framework”.

[0089] By adding UnityFramework to Build Phases-Target Dependencies, "TargetVision" depends on "UnityFramework" before building, ensuring that the code and resources in UnityFramework are included in the final build product of Target Vision, so that the native project Vision.xcodeproj can use the functions and resources provided by UnityFramework.

[0090] By adding libPolySpatial_xrsimulator.a to Build Phases-Link Binary With Libraries, this simulator library is linked to "Target Vision". During the build process of Target Vision, the code of this library will be included in the final executable file, so that the native project Vision.xcodeproj can use the functions and resources provided by libPolySpatial_xrsimulator.a.

[0091] By adding the Data folder to Build Phases-Copy Bundle Resources, the data files, image files, audio files, and configuration files in this folder will be copied to the application package during the build process of Target Vision, so that the native project Vision.xcodeproj can use the data files, image files, audio files, and configuration files in the Data folder.

[0092] By adding UnityFramework.framework to Build Phases-Embed Frameworks, this framework library will be embedded into the application package during the build process of Target Vision, so that the native project Vision.xcodeproj can use the functions and resources provided by UnityFramework.framework.

[0093] Among them, the functional content of the application project described in the previous embodiment includes the visual system configuration source file, multi-space application proxy source file, library source file and compute shader source file, which are UnityVisionOSSettings.swift, UnityPolySpatialAppDelegate.swift, UnityLibrary.swift and ComputeShaders.metal respectively in this example.

[0094] The process of establishing resource mapping between the native project Vision.xcodeproj and Unity is: add UnityVisionOSSettings.swift, UnityPolySpatialAppDelegate.swift, UnityLibrary.swift and ComputeShaders.metal to the native project Vision.xcodeproj, so as to expand or customize the functions of the native project, including integrating VisionOS support, enhancing AR / VR experience and optimizing computationally intensive tasks.

[0095] Modify UnityPolySpatialAppDelegate.swift and add the first preset code snippet and the second preset code snippet to the file to provide the loadUnity and unloadUnity methods, so as to more finely control the loading and unloading process of the Unity engine, more flexibly control the life cycle of the Unity engine, and optimize the performance and resource usage of the native project.

[0096] Add the Xcode project UnityVisionOS.xcodeproj to the dependency directory of the native project Vision.xcodeproj to isolate the two codes.

[0097] When Unity is modified, you only need to replace the original Xcode project in the dependency directory of the native project Vision.xcodeproj with the newly exported Xcode project to make the native project Vision.xcodeproj use the functions provided by the newly exported Xcode project.

[0098] In order to execute the corresponding steps in the above method embodiment and each possible implementation method, an implementation method of a visual development engine loading device 100 of a mixed reality display device is provided below.

[0099] Please refer to Figure 5 The visual development engine loading device 100 of the mixed reality display device includes a creation module 101, a processing module 102 and an adding module 103.

[0100] The creation module 101 is used to create a workspace in the development project package and create a native project corresponding to the visual development engine in the workspace. The project development package corresponds to the operating platform of the mixed reality display device.

[0101] Processing module 102 is used to establish mapping information between the native project and the visual development engine in the engineering content of the native project based on the engineering content of the application project exported by the visual development engine, so that the native project can load the visual development engine according to the mapping information at any time after it is started.

[0102] The adding module 103 is used to save the application project to the dependency directory of the native project, so that the native project can use the functions provided by the application project while being in code isolation from the application project.

[0103] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the visual development engine loading device 100 of the mixed reality display device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0104] Furthermore, the embodiment of the present invention also provides a mixed reality display device 200, please refer to Figure 6 The mixed reality display device 200 may include a memory 210 , a processor 220 , a display 230 , a positioning system 240 , an input device 250 , an audio device 260 , and a battery 270 .

[0105] The processor 220 includes a central processing unit and a graphics processing unit. The central processing unit is used to process and run applications and perform data calculation and processing. The graphics processor is used to render high-quality virtual images and scenes.

[0106] The memory 210 may be a ROM or other type of static storage device that can store static information and instructions, a RAM or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 210 may exist independently and be connected to the processor 220 via a communication bus. The memory 210 may also be integrated with the processor 220. Among them, the memory 210 is used to store machine executable instructions for executing the scheme of the present invention. The processor 220 is used to execute the machine executable instructions stored in the memory 210 to implement the above-mentioned method embodiment.

[0107] The display 230 may be a head-mounted display, which is used to fix the display screen in front of the user's eyes to provide an immersive visual experience.

[0108] The positioning system 240 includes external sensors and internal sensors. The external sensors are used to track the position and orientation of the head mounted display. The internal sensors, such as gyroscopes, accelerometers, and magnetometers, are used to detect the user's head movement.

[0109] The input device 250 includes a handle, a motion tracking glove, and an eye tracker. The handle is usually equipped with buttons, joysticks, and triggers for interacting in a VR environment. The motion tracking glove is used to capture hand movements and provide a more natural interaction method. The eye tracker is used to track the user's eye movements and provide more accurate interaction and visual rendering optimization.

[0110] The audio device 260 includes headphones and a built-in microphone. The headphones are used to provide an immersive audio experience. The built-in microphone is used for voice input and social interaction.

[0111] The battery 270 is used to provide a portable power source for the mixed reality display device.

[0112] Mixed reality display devices may also include an environment perception camera and a depth sensor. The environment perception camera is used to capture images of the real world to achieve the integration of virtual objects with the real environment. The depth sensor is used to measure the distance between the object and the device to help the correct placement of virtual objects in the real space.

[0113] An embodiment of the present invention also provides a computer-readable storage medium containing a computer program. When the computer program is executed, it can be used to perform relevant operations in the visual development engine loading method of the mixed reality display device provided in the above-mentioned method embodiment.

[0114] The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A method for loading a visual development engine of a mixed reality display device, characterized in that: Applied to a mixed reality display device, on which a development project package and a visual development engine are deployed, the method includes: Creating a workspace in the development project package, and creating a native project corresponding to the visual development engine in the workspace, wherein the project development package corresponds to the operating platform of the mixed reality display device; Based on the engineering content of the application project exported by the visual development engine, mapping information between the native project and the visual development engine is established in the engineering content of the native project, so that the native project can load the visual development engine according to the mapping information at any time after it is started.

2. The method according to claim 1, characterized in that The engineering content of the application engineering includes resource content and function content, the engineering content of the native engineering includes engineering target content and source file content, the mapping information includes resource mapping and function mapping, and the step of establishing the mapping information between the native engineering and the visual development engine in the engineering content of the native engineering based on the engineering content of the application engineering exported by the visual development engine includes: Using the resource content of the application project to establish a resource mapping in the project target content of the native project; The functional content of the application project is used to establish a functional mapping in the source file content of the native project.

3. The method according to claim 2, characterized in that The resource content of the application project includes an engine framework, a simulator library, resource files, and an engine framework library, the project target content of the native project includes a compilation target, and the step of using the resource content of the application project to edit and establish a resource mapping in the project target content of the native project includes: The engine framework, simulator library, resource files and engine framework library are used to edit each construction phase of the compilation target to establish the resource mapping.

4. The method according to claim 3, characterized in that The construction phase of the compilation target includes a construction target dependency phase, a link binary file phase, a copy resource phase, and an embed framework phase. The steps of editing each construction phase of the compilation target using the engine framework, simulator library, resource file, and engine framework library include: Editing the target dependency phase using the engine framework; Editing the linked binary file stage using the simulator library; Editing the copied resource stage using the resource file; The embedded framework stage is edited using the engine framework library.

5. The method according to claim 2, characterized in that The functional content of the application project includes a visual system configuration source file, the multi-space application proxy source file, a library source file, and a compute shader source file. The step of using the functional content of the application project to establish a functional mapping in the source file content of the native project includes: The visual system configuration source file, the multi-space application proxy source file, the library source file and the compute shader source file are all added to the source file content of the native project to establish the function mapping.

6. The method according to claim 5, characterized in that The step of using the functional content of the application project to establish a functional mapping in the source file content of the native project also includes: Adding a first preset code snippet to the multi-space application proxy source file in the source file content of the native project, so that the native project loads the visual development engine by calling the first preset code snippet; A second preset code snippet is added to the multi-space application proxy source file in the source file content of the native project, so that the native project uninstalls the visual development engine by calling the second preset code snippet.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: The application project is saved to a dependent directory of the native project, so that the native project can use the functions provided by the application project while being in code isolation from the application project.

8. A visual development engine loading device for a mixed reality display device, characterized in that: Applied to a mixed reality display device, a development project package and a visual development engine are deployed on the mixed reality display device, and the device includes: A creation module, used to create a workspace in the development project package, and create a native project corresponding to the visual development engine in the workspace, wherein the project development package corresponds to the operating platform of the mixed reality display device; A processing module establishes mapping information between the native project and the visual development engine in the engineering content of the native project based on the engineering content of the application project exported by the visual development engine, so that the native project can load the visual development engine according to the mapping information at any time after it is started.

9. A mixed reality display device, characterized in that: It includes a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, it implements the visual development engine loading method of the mixed reality display device as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: It stores a computer program, which, when executed by a processor, implements the visual development engine loading method of the mixed reality display device as described in any one of claims 1 to 7.