Flutter-based augmented reality application development framework and use method

Abstract

The embodiment of the invention provides an augmented reality application development framework based on Flutter and a use method. The framework is applied to the technical field of application development and comprises a core management layer, an API layer and a plug-in system. Wherein the core management layer is used for configuring and initializing system resources, a global state and a preloading service when an application is started; the API layer is used for providing a tool for accessing a core function of an augmented reality application and packaging and abstracting input and output data; by calling resource management and performance monitoring functions provided by the core management layer, stable operation of the augmented reality application function is ensured, and by calling a plug-in interface provided by the plug-in system, function increase is realized; and the plug-in system is used for realizing modular design through a plug-in extension framework. In this way, the development cost can be reduced, the marketing time of products is shortened, and the user satisfaction degree and the application availability are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of application development, and further to the field of augmented reality application development, and in particular to an augmented reality application development framework based on Flutter and a method for using the same. Background Art

[0002] For the two major existing mobile operating systems, Android and iOS, software developers generally need to develop two sets of codes. The company's R&D costs are high, human resources investment is large, version management is complex, and iterative upgrades are time-consuming. At the same time, it is difficult for R&D personnel to develop, and the learning costs and development are also very high.

[0003] Traditional augmented reality application development involves complex programming and multi-platform adaptation issues. Augmented reality applications usually require high-performance graphics and data processing capabilities to achieve a smooth user experience. However, existing development methods often find it difficult to support cross-platform functions without sacrificing performance. Summary of the invention

[0004] The present invention provides an augmented reality application development framework based on Flutter and a method for using the framework, which solves the technical problems in the prior art of high development cost, low efficiency and the need to sacrifice performance to achieve cross-platform functions.

[0005] According to the first aspect of the present disclosure, an augmented reality application development framework based on Flutter is provided. The framework includes: a core management layer, an API layer, and a plug-in system; wherein:

[0006] The core management layer is used to configure and initialize system resources, global status and preload services when the application starts, including starting the services and components required by the API layer at initialization, receiving performance data and error reports from the API layer for resource management and performance monitoring, and managing the loading and unloading of plug-ins to ensure plug-in compatibility and stability;

[0007] The API layer is used to provide tools for accessing the core functions of the augmented reality application and to encapsulate and abstract the input and output data; by calling the resource management and performance monitoring functions provided by the core management layer, the augmented reality application functions are ensured to run stably, and by calling the plug-in interface provided by the plug-in system, the functions are added;

[0008] The plug-in system is used to implement modular design through plug-in extension framework; wherein, when the application is started, the plug-in is registered to the core management layer, and the core management layer maintains the plug-in registry so that the API layer can query the plug-in registry through the core management layer to find and call the plug-in.

[0009] According to the above aspects and any possible implementation, an implementation is further provided, wherein the core management layer includes:

[0010] Adaptation layer, used to resolve differences between operating systems on different target platforms;

[0011] The performance optimization layer is used to adjust and optimize performance according to the hardware characteristics of the target platform;

[0012] Debugging and testing tools for testing and optimizing augmented reality applications.

[0013] According to the above aspects and any possible implementation, an implementation is further provided, wherein the API layer includes:

[0014] API interface, used to provide an interface for developing augmented reality applications;

[0015] The developer toolkit module provides the developer toolkit.

[0016] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the framework further includes:

[0017] Third-party integration modules for seamless integration with mainstream AR tools.

[0018] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the framework further includes:

[0019] Modular design module for adding and / or removing functional modules according to project requirements;

[0020] Interaction design tools for creating user interfaces and interactions;

[0021] Real-time rendering engine, used to provide real-time graphics rendering capabilities.

[0022] According to a second aspect of the present disclosure, a method for using an augmented reality development framework based on Flutter is provided. The method includes: starting the core management layer, configuring and initializing system resources, global status, and preloading services;

[0023] Call services and components in the core management layer to start the API layer, and receive performance data and error reports through the API layer for resource management and performance monitoring;

[0024] Use the core management layer to manage the loading and unloading of plug-ins, ensuring the compatibility and stability of plug-ins with the core management layer and other components;

[0025] The core functions of the augmented reality application are accessed through the tools provided by the API layer, and the input and output data are encapsulated and abstracted. In particular, a developer toolkit module is provided in the API layer to support developers in using the toolkit for application development.

[0026] Call the plug-in interface provided by the plug-in system to add and expand functions.

[0027] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the method includes:

[0028] Resolve differences between target platform operating systems through adaptation layers;

[0029] The performance optimization layer is used to adjust and optimize the performance according to the hardware characteristics of the target platform;

[0030] Use debugging and testing tools to perform performance analysis and real-time debugging to optimize augmented reality apps.

[0031] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the method includes:

[0032] Use API interfaces to develop augmented reality applications;

[0033] Use the developer toolkit module to provide users with a developer toolkit.

[0034] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the method further includes:

[0035] Seamlessly integrate with mainstream AR tools through third-party integration modules to expand the functionality of augmented reality applications.

[0036] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the method further includes:

[0037] Utilize modular design modules to dynamically add and / or remove functional modules based on project requirements;

[0038] Use interactive design tools to create user interfaces and define interaction methods to enhance user experience;

[0039] The real-time rendering engine provides real-time graphics rendering capabilities to ensure the visual effects and performance of augmented reality applications.

[0040] In this disclosure, the design concept of layered services is adopted to divide the Flutter-based augmented reality application development framework into the core management layer, API layer and plug-in system. Through a unified development environment, the application can run seamlessly on different operating systems and devices, which greatly simplifies the development process, reduces development costs, and accelerates the time to market for products. At the same time, the visual and functional consistency of the augmented reality application experience on all platforms is ensured, which improves user satisfaction and application availability; using Flutter's efficient rendering engine, the rendering process of augmented reality application scenarios is optimized, which can provide smooth animation and fast response speed even on resource-constrained devices. The intelligent resource management system effectively reduces the consumption of memory and processing resources, prolongs the use time of the device, and ensures the high performance of the application.

[0041] It should be understood that the contents described in the summary of the invention are not intended to limit the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, among which:

[0043] Figure 1 A structural diagram of an augmented reality application development framework based on Flutter according to an embodiment of the present disclosure is shown;

[0044] Figure 2 A core management layer structure diagram of an augmented reality application development framework based on Flutter according to an embodiment of the present disclosure is shown;

[0045] Figure 3 The API layer structure diagram of the Flutter-based augmented reality application development framework according to an embodiment of the present disclosure is shown;

[0046] Figure 4 Another structural diagram of an augmented reality application development framework based on Flutter according to an embodiment of the present disclosure is shown;

[0047] Figure 5 Another structural diagram of an augmented reality application development framework based on Flutter according to an embodiment of the present disclosure is shown;

[0048] Figure 6 A flow chart of a method for using an augmented reality application development framework based on Flutter according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0050] In addition, the term "and / or" in this article is only a description of the association relationship between the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0051] In the present disclosure, in order to solve the technical problems that traditional AR application development involves complex programming and multi-platform adaptation, and that existing tools and frameworks are often difficult to support cross-platform functions without sacrificing performance, a Flutter-based augmented reality application development framework is proposed, which includes: a core management layer, an API layer, and a plug-in system; by calling each other among the three, the seamless operation of the application on different operating systems and devices is realized, which greatly simplifies the development process and reduces the development cost. At the same time, it ensures the visual and functional consistency of the AR experience on all platforms, improves user satisfaction and application availability; using Flutter's efficient rendering engine, the rendering process of the AR scene is optimized, and smooth animation and fast response speed can be provided even on resource-constrained devices; the intelligent resource management system effectively reduces the consumption of memory and processing resources, prolongs the use time of the device, and ensures the high performance of the application.

[0052] Figure 1 The structure diagram of the augmented reality application development framework 100 based on Flutter according to an embodiment of the present disclosure is shown as follows: Figure 1 As shown in the figure, the augmented reality application development framework based on Flutter includes:

[0053] The core management layer 110, API layer 120, and plug-in system 130 are three modules.

[0054] The core management layer 110 is used to configure and initialize system resources, global status, and preload services when the application starts, including starting the services and components required by the API layer during initialization, receiving performance data and error reports from the API layer for resource management and performance monitoring, and managing the loading and unloading of plug-ins to ensure plug-in compatibility and stability;

[0055] In some embodiments, the core management layer 110 is the core of the framework and is responsible for coordinating the operations of various modules, including initialization, resource management, performance monitoring, and cross-platform adaptation.

[0056] In one possible implementation, the core management layer first needs to be initialized when the application starts. This includes configuring system resources, setting global state, and preloading necessary services.

[0057] In some embodiments, in Flutter, the initialization of resources and services can be managed through constructors and initialization lists. In order to optimize memory and resource management, the Singleton pattern can be used to ensure that the core management layer is globally unique.

[0058] In some embodiments, in Flutter, EventChannel can be used to process events from the native platform, and StreamController can be used to manage the event stream on the Flutter side.

[0059] In some embodiments, flutter's garbage collection mechanism and manual resource management techniques are used to optimize memory usage. The dispose method of an object can be explicitly called to release resources, especially for objects that use a large amount of memory or system resources.

[0060] In some embodiments, data security and privacy protection measures involve how user data is securely processed and stored, especially in a multi-user environment.

[0061] The API layer 120 is used to provide tools for accessing the core functions of the augmented reality application and to encapsulate and abstract the input and output data. It ensures the stable operation of the augmented reality application functions by calling the resource management and performance monitoring functions provided by the core management layer 110, and realizes the addition of functions by calling the plug-in interface provided by the plug-in system.

[0062] In some embodiments, the API layer provides developers with an interface to access AR core functions, including 3D object detection, spatial tracking, image processing, and virtual object rendering.

[0063] In one possible implementation, when designing an API interface, you need to determine which functions are necessary, define clear interfaces for each function, and ensure that their use is both intuitive and consistent.

[0064] In some embodiments, for each API, its specific functionality is implemented. This usually involves calling underlying libraries (such as ARKit or ARCore) or interacting directly with the hardware.

[0065] In some embodiments, to simplify the use of the API and protect the internal logic, the input and output data can be encapsulated and abstracted. A data model is defined to standardize the data exchange format, reduce errors and improve the maintainability of the code.

[0066] In some embodiments, since many AR operations are computationally intensive and may need to wait for hardware input, the asynchronous nature of Dart should be utilized to avoid blocking the UI thread.

[0067] In some embodiments, comprehensive error handling is implemented at the API level.

[0068] In some embodiments, the plugin system supports extending framework functionality through plugins, allowing integration of third-party libraries and services such as Google ARCore, Apple ARKit, and other graphics acceleration tools.

[0069] The plug-in system 130 is used to implement modular design by extending the framework through plug-ins; wherein, when the application starts, the plug-in is registered with the core management layer 110, and the core management layer 110 maintains the plug-in registry so that the API layer 120 can query the plug-in registry through the core management layer 110 to find and call the plug-in.

[0070] Figure 2 A structural diagram of the core management layer 110 of the Flutter-based augmented reality application development framework according to an embodiment of the present disclosure is shown.

[0071] In a possible implementation, Figure 2 As shown in the figure, the core management layer of the Flutter-based augmented reality application development framework includes:

[0072] Adaptation layer 111, performance optimization layer 112, debugging and testing tools 113. Among them,

[0073] Adaptation layer 111, used to resolve differences between operating systems of different target platforms;

[0074] In one possible implementation, Flutter's cross-platform feature enables one-time development and multi-platform deployment. The adaptation layer solves the differences between different operating systems and ensures that the application provides a consistent experience on different devices.

[0075] In some embodiments, Flutter allows Dart code to communicate with platform native code through platform channels. The native layer of iOS and Android needs to implement the startARSession method, which involves calling the ARKit or ARCore API.

[0076] In some embodiments, the adaptation layer defines an abstract interface to shield implementation differences between different platforms, which can greatly improve the maintainability and portability of the code.

[0077] In some embodiments, Flutter supports conditional compilation, which means that different code segments can be compiled from the same code depending on the platform.

[0078] The performance optimization layer 112 is used to adjust and optimize the performance according to the hardware characteristics of the target platform;

[0079] In some embodiments, the performance optimization layer performs performance adjustment and optimization according to the hardware characteristics of the target platform to ensure that the application can run efficiently on all target platforms and provide good performance and user experience.

[0080] In some embodiments, the performance of UI and interaction is optimized to ensure that the application remains smooth even in complex AR scenarios.

[0081] By using Isolate to handle time-consuming tasks, you can avoid blocking the main thread and improve the responsiveness of the UI.

[0082] In some embodiments, real-time performance monitoring and adjustment of the augmented reality application are performed, including real-time monitoring of performance data and dynamic adjustment of the system based on the data.

[0083] In some embodiments, resource and task management is performed, such as memory management, CPU and GPU usage optimization.

[0084] The debugging and testing tool 113 is used to test and optimize the augmented reality application.

[0085] In some embodiments, the prompts and testing tools integrate various debugging tools to help developers test and optimize their AR applications, including performance analyzers and real-time debugging support.

[0086] In one possible implementation, the debugging and testing tool 113 includes a performance analyzer and a real-time debugging tool.

[0087] Figure 3 A structural diagram of the API layer 120 of the Flutter-based augmented reality application development framework according to an embodiment of the present disclosure is shown.

[0088] In some embodiments, Figure 3 As shown in the figure, the API layer of the Flutter-based augmented reality application development framework includes:

[0089] API interface 121, developer toolkit module 122. Among them,

[0090] API interface 121, used to provide an interface for implementing augmented reality application development;

[0091] In some embodiments, the API interface includes 3D object detection, space tracking, image processing, and virtual object rendering.

[0092] The developer toolkit module 122 is used to provide a developer toolkit.

[0093] In some embodiments, the developer toolkit module provides an easy-to-install and use SDK that includes library files, sample code, and detailed documentation.

[0094] Figure 4 Another structural diagram 400 of an augmented reality application development framework based on Flutter according to an embodiment of the present disclosure is shown.

[0095] In some embodiments, Figure 4 As shown, the Flutter-based augmented reality application development framework also includes:

[0096] The third-party integration module 140 is used for seamless integration with mainstream AR tools.

[0097] In some embodiments, the third-party integration module supports seamless integration with mainstream AR tools and services, such as location services, social media integration, and advanced image recognition technology.

[0098] Figure 5 Another structural diagram 500 of an augmented reality application development framework based on Flutter according to an embodiment of the present disclosure is shown.

[0099] In one possible implementation, Figure 5 As shown, the Flutter-based augmented reality application development framework also includes:

[0100] A modular design module 150 for adding and / or removing functional modules according to project requirements;

[0101] In some embodiments, the modular design module allows developers to add or remove functional modules according to project requirements, thereby improving the flexibility and maintainability of the framework.

[0102] Interaction design tools 160, used to create user interfaces and interaction methods;

[0103] In some embodiments, the framework includes a set of visual design and interaction tools that enable developers to create intuitive user interfaces and interactions that support input methods such as touch, voice commands, and gesture control.

[0104] In one possible implementation, Flutter's interaction design is not limited to clicks and touches, but can also integrate more input methods such as voice and gestures to enhance the interactivity and naturalness of the AR experience.

[0105] In some embodiments, application accessibility and user experience are enhanced by integrating multiple input modes, including touch, voice commands, and visual input.

[0106] In some embodiments, the UI is designed using the powerful component library and layout system of the Flutter framework to create a responsive and beautiful user interface.

[0107] The real-time rendering engine 170 is used to provide real-time graphics rendering capabilities.

[0108] In some embodiments, Flutter's high-performance rendering engine is used to provide real-time graphics rendering capabilities for AR applications, supporting complex visual effects and animations.

[0109] Figure 6 A flowchart of a method 600 for using an augmented reality application development framework based on Flutter according to an embodiment of the present disclosure is shown. Figure 6 As shown, the method 600 for using the Flutter-based augmented reality application development framework includes:

[0110] S610, starting the core management layer, configuring and initializing system resources, global status, and preloading services;

[0111] S620, calling services and components in the core management layer to start the API layer, and receiving performance data and error reports through the API layer to perform resource management and performance monitoring;

[0112] S630, uses the core management layer to manage the loading and unloading of plug-ins, ensuring the compatibility and stability of plug-ins with the core management layer and other components;

[0113] S640, accesses the core functions of the augmented reality application through the tools provided by the API layer, and encapsulates and abstracts the input and output data;

[0114] In a possible implementation, a developer toolkit module is provided in the API layer to support developers in using the toolkit for application development;

[0115] S650, calling the plug-in interface provided by the plug-in system to implement the addition and expansion of functions;

[0116] In some embodiments, the differences between the operating systems of different target platforms are resolved through an adaptation layer;

[0117] The performance optimization layer is used to adjust and optimize the performance according to the hardware characteristics of the target platform;

[0118] Use debugging and testing tools to perform performance analysis and real-time debugging to optimize augmented reality apps.

[0119] In some embodiments, the debugging and testing tools include a performance analyzer and a real-time debugging tool.

[0120] In some embodiments, a performance analyzer is used to perform a performance evaluation on the augmented reality application;

[0121] According to the evaluation results, adjust and optimize the performance parameters of the application in the performance optimization layer;

[0122] Monitor the performance changes of augmented reality applications in real time and make further optimization adjustments as needed.

[0123] In one possible implementation, the real-time debugging tool is used to monitor performance data and resource usage of the augmented reality application while it is running;

[0124] Based on the monitoring results, the core management layer automatically or manually adjusts the allocation of system resources;

[0125] Update resource access permissions and configurations of the API layer and plug-in system in real time to adapt to resource changes.

[0126] In some embodiments, an augmented reality application is developed using an API interface;

[0127] Use the developer toolkit module to provide users with a developer toolkit.

[0128] In one possible implementation, the API interface includes 3D object detection, space tracking, image processing, and virtual object rendering.

[0129] In a possible implementation, the developer toolkit module provides users with an easy-to-use developer toolkit, including library files, sample codes, and detailed documentation.

[0130] In one possible implementation, third-party integration modules are used to seamlessly integrate with mainstream AR tools to expand the functionality of augmented reality applications.

[0131] In some embodiments, a modular design module is used to dynamically add and / or remove functional modules according to project requirements;

[0132] Use interactive design tools to create user interfaces and define interaction methods to enhance user experience;

[0133] The real-time rendering engine provides real-time graphics rendering capabilities to ensure the visual effects and performance of augmented reality applications.

[0134] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present disclosure is not limited by the order of the actions described, because according to the present disclosure, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

[0135] In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0136] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0137] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0138] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0139] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0140] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0141] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0142] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0143] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. An augmented reality application development framework based on Flutter, characterized in that: include: Core management layer, API layer, plug-in system; among them, The core management layer is used to configure and initialize system resources, global status and preload services when the application starts, including starting the services and components required by the API layer at initialization, receiving performance data and error reports from the API layer for resource management and performance monitoring, and managing the loading and unloading of plug-ins to ensure plug-in compatibility and stability; The API layer is used to provide tools for accessing the core functions of the augmented reality application and to encapsulate and abstract the input and output data; by calling the resource management and performance monitoring functions provided by the core management layer, the augmented reality application functions are ensured to run stably, and by calling the plug-in interface provided by the plug-in system, the functions are added; The plug-in system is used to implement modular design through plug-in extension framework; wherein, when the application is started, the plug-in is registered to the core management layer, and the core management layer maintains the plug-in registry so that the API layer can query the plug-in registry through the core management layer to find and call the plug-in.

2. The frame according to claim 1, characterized in that The core management team includes: Adaptation layer, used to resolve differences between operating systems on different target platforms; Performance optimization layer, used to adjust and optimize performance according to the hardware characteristics of the target platform; Debugging and testing tools for testing and optimizing augmented reality applications.

3. The frame according to claim 1, characterized in that The API layer includes: API interface, used to provide an interface for developing augmented reality applications; The developer toolkit module provides the developer toolkit.

4. The frame according to claim 1, characterized in that The framework also includes: Third-party integration modules for seamless integration with mainstream AR tools.

5. The frame according to claim 1, characterized in that The framework also includes: Modular design module for adding and / or removing functional modules according to project requirements; Interaction design tools for creating user interfaces and interactions; Real-time rendering engine, used to provide real-time graphics rendering capabilities.

6. A method for using an augmented reality development framework based on Flutter, applied to the augmented reality development framework based on Flutter as described in claims 1-5, characterized in that: include: Start the core management layer, configure and initialize system resources, global status, and preload services; Call services and components in the core management layer to start the API layer, and receive performance data and error reports through the API layer for resource management and performance monitoring; Use the core management layer to manage the loading and unloading of plug-ins, ensuring the compatibility and stability of plug-ins with the core management layer and other components; The core functions of the augmented reality application are accessed through the tools provided by the API layer, and the input and output data are encapsulated and abstracted. In particular, a developer toolkit module is provided in the API layer to support developers in using the toolkit for application development. Call the plug-in interface provided by the plug-in system to add and expand functions.

7. The method according to claim 6, characterized in that The method comprises: Resolve differences between target platform operating systems through adaptation layers; The performance optimization layer is used to adjust and optimize the performance according to the hardware characteristics of the target platform; Use debugging and testing tools to perform performance analysis and real-time debugging to optimize augmented reality apps.

8. The method according to claim 6, characterized in that The method comprises: Use API interfaces to develop augmented reality applications; Use the developer toolkit module to provide users with a developer toolkit.

9. The method according to claim 6, characterized in that The method further comprises: Seamlessly integrate with mainstream AR tools through third-party integration modules to expand the functionality of augmented reality applications.

10. The method according to claim 6, characterized in that The method further comprises: Utilize modular design modules to dynamically add and / or remove functional modules based on project requirements; Use interactive design tools to create user interfaces and define interaction methods to enhance user experience; The real-time rendering engine provides real-time graphics rendering capabilities to ensure the visual effects and performance of augmented reality applications.

Images