A system and method for hot loading applications without installation on an AR glasses platform

By providing the installation and application heat loading system on the side of the AR glasses platform, the remote download and update of the plug -in using virtual container and communication modules can be used to solve the tedious and resource occupation of existing AR glasses application extensions and renewal, and realize the application of applications. Convenient updates and system stability and security improvement.

CN119088475BActive Publication Date: 2025-01-28NANJING MAGIC GRP INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411585476.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-11-08
Publication Date
2025-01-28
Estimated Expiration
2044-11-08

AI Technical Summary

Technical Problem

Existing AR glasses have cumbersome operations, large resource usage, time-consuming updates, and may lead to data loss or device compatibility issues in application expansion and updates.

Method used

Provide the installation and application heat loading system on the side of the AR glasses platform. The remote download and update of the plug -in plug -in through the virtual container and communication module uses the plug -in technology to divide the application into multiple independent plug -ins. Users can dynamically load and uninstall the plug -in plug -in. , Support thermal loading technology.

Benefits of technology

Improve the expansion and convenience of the application of AR glasses, optimize the efficiency of system resource utilization, realize the installation and instant update of applications, and enhance the stability and security of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088475B_ABST
    Figure CN119088475B_ABST
Patent Text Reader

Abstract

The present application discloses a system and method for hot loading applications without installation on the AR glasses platform side. The system includes: an AR glasses platform, a virtual container pre-installed on the AR glasses platform, and a communication module; the AR glasses platform is responsible for displaying AR content and providing a user interaction interface; the communication module is responsible for the communication between the AR glasses platform and an external server or other device to realize remote download and update of plug-ins; the virtual container is used to run plug-ins generated by splitting AR glasses applications without installation and manage the plug-ins; specifically includes: a plug-in repository and a plug-in manager; the plug-in repository is used to provide several independent user spaces according to user needs to store the plug-ins generated by splitting AR glasses applications developed by users; the plug-in manager is responsible for loading, unloading and updating plug-ins. The present application can improve the application scalability, ease of use and system resource utilization efficiency of AR glasses.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of augmented reality (AR) technology, and in particular to a system and method for hot loading an installation-free application on an AR glasses platform. Background Art

[0002] With the continuous development of AR technology, AR glasses are increasingly used in daily life and work. However, existing AR glasses have certain limitations in application expansion and updating. The traditional method requires users to manually install or uninstall applications, which is not only cumbersome to operate, but also takes up a lot of system resources. At the same time, application updates usually require users to re-download and re-install, which is not only time-consuming, but may also cause data loss or device compatibility issues.

[0003] Therefore, how to improve the application scalability, ease of use and system resource utilization efficiency of AR glasses has become a problem that needs to be solved urgently. Summary of the invention

[0004] In order to improve the application scalability, ease of use and system resource utilization efficiency of AR glasses, the present application provides a system and method for hot loading of installation-free applications on the AR glasses platform side.

[0005] In a first aspect, the present application provides an installation-free application hot loading system on an AR glasses platform, including: an AR glasses platform, a virtual container pre-installed on the AR glasses platform, and a communication module;

[0006] The AR glasses platform is responsible for displaying AR content and providing a user interaction interface;

[0007] The communication module is used to be responsible for the communication between the AR glasses platform and the external server or other third-party devices to realize the remote download and update of the plug-in;

[0008] The virtual container is used to run the plug-ins generated by splitting the AR glasses application without installation, and manage the plug-ins; specifically includes: a plug-in repository and a plug-in manager;

[0009] The plug-in repository is used to provide a number of independent user spaces according to user needs to store plug-ins generated by splitting AR glasses applications developed by users;

[0010] The plug-in manager is responsible for loading, unloading and updating plug-ins, specifically including: completing the loading of specified plug-ins of specified user space according to user needs, and dynamically integrating the specified plug-in into the virtual operating environment, and using hook technology to complete the operation of the specified plug-in, including: obtaining the call request of the specified plug-in, intercepting the request by using hook technology and modifying the request parameters and sending them to the Android system, intercepting the operation result returned by the Android system and restoring the parameters of the operation result; wherein, in the process of completing the loading of the specified plug-in of the specified user space, hot loading technology is used to dynamically replace or update the plug-in code when the specified plug-in is running; the virtual operating environment is a virtual operating environment generated by simulating various services and components of Android applications.

[0011] By adopting the above solution and plug-in technology, the application is split into multiple independent plug-ins. Users can dynamically load and unload plug-ins according to their needs, realizing installation-free and instant updates of applications, and improving the application scalability and ease of use of AR glasses; and providing an independent user space to store the user's own installed applications and personal data according to user needs, thereby improving the efficiency of device use; hooking the service called by the specified call during the operation of the plug-in, and obtaining the specific return value and execution logic of the control plug-in, strengthening the management ability of the plug-in, and improving the stability and security of the system.

[0012] Preferably, it also includes:

[0013] The SDK package pre-installed for developing XR glasses applications is used to provide users with the basic tools required to develop AR glasses applications on the AR glasses platform side, so that users can develop AR glasses applications on the AR glasses platform side.

[0014] By adopting the above solution, an SDK package for developing XR glasses applications is provided, allowing users to develop AR glasses applications directly on the AR glasses platform side. Compared with using a communication module, remote downloading and updating of plug-ins is more convenient.

[0015] Preferably, the plug-in manager is also used to perform IO redirection when completing the operation of the specified plug-in according to user needs; the IO redirection is to modify the original AR glasses application IO path access to the IO path under the user space through address mapping.

[0016] By adopting the above solution, considering that some users will write the access path for interacting with the Android system as an absolute path when developing applications, in order to avoid the situation where the access path does not exist because the application is not actually installed on the system, the IO path installed by the IO redirection container is used.

[0017] Preferably, the plug-in manager is also used to perform other types of management on the specified plug-in of the specified user space according to user needs, and the other types of management include installing, stopping, clearing plug-in data, obtaining a list of installed plug-ins, and monitoring the life cycle of the plug-in; wherein, the installation method for the specified plug-in of the specified user space includes: installing the plug-in according to the specified plug-in APK package name, installing the plug-in through the file Uri, installing the plug-in through the file object, or first decompressing the plug-in APK in the assets directory to the built-in storage when the container is started for the first time, and then installing the plug-in through the Uri or File object.

[0018] By adopting the above solution, the design uses the plug-in APK package name, file Uri method, file object method, etc. to install, so as to meet the needs of users to choose the appropriate installation method according to specific needs and scenarios.

[0019] Preferably, the plug-in manager is also used to perform a security audit on the specified plug-in of the specified user space during the loading process of the specified plug-in of the specified user space, including using the developer's public key to verify the validity of the plug-in signature, the integrity of the plug-in code and the legitimacy of the plug-in data; after the security audit is passed, continue to complete the operation of the specified plug-in, otherwise, stop the operation of the specified plug-in.

[0020] By adopting the above solution, while improving the flexibility and scalability of the system, it is also necessary to ensure the security and credibility of the plug-in. When designing and loading, the public key is used to verify the signature, determine the integrity of the plug-in code, and determine the legitimacy of the plug-in data for security audit.

[0021] Preferably, the plug-in manager is also used to monitor the running process of the specified plug-in using the hook technology, and when an operation timeout is found, a message that the specified plug-in in the specified user space has failed to run is generated and transmitted back to the AR glasses platform; the plug-in repository is also used to receive a message that the specified plug-in in the specified user space has failed to run and isolate the specified plug-in corresponding to the specified user space.

[0022] By adopting the above solution, considering the situation that the plug-in may fail to run during the plug-in running process, the failure information is generated and pushed to the AR glasses platform in real time, so that users can understand the current plug-in running status.

[0023] Preferably, the AR glasses platform is also used for the user to register an application container on the AR glasses platform to generate a unique application identifier; the virtual container is used to read the unique application identifier as a parameter for container authentication when the container is started, and authorize normal use of the container after authentication is passed.

[0024] By adopting the above solution, the unique application identifier of the container is used for permission permission, so that flexible and secure permission management of the container for hot loading of the application without installation is realized.

[0025] In a second aspect, the present application provides a method for hot loading an installation-free application on an AR glasses platform, comprising:

[0026] Connect to an external server or other third-party device through the communication module to automatically detect and download the plug-ins generated by splitting the AR glasses application developed by the user;

[0027] Receive user needs and create an independent user space to store the plug-ins generated by splitting the AR glasses application developed by the user;

[0028] Receive the plug-in that the user selects to be loaded through the user interface of the AR glasses platform, and use the plug-in manager to complete the loading of the specified plug-in in the specified user space according to the user's needs; during the loading process of the specified plug-in in the specified user space, use the hot loading technology to dynamically replace or update the plug-in code when the specified plug-in is running;

[0029] Dynamically integrate the specified plug-in into the virtual runtime environment;

[0030] Use hook technology to complete the operation of the specified plug-in; including: obtaining the call request of the specified plug-in, intercepting the request by hook technology and modifying the request parameters and sending them to the Android system, intercepting the operation results returned by the Android system and restoring the parameters of the operation results;

[0031] The running results are sent back to the AR glasses platform.

[0032] By adopting the above solution and utilizing plug-in technology, the AR glasses application can be installed-free and updated instantly, which improves the application scalability, ease of use and resource utilization efficiency.

[0033] In a third aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the method as described above.

[0034] In a fourth aspect, the present application provides a computer device, comprising a memory, a processor, and a program stored and executable on the memory, wherein the program implements the steps of the above method when executed by the processor.

[0035] In summary, this application has the following beneficial effects:

[0036] 1. Through plug-in design, users can dynamically load and uninstall plug-ins according to their needs without reinstalling the entire application, which improves the scalability of the AR glasses platform and enables the platform to quickly adapt to different user needs or application scenarios; through plug-in and on-demand loading, only necessary plug-ins are loaded into independent user spaces, avoiding the waste of system resources and preventing plug-ins in different user spaces from affecting each other, thereby improving the efficiency of device use;

[0037] 2. Support hot loading of plug-ins, so users can update and upgrade applications without restarting the device;

[0038] 3. Build a virtual operating environment to proxy the interaction between the plug-in application and the system, so that the plug-in application can run in the virtual operating environment, hook the plug-in call service, and control the specific return value and execution logic of the plug-in apk, which strengthens the host's ability to manage plug-ins and improves the stability and security of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 It is a structural schematic diagram of a system for hot loading an installation-free application on an AR glasses platform side described in a specific embodiment;

[0040] Figure 2 It is an architectural diagram of a container in a hot loading system for installation-free applications on an AR glasses platform side described in a specific embodiment;

[0041] Figure 3 It is a flowchart of a method for hot loading an installation-free application on an AR glasses platform side described in a specific embodiment. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0043] Example 1

[0044] like Figure 1 As shown, an embodiment of the present application discloses a system for hot loading applications without installation on an AR glasses platform, which specifically includes: an AR glasses platform 1, a communication module 2, an SDK package 3 for developing XR glasses applications pre-installed on the AR glasses platform, and a virtual container 4 pre-installed on the AR glasses platform.

[0045] The AR glasses platform 1, as the software and hardware platform of the AR glasses device, involves the AR glasses' operating system, application program interface, development tools, cloud services, and related technologies and functions such as interaction with other devices, and is mainly responsible for displaying AR content and providing a user interaction interface. In addition, in order to ensure the security and stability of the system, the AR glasses platform is also used to generate a unique application identifier when the user registers an application container on the AR glasses platform.

[0046] The communication module 2 is responsible for the communication between the AR glasses platform and the external server or other third-party devices to realize the remote download and update of the plug-in; the plug-in is an independent plug-in split from the AR glasses application developed by the user for various AR glasses devices, and each plug-in APK contains specific functions and resources, such as: each AR interaction scene solution package.

[0047] The XR glasses application development SDK package 3, as an SDK package for developing the basis of AR glasses applications, contains all the kits required for the development of AR glasses applications, mainly unified interaction logic and UI components suitable for XR glasses; it is used to provide users with the basic tools required to develop AR glasses applications on the AR glasses platform side, so that users can develop AR glasses applications on the AR glasses platform side, provide developers with a unified hardware interaction interface, and bring users a more consistent user experience on AR hardware from various manufacturers.

[0048] The virtual container 4, as a basic container providing plug-in capabilities, is used to run the AR glasses plug-in without installation and manage the installed AR glasses plug-in. In addition, the virtual container 4 is used to read the unique application identifier as a parameter for container authentication when the container is started. After the authentication is passed, the container is authorized to be used normally, and the plug-in storage, installation-free operation and application hot loading are performed.

[0049] Specifically, Figure 2 As shown, the virtual container 4 creates a sandbox environment, simulating various services and components of the Android application system. The framework of the virtual container can be divided into layers such as Plugin Space, Plugin Framework, and Plugin Native.

[0050] Among them, the Plugin Space level can be used specifically to store the plug-in repository 41; the plug-in repository 41 is used to provide several independent user spaces according to user needs to store the plug-ins generated by splitting the AR glasses application developed by the user. User spaces can be created or deleted according to user needs, and each user space is used to store the plug-ins split from the application that the user needs to install and test, and multiple user spaces are isolated from each other. The plug-in repository 41 can use the user registration ID as an identifier to establish an index for fast retrieval and loading.

[0051] To further ensure data security, each user space has permission settings and is configured with different application access permissions. To ensure plug-in application communication compatibility under the same user space, plug-ins under the same user space communicate with each other in accordance with the Android system communication rules, such as: intent system, shared files, use of Content Providers, BroadcastReceivers, etc.

[0052] The two layers of Plugin Framework and Plugin Native can provide specific services and components for plug-in operation, and support the operation of some functions of the unit module of the plug-in manager 42. The plug-in manager 42 is responsible for loading, unloading and updating plug-ins.

[0053] Specifically, using the plug-in manager 42 to load the plug-in specifically includes: completing the loading of the specified plug-in in the specified user space according to user needs, and dynamically integrating the specified plug-in into the virtual operating environment, and using the hook technology to complete the operation of the specified plug-in. Among them, using the hook technology to complete the operation of the specified plug-in includes: obtaining the call request of the specified plug-in, intercepting the request by the hook technology and modifying the request parameters and sending it to the Android system, intercepting the operation result returned by the Android system and restoring the parameters of the operation result.

[0054] For example, the Plugin Framework provides an infrastructure and API for simulating the development of applications on the Android system. These APIs can be called by plugins to achieve specific functions. The specified plugin APK calls the specified class and class->method through the API, that is, obtains the request of the specified plugin to call the specified class and class->method, hooks the specified class and class->method, modifies the parameters to the host parameters, sends the host parameters to the original Android system Framework, intercepts the running results returned by the Android system and restores the parameters of the running results, so that the plugin can successfully find the Class from the host classloader when calling the Java class that is not in the plugin's own dex; and the host can control the specific return value and execution logic (IAT) of the plugin apk calling class->method; that is, the plugin can call the host-related classes and methods; or the plugin calls the host's Activity and gets the return data through onActivityResult. The host can reflectively call the plugin's Activity and any Java class. And considering that some INI functions cannot be hooked in the Plugin Framework, it is necessary to hook the relevant call requests at the native layer and lugin Native layer.

[0055] In addition, when completing the loading of a specified plug-in in a specified user space, the plug-in manager supports hot loading technology, that is, updating the loaded plug-in in real time without restarting the AR glasses platform. Hot loading technology, such as dynamic link library (DLL), is used to dynamically replace or update the plug-in code when the specified plug-in is running.

[0056] Considering that some users will write the access path for interacting with the Android system as an absolute path when developing applications, since the application components of the Android system are not actually installed, IO redirection can be supported at the Plugin Native level, that is, the plug-in manager 42 is also used to perform IO redirection during the operation of the specified plug-in according to user needs; the IO redirection is to modify the original AR glasses application IO path access to the IO path installed by the container through address mapping. For example: map directory A to directory A of the sub-user directory of the container sub-user space.

[0057] The use of the plug-in manager 42 to uninstall the plug-in specifically includes: when the plug-in is no longer needed, the user can uninstall the plug-in in the same manner as described above to release system resources. If the user chooses to uninstall a plug-in, the plug-in manager will first stop the operation of the plug-in, and then remove its related files and registration information from the system to release system resources.

[0058] The plug-in manager 42 is used to update the plug-in, which specifically includes: obtaining the latest plug-in detected through an API, and completing the update of the plug-in in the user space.

[0059] The management of plug-ins by plug-in manager 42 specifically includes: managing specified plug-ins of specified user space through API according to user needs, and other types of management include installing, stopping, clearing plug-in data, obtaining a list of installed plug-ins, and monitoring the life cycle of plug-ins.

[0060] Among them, the installation methods for the specified plug-in in the specified user space include: installing the plug-in according to the specified plug-in APK package name, installing the plug-in through the file Uri, installing the plug-in through the file object, or first decompressing the plug-in APK in the assets directory to the built-in storage when the container is started for the first time, and then installing the plug-in through the Uri or File object.

[0061] Through the system described in the above embodiment, the user can select the plug-in to be loaded through the user interface of the AR glasses platform, and the plug-in manager loads the plug-in from the plug-in repository according to the user request and dynamically integrates it into the operating environment of the AR glasses. When the plug-in needs to be updated, the communication module will connect to the external server or other device to automatically detect and download the latest plug-in update. At the same time, the plug-in manager supports hot loading technology, which can update the loaded plug-in in real time without restarting the AR glasses platform.

[0062] Example 2

[0063] Compared with Example 1, the difference of this embodiment lies in the specific loading process of the plug-in.

[0064] Taking into account the security of plug-in operation, the plug-in manager 42 in the system is also used to perform a security audit on the specified plug-in in the specified user space during the loading process of the specified plug-in in the specified user space, including using the developer's public key to verify the validity of the plug-in signature, the integrity of the plug-in code and the legitimacy of the plug-in data; after the security audit is passed, continue to complete the operation of the specified plug-in; otherwise, stop the operation of the specified plug-in.

[0065] Specifically, each developer will obtain a pair of public and private keys when registering as an AR glasses platform developer. This pair of keys will be used in the plug-in signing process. When the developer completes the plug-in development, before publishing it, he needs to use his own private key to digitally sign the plug-in. When a plug-in is loaded according to user needs, the digital signature of the plug-in will be checked, and the developer's public key will be used to verify the validity of the signature. In addition to verifying the signature, when a plug-in is loaded according to user needs, the integrity of the plug-in code must be checked to ensure that it has not been tampered with during transmission or storage. In addition, some plug-in data in the plug-in, such as pictures, files, etc., check whether the content of these plug-in data complies with legal provisions to prevent the existence of illegal plug-in applications.

[0066] Through the system described in the above embodiment, when a user chooses to load a plug-in, the plug-in manager first obtains the plug-in from the plug-in repository and then performs a security check on it. Once the check passes, the plug-in manager will load it into the operating environment of the AR glasses platform and enable it to interact with other plug-ins and the main system.

[0067] Example 3

[0068] Compared with Example 1, the difference of this embodiment lies in the specific loading process of the plug-in.

[0069] Considering the situation that the plug-in fails to run, the system provides a notification management service to facilitate the subsequent plug-in isolation operation and plug-in mirror source. The plug-in manager 42 in the system is also used to monitor the operation process of the specified plug-in using the hook technology, and when the operation timeout is found, a message that the specified plug-in of the specified user space fails to run is generated; the plug-in repository 41 is also used to receive the message that the specified plug-in of the specified user space fails to run and isolate the specified plug-in corresponding to the specified user space.

[0070] Among them, according to the plug-in type split by the AR application, the preset running time of the corresponding plug-in type can be obtained to determine the type of plug-in selected by the user to load, and then monitor whether the running time of the currently loaded plug-in is greater than the preset running time, that is, a running timeout occurs, and a corresponding message of the running report of the specified plug-in in the specified user space is generated.

[0071] Among them, after receiving the message of plug-in running failure and isolating the specified plug-in corresponding to the specified user space, the virtual container can provide an alternative plug-in acquisition channel to re-acquire the plug-in by setting the plug-in mirror source.

[0072] Through the system described in the above embodiment, after a user chooses to load and run a plug-in and fails, the plug-in failure information can be obtained in a timely manner to facilitate subsequent isolation and reloading.

[0073] like Figure 3As shown, the embodiment of the present application also provides a method for hot loading an installation-free application on an AR glasses platform side using the system described in the above embodiment, including:

[0074] S1. Obtain the plug-in generated by splitting the AR glasses application developed by the user and store it in the plug-in repository.

[0075] Specifically, the communication module is connected to an external server or other third-party device to automatically detect and download the plug-ins generated by splitting the AR glasses application developed by the user; and several independent user spaces are created according to user needs to store the plug-ins generated by splitting the AR glasses application developed by the user.

[0076] S2. Based on the user's plug-in loading requirements, use the plug-in manager to complete plug-in installation-free and application hot loading.

[0077] Specifically, the user selects the plug-in to be loaded through the user interface of the AR glasses platform, and uses the plug-in manager to complete the loading of the specified plug-in in the specified user space according to the user's needs; during the loading process of the specified plug-in in the specified user space, the hot loading technology is used to dynamically replace or update the plug-in code when the specified plug-in is running;

[0078] Dynamically integrate the specified plug-in into the virtual runtime environment;

[0079] The hook technology is used to complete the operation of the specified plug-in; including: obtaining the call request of the specified plug-in, intercepting the request with the hook technology and modifying the request parameters and sending them to the Android system, intercepting the operation results returned by the Android system and restoring the parameters of the operation results.

[0080] S3. Send the running results back to the AR glasses platform.

[0081] In a specific embodiment, step S2 of the method further includes:

[0082] During the loading process of the specified plug-in in the specified user space, a security audit is performed on the specified plug-in in the specified user space, including using the developer's public key to verify the validity of the plug-in signature, the integrity of the plug-in code, and the legitimacy of the plug-in data; after the security audit is passed, the operation of the specified plug-in continues to be completed, otherwise, the operation of the specified plug-in is stopped.

[0083] In a specific embodiment, step S2 of the method further includes:

[0084] The monitoring uses hook technology to complete the running process of the specified plug-in. When the running timeout is found, a message that the specified plug-in in the specified user space fails to run is generated, and the message of the running failure is sent back to the AR glasses platform; according to the message of the specified plug-in in the specified user space failing to run, the specified plug-in corresponding to the specified user space is isolated.

[0085] The embodiment of the present application also discloses a computer-readable storage medium.

[0086] Specifically, the computer-readable storage medium stores a computer program that can be loaded by a processor and execute the above-mentioned installation-free application hot loading method on the AR glasses platform side. The computer-readable storage medium includes, for example: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0087] The embodiment of the present application also discloses a computer device.

[0088] Specifically, the computer device includes a memory and a processor, and the memory stores a computer program that can be loaded by the processor and execute the above-mentioned installation-free application hot loading method on the AR glasses platform side.

[0089] The above are all preferred embodiments of the present application, and are not intended to limit the protection scope of the present application. Any feature disclosed in this specification (including the abstract and drawings), unless otherwise stated, can be replaced by other equivalent or alternative features with similar purposes. That is, unless otherwise stated, each feature is only an example of a series of equivalent or similar features.

Claims

1. A hot loading system for installation-free applications on an AR glasses platform, characterized in that: include: AR glasses platform, a virtual container and a communication module pre-installed on the AR glasses platform; The AR glasses platform is responsible for displaying AR content and providing a user interaction interface; The communication module is used to be responsible for the communication between the AR glasses platform and the external server or other third-party devices to realize the remote download and update of the plug-in; The virtual container is used to run the plug-ins generated by splitting the AR glasses application without installation, and manage the plug-ins; specifically includes: a plug-in repository and a plug-in manager; The plug-in repository is used to provide a number of independent user spaces according to user needs to store plug-ins generated by splitting AR glasses applications developed by users; The plug-in manager is responsible for loading, unloading and updating plug-ins, and is specifically used to complete the loading of specified plug-ins in the specified user space according to user needs, and dynamically integrate the specified plug-in into the virtual operating environment, and use hook technology to complete the operation of the specified plug-in, including obtaining the call request of the specified plug-in, intercepting the request with hook technology and modifying the request parameters and sending them to the Android system, intercepting the operation result returned by the Android system and restoring the parameters of the operation result; wherein, in the process of completing the loading of the specified plug-in in the specified user space, the hot loading technology is used to dynamically replace or update the plug-in code when the specified plug-in is running; the virtual operating environment is a virtual operating environment generated by simulating various services and components of the Android application.

2. The installation-free application hot loading system on the AR glasses platform side according to claim 1 is characterized in that: Also includes: The SDK package pre-installed for developing AR glasses applications is used to provide users with the basic tools required to develop AR glasses applications on the AR glasses platform side, so that users can develop AR glasses applications on the AR glasses platform side.

3. The installation-free application hot loading system on the AR glasses platform side according to claim 1 is characterized in that: The plug-in manager is also used to perform IO redirection when completing the operation of the specified plug-in according to user needs; the IO redirection is to modify the original AR glasses application IO path access to the IO path installed by the container through address mapping.

4. The installation-free application hot loading system on the AR glasses platform side according to claim 1, characterized in that: The plug-in manager is also used to perform other types of management on the specified plug-in of the specified user space according to user needs, and the other types of management include: installing, stopping, clearing plug-in data, obtaining a list of installed plug-ins, and monitoring the life cycle of plug-ins; wherein, the installation method for the specified plug-in of the specified user space includes: installing the plug-in according to the specified plug-in APK package name, installing the plug-in through the file Uri method, installing the plug-in through the file object method, or first decompressing the plug-in APK in the assets directory to the built-in storage when the container is started for the first time, and then installing the plug-in through the Uri or File object method.

5. The installation-free application hot loading system on the AR glasses platform side according to claim 1, characterized in that: The plug-in manager is further used to perform a security audit on the specified plug-in of the specified user space during the loading process of the specified plug-in of the specified user space, including verifying the validity of the plug-in signature, the integrity of the plug-in code and the legitimacy of the plug-in data using the developer's public key; After the security audit is passed, the specified plug-in continues to run, otherwise, the specified plug-in stops running.

6. The installation-free application hot loading system on the AR glasses platform side according to claim 1, characterized in that: The plug-in manager is also used to monitor the running process of the specified plug-in using hook technology. When an operation timeout is found, a message of the failure of the specified plug-in in the specified user space to run is generated and transmitted back to the AR glasses platform; the plug-in repository is also used to receive the message of the failure of the specified plug-in in the specified user space to run and isolate the specified plug-in corresponding to the specified user space.

7. The installation-free application hot loading system on the AR glasses platform side according to claim 1, characterized in that: The AR glasses platform is also used for users to register application containers on the AR glasses platform to generate unique application identifiers; the virtual container is used to read the unique application identifier as a parameter for container authentication when the container is started, and authorize normal use of the container after authentication is passed.

8. A method for hot loading an application without installation on an AR glasses platform using the system described in any one of claims 1 to 7, characterized in that: include: Connect to an external server or other third-party device through the communication module to automatically detect and download the plug-ins generated by splitting the AR glasses application developed by the user; Receive user needs and create an independent user space to store the plug-ins generated by splitting the AR glasses application developed by the user; Receive the plug-in that the user selects to be loaded through the user interface of the AR glasses platform, and use the plug-in manager to complete the loading of the specified plug-in in the specified user space according to the user's needs; during the loading process of the specified plug-in in the specified user space, use the hot loading technology to dynamically replace or update the plug-in code when the specified plug-in is running; Dynamically integrate the specified plug-in into the virtual runtime environment; Use hook technology to complete the operation of the specified plug-in; including: obtaining the call request of the specified plug-in, intercepting the request by hook technology and modifying the request parameters and sending them to the Android system, intercepting the operation results returned by the Android system and restoring the parameters of the operation results; Send the running results back to the AR glasses platform.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to claim 8.

10. A computer device, characterized in that: The computer device comprises a memory, a processor and a program stored and executable on the memory, and the program implements the steps of the method according to claim 8 when executed by the processor.

Citation Information

Patent Citations

  • Android plug-in implementation method and device based on APK (Android Package) dynamic loading and interaction method

    CN104216741A

  • Android application pluggable development system and method

    CN106648559A