State management system for XR system and storage medium

Abstract

The present invention provides a state management system for an XR system. The state management system for the XR system comprises an application starting state management module, an application closing state management module, a scene state switching module, and a state management module of a Home key. The present invention distinguishes different states of Home and XR applications in the XR system by means of setting a state value. When the XR applications or Home are started or closed, a current scene state of the XR system is planned by means of receiving and processing state change information of the applications. For example, this allows for starting Home without changing the lifecycle of the XR applications, that is, Home is opened while the XR applications remain in a running state. An interaction logic of an XR device is added, thereby increasing the degree of freedom of use by users.

Description

A state management system and storage medium for an XR system Technical Field

[0001] The present invention relates to the field of XR technology, and in particular to a state management system and storage medium for an XR system. Background Art

[0002] Extended Reality (XR) refers to the use of computers to combine the real and virtual worlds to create a virtual environment where humans and machines can interact. It is a general term for various technologies, including AR, VR, and MR. By integrating the visual interaction technologies of these three, users can experience an immersive experience, with a seamless transition between the virtual and real worlds. XR encompasses a variety of technologies, including virtual reality (VR), augmented reality (AR), and mixed reality (MR), as well as various wearable devices, gesture recognition, voice recognition, and other interaction methods. By simulating and enhancing the experience of multiple senses, XR creates an immersive interactive environment for users.

[0003] With the advancement of XR technology, applications on XR systems are becoming increasingly diverse, and the use cases for XR devices are expanding. To enhance the user experience with XR devices, it's necessary to be able to access the system menu on the XR device at any time without interrupting the foreground application. For example, while playing an XR game, you might encounter a network anomaly and need to switch networks, get stuck at a level and need to open a 2D browser to look up game guides, or answer a WeChat call from a friend. To continue these operations, you need to exit the XR game. Existing XR systems address this by closing the XR application and returning to the home page (i.e., the XR system's desktop), or pausing the XR application (changing the game lifecycle), exiting it to the background, and returning to YvrHome before completing subsequent operations. Existing XR systems are unable to launch other applications without the XR application being aware of them or without changing the XR application lifecycle, severely impacting the user experience. Existing XR systems are unable to inform client applications of the current system context, making it impossible for the XR system to manage its own context. Consequently, existing XR systems are unable to properly allocate CPU resources when multiple applications are running simultaneously in the foreground. Summary of the Invention

[0004] The present invention provides a state management system for an XR system to solve the technical problem that the existing XR devices are unable to manage their own situational states.

[0005] In order to solve the above problems, the present invention provides a state management system for an XR system, which includes: an application startup state management module, which can obtain startup information sent by an application when an application is started; determine whether the application is an XR application; if not, set the state of the XR system to HOME_IDLE and stop executing subsequent steps of the application startup state management module; if so, the application enters the loading state, and determines whether the state of the XR system is HOME_IDLE before the application is started; if so, set the state of the XR system to HOME_PAUSING_APP_RESUMING; if not, set the state of the XR system to HOME_PAUSING_APP_RESUMING_JUMP; When the application completes loading, the application startup status management module can obtain the loading information sent by the application and set the status of the XR system to HOME_PAUSED_APP_RESUMED; the application shutdown status management module, when an application is closed, the application shutdown status management module can obtain the shutdown information sent by the application; determine whether another XR application is started; if so, set the status of the XR system to HOME_PAUSING_APP_RESUMING_JUMP; if not, determine whether the application is an XR application, and determine whether the application is terminated abnormally; if the application is an XR application and the application is not terminated abnormally, set the status of the XR system to HOME_IDLE; if the application is an XR application and the application is terminated abnormally, generate an exception report and upload it.

[0006] Furthermore, in the application startup status management module, after the application startup status management module obtains the startup information sent by an application, the application startup status management module checks the startup information of the application to determine whether there is an abnormality in the startup of the application; if so, terminates the startup of the application; if not, allows the application to start.

[0007] Furthermore, the state management system of the XR system further includes: a scenario state switching module, which updates the scenario state value of the XR system and then updates the display state of the XR system when receiving a state switching request of the XR system.

[0008] Furthermore, the display status of the XR system includes the virtual screen status, the handle status and the display order of the windows; the virtual screen status includes the Home virtual screen status and other virtual screen statuses; the handle status includes the handle display model and the handle posture.

[0009] Furthermore, when the scenario state switching module receives a state switching request from the XR system, the scenario state switching module performs a validity judgment and a timeout judgment on the scenario state of the XR system, judges whether there is an abnormality in the scenario state of the XR system, and judges whether there is a timeout in the state switching request of the XR system; if both are negative, the state switching request of the XR system is rejected, and the subsequent steps of the scenario state switching module are stopped; if both are negative, the state switching request of the XR system is allowed.

[0010] Furthermore, the state management system of the XR system also includes: an observation module, which can monitor changes in the system scenario state. When the scenario state value of the XR system changes, the scenario state switching module can transmit the scenario state change information of the XR system to the observation module.

[0011] Furthermore, the state management system of the XR system also includes: a state management module of the Home button. When the Home button is pressed, the state management module of the Home button can obtain the Home opening request of the XR system; then make the following judgments: the first judgment condition, judge whether the display screen of the current XR system is on; the second judgment condition, judge whether the current XR device has tracking loss; the third judgment condition, judge whether the handle posture of the current XR device is outside the safety boundary; the fourth judgment condition, judge whether Home is restarting; the fifth judgment condition, judge whether the current XR system has an application that requires not to process the Home button; if the result of the first judgment condition is no or the result of any one of the judgment conditions from the second to the fifth judgment conditions is yes, then the state management module of the Home button does not respond to the Home opening request of the XR system; otherwise, make the following judgments: the sixth judgment condition, judge whether the current XR system has an application that requires pressing the Home button to exit; if the sixth judgment condition If the result of the judgment condition is yes, exit the application; otherwise, make the following judgment: the seventh judgment condition, judge whether there is an abnormality in the startup of an XR application in the current XR system; if the result of the seventh judgment condition is yes, set the state of the XR system to HOME_IDLE and terminate the startup of the application; otherwise, make the following judgment: the eighth judgment condition, judge whether the state of the current XR system is HOME_PAUSED_APP_RESUMED or HOME_RESUMING_FA_APP_RESUMED_FA, if the state of the current XR system is HOME_PAUSED_APP_RESUMED, set the state of the XR system to HOME_RESUMING_FA_APP_RESUMED_FA; if the state of the current XR system is HOME_RESUMING_FA_APP_RESUMED_FA, set the state of the XR system to HOME_PAUSED_APP_RESUMED.

[0012] Furthermore, the state management system of the XR system also includes: a Home crash processing module, which sets the state of the XR system to HOME_RESTARTING when the Home program crashes and restarts Home. When Home restarts, the state of the XR system is set to HOME_IDLE.

[0013] The present invention also provides a storage medium for storing executable program code; the present invention also includes a processor for reading the executable program code to run a computer program corresponding to the executable program code to implement at least one module in the state management system of the above-mentioned XR system.

[0014] The advantage of the present invention is that, in order to effectively manage the contextual state of the XR system, the present invention distinguishes the various states of Home and XR applications in the XR system by setting a state value. When the XR application or Home is started or closed, the current contextual state of the XR system is planned by receiving and processing the state change information of these applications. For example, it is possible to start Home without changing the life cycle of the XR application, that is, to open Home while the XR application remains running. An interactive logic of the XR device is added, which increases the freedom of user use.

[0015] Due to the limited computing power of XR devices, when XR applications and YvrHome are running at the same time, by accessing the CPU binding and calling strategy of the scenario state management, that is, reasonably allocating the CPU resources obtained by various applications according to the different scenario states of the XR system, the current YvrHome running frame rate can be effectively improved, making the handle movement smoother and reducing the occurrence of dizziness and black edges. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] FIG1 is a flow chart of an application startup status management module according to an embodiment of the present invention;

[0017] FIG2 is a flowchart of an application shutdown status management module according to an embodiment of the present invention;

[0018] FIG3 is a flow chart of a state management module of a Home key according to an embodiment of the present invention;

[0019] FIG4 is a flow chart of an application startup status management module according to an embodiment of the present invention. Specific embodiments

[0020] The following describes preferred embodiments of the present invention with reference to the accompanying drawings to illustrate that the present invention can be implemented. These embodiments will fully explain the technical content of the present invention to those skilled in the art, making the technical content of the present invention clearer and easier to understand. However, the present invention can be embodied in many different forms of embodiments, and the scope of protection of the present invention is not limited to the embodiments described herein.

[0021] The present invention provides a state management system for an XR system. For each state of the Home and XR applications in the XR system, a state value representing the contextual state of the XR system is set, and the contextual state of the XR system is classified as follows:

[0022] When Home is started and no XR application is started, the XR system context state is HOME_IDLE, and the state value is 0. The default state of the XR system is the state after the XR device is powered on.

[0023] When an XR app is started and loading, the XR system context state is HOME_PAUSING_APP_RESUMING, and the state value is 100. XR apps take a long time to start, about several seconds, and can only submit valid frames after the Android Resume lifecycle is completed.

[0024] When an XR application is running and has acquired the focus of the XR system, the context state of the XR system is HOME_PAUSED_APP_RESUMED, and the status value is 101. After the XR application submits a valid frame, the XR application can run normally.

[0025] When an XR app is running and Home has the focus of the XR system, the XR system context state is HOME_RESUMING_FA_APP_RESUMED_FA, and the state value is 102. When the user presses the Home button while an XR app is running, Home pops up as an app. At this time, the XR app is still running but has no focus, and Home has the focus of the XR system.

[0026] When an XR app is closed and another XR app is started, and the XR app is loading, the XR system context state is HOME_PAUSING_APP_RESUMING_JUMP, and the status value is 104. This state indicates that an XR app jump has occurred, and the new XR app replaces the old XR app in a special state.

[0027] When Home restarts due to an exception, the XR system's context state is HOME_RESTARTING, and the status value is 110. XR system Home can crash for a variety of reasons, and you need to restart Home immediately.

[0028] As shown in Figure 1, the XR system's state management system includes an application launch state management module. When an application is launched, the application launch state management module receives the launch information sent by the application. The application launch state management module checks the application launch information to determine whether there are any abnormalities in the application launch. If so, the application launch is terminated. Otherwise, the application is allowed to launch. This step is because the application launch process requires verification of the legitimacy of the application launch, complying with native Android service requirements and its own derivative service requirements. If an abnormality occurs, the application must return to the initial default state, i.e., HOME_IDLE. If the application launch is not terminated, the application is determined to be an XR application. If not, the context state switching module sets the XR system state to HOME_IDLE and stops executing subsequent steps of the application launch state management module. If so, the application enters the loading state and determines whether the XR system state was HOME_IDLE before the application was launched. If so, the context state switching module sets the XR system state to HOME_PAUSING_APP_RESUMING. If not, the context state switching module sets the XR system state to HOME_PAUSING_APP_RESUMING_JUMP. When the application finishes loading, the application startup state management module can obtain the loading information sent by the application and set the XR system state to HOME_PAUSED_APP_RESUMED.

[0029] As shown in Figure 2, the XR system's state management system includes an application shutdown state management module. When an application is closed, the application shutdown state management module receives the shutdown information sent by the application. It determines whether another XR application is launched. If so, the context state switching module sets the XR system state to HOME_PAUSING_APP_RESUMING_JUMP. If not, it determines whether the application is an XR application and whether it terminated abnormally. If the application is an XR application and the application did not terminate abnormally, the context state switching module sets the XR system state to HOME_IDLE. If the application is an XR application and the application terminated abnormally, an exception report is generated and uploaded. The operating logic of this module is that when an application is closed, it determines whether the application closed normally or abnormally. If the application closed normally, if another XR application was launched at the time of the application closing, the application was forced to close due to the launch of the other application, which means that an application jump occurred.

[0030] The state management system of the XR system includes a scenario state switching module. When the scenario state switching module receives a state switching request from the XR system, the scenario state switching module performs a validity judgment and a timeout judgment on the scenario state of the XR system, determines whether there is an abnormality in the scenario state of the XR system, and determines whether the state switching request of the XR system has timed out. If both are negative, the state switching request of the XR system is rejected, and the subsequent steps of the scenario state switching module are stopped. If both are negative, the state switching request of the XR system is allowed. After accepting the state switching request of the XR system, the scenario state value of the XR system is updated. The scenario state switching module can pass the scenario state change information of the XR system to the observation module. Then, the display state of the XR system is updated. The display state of the XR system includes the virtual screen state, the handle state, and the display order of the windows. The virtual screen state includes the Home virtual screen state and other virtual screen states. The handle state includes the handle display model and the handle posture.

[0031] When the context switch module receives a state switch request from the XR system, for example, when a user launches an application from the desktop and the application is loading, the XR system sends a message to the context switch module, switching the XR system's state from HOME_IDLE to HOME_PAUSING_APP_RESUMING. When the context switch module receives the XR system's state switch request, it first verifies the validity of the XR system's context state to prevent context state confusion. It also implements a timeout for the XR system's context state. If a request times out, the request is aborted to ensure the security of multi-threaded calls. If the request is deemed valid, it updates the XR system's state value from 0 to 100. The context switch module transmits the XR system's context state change information to the observation module, which then updates the XR system's display state.

[0032] The virtual screen status of the XR system is as follows: In the XR system, the virtual screen refers to the virtual display screen presented in front of the user's eyes through a head-mounted display device. It simulates the concept of a traditional computer monitor, but there is actually no physical screen. The virtual screen can present computer-generated images, videos, applications and other content to the user in a three-dimensional or flat form. The virtual screen uses the display technology of the head-mounted device to create a realistic virtual environment in front of the user's eyes, making the user feel like they are in it. In the XR system of this embodiment, Home and XR applications use different virtual screens to generate images. When the XR system sends a message to the scene state switching module to switch the XR system state from the original HOME_IDLE to HOME_PAUSING_APP_RESUMING, the XR system will adjust its focus to the virtual screen corresponding to the XR application.

[0033] The state of the handle includes the handle display model and the handle posture. In an embodiment of the present invention, whether the application renders the handle model is determined by determining whether the mapping coordinates of the handle on the display screen are located in the display area of ​​a certain application. When the mapping coordinates of the handle are within the display area of ​​an application, the remaining applications are immediately notified to stop rendering the handle model. And when the mapping coordinates of the handle are located in the Home and XR applications, the handle display model seen by the user is also different. Therefore, it is necessary to update the handle display model and the handle posture when the state of the XR system is switched.

[0034] The state management system of the XR system also includes an observation module, which can monitor changes in the system's scenario state. When the scenario state value of the XR system changes, the scenario state switching module can transmit the scenario state change information of the XR system to the observation module.

[0035] The observation module retrieves the current display state based on the client interface and restores YvrHome's full display and functionality in the HOME_IDLE context. In XR devices, YvrHome not only provides the functionality of native Android Home but also enables 2D applications to be displayed on the screen. Using Android's Multi-Resume technology, YvrHome can run on a virtual screen simultaneously with XR applications on the main screen. The system's context state management service manages the lifecycle of YvrHome. As a key caller and observer of the system context state, YvrHome monitors system context state changes through the client interface.

[0036] In the HOME_RESUMING_FA_APP_RESUMED_FA scenario, the observation module needs to streamline the displayed content, hide unnecessary scenes, and disable some restricted functions. At the same time, it obtains the current XR application and provides a pop-up window to close the XR application. It also provides some system modifications that may be required during the use of the XR application or opens some 2D applications, such as viewing motion data, opening a browser to access web pages, managing network connections and switching, etc.

[0037] As shown in Figure 3, the XR system's state management system also includes a Home button state management module. When the Home button is pressed, the Home button state management module can receive the XR system's Home activation request. The following judgments are then made: First, determine whether the XR system's display is currently on. Second, determine whether the XR device has lost tracking. Third, determine whether the XR device's controller position is outside the safety boundary. Fourth, determine whether the Home button is currently being restarted. Fifth, determine whether the XR system currently has an application that requests that the Home button not be processed. If the first judgment is false or any of the second through fifth judgments is true, the Home button state management module does not respond to the XR system's Home activation request. Otherwise, the following judgment is made: Sixth, determine whether the XR system currently has an application that requires the Home button to exit. If the sixth judgment is true, exit the application. Otherwise, the following judgment is made: Seventh, determine whether the XR system currently has an XR application that has experienced an abnormality during startup. If the result of the seventh judgment condition is yes, the context state switching module sets the XR system state to HOME_IDLE and terminates the launch of the application. Otherwise, the following judgment is made: The eighth judgment condition determines whether the current XR system state is HOME_PAUSED_APP_RESUMED or HOME_RESUMING_FA_APP_RESUMED_FA. If the current XR system state is HOME_PAUSED_APP_RESUMED, the context state switching module sets the XR system state to HOME_RESUMING_FA_APP_RESUMED_FA. If the current XR system state is HOME_RESUMING_FA_APP_RESUMED_FA, the context state switching module sets the XR system state to HOME_PAUSED_APP_RESUMED.

[0038] In the Home button status management module, the reason for the first judgment condition is that the Home button can only be activated when the display is on. If the display is off, the XR device is not started and the Home button will not work.

[0039] The second judgment condition is that the Home button can only be used when the XR device does not experience tracking loss. In XR devices, tracking loss usually refers to a situation where the XR device cannot accurately track the position and movement of the user's head or hands. XR devices use built-in sensors and external tracking systems to track the user's position and movement in a virtual reality or augmented reality environment in real time. When tracking loss occurs, the XR device usually attempts to re-track to restore accurate tracking of the user's position and movement. During tracking loss, the user may feel that the presentation of the virtual world is unstable or jittery, which may affect the user's immersion and interactive experience. Therefore, the Home button can only be used when the XR device does not experience tracking loss.

[0040] The third condition is that the Home button can only be used when the XR device's controller posture is within the safe boundary. If the XR device's controller posture is outside the safe boundary, the Home button is invalid.

[0041] The fourth condition is that the Home button can only be used when Home is not restarting. If Home crashes and restarts, calling Home will cause an error, so the fourth condition needs to be added.

[0042] The fifth condition is that the Home button can only be used if there are no applications on the current XR system that require the Home button to be disabled. Some real-world applications have special settings that require the Home button to be disabled, or the Home button has other functions within these applications. Therefore, when an application that requires the Home button to be disabled is running, the Home button is disabled.

[0043] The sixth judgment condition is that if there is an application in the current XR system that requires pressing the Home button to exit, the function of the Home button is bound to exiting the application.

[0044] The seventh judgment condition is that if the current XR system has an abnormality in the launch of an XR application, and the user presses the Home button, the context state switching module can set the XR system state to HOME_IDLE and terminate the launch of the application, preventing the user from being stuck on the abnormal application launch interface.

[0045] The eighth judgment condition is the normal function of the Home button in the normal process of the XR system in this embodiment, that is, when the user is experiencing an XR application, the current state of the XR system is HOME_PAUSED_APP_RESUMED, and the user can call Home by pressing the Home button, so that the state of the XR system changes to HOME_RESUMING_FA_APP_RESUMED_FA. It is possible to start Home without changing the life cycle of the XR application, that is, to open Home while the XR application remains running. An interaction logic for the XR device is added, which increases the freedom of user use. When the user presses the Home button again, the state of the XR system changes back to HOME_PAUSED_APP_RESUMED, that is, closes Home and re-experiences the original XR application. In this process, the process of closing and restarting the original application is omitted, which improves the user experience.

[0046] The XR system's state management system also includes a Home crash handling module. When the Home program crashes, the XR system's state is set to HOME_RESTARTING and Home is restarted. After Home restarts, the XR system's state is set to HOME_IDLE.

[0047] As shown in Figure 4, due to the limited computing power of XR devices, when XR applications and YvrHome are running at the same time, by accessing the CPU binding and calling strategy of the scenario state management, that is, reasonably allocating the CPU resources obtained by various applications according to the different scenario states of the XR system, the current running frame rate of YvrHome can be effectively improved, making the handle movement smoother and reducing the occurrence of dizziness and black edges.

[0048] From the table in Figure 4, we can see that slightly reducing the frame rate of the XR application when the XR system is in the HOME_RESUMING_FA_APP_RESUMED_FA state significantly improves the frame rate of YvrHome at this time, with an average frame rate increase of approximately 20%-70%.

[0049] The advantage of the present invention is that, in order to effectively manage the contextual state of the XR system, the present invention distinguishes the various states of Home and XR applications in the XR system by setting a state value. When the XR application or Home is started or closed, the current contextual state of the XR system is planned by receiving and processing the state change information of these applications. For example, it is possible to start Home without changing the life cycle of the XR application, that is, to open Home while the XR application remains running. An interactive logic of the XR device is added, which increases the freedom of user use.

[0050] Due to the limited computing power of XR devices, when XR applications and YvrHome are running at the same time, by accessing the CPU binding and calling strategy of the scenario state management, that is, reasonably allocating the CPU resources obtained by various applications according to the different scenario states of the XR system, the current YvrHome running frame rate can be effectively improved, making the handle movement smoother and reducing the occurrence of dizziness and black edges.

[0051] The above describes in detail the preferred embodiments of the present invention. It should be understood that those skilled in the art can make numerous modifications and variations based on the concepts of the present invention without inventive effort. Therefore, any technical solutions that can be derived by those skilled in the art through logical analysis, reasoning, or limited experimentation based on the concepts of the present invention and the prior art should be within the scope of protection defined by the claims.

Claims

1. A state management system for an XR system, characterized in that: include: An application startup status management module, which is capable of obtaining startup information sent by an application when the application is started; Determine whether the application is an XR application; if not, set the XR system state to HOME_IDLE and stop executing subsequent steps of the application startup state management module; if so, the application enters the loading state, and determines whether the XR system state is HOME_IDLE before the application is started; if so, set the XR system state to HOME_PAUSING_APP_RESUMING; if not, set the XR system state to HOME_PAUSING_APP_RESUMING_JUMP; when the application completes loading, the application startup state management module can obtain the loading information sent by the application and set the XR system state to HOME_PAUSED_APP_RESUMED; Application closing status management module: When an application is closed, the application closing status management module can obtain the closing information sent by the application; determine whether another XR application is started; if so, set the status of the XR system to HOME_PAUSING_APP_RESUMING_JUMP; if not, determine whether the application is an XR application, and determine whether the application is abnormally terminated; if the application is an XR application and the application is not abnormally terminated, set the status of the XR system to HOME_IDLE; if the application is an XR application and the application is abnormally terminated, generate an exception report and upload it.

2. The state management system of the XR system as claimed in claim 1, characterized in that: In the application startup state management module, after the application startup state management module obtains startup information sent by an application, the application startup state management module checks the startup information of the application to determine whether there is any abnormality in the startup of the application; If yes, the application is terminated from launching; if no, the application is allowed to launch.

3. The state management system of the XR system as claimed in claim 1, characterized in that: Also includes: The scenario state switching module updates the scenario state value of the XR system and then updates the display state of the XR system when receiving a state switching request from the XR system.

4. The state management system of the XR system as claimed in claim 3, characterized in that: The display status of the XR system includes: Virtual screen status, including Home virtual screen status and other virtual screen status; Controller status, including the controller display model and controller posture; as well as The order in which windows are displayed.

5. The state management system of the XR system as claimed in claim 3, characterized in that: When the scenario state switching module receives a state switching request from the XR system, the scenario state switching module performs a validity judgment and a timeout judgment on the scenario state of the XR system, judges whether there is an abnormality in the scenario state of the XR system, and judges whether there is a timeout in the state switching request of the XR system; if both are negative, the state switching request of the XR system is rejected, and the subsequent steps of the scenario state switching module are stopped; if both are negative, the state switching request of the XR system is allowed.

6. The state management system of the XR system as claimed in claim 3, characterized in that: Also includes: The observation module can monitor changes in the system's context state. When the context state value of the XR system changes, the context state switching module can transmit the context state change information of the XR system to the observation module.

7. The state management system of the XR system according to claim 1, wherein: Also includes: The Home button state management module, when the Home button is pressed, can obtain the Home opening request of the XR system; and make the following judgment: The first judgment condition is to determine whether the display screen of the current XR system is turned on; The second judgment condition is to determine whether the current XR device has lost tracking; The third judgment condition is to determine whether the handle posture of the current XR device is outside the safety boundary; The fourth judgment condition is to determine whether Home is restarting; The fifth judgment condition is to determine whether there is an application in the current XR system that requires not processing the Home button; If the result of the first judgment condition is no or the result of any one of the second to fifth judgment conditions is yes, the Home button state management module does not respond to the Home opening request of the XR system; Otherwise, make the following judgment: The sixth judgment condition is to determine whether there is an application in the current XR system that requires pressing the Home button to exit; If the result of the sixth judgment condition is yes, then exit the application; Otherwise, make the following judgment: The seventh judgment condition is to judge whether there is an abnormality in the startup of an XR application in the current XR system; If the result of the seventh judgment condition is yes, the XR system state is set to HOME_IDLE and the launch of the application is terminated; otherwise, the following judgment is made: The eighth judgment condition determines whether the current XR system status is HOME_PAUSED_APP_RESUMED or HOME_RESUMING_FA_APP_RESUMED_FA. If the current XR system status is HOME_PAUSED_APP_RESUMED, set the XR system status to HOME_RESUMING_FA_APP_RESUMED_FA; if the current XR system status is HOME_RESUMING_FA_APP_RESUMED_FA, set the XR system status to HOME_PAUSED_APP_RESUMED.

8. The state management system of the XR system according to claim 1, wherein: Also includes: The Home crash handling module sets the XR system status to HOME_RESTARTING when the Home program crashes and restarts Home. After Home restarts, the XR system status is set to HOME_IDLE.

9. A storage medium, characterized in that: Used to store executable program code; A processor is configured to read the executable program code to run a computer program corresponding to the executable program code to implement at least one module in the state management system of the XR system according to any one of claims 1 to 8.

Images