Method and apparatus for switching smoothness of augmented reality experience
Patent Information
- Application Number
- CN202211727617.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-30
- Publication Date
- 2026-09-18
- Estimated Expiration
- 2042-12-30
AI Technical Summary
[0004]相关技术中在连续体验多个AR内容时,由于加载的算法不同以及算法数据源的要求不同,需要重新退出内容和重新进入内容,打断了AR体验流程,增加了AR体验的时间成本
[0016] Fourthly, embodiments of this disclosure also provide a computer-readable storage medium storing computer instructions for causing a computer to execute any of the above-described methods for switching the smoothness of augmented reality experiences.
Smart Images

Figure CN116185181B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of augmented reality (AR) experience technology, and in particular to a method and apparatus for switching the smoothness of an augmented reality experience. Background Technology
[0002] Augmented reality (AR) is a technology that enhances reality based on camera video stream data or sensor data streams from AR devices. Augmented reality technology relies on hardware that includes one or more of the following: camera, gyroscope, magnetometer, linear accelerometer, motion sensor, etc.
[0003] Typically, an app or AR device's entry point often includes multiple AR experiences, and these experiences sometimes need to be enjoyed consecutively. In this case, at the algorithm level, each AR experience requires the uninstallation and reloading of its algorithm modules, including reloading both the same and different algorithms.
[0004] In related technologies, when experiencing multiple AR content sessions consecutively, the different algorithms used and the varying requirements of the algorithm data sources necessitate exiting and re-entering the content, disrupting the AR experience flow and increasing its time cost. Furthermore, most current AR experiences are independent of each other. When experiencing AR in large spaces or themed scenarios, seamless switching between AR content requires support for spatial continuity, thematic contextual connections, and rich immersive gameplay. Current technologies cannot support smooth switching between AR content. Summary of the Invention
[0005] In view of this, the present disclosure provides a method and apparatus for smooth switching of augmented reality experience, which can support the switching of different AR algorithms and the spatial continuity of tracking pose in AR virtual space. Based on decoupling the data source and algorithm part of AR algorithm, a camera and sensor management module of AR device is introduced. It can realize real-time dynamic opening and closing management of data source of AR device when switching algorithms, ensuring that the camera and sensor of AR device do not need to be restarted when experiencing multiple AR content continuously, thereby ensuring the continuity of experience form, and providing smooth switching of tracking pose data of AR content corresponding to the algorithm in AR virtual space, which can realize the continuity of POSE, thereby realizing the continuity of AR space, and thus meeting the user's need for a smooth and stable AR effect experience.
[0006] In a first aspect, embodiments of this disclosure provide a method for switching the smoothness of an augmented reality experience, employing the following technical solution: Detect user switching actions on augmented reality (AR) devices for the first AR content; When the switching operation is detected, and the AR interface of the AR device is playing the first AR content, the first AR content is switched to the second AR content corresponding to the switching operation according to a preset switching strategy, including: According to the preset switching strategy, the first camera and the first sensor corresponding to the first AR content are dynamically turned off, and the second camera and the second sensor corresponding to the second AR content are dynamically turned on. Acquire the second camera data collected by the second camera, and acquire the second sensor data collected by the second sensor; The unloading operation of the first algorithm corresponding to the first AR content is performed by the finite state machine (FSM) algorithm. When the first algorithm is unloaded, the second algorithm corresponding to the second AR content is run through the FSM algorithm. The second algorithm includes a second sensor algorithm for playing the second sensor data and a second camera algorithm for playing the second camera data. Play the second AR content on the AR interface.
[0007] In some embodiments, the data source for the first algorithm and the second algorithm is the same.
[0008] Therefore, the data sources for the first and second algorithms may be the same, and no restart is required when switching, which enables fine-grained management of the data source and reflects the first characteristic of continuous experience.
[0009] In some embodiments, executing the second algorithm operation on the second AR content through the FSM algorithm includes at least one of the following: The FSM algorithm is used to perform independent operation on the second algorithm; The FSM algorithm is used to perform a combined operation of the second algorithm based on common or private components.
[0010] In some embodiments, the method further includes: Obtain the first pose data of the first algorithm corresponding to the first AR content in the AR virtual space; When the first Pose data meets the first preset condition, the second algorithm corresponding to the second AR content is run, and the second Pose data of the second algorithm is obtained; when the first Pose data does not meet the first preset condition, the first Pose data is discarded and the second algorithm is run directly. When the second pose data meets the second preset condition, the second algorithm continues to run; when the second pose data does not meet the second preset condition, the second pose data is optimized and the second algorithm is run.
[0011] In some embodiments, the first pose data is confirmed not to meet the first preset condition when at least one of the following conditions is met: The first difference between the first timestamp corresponding to the first Pose data and the current timestamp is greater than or equal to a first preset threshold. The first Pose data does not support continuous pose switching; Only the first Pose data can be run.
[0012] In some embodiments, the second Pose data is optimized, including at least one of the following: Update the second timestamp corresponding to the second Pose data to the current timestamp; Perform multidimensional difference compensation on the second Pose data; The second pose data is smoothed. The second Pose data is weighted and differentially compensated according to the types of the first algorithm and the second algorithm.
[0013] Secondly, this disclosure also provides a device for switching the smoothness of augmented reality experiences, employing the following technical solution: The detection unit is configured to detect user switching operations on augmented reality (AR) devices for the first AR content; The content switching unit is configured to, when the switching operation is detected and the AR interface of the AR device is playing the first AR content, switch the first AR content to the second AR content corresponding to the switching operation according to a preset switching strategy; The content playback unit is configured to play the second AR content on the AR interface.
[0014] In some embodiments, the content switching unit includes: The dynamic on / off module is configured to dynamically turn off the first camera and the first sensor corresponding to the first AR content, and dynamically turn on the second camera and the second sensor corresponding to the second AR content, according to the preset switching strategy. The data acquisition module is configured to acquire second camera data collected by the second camera, and to acquire second sensor data collected by the second sensor. The algorithm unloading module is configured to perform an unloading operation on the first algorithm corresponding to the first AR content through a finite state machine (FSM) algorithm; The algorithm execution module is configured to execute the execution operation of the second algorithm corresponding to the second AR content through the FSM algorithm when the first algorithm is unloaded. The second algorithm includes a second sensor algorithm for playing the second sensor data and a second camera algorithm for playing the second camera data.
[0015] Thirdly, this disclosure also provides an electronic device that adopts the following technical solution: The electronic device includes: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform any of the above-described methods for switching the smoothness of the augmented reality experience.
[0016] Fourthly, embodiments of this disclosure also provide a computer-readable storage medium storing computer instructions for causing a computer to execute any of the above-described methods for switching the smoothness of augmented reality experiences.
[0017] This disclosure provides a method and apparatus for smooth switching of augmented reality (AR) experiences. The method includes: detecting a user's switching operation on first AR content on an AR device; when the switching operation is detected and the AR interface of the AR device is playing the first AR content, switching the first AR content to second AR content corresponding to the switching operation according to a preset switching strategy; and playing the second AR content on the AR interface. This disclosure supports switching between different AR algorithms and the spatial continuity of tracking poses in AR virtual space. It enables real-time dynamic opening and closing management of the AR device's data source during algorithm switching, ensuring that the camera and sensors of the AR device do not need to be restarted when experiencing multiple AR contents consecutively, thus guaranteeing the continuity of the experience. It also provides smooth switching of tracking pose data in AR virtual space corresponding to the AR content's algorithm, achieving pose continuity and thus AR spatial continuity, thereby meeting the user's need for a smooth and stable AR experience.
[0018] The above description is merely an overview of the technical solution disclosed herein. In order to better understand the technical means of this disclosure and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description
[0019] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0020] Figure 1 A flowchart illustrating a method for switching the smoothness of an augmented reality experience according to an embodiment of this disclosure; Figure 2 An interactive schematic diagram of a smoothness switching method for augmented reality experience provided in an embodiment of this disclosure; Figure 3 A schematic diagram of the structure of an augmented reality experience smoothness switching device provided in an embodiment of this disclosure; Figure 4 A schematic diagram of another augmented reality experience smoothness switching device provided in an embodiment of this disclosure; Figure 5 This is a schematic block diagram of an electronic device provided in an embodiment of the present disclosure. Detailed Implementation
[0021] The embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.
[0022] It should be understood that the following specific examples illustrate the implementation of this disclosure, and those skilled in the art can easily understand other advantages and effects of this disclosure from the content disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. This disclosure can also be implemented or applied through other different specific implementation methods, and the details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this disclosure. It should be noted that, in the absence of conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.
[0023] It should be noted that various aspects of embodiments within the scope of the appended claims are described below. It will be apparent that the aspects described herein can be embodied in a wide variety of forms, and any particular structure and / or function described herein is merely illustrative. Based on this disclosure, those skilled in the art will understand that one aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects set forth herein can be used to implement the device and / or practice the method. Additionally, this device and / or method can be implemented using structures and / or functionalities other than one or more of the aspects set forth herein.
[0024] It should also be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of this disclosure. The drawings only show the components related to this disclosure and are not drawn according to the number, shape and size of the components in actual implementation. In actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.
[0025] Furthermore, specific details are provided in the following description to facilitate a thorough understanding of the examples. However, those skilled in the art will understand that the described aspects can be practiced without these specific details.
[0026] like Figure 1 As shown, this disclosure provides a method for switching the smoothness of an augmented reality experience, including: S101, Detect the user's switching operation on the augmented reality (AR) device for the first AR content.
[0027] S102. When a switching operation is detected and the AR interface of the AR device is playing the first AR content, the first AR content is switched to the second AR content corresponding to the switching operation according to the preset switching strategy.
[0028] In this embodiment, the first AR content and the second AR content are continuously experienced. By executing a corresponding preset switching strategy in the algorithm layer, a stable and smooth experience when the first AR content and the second AR content are continuously experienced is ensured. It should be noted that there can be multiple continuously experienced AR contents, and this embodiment does not limit this.
[0029] S103. Play the second AR content on the AR interface.
[0030] In some embodiments, step S102, switching the first AR content to the second AR content corresponding to the switching operation according to a preset switching strategy, includes: According to the preset switching strategy, the first camera and the first sensor corresponding to the first AR content are dynamically turned off, and the second camera and the second sensor corresponding to the second AR content are dynamically turned on. Acquire the second camera data collected by the second camera, and acquire the second sensor data collected by the second sensor; The unloading operation of the first algorithm corresponding to the first AR content is performed by the finite state machine (FSM) algorithm. When the first algorithm is unloaded, the second algorithm corresponding to the second AR content is executed via the FSM algorithm. The second algorithm includes a second sensor algorithm for playing second sensor data and a second camera algorithm for playing second camera data. The data sources for the first and second algorithms can be the same.
[0031] like Figure 2 As shown in the figure, this embodiment of the present disclosure provides an interactive schematic diagram of a smoothness switching method for augmented reality experience, wherein camera 1 is the first camera, camera 2 is the second camera, sensor 1 is the first sensor, sensor 2 is the second sensor, algorithm 1 and algorithm 2 can be defined as the first algorithm, algorithm 3 and algorithm 4 can be defined as the second algorithm, and the algorithm management layer is the finite state machine (FSM) algorithm.
[0032] The FSM algorithm has states such as initialization, startup, pause, running, and unloading. The FSM algorithm includes, but is not limited to, image localization and tracking algorithms, object recognition and tracking algorithms, and plane recognition and tracking algorithms. Algorithms 1, 2, 3, and 4 can perform camera frame processing operations, visual localization operations, and machine learning operations. The FSM algorithm can be based on... Figure 2 The common component 1, common component 2, private component 3 or private component 4 can be used to combine and run algorithm 1, algorithm 2, algorithm 3 or algorithm 4, or they can be run independently.
[0033] Figure 2 The camera management module and sensor management module operate independently. The camera management module can realize the data acquisition, processing and distribution of camera 1 and camera 2, and the sensor management module can realize the data acquisition, processing and distribution of sensor 1 and sensor 2. The camera management module and sensor management module send available, effective and stable and smooth camera data and sensor data to the corresponding algorithm execution through the algorithm management layer.
[0034] In some embodiments, the execution of the second algorithm corresponding to the second AR content via the FSM algorithm includes at least one of the following: The second algorithm is run independently using the FSM algorithm; The FSM algorithm is used to perform combinatorial operations on the second algorithm based on common or private components.
[0035] In some embodiments, the method further includes: Obtain the first pose data of the first algorithm corresponding to the first AR content in the AR virtual space; When the first Pose data meets the first preset condition, the second algorithm corresponding to the second AR content is run, and the second Pose data of the second algorithm is obtained; when the first Pose data does not meet the first preset condition, the first Pose data is discarded and the second algorithm is run directly. If the second pose data meets the second preset condition, the second algorithm continues to run; if the second pose data does not meet the second preset condition, the second pose data is optimized and the second algorithm is run.
[0036] Optionally, the situation where the second Pose data does not meet the second preset condition includes, but is not limited to: 1. The timestamps of the first Pose data and the second Pose data differ too much, that is, the second difference between the second timestamp corresponding to the second Pose data and the current timestamp is greater than or equal to the second preset threshold; 2. The second Pose data does not support continuous pose switching, for example, the spatial distance between the pose data of the first Pose data and the second Pose data is too large.
[0037] Optionally, when an algorithm switch is required, the old algorithm, such as the first algorithm in this embodiment, is uninstalled first, and the new algorithm (i.e., the second algorithm) is initialized, started, and run after the first algorithm is uninstalled.
[0038] Optionally, the first Pose data and the second Pose data include location information, orientation information, timestamp, algorithm type, etc. in the AR virtual space. Users can set these according to their actual needs, and this disclosure does not limit this.
[0039] In some embodiments, the first pose data is confirmed not to meet the first preset condition when at least one of the following conditions is met: The first difference between the first timestamp corresponding to the first Pose data and the current timestamp is greater than or equal to the first preset threshold. The first Pose data does not support continuous pose switching; Only the first Pose data can be run.
[0040] In some embodiments, the second pose data is optimized by at least one of the following: Update the second timestamp corresponding to the second Pose data to the current timestamp; Perform multidimensional difference compensation on the second pose data; Smooth the second pose data; The second pose data is weighted and the difference is compensated according to the type of the first algorithm and the second algorithm.
[0041] Optionally, in order to ensure the continuity of pose, the embodiments of this disclosure optimize the second pose data, wherein pose data of the old algorithm (i.e., the first algorithm) that cannot meet the optimization conditions can be discarded.
[0042] Optionally, the first algorithm and the second algorithm can be the same algorithm or different algorithms. This disclosure embodiment can also support two or more new algorithms and old algorithms running at the same time, which can be preset when configuring the algorithms.
[0043] like Figure 3 As shown in the embodiments of this disclosure, a smoothness switching device for augmented reality experiences is also provided, including: The detection unit 31 is configured to detect the user's switching operation on the augmented reality (AR) device for the first AR content; The content switching unit 32 is configured to switch the first AR content to the second AR content corresponding to the switching operation according to a preset switching strategy when a switching operation is detected and the AR interface of the AR device is playing the first AR content. Content playback unit 33 is configured to play second AR content on the AR interface.
[0044] like Figure 4 As shown, in some embodiments, the content switching unit 32 includes: The dynamic opening and closing module 321 is configured to dynamically close the first camera and the first sensor corresponding to the first AR content according to a preset switching strategy, and to dynamically open the second camera and the second sensor corresponding to the second AR content. The data acquisition module 322 is configured to acquire second camera data collected by the second camera and second sensor data collected by the second sensor. The algorithm unloading module 323 is configured to perform an unloading operation on the first algorithm corresponding to the first AR content through a finite state machine (FSM) algorithm; The algorithm execution module 324 is configured to execute the execution operation of the second algorithm corresponding to the second AR content through the FSM algorithm when the first algorithm is unloaded. The second algorithm includes a second sensor algorithm for playing second sensor data and a second camera algorithm for playing second camera data.
[0045] An electronic device according to embodiments of this disclosure includes a memory and a processor. The memory is used to store non-transitory computer-readable instructions. Specifically, the memory may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may, for example, include random access memory (RAM) and / or cache memory. The non-volatile memory may, for example, include read-only memory (ROM), a hard disk, flash memory, etc.
[0046] The processor may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device to perform desired functions. In one embodiment of this disclosure, the processor is used to execute computer-readable instructions stored in the memory, causing the electronic device to perform all or part of the steps of the augmented reality experience smoothness switching method described in the foregoing embodiments of this disclosure.
[0047] Those skilled in the art will understand that, in order to solve the technical problem of how to achieve a good user experience, this embodiment may also include well-known structures such as communication buses and interfaces, and these well-known structures should also be included within the protection scope of this disclosure.
[0048] like Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. It illustrates a structural schematic diagram suitable for implementing the electronic device in the embodiment of the present disclosure. Figure 5 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.
[0049] like Figure 5 As shown, an electronic device may include a processing unit (such as a central processing unit, graphics processing unit, etc.) that can perform various appropriate actions and processes based on a program stored in read-only memory (ROM) or a program loaded from a storage device into random access memory (RAM). The RAM also stores various programs and data required for the operation of the electronic device. The processing unit, ROM, and RAM are interconnected via a bus. Input / output (I / O) interfaces are also connected to the bus.
[0050] Typically, the following devices can be connected to the I / O interface: input devices, such as sensors or visual information acquisition devices; output devices, such as displays; storage devices, such as magnetic tapes or hard drives; and communication devices. Communication devices allow electronic devices to exchange data wirelessly or via wired communication with other devices, such as edge computing devices. Although Figure 5Electronic devices with various devices are shown, but it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.
[0051] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by a processing device, all or part of the steps of the augmented reality experience smoothness switching method of embodiments of this disclosure are performed.
[0052] For a detailed description of this embodiment, please refer to the corresponding descriptions in the foregoing embodiments, which will not be repeated here.
[0053] A computer-readable storage medium according to embodiments of the present disclosure stores non-transitory computer-readable instructions. When the non-transitory computer-readable instructions are executed by a processor, all or part of the steps of the augmented reality experience smoothness switching method described in the foregoing embodiments of the present disclosure are performed.
[0054] The aforementioned computer-readable storage media include, but are not limited to: optical storage media (e.g., CD-ROM and DVD), magneto-optical storage media (e.g., MO), magnetic storage media (e.g., magnetic tape or portable hard drive), media with built-in rewritable non-volatile memory (e.g., memory card), and media with built-in ROM (e.g., ROM cartridge).
[0055] For a detailed description of this embodiment, please refer to the corresponding descriptions in the foregoing embodiments, which will not be repeated here.
[0056] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.
[0057] In this disclosure, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. The block diagrams of devices, apparatuses, devices, and systems involved in this disclosure are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as "comprising," "including," "having," etc., are open-ended terms meaning "including but not limited to," and are used interchangeably with them. The terms "or" and "and" as used herein refer to the terms "and / or," and are used interchangeably with them unless the context clearly indicates otherwise. The term "such as" as used herein refers to the phrase "such as but not limited to," and is used interchangeably with it.
[0058] Additionally, as used herein, the "or" used in a list of items beginning with "at least one" indicates a separate list, such that a list of, for example, "at least one of A, B, or C" means A or B or C, or AB or AC or BC, or ABC (i.e., A and B and C). Furthermore, the word "exemplary" does not imply that the described example is preferred or better than other examples.
[0059] It should also be noted that in the systems and methods of this disclosure, the components or steps can be decomposed and / or recombined. These decompositions and / or recombinations should be considered as equivalent solutions to this disclosure.
[0060] Various changes, substitutions, and modifications can be made to the technology described herein without departing from the teachings defined by the appended claims. Furthermore, the scope of the claims of this disclosure is not limited to the specific aspects of the processes, machines, manufactures, events, means, methods, and actions described above. Currently existing or later-developed processes, machines, manufactures, events, means, methods, or actions that perform substantially the same function or achieve substantially the same result as the corresponding aspects described herein can be utilized. Therefore, the appended claims include such processes, machines, manufactures, events, means, methods, or actions within their scope.
[0061] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.
[0062] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.
Claims
1. A method for smooth switching of augmented reality experience, characterized in that, include: Detect user switching actions on augmented reality (AR) devices for the first AR content; When the switching operation is detected, and the AR interface of the AR device is playing the first AR content, the first AR content is switched to the second AR content corresponding to the switching operation according to a preset switching strategy, including: According to the preset switching strategy, the first camera and the first sensor corresponding to the first AR content are dynamically turned off, and the second camera and the second sensor corresponding to the second AR content are dynamically turned on. Acquire the second camera data collected by the second camera, and acquire the second sensor data collected by the second sensor; The unloading operation of the first algorithm corresponding to the first AR content is performed by the finite state machine (FSM) algorithm. When the first algorithm is unloaded, the second algorithm corresponding to the second AR content is run through the FSM algorithm. The second algorithm includes a second sensor algorithm for playing the second sensor data and a second camera algorithm for playing the second camera data. Play the second AR content on the AR interface.
2. The method for switching the smoothness of augmented reality experience according to claim 1, wherein the data source of the first algorithm and the second algorithm is the same.
3. The method for switching the smoothness of augmented reality experience according to claim 1, characterized in that, Executing the second algorithm operation corresponding to the second AR content through the FSM algorithm includes at least one of the following: The FSM algorithm is used to perform independent operation on the second algorithm; The FSM algorithm is used to perform a combined operation of the second algorithm based on common or private components.
4. The method for switching the smoothness of augmented reality experience according to claim 1, characterized in that, The method further includes: Obtain the first pose data of the first algorithm corresponding to the first AR content in the AR virtual space; When the first Pose data meets the first preset condition, the second algorithm corresponding to the second AR content is run, and the second Pose data of the second algorithm is obtained; when the first Pose data does not meet the first preset condition, the first Pose data is discarded and the second algorithm is run directly. When the second pose data meets the second preset condition, the second algorithm continues to run; when the second pose data does not meet the second preset condition, the second pose data is optimized and the second algorithm is run.
5. The method for switching the smoothness of augmented reality experience according to claim 4, characterized in that, When the first Pose data meets at least one of the following conditions, it is confirmed that the first Pose data does not meet the first preset condition: The first difference between the first timestamp corresponding to the first Pose data and the current timestamp is greater than or equal to a first preset threshold. The first Pose data does not support continuous pose switching; Only the first Pose data can be run.
6. The method for switching the smoothness of augmented reality experience according to claim 4, characterized in that, The second pose data is optimized by at least one of the following: Update the second timestamp corresponding to the second Pose data to the current timestamp; Perform multidimensional difference compensation on the second Pose data; The second pose data is smoothed. The second Pose data is weighted and differentially compensated according to the types of the first algorithm and the second algorithm.
7. A device for switching the smoothness of an augmented reality experience, characterized in that, include: The detection unit is configured to detect user switching operations on augmented reality (AR) devices for the first AR content; The content switching unit is configured to, when the switching operation is detected and the AR interface of the AR device is playing the first AR content, switch the first AR content to the second AR content corresponding to the switching operation according to a preset switching strategy; The content playback unit is configured to play the second AR content on the AR interface; The content switching unit includes: a dynamic on / off module configured to dynamically turn off the first camera and first sensor corresponding to the first AR content, and dynamically turn on the second camera and second sensor corresponding to the second AR content, according to the preset switching strategy; a data acquisition module configured to acquire second camera data collected by the second camera, and acquire second sensor data collected by the second sensor; an algorithm unloading module configured to perform an unloading operation on the first algorithm corresponding to the first AR content through a finite state machine (FSM) algorithm; and an algorithm running module configured to perform a running operation on the second algorithm corresponding to the second AR content through the FSM algorithm when the first algorithm unloading is completed, wherein the second algorithm includes a second sensor algorithm for playing the second sensor data and a second camera algorithm for playing the second camera data.
8. An electronic device, characterized in that, The electronic device includes: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the smoothness switching method for augmented reality experience as described in any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions for causing a computer to perform the smoothness switching method for augmented reality experiences as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Augmented reality (AR) implementation method and device and computer readable storage medium
CN108230448A