Method and apparatus for degrading an augmented reality tracking algorithm

Abstract

The embodiment of the present disclosure discloses a degradation method and device of an augmented reality tracking algorithm. The method comprises: when an AR device is started, if the AR device meets a preset running condition, running a first tracking algorithm and the AR device; when the AR device does not meet the preset running condition, and a data source of the AR device meets any one of a plurality of preset validities, running a first tracking algorithm or a second tracking algorithm corresponding to the preset validity, and running the AR device, the first tracking algorithm being higher than the second tracking algorithm in level; when the AR device does not meet the preset running condition, and the data source of the AR device does not meet the plurality of preset validities, ending the running of the AR device, and returning a result of AR device running failure. The method can realize AR experience on different devices through the validity determination of the data source of the AR tracking algorithm, and improve the AR device compatibility coverage while ensuring the smooth AR experience.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the field of augmented reality technology, and in particular to a degradation method and device of an augmented reality tracking algorithm. BACKGROUND

[0002] Augmented reality technology (i.e., AR) is a reality augmentation technology based on video stream data or device sensor data stream. The technology relies on device hardware including one or more of a camera, a gyroscope, a magnetometer, a linear accelerometer, a motion sensor, etc. The equipment (including peripherals) of the device hardware and its performance affect the algorithmic capability of AR and the content display effect based on the algorithmic capability. Especially for mobile terminals, the differences in device brand, model, and parameter performance in the current market seriously reduce the device compatibility capability in the AR promotion process.

[0003] In order to solve the device compatibility problem, the related technology usually adopts a device black and white list to determine the AR support capability of the running device. The devices set in the white list are allowed to run AR experience, and the devices set in the black list do not support running AR experience. However, this method does not solve the problem of low device compatibility. In the related technology, the algorithm capability is realized by the internal algorithm of the AR algorithm, which is generally degraded from 6 degrees of freedom to 3 degrees of freedom, improving the compatibility of the device, but leading to high coupling in the algorithm, which is not conducive to diversified business needs and reduces the general capability of the algorithm. SUMMARY

[0004] Therefore, the embodiments of the present disclosure provide a degradation method and device of an augmented reality tracking algorithm, which can realize AR experience on different devices through effective validity determination of the data source of the AR tracking algorithm, ensure smooth AR experience, improve the device compatibility coverage of tracking algorithm demand content, reduce the threshold of user experience AR, facilitate the promotion of AR experience, and improve the efficiency of content development.

[0005] In a first aspect, the embodiments of the present disclosure provide a degradation method of an augmented reality tracking algorithm, which adopts the following technical solution:

[0006] When the AR device is started, if the AR device meets a preset running condition, a first tracking algorithm and the AR device are run.

[0007] When the AR device does not meet the preset running condition, and a data source of the AR device meets any one of a plurality of preset validities, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity is run, and the AR device is run, wherein the level of the first tracking algorithm is higher than that of the second tracking algorithm.

[0008] When the AR device does not meet the preset running condition, and the data sources of the AR device do not meet the preset validity, the running of the AR device is ended, and a result of failure of the AR device is returned.

[0009] When the camera video stream meets the first validity, the first tracking algorithm is run.

[0010] When the camera video stream does not meet the first validity, and the camera video stream meets the second validity, the configuration information of the first tracking algorithm is optimized, and the optimized first tracking algorithm is run.

[0011] When the first tracking algorithm is not set in the AR device, it is determined that the AR device does not meet the preset running condition.

[0012] In some embodiments, the data sources include sensor data streams, when the AR device does not meet the preset running condition, and the data sources of the AR device meet any one of the preset validities, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity is run, including:

[0013] When the first tracking algorithm is not set in the AR device, it is determined that the AR device does not meet the preset running condition.

[0014] When the sensor data stream meets the first validity, the first tracking algorithm is set in the AR device, and the first tracking algorithm is run.

[0015] When the sensor data stream does not meet the first validity, and the sensor data stream meets the second validity, the second tracking algorithm is run.

[0016] When the sensor data stream does not meet the first validity, does not meet the second validity, and meets the third validity, the second tracking algorithm is set in the AR device, and the second tracking algorithm is run.

[0017] In some embodiments, when the AR device does not meet the preset running condition, and the data sources of the AR device do not meet the preset validity, the running of the AR device is ended, and a result of failure of the AR device is returned, including:

[0018] When the AR device does not meet the preset running condition, and the sensor data stream does not meet the first validity, does not meet the second validity, and does not meet the third validity, the running of the AR device is ended, and a result of failure of the AR device is returned.

[0019] In some embodiments, the data source includes a camera video stream. When the AR device does not meet preset operating conditions, and the data source of the AR device meets any one of several preset validity conditions, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity conditions is run, including:

[0020] When the camera video stream does not satisfy the first validity and the second validity, but satisfies the third validity, the second tracking algorithm is run.

[0021] In some embodiments, the data source includes sensor data streams and camera video streams. When the AR device does not meet preset operating conditions, and the data source of the AR device meets any one of several preset validity conditions, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity conditions is run, including:

[0022] When both the sensor data stream and the camera video stream satisfy the first validity requirement, the first tracking algorithm is executed.

[0023] When neither the sensor data stream nor the camera video stream satisfies the first validity requirement, but the sensor data stream satisfies the second validity requirement, the second tracking algorithm is executed.

[0024] The second tracking algorithm is executed when neither the sensor data stream nor the camera video stream satisfies the first validity requirement, the sensor data stream does not satisfy the second validity requirement, and the sensor data stream satisfies the third validity requirement.

[0025] In some embodiments, the method further includes:

[0026] The data source is calibrated offline to determine whether it meets the several preset validity criteria, and a calibration file is obtained.

[0027] The calibration file is embedded into the AR device;

[0028] When the AR device is detected to be activated, the calibration file is obtained;

[0029] The calibration file is parsed to obtain the determination result.

[0030] In some embodiments, the method further includes:

[0031] When the AR device does not meet the preset operating conditions, the AR device will be switched to the H5 interactive interface.

[0032] Secondly, this disclosure also provides a degradation device for an augmented reality tracking algorithm, which adopts the following technical solution:

[0033] The first running unit is configured to run the first tracking algorithm and the AR device when the AR device starts and the AR device meets preset running conditions.

[0034] The second running unit is configured to run the first tracking algorithm or the second tracking algorithm corresponding to the preset validity and run the AR device when the AR device does not meet the preset running conditions and the data source of the AR device meets any one of a plurality of preset validities, and the grade of the first tracking algorithm is higher than that of the second tracking algorithm.

[0035] The end running unit is configured to end the running of the AR device and return a result of running failure of the AR device when the AR device does not meet the preset running conditions and the data source of the AR device does not meet the plurality of preset validities.

[0036] When the camera video stream meets the first validity, the first tracking algorithm is run.

[0037] When the camera video stream does not meet the first validity and the camera video stream meets the second validity, the configuration information of the first tracking algorithm is optimized, and the optimized first tracking algorithm is run.

[0038] When the first tracking algorithm is not set in the AR device, it is confirmed that the AR device does not meet the preset running conditions.

[0039] In a third aspect, the embodiments of the present disclosure further provide an electronic device, which adopts the following technical scheme:

[0040] The electronic device comprises:

[0041] at least one processor; and

[0042] a memory connected with the at least one processor in communication; wherein

[0043] The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the degradation method of the augmented reality tracking algorithm described in any of the above.

[0044] In a fourth aspect, the embodiments of the present disclosure further provide a computer readable storage medium storing computer instructions for causing a computer to execute the degradation method of the augmented reality tracking algorithm described in any of the above.

[0045] This disclosure provides a method and apparatus for downgrading augmented reality tracking algorithms. When an AR device is started, if the AR device meets preset operating conditions, a first tracking algorithm and the AR device are run. If the AR device does not meet the preset operating conditions, but the data source of the AR device meets any one of several preset validity criteria, the first tracking algorithm or a second tracking algorithm corresponding to the preset validity criteria is run, and the AR device is run, wherein the first tracking algorithm has a higher priority than the second tracking algorithm. If the AR device does not meet the preset operating conditions, and the data source of the AR device does not meet any of the preset validity criteria, the operation of the AR device is terminated, and a result indicating that the AR device failed to run is returned. This disclosure can achieve AR experience on different devices by determining the validity of the data source of the AR tracking algorithm. While ensuring a smooth AR experience, it improves the device compatibility coverage of tracking algorithm requirements, lowers the threshold for users to experience AR, facilitates the promotion of AR experience, and improves the efficiency of content development.

[0046] The above description is merely an overview of the technical solution disclosed herein. In order to better understand the technical means of this disclosure and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0047] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0048] Figure 1 A flowchart illustrating a degradation method for an augmented reality tracking algorithm provided in this embodiment of the disclosure;

[0049] Figure 2 A schematic diagram of the structure of a degradation device for an augmented reality tracking algorithm provided in an embodiment of this disclosure;

[0050] Figure 3 This is a schematic block diagram of an electronic device provided in an embodiment of the present disclosure. Detailed Implementation

[0051] The embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0052] It should be understood that the following specific examples illustrate the implementation of this disclosure, and those skilled in the art can easily understand other advantages and effects of this disclosure from the content disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. This disclosure can also be implemented or applied through other different specific implementation methods, and the details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this disclosure. It should be noted that, in the absence of conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0053] It should be noted that various aspects of embodiments within the scope of the appended claims are described below. It will be apparent that the aspects described herein can be embodied in a wide variety of forms, and any particular structure and / or function described herein is merely illustrative. Based on this disclosure, those skilled in the art will understand that one aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects set forth herein can be used to implement the device and / or practice the method. Additionally, this device and / or method can be implemented using structures and / or functionalities other than one or more of the aspects set forth herein.

[0054] It should also be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of this disclosure. The drawings only show the components related to this disclosure and are not drawn according to the number, shape and size of the components in actual implementation. In actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.

[0055] Furthermore, specific details are provided in the following description to facilitate a thorough understanding of the examples. However, those skilled in the art will understand that the described aspects can be practiced without these specific details.

[0056] like Figure 1 As shown, this disclosure provides a degradation method for an augmented reality tracking algorithm, including the following steps:

[0057] S101. When the AR device is started, if the AR device meets the preset operating conditions, the first tracking algorithm and the AR device are run.

[0058] Optionally, the first tracking algorithm of the AR device can adopt the 6DOF algorithm, and the second tracking algorithm can adopt the 3DOF algorithm. Optionally, the 6DOF algorithm relies on vision, that is, data from the camera video stream, and can also be supplemented by sensor data streams to comprehensively obtain the tracking pose (hereinafter referred to as pose) in the virtual space based on AR technology; the 3DOF algorithm mainly relies on sensor devices, such as motion sensors and gyroscopes.

[0059] S102. When the AR device does not meet the preset operating conditions, and the data source of the AR device meets any one of several preset validity conditions, the first tracking algorithm or the second tracking algorithm corresponding to the preset validity is run, and the AR device is run, wherein the first tracking algorithm has a higher level than the second tracking algorithm.

[0060] S103. When the AR device does not meet the preset operating conditions and the data source of the AR device does not meet several preset validity requirements, the operation of the AR device is terminated and the result of AR device failure is returned.

[0061] This disclosure embodiment is based on commonly used AR tracking algorithms, such as the 6DOF algorithm and the 3DOF algorithm. It determines the validity of the data source on which the AR tracking algorithm depends. By supplementing the AR tracking algorithm (i.e., connecting the AR device to the AR tracking algorithm) and optimizing the configuration information of the AR tracking algorithm, a smooth real-time degradation method for AR devices is realized.

[0062] In some embodiments, the data source includes a sensor data stream. When the AR device does not meet preset operating conditions, and the AR device's data source meets any one of several preset validity conditions, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity condition is executed, including:

[0063] When the first tracking algorithm is not set in the AR device, it is confirmed that the AR device does not meet the preset operating conditions;

[0064] When the sensor data stream meets the first validity requirement, the first tracking algorithm is set into the AR device and the first tracking algorithm is run.

[0065] When the sensor data stream does not meet the first validity requirement, but the sensor data stream meets the second validity requirement, the second tracking algorithm is executed.

[0066] When the sensor data stream does not meet the first validity requirement, does not meet the second validity requirement, but meets the third validity requirement, the second tracking algorithm is set into the AR device and the second tracking algorithm is run.

[0067] Optionally, regarding the sensor data stream, the determination mainly focuses on the AR device's built-in AR capabilities and the validity of the sensor data stream. Determining the AR device's built-in AR capabilities primarily involves assessing the tracking capabilities built into the AR device's host app or AR device system. For example, it might determine whether the AR device's host app or AR device system possesses a smooth and stable 6DOF algorithm. If the 6DOF algorithm is built-in, the AR device is deemed to meet the preset operating conditions. If the AR device's host app or AR device system does not support the 6DOF algorithm or the AR device's performance is poor, the AR device is deemed not to meet the preset operating conditions.

[0068] Optionally, the validity determination of sensor data streams mainly involves assessing the validity of the data sources upon which the 6DOF and 3DOF algorithms rely. If the validity determination is successful, the process can proceed to the corresponding running tracking algorithm or supplementary tracking algorithm. The validity determination process typically includes the following three steps:

[0069] The first-level judgment process determines whether the sensor data stream is stable and smooth, and the judgment parameters include, but are not limited to, the frequency, accuracy, and expression method of the data source. Simultaneously, it can meet the data source requirements of the 6DOF algorithm through certain modifications or transformations. For example, if the accuracy and frequency of the adapted effective data are not high, but its effective interpolation based on time and data meets the data source requirements of the 6DOF algorithm, the step of supplementing the AR device with the 6DOF algorithm can also be executed.

[0070] The second-level decision-making process, when the sensor data stream does not meet the first validity requirement (i.e., does not meet the data source requirements of the 6DOF algorithm), determines whether the sensor data stream meets the second validity requirement (i.e., whether it meets the data source validity requirements of the 3DOF algorithm). This primarily applies to data streams from motion sensors and gyroscopes. Optionally, if the sensor data stream is stable and smooth, it is confirmed that the sensor data stream meets the second validity requirement, and the second tracking algorithm (i.e., the 3DOF algorithm) is run.

[0071] The third-level judgment process determines whether the sensor data stream meets the third validity requirement if it does not meet the first or second validity requirement. If it does meet the third validity requirement, the AR device can achieve the ability to run the 3DOF algorithm by supplementing the second tracking algorithm (i.e., the 3DOF algorithm) to the AR device.

[0072] If the sensor data stream meets any of the above criteria, the AR device can be run and a result indicating successful AR device operation will be returned. If the sensor data stream does not meet any of the above three criteria, a result indicating failure to run the AR device will be returned.

[0073] In some embodiments, when the AR device does not meet preset operating conditions and the data source of the AR device does not meet several preset validity requirements, the operation of the AR device is terminated, and a result indicating that the AR device has failed is returned, including:

[0074] If the AR device does not meet the preset operating conditions, and the sensor data stream does not meet the first validity, second validity, and third validity, the operation of the AR device will be terminated, and the result of AR device failure will be returned.

[0075] In some embodiments, the data source includes a camera video stream. When the AR device does not meet preset operating conditions, and the AR device's data source meets any one of several preset validity conditions, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity conditions is run, including:

[0076] When the camera video stream meets the first validity requirement, the first tracking algorithm is run;

[0077] When the camera video stream does not meet the first validity requirement, but the camera video stream meets the second validity requirement, optimize the configuration information of the first tracking algorithm and run the optimized first tracking algorithm.

[0078] If the camera video stream does not meet the first validity requirement and the second validity requirement, but meets the third validity requirement, then the second tracking algorithm is executed.

[0079] Optionally, if the AR device or its host app supports a stable and smooth 6DOF algorithm, then there is no need to determine the validity of the camera video stream; otherwise, if the AR device or its host app does not support a stable and smooth 6DOF algorithm, or its ability to run the 6DOF algorithm is insufficient, then the validity of the camera video stream needs to be determined. Determining the validity of the camera video stream includes the following three levels of validity determination:

[0080] The first layer of judgment determines whether the camera video stream of the AR device is valid. If the frame data meets the data source requirements of the 6DOF algorithm, the camera video stream is deemed to have met the first validity requirement. Then, the 6DOF algorithm and the AR device are run, and a result indicating successful AR device operation is returned. The frame data typically includes, but is not limited to, the image size, resolution, aspect ratio, and the intrinsic fovea (field of view) parameters calibrated by the image.

[0081] The second layer of determination involves optimizing the frames based on the original camera video stream. If the optimized frames meet the data source requirements for running the first tracking algorithm (i.e., the 6DOF algorithm), then the optimized 6DOF algorithm can be run. Optionally, the frame optimization generally includes methods such as image cropping, compression, ROI extraction, and light intensity extraction. Users can configure these methods according to their actual needs, and this embodiment does not limit the specific methods used.

[0082] The third layer of judgment occurs when the camera video stream does not meet the first and second validity requirements, meaning it does not meet the conditions for running the 6DOF algorithm. For example, if the camera video stream cannot be acquired due to insufficient frame size or camera startup failure. If the camera video stream meets the third validity requirement, then the second tracking algorithm (i.e., the 3DOF algorithm) can be run.

[0083] If the camera video stream meets any of the above criteria, the AR device can be run and a result indicating successful AR device operation will be returned. If the camera video stream does not meet any of the above three criteria, a result indicating failure to run the AR device will be returned.

[0084] In some embodiments, the data source includes sensor data streams and camera video streams. When the AR device does not meet preset operating conditions, and the AR device's data source meets any one of several preset validity conditions, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity condition is run, including:

[0085] When the first tracking algorithm is not set in the AR device, it is confirmed that the AR device does not meet the preset operating conditions;

[0086] When both the sensor data stream and the camera video stream meet the first validity requirement, the first tracking algorithm is run.

[0087] When neither the sensor data stream nor the camera video stream satisfies the first validity requirement, but the sensor data stream satisfies the second validity requirement, the second tracking algorithm is executed.

[0088] The second tracking algorithm is executed when neither the sensor data stream nor the camera video stream satisfies the first validity requirement, the sensor data stream does not satisfy the second validity requirement, and the sensor data stream satisfies the third validity requirement.

[0089] In some embodiments, the method further includes:

[0090] The data source is calibrated offline to determine whether it meets several preset validity criteria, resulting in a calibration file.

[0091] Embed calibration files into AR devices;

[0092] When an AR device is detected to be activated, obtain the calibration file;

[0093] The calibration file is parsed to obtain the judgment result.

[0094] In some embodiments, the method further includes:

[0095] When the AR device does not meet the preset operating conditions, switch the AR device to the H5 interactive interface.

[0096] Optionally, embodiments of this disclosure can specifically compensate for the impact of algorithm downgrade on AR effects by adding interactive gameplay prompts or converting AR devices into H5 interactive experiences when AR devices do not support running AR.

[0097] This disclosure fully leverages the fundamental capabilities of AR device hardware and, through validity assessment, enables AR experiences across different AR devices. While ensuring a smooth AR experience, it improves the compatibility and coverage of tracking algorithm requirements for AR devices, lowers the barrier to entry for AR users, and facilitates the promotion of AR experiences. The first and second tracking algorithms in this disclosure are universally applicable to tracking-based content, satisfying both 3DOF and 6DOF algorithm AR experiences. This avoids the need for developing two sets of resources to address downgraded requirements for such AR content, improving content development efficiency. Furthermore, by determining the validity of the AR tracking algorithm's data source, it allows selection of whether to run 6DOF tracking, 3DOF tracking, or any other tracking algorithm that is not supported.

[0098] like Figure 2 As shown, this disclosure also provides a degradation device for an augmented reality tracking algorithm, including:

[0099] The first operating unit 21 is configured to run the first tracking algorithm and the AR device when the AR device is started, if the AR device meets the preset operating conditions.

[0100] The second operating unit 22 is configured to run a first tracking algorithm or a second tracking algorithm corresponding to the preset validity when the AR device does not meet the preset operating conditions and the data source of the AR device meets any one of several preset validitys, and to run the AR device, wherein the first tracking algorithm has a higher level than the second tracking algorithm.

[0101] The termination unit 23 is configured to terminate the operation of the AR device and return a result indicating that the AR device failed to run when the AR device does not meet the preset operating conditions and the data source of the AR device does not meet several preset validity requirements.

[0102] When the camera video stream meets the first validity requirement, the first tracking algorithm is executed.

[0103] When the camera video stream does not meet the first validity requirement, but the camera video stream meets the second validity requirement, optimize the configuration information of the first tracking algorithm and run the optimized first tracking algorithm.

[0104] When the first tracking algorithm is not set in the AR device, it is confirmed that the AR device does not meet the preset operating conditions.

[0105] An electronic device according to embodiments of this disclosure includes a memory and a processor. The memory is used to store non-transitory computer-readable instructions. Specifically, the memory may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may, for example, include random access memory (RAM) and / or cache memory. The non-volatile memory may, for example, include read-only memory (ROM), a hard disk, flash memory, etc.

[0106] The processor may be a central processing unit (CPU) or other processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device to perform desired functions. In one embodiment of this disclosure, the processor is used to execute computer-readable instructions stored in the memory, causing the electronic device to perform all or part of the steps of the degradation method of the augmented reality tracking algorithm of the foregoing embodiments of this disclosure.

[0107] Those skilled in the art will understand that, in order to solve the technical problem of how to achieve a good user experience, this embodiment may also include well-known structures such as communication buses and interfaces, and these well-known structures should also be included within the protection scope of this disclosure.

[0108] like Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. It illustrates a structural schematic diagram suitable for implementing the electronic device in the embodiment of the present disclosure. Figure 3 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0109] like Figure 3As shown, an electronic device may include a processing unit (such as a central processing unit, graphics processing unit, etc.) that can perform various appropriate actions and processes based on a program stored in read-only memory (ROM) or a program loaded from a storage device into random access memory (RAM). The RAM also stores various programs and data required for the operation of the electronic device. The processing unit, ROM, and RAM are interconnected via a bus. Input / output (I / O) interfaces are also connected to the bus.

[0110] Typically, the following devices can be connected to the I / O interface: input devices, such as sensors or visual information acquisition devices; output devices, such as displays; storage devices, such as magnetic tapes or hard drives; and communication devices. Communication devices allow electronic devices to exchange data wirelessly or via wired communication with other devices, such as edge computing devices. Although Figure 3 Electronic devices with various devices are shown, but it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0111] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by a processing device, all or part of the steps of the degradation method of the augmented reality tracking algorithm of embodiments of this disclosure are performed.

[0112] For a detailed description of this embodiment, please refer to the corresponding descriptions in the foregoing embodiments, which will not be repeated here.

[0113] A computer-readable storage medium according to embodiments of the present disclosure stores non-transitory computer-readable instructions. When these non-transitory computer-readable instructions are executed by a processor, all or part of the steps of the degradation method of the augmented reality tracking algorithm described in the foregoing embodiments of the present disclosure are performed.

[0114] The aforementioned computer-readable storage media include, but are not limited to: optical storage media (e.g., CD-ROM and DVD), magneto-optical storage media (e.g., MO), magnetic storage media (e.g., magnetic tape or portable hard drive), media with built-in rewritable non-volatile memory (e.g., memory card), and media with built-in ROM (e.g., ROM cartridge).

[0115] For a detailed description of this embodiment, please refer to the corresponding descriptions in the foregoing embodiments, which will not be repeated here.

[0116] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.

[0117] In this disclosure, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. The block diagrams of devices, apparatuses, devices, and systems involved in this disclosure are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as "comprising," "including," "having," etc., are open-ended terms meaning "including but not limited to," and are used interchangeably with them. The terms "or" and "and" as used herein refer to the terms "and / or," and are used interchangeably with them unless the context clearly indicates otherwise. The term "such as" as used herein refers to the phrase "such as but not limited to," and is used interchangeably with it.

[0118] Additionally, as used herein, the "or" used in a list of items beginning with "at least one" indicates a separate list, such that a list of, for example, "at least one of A, B, or C" means A or B or C, or AB or AC or BC, or ABC (i.e., A and B and C). Furthermore, the word "exemplary" does not imply that the described example is preferred or better than other examples.

[0119] It should also be noted that in the systems and methods of this disclosure, the components or steps can be decomposed and / or recombined. These decompositions and / or recombinations should be considered as equivalent solutions to this disclosure.

[0120] Various changes, substitutions, and modifications can be made to the technology described herein without departing from the teachings defined by the appended claims. Furthermore, the scope of the claims of this disclosure is not limited to the specific aspects of the processes, machines, manufactures, events, means, methods, and actions described above. Currently existing or later-developed processes, machines, manufactures, events, means, methods, or actions that perform substantially the same function or achieve substantially the same result as the corresponding aspects described herein can be utilized. Therefore, the appended claims include such processes, machines, manufactures, events, means, methods, or actions within their scope.

[0121] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.

[0122] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.

Claims

1. A degradation method for an augmented reality tracking algorithm, characterized in that, include: When the AR device is started, if the AR device meets the preset operating conditions, the first tracking algorithm and the AR device are run. When the AR device does not meet the preset operating conditions, and the data source of the AR device meets any one of several preset validity conditions, the first tracking algorithm or the second tracking algorithm corresponding to the preset validity condition is run, and the AR device is run, wherein the first tracking algorithm has a higher level than the second tracking algorithm; When the AR device does not meet the preset operating conditions, and the data source of the AR device does not meet the preset validity requirements, the operation of the AR device is terminated, and the result of the AR device operation failure is returned. Specifically, the first tracking algorithm is executed when the camera video stream meets the first validity requirement; When the camera video stream does not meet the first validity requirement, but the camera video stream meets the second validity requirement, the configuration information of the first tracking algorithm is optimized, and the optimized first tracking algorithm is run. When the first tracking algorithm is not set in the AR device, it is confirmed that the AR device does not meet the preset operating conditions.

2. The degradation method for the augmented reality tracking algorithm according to claim 1, characterized in that, The data source includes sensor data streams. When the AR device does not meet preset operating conditions, and the AR device's data source meets any one of several preset validity conditions, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity conditions is run, including: When the first tracking algorithm is not set in the AR device, it is confirmed that the AR device does not meet the preset operating conditions; When the sensor data stream meets the first validity requirement, the first tracking algorithm is set into the AR device and the first tracking algorithm is run. When the sensor data stream does not satisfy the first validity requirement, and the sensor data stream satisfies the second validity requirement, the second tracking algorithm is executed; When the sensor data stream does not meet the first validity requirement, does not meet the second validity requirement, but meets the third validity requirement, the second tracking algorithm is set into the AR device and the second tracking algorithm is run.

3. The degradation method for the augmented reality tracking algorithm according to claim 2, characterized in that, When the AR device does not meet the preset operating conditions, and the data source of the AR device does not meet the preset validity requirements, the operation of the AR device is terminated, and a result indicating that the AR device has failed is returned, including: When the AR device does not meet the preset operating conditions, and the sensor data stream does not meet the first validity, the second validity, and the third validity, the operation of the AR device is terminated, and the result of the AR device operation failure is returned.

4. The degradation method for the augmented reality tracking algorithm according to claim 1, characterized in that, The data source includes camera video streams. When the AR device does not meet preset operating conditions, and the data source of the AR device meets any one of several preset validity conditions, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity conditions is run, including: When the camera video stream does not satisfy the first validity and the second validity, but satisfies the third validity, the second tracking algorithm is run.

5. The degradation method for the augmented reality tracking algorithm according to claim 1, characterized in that, The data source includes sensor data streams and camera video streams. When the AR device does not meet preset operating conditions, and the AR device's data source meets any one of several preset validity conditions, a first tracking algorithm or a second tracking algorithm corresponding to the preset validity condition is run, including: When both the sensor data stream and the camera video stream satisfy the first validity requirement, the first tracking algorithm is executed. When neither the sensor data stream nor the camera video stream satisfies the first validity requirement, but the sensor data stream satisfies the second validity requirement, the second tracking algorithm is executed. The second tracking algorithm is executed when neither the sensor data stream nor the camera video stream satisfies the first validity requirement, the sensor data stream does not satisfy the second validity requirement, and the sensor data stream satisfies the third validity requirement.

6. The degradation method for the augmented reality tracking algorithm according to claim 1, characterized in that, The method further includes: The data source is calibrated offline to determine whether it meets the several preset validity criteria, and a calibration file is obtained. The calibration file is embedded into the AR device; When the AR device is detected to be activated, the calibration file is obtained; The calibration file is parsed to obtain the determination result.

7. The degradation method for the augmented reality tracking algorithm according to any one of claims 1 to 6, characterized in that, The method further includes: When the AR device does not meet the preset operating conditions, the AR device will be switched to the H5 interactive interface.

8. A degradation device for an augmented reality tracking algorithm, characterized in that, include: The first operating unit is configured to run the first tracking algorithm and the AR device when the AR device is started, if the AR device meets the preset operating conditions. The second operating unit is configured to run a first tracking algorithm or a second tracking algorithm corresponding to the preset validity when the AR device does not meet the preset operating conditions and the data source of the AR device meets any one of several preset validitys, and to run the AR device, wherein the first tracking algorithm has a higher level than the second tracking algorithm. The termination unit is configured to terminate the operation of the AR device and return a result indicating that the AR device failed to run when the AR device does not meet the preset operating conditions and the data source of the AR device does not meet the preset validity requirements. Specifically, the first tracking algorithm is executed when the camera video stream meets the first validity requirement; When the camera video stream does not meet the first validity requirement, but the camera video stream meets the second validity requirement, the configuration information of the first tracking algorithm is optimized, and the optimized first tracking algorithm is run. When the first tracking algorithm is not set in the AR device, it is confirmed that the AR device does not meet the preset operating conditions.

9. An electronic device, characterized in that, The electronic device includes: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the degradation method of the augmented reality tracking algorithm according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions for causing a computer to perform the degradation method of the augmented reality tracking algorithm according to any one of claims 1 to 7.

Images