Method for generating XR scene using web environment of mobile user device

The method enables reliable and stable cross-platform XR scene generation by identifying devices, using a single API, and adapting code to native APIs, ensuring consistent scene display across diverse mobile devices with varying operating systems.

WO2026084625A1PCT designated stage Publication Date: 2026-04-23LLC ADDON
View PDF 5 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
LLC ADDON
Filing Date
2025-10-21
Publication Date
2026-04-23

AI Technical Summary

Technical Problem

Existing XR applications struggle with cross-platform compatibility across mobile devices with different operating systems, leading to inconsistent user experience and limited device usage, especially in environments like exhibition events.

Method used

A method for generating XR scenes using a web environment that identifies the mobile device, utilizes cache memory, and employs a single API while providing program code to adapt to the device's native API, leveraging sensors like accelerometers and gyroscopes for orientation, and optionally lidar for enhanced accuracy, ensuring consistent scene generation across diverse devices.

Benefits of technology

Ensures reliable and stable cross-platform XR scene generation, allowing the same scene to be displayed on multiple heterogeneous devices, including those without lidar, by using a common web environment and adaptive code, thus enhancing user experience and stability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000019_0000
    Figure 00000019_0000
  • Figure 00000020_0000
    Figure 00000020_0000
Patent Text Reader

Abstract

The technical solution relates to the field of information technology, and more particularly to processes and methods for creating extended reality (XR) scenes. A need exists to enable the creation of reliable and stable XR applications that allow the stable and reliable generation of an XR scene irrespective of the operating system installed on a mobile user device. A method for generating an XR scene using the web environment of a mobile user device is proposed. The technical result achieved by the claimed technical solution, in addition to providing a product and / or process which fulfils its intended purpose, is that of enabling reliable and stable generation of an XR scene using the web environment of a mobile user device. In certain aspects of the technical solution, a further technical result achieved is that of also increasing the stability of an XR scene.
Need to check novelty before this filing date? Find Prior Art

Description

A METHOD FOR GENERATING AN XR SCENE USING THE WEB ENVIRONMENT OF A MOBILE USER DEVICE

[0001] AREA OF TECHNOLOGY

[0002] The technical solution relates to the field of information technology, more specifically, to methods and techniques for creating extended reality scenes (XR).

[0003] LEVEL OF TECHNOLOGY

[0004] Various methods and techniques for generating XR scenes are known, using dedicated computer applications. Most commonly, such computer applications provide software codes that enable the generation of extended reality (XR) scenes within the application itself. However, such applications are not always cross-platform, meaning they do not always support generating the same XR scene across multiple, diverse mobile devices. Typically, mobile devices can be divided into those with open-source operating systems and those with proprietary operating systems, depending on their operating system.For example, but not limited to, the most in-demand mobile user devices as of the date of this patent document are those running the Android® operating system (Google LLC, US), an open-source operating system, and those running the iOS® operating system (Apple Inc., US), a proprietary operating system. In most cases, ensuring cross-platform compatibility—that is, adapting an application's software code to run on different operating systems—is a non-trivial and labor-intensive task, which is why application developers are often forced to focus on developing applications for a single operating system.In turn, this leads to inconvenience for users, who are thus forced to choose mobile user devices of the same operating system for the possibility of sharing, for example, an XR application, which in turn limits, for example, the use of such an XR application in situations where. the flow of users and, as a consequence, mobile user devices, is inconsistent and heterogeneous, for example, within the framework of exhibition events.

[0005] Moreover, patent document US11328491 B2, published May 10, 2022 (D1), discloses an invention that discloses systems and methods for improving interaction between computers in systems for providing, displaying, and / or hosting content supported or configured by devices, servers, and / or platforms. The systems and methods disclosed in D1 provide a new structure that displays an XR interface panel. The XR panel is configured to display and automatically and progressively adjust the panel and / or the augmented reality (AR), virtual reality (VR), and / or mixed reality (MR) content displayed therein based on the dynamically determined and updated positioning of the viewing user. Furthermore, D1 indicates that the method can be implemented using a web environment. However, no examples are provided of how exactly the web environment can be used to generate an XR scene.Meanwhile, although it may seem that using a web environment to ensure cross-platform compatibility is an obvious choice for a person skilled in the art, this approach is nevertheless associated with many problems, including, but not limited to, the fact that any WebXR application requires the use of a corresponding operating system API, access to which from the outside, that is, at least from a web environment deployed in a browser, may be limited, for example, by the developer of an operating system with proprietary source code for reasons known only to him.

[0006] Therefore, there is a need to ensure the ability to create reliable and stable XR applications that can generate XR scenes reliably and stably, regardless of the operating system of the mobile user device.

[0007] The solution known from D1 can be accepted as the closest analogue of the declared technical solution.

[0008] DISCLOSURE OF THE TECHNICAL SOLUTION

[0009] The technical problem solved by the claimed technical solution is the creation of a product and / or method and / or application of a product or method that eliminates the shortcomings of the prior art and thus ensures reliable and stable cross-platform Generation and / or playback of XR scenes independent of the operating system of the mobile user device. In some other respects, increased stability of the XR scene is also ensured. Another technical problem addressed by the claimed technical solution is the creation of a product and / or method and / or application that expands the arsenal of technical means—methods—for generating XR scenes.

[0010] The technical result achieved by implementing the claimed technical solution, in addition to the product and / or method fulfilling its intended purpose, is to ensure the reliability and stability of XR scene generation using the web environment of a mobile user device. In some other respects, the technical result achieved by implementing the claimed technical solution also includes increased XR scene stability.

[0011] The technical result is achieved due to the fact that a method for generating an XR scene, executed by at least one processor of at least one mobile user device, is provided, which method consists of at least performing the following steps: a step of identifying the mobile user device; a step of obtaining data for generating the XR scene and placing the obtained data in the cache memory of the mobile user device; a step of generating a virtual part of the XR scene; a step of obtaining coordinates of the real part of the XR scene; a step of creating anchor marks for binding the virtual part of the XR scene to the coordinates of the real part of the XR scene; a step of obtaining coordinates of the mobile user device and its position and / or orientation in space and displaying the created XR scene taking into account the obtained coordinates and the position and / or orientation in space of the mobile user device;wherein, when generating the XR scene, only one API suitable for generating the XR scene is used; wherein, based on the identification of the mobile user device, if necessary, a program code is provided which, when implemented by the processor of the mobile user device, at least ensures the possibility of at least partially using the said API suitable for generating the XR scene instead of the said API used by default.

[0012] BRIEF DESCRIPTION OF DRAWINGS

[0013] Illustrative embodiments of the present utility model are described below in detail with reference to the accompanying drawings, which are incorporated herein by reference, and in which:

[0014] Fig. 1 shows an exemplary diagram of a method 100 for generating an XR scene.

[0015] Fig. 2 shows an exemplary diagram of an XR scene generation system 200.

[0016] IMPLEMENTATION OF THE TECHNICAL SOLUTION

[0017] In a preferred embodiment of the present invention, there is provided a method for generating an XR scene, executable by at least one processor of at least one mobile user device, which method comprises at least the following steps: a step of identifying the mobile user device; a step of obtaining data for generating the XR scene and placing the obtained data in the cache memory of the mobile user device; a step of generating a virtual part of the XR scene; a step of obtaining coordinates of the real part of the XR scene; a step of creating anchor marks for binding the virtual part of the XR scene to the coordinates of the real part of the XR scene; a step of obtaining coordinates of the mobile user device and its position and / or orientation in space and displaying the created XR scene taking into account the obtained coordinates and the position and / or orientation in space of the mobile user device;wherein, when generating the XR scene, only one API suitable for generating the XR scene is used; wherein, based on the identification of the mobile user device, if necessary, a program code is provided which, when implemented by the processor of the mobile user device, at least ensures the possibility of at least partially using the said API suitable for generating the XR scene instead of the said API used by default.

[0018] In a particular embodiment of the present invention, any said method is provided, characterized in that the provision of said program code is ensured by means of an application distribution system.

[0019] In a particular embodiment of the present invention, any of the above mentioned methods is provided, characterized in that after generating the XR scene, data is obtained from at least an accelerometer and a gyroscope of a mobile user device for sequentially determining the position and / or orientation of the mobile user device in space; wherein, if necessary, the reproduction of the virtual part of the XR scene is adjusted based on the received data from the accelerometer and gyroscope of the mobile user device.

[0020] In a particular embodiment of the present invention, any of the mentioned methods is provided, characterized in that after generating the XR scene, data from at least the lidar of the mobile user device is additionally obtained; wherein, if necessary, the reproduction of the virtual part of the XR scene is corrected based on the obtained data from the accelerometer and gyroscope of the mobile user device and additional data from the lidar of the mobile user device.

[0021] In a particular embodiment of the present invention, any said method is provided, characterized in that when said mobile user device, which is the first mobile user device, is not equipped with a lidar, then the lidar data of the mobile user device is obtained using a second mobile user device equipped with a lidar.

[0022] In a particular embodiment of the present invention, any of the mentioned methods is provided, characterized in that an environment mask is formed by means of the obtained anchor marks.

[0023] In another preferred embodiment of the present invention, an XR scene generating device is provided, comprising at least: one or more processors; a transceiver; a means for determining the position and / or orientation of the device in space; a memory containing program code, which, when implemented by at least one processor, ensures the execution of any of the mentioned methods for generating an XR scene.

[0024] In another preferred embodiment of the present invention, there is provided an XR scene generation system comprising at least: a server device at least configured to provide data for generating an XR scene to at least one mobile user device; and a mobile user device, which is any of the said mobile user devices, at least configured to obtaining the said data for generating an XR scene and generating an XR scene based on the obtained data.

[0025] In another preferred embodiment of the present invention, a machine-readable data carrier is provided containing a program code which, when executed by at least one processor of at least one computing device, enables the execution of any of the said methods for generating an XR scene.

[0026] The following are embodiments of the present invention, revealing examples of its implementation in specific embodiments. However, the description itself is not intended to limit the scope of rights granted by this patent. Rather, it should be understood that the claimed invention may also be implemented in other ways that incorporate different elements and conditions, or combinations of elements and conditions similar to those described herein, in combination with other existing and future technologies.

[0027] Fig. 1 shows an exemplary diagram of a method 100 for generating an XR scene. In a preferred embodiment of the present invention, there is provided a method 100 for generating an XR scene, executable by at least one processor 2011 of at least one mobile user device 201, which method consists of at least performing the steps of: a step 101 of identifying the mobile user device 201; a step 102 of obtaining data for generating an XR scene and placing the obtained data in the cache memory of the mobile user device 201; a step 103 of generating a virtual part of the XR scene; a step 104 of obtaining coordinates of the real part of the XR scene; a step 105 of creating anchor marks for binding the virtual part of the XR scene to the coordinates of the real part of the XR scene;step 106 of obtaining the coordinates of the mobile user device 201 and its position and / or orientation in space and displaying the created XR scene taking into account the obtained coordinates and the position and / or orientation in space of the mobile user device 201; wherein, when generating the XR scene, only one API suitable for generating the XR scene is used; wherein, based on the identification of the user web browser, program code is provided or not provided, which, when implemented by the processor of the computer device 201, at least ensures the possibility of using the said API, which was used for; generating an XR scene instead of the default API. Most typically, the mobile user device 201 may be a mobile user device 201 with the Android® operating system (Google LLC, US), which is an open source operating system, or a mobile user device 201 with the iOS® operating system (Apple Inc., US), which is an operating system based on proprietary source code. Most typically, such an Android™-based mobile device 201 contains program code that, when executed by at least one processor of such a mobile device 201, causes the processor to implement a web environment that is accessed through a web browser of the mobile user device 201, where, as a rule, for such an Android®-based mobile user device 201, the web browser is a web browser based on Chromium® (Google LLC, US).Most typically, the iOS®-based mobile device 201 contains program code that, when executed by at least one processor of such mobile device 201, causes the processor to implement a web environment that is accessed through a web browser of the mobile user device 201, where, as a rule, for such an iOS®-based mobile user device 201 the web browser is a web browser based on Safari® (Apple Inc., US).In this case, without limitation, most typically, within the framework of the mentioned step 101, a request is generated to the server 202 for storing XR scenes for providing data for generating an XR scene; in this case, as a rule, such a request most typically includes at least data about the mobile user device 201, in particular concerning the operating system of the mobile user device 201, which thus are identification data of the mobile user device 201; and, accordingly, the mentioned server 202 most typically is configured with the possibility of extracting the mentioned identification data for identifying the mobile user device 201, which is most typically provided as selected from the group: a mobile user device 201 based on Android® or a mobile user device 201 based on iOS®.In this case, without limitation, once the identification data of the mobile user device 201 is obtained, it becomes possible to provide data for generating an XR scene. In this case, without limitation, the data for generating an XR scene typically... include at least scripts for generating an XR scene using a suitable API, three-dimensional models for use in the XR scene to be generated, and, optionally, textures and / or environment images (skybox) associated with the three-dimensional models. Accordingly, without limitation, for an Android®-based device 201, scripts are provided for generating an XR scene using the ARCore® API (Google LLC, US), which is thus a suitable API, and, without limitation, for an iOS®-based device, scripts are provided for adjusting the generated XR scene using the ARKit® API (Apple Inc., US), which is thus the default API, but without limitation, when the device is identified as an iOS®-based device, then scripts for generating an XR scene using the ARCore® API are additionally also provided, and, at the same time, program code is provided, for example, through an application distribution system, such as, for example, but not limited to, the App Store®, wherein the provided program code, when implemented by the processor of the device 201, for which the default API is used, at least provides the possibility of at least partially using the said API suitable for generating an XR scene instead of the default API.More specifically, but not limited to, when generating an XR scene on an iOS®-based mobile device 201, the default ARKit® will be replaced by at least partial use of ARCore®, i.e., a suitable API used on Android®-based devices 201. At the same time, but not limited to, the default ARKit® may still be used to adjust the position and display of objects in the XR scene, but only to the extent that the lidar of the iOS®-based mobile device 201 is used.It should be obvious to a person skilled in the art, having ordinary knowledge, for whom the present invention is intended, that the reference to specific operating systems and reference to specific APIs in this document are made only as part of non-limiting examples and, accordingly, ARCore® is not necessarily a suitable API, and ARKit® is not necessarily the default API, but the opposite situation is possible, in which ARKit® is preferably used for generating an XR scene, and ARCore® is used only to a limited extent to engage certain components of the device for which such API is the default API; thus, without limitation, mobile devices 201 with different operating systems should rather be considered as first mobile devices 201 and second mobile devices 201 , and the corresponding API suitable for generating an XR scene and the API used by default should rather be considered as the first API and the second API, respectively.

[0028] In this case, without limitation, the data obtained at step 102 for generating the XR scene are stored in the cache memory of the user device 201, which allows for at least partial generation of the XR scene using at least one processor 2011 of the device 201, which ensures the required stability of the XR scene under conditions when the device 201 is experiencing a lack of radio signal and cannot receive data from the server. 202 or the acquisition of data is significantly complicated. In this case, for example, without limitation, at step 103, pre-rendering of virtual components of the XR scene is ensured, such as, for example, but not limited to, virtual objects, provided or not provided with textures and / or images-environments, which will be used later during the reproduction of the XR scene using the device 201. In this case, without limitation, at step 104, obtaining the coordinates of the real part of the XR scene is ensured, namely, without limitation, an analysis of the environment and calculation of the coordinates of the virtual objects obtained at step 103 are ensured; in this case, for example, without limitation, the lidar of the mobile user device 201 can be used to obtain more detailed information about the surrounding space.In this case, without being limited to, at step 105, at least the creation of anchor marks for linking the virtual part of the XR scene to the calculated coordinates of the real part of the XR scene is ensured; in this case, for example, without being limited to, the correction of the calculated coordinates of the objects of the virtual part of the XR scene can be ensured. In this case, without being limited to, at step 106, the coordinates of the mobile user device 201 in space are obtained, as well as its position and / or orientation in space, including, without being limited to, at least the angle of inclination to the horizon and / or surfaces of the real part of the XR scene and the like, after which the display of the objects of the virtual part of the XR scene with the use of the mobile user device 201 is ensured with reference by means of the anchor marks obtained in step 105 to the real part of the XR scene; in this case, without being limited to, subsequent correction of the generated XR- is ensured. scenes after receiving data from the sensors of the mobile user devices 201; wherein, for example, without limitation, after generating the XR scene, data is received from at least the accelerometer 2013 and the gyroscope 2014 of the mobile user device 201 for sequentially determining the position and / or orientation of the mobile user device 201 in space; wherein, if necessary, the reproduction of the virtual part of the XR scene is corrected based on the received data from the accelerometer 2013 and the gyroscope 2014 of the mobile user device.

[0029] Thus, without limitation, it is possible to create and display the same XR scene for multiple heterogeneous mobile user devices 201 , which accordingly offers a number of advantages. For example, without limitation, it becomes possible to use a second mobile user device 201 equipped with a lidar, which, if its default API were used, would not provide XR scene playback on the first mobile user devices 201 , which are not equipped with a lidar.Thus, when a common web environment for generating XR scenes and reproducing and adjusting them is provided, then after generating an XR scene, the possibility of obtaining data from at least the lidar of the second mobile user device 201 is provided, thanks to which, for example, without limitation, it is possible to ensure the adjustment of the reproduction of the virtual part of the XR scene not only on the basis of the received data from the accelerometer 2013 and the gyroscope 2014 of the first and second mobile user devices 201, but also additional data from the lidar 2015 of at least one second mobile user device 201 equipped with the lidar 2015.Moreover, without limitation, when the mentioned mobile user device 201 , which is the first mobile user device 201 , is not equipped with a lidar, then the lidar 2015 data for generating the XR scene on the first mobile user device 201 are obtained using the second mobile user device 201 , equipped with the lidar 2015. In this way, a correction subsystem can be provided, in which the second mobile user device 201 , equipped with the lidar 2015 , can be involved on a permanent basis, which thus, for example, without limitation, by exchanging data with the server 202, ensures a permanent update and correction of the display of the generated XR scene for a plurality of those involved at once. mobile user devices 201. For example, without limitation, for this purpose, using the mentioned anchor marks, the formation of an environment mask is ensured, at least partial storage of which is ensured using the mobile user device 201, wherein the formation of such an environment mask is carried out in advance using a second mobile user device 201, which is equipped with a lidar 2015, wherein, without limitation, a continuous transmission of the obtained environment mask is subsequently ensured, which makes it possible to use lidar data for calculating the coordinates of virtual objects, even when the mobile user device 201 is not equipped with it.Alternatively, without limitation, the previously obtained environment masks can be placed in the memory of the server 202 and / or in the memory of the database 203 for use by a plurality of devices 201 without the need to constantly engage the device 201 with the lidar 2015. At the same time, the said server 202, as a means of distributing the environment mask, can be a second mobile user device 201, which thus ensures the distribution of the environment mask and / or the lidar 2015 data for a plurality of first devices 201 via any data transmission network 300. In this way, without limitation, increased accuracy and stability of the generated XR scene can be ensured.

[0030] Thus, without being limited, in another preferred embodiment of the present invention, an XR scene generating device 201 is provided, comprising at least: one or more processors 2011; a transceiver 2016; means 2013, 2014, 2015 for determining the position and / or orientation of the device in space; a memory 2012 containing a program code, which, when implemented by at least one processor 2011, ensures the execution of any of the mentioned XR scene generating method 100.In this case, without being limited, the transceiver 2016 provides the ability to communicate between the device 201 via any data transmission network 300 with other devices 201, as well as with the server 202, which ensures the formation of the XR scene generation system 200, thus containing at least: the server device 202, which thus also contains at least a processor 2021 and a memory 2022 containing procedures, codes, databases 203, ensuring at least the provision of data for generating the XR scene to at least one mobile. user device 201; and a mobile user device 201, which is any of the said mobile user devices 201, at least configured to receive said data for generating an XR scene and to generate an XR scene based on the received data. Accordingly, without limitation, a machine-readable data carrier is also provided, containing program code, which, when executed by at least one processor of at least one computer device, ensures the execution of any of the said method for generating an XR scene.

[0031] In this case, when the XR scene generating device is a mobile user device, then such a mobile user device is most typically a portable computer device, such as, for example, but not limited to, a laptop, a netbook, a tablet computer, a smartphone and the like, and may not necessarily include an output device, such as, for example, a display, which may be a touch screen and thus also represent an input / output device; however, it should be obvious to a person skilled in the art, possessing ordinary knowledge, for whom the present invention is intended, that instead of an output device, the generated XR scene can be reproduced by means of a connected output device, such as, for example, but not limited to, a display, a virtual reality helmet or glasses, an augmented reality helmet or glasses and the like;In this case, without limitation, the external output device and its position in space can be tracked to ensure the correct display of the XR scene on such a device.

[0032] Thus, preferably, without limitation, a computing device may be provided in the context of the present invention. Such a computing device most typically comprises at least: one or more processors; memory containing the corresponding program code, as shown earlier. At the same time, such a computing device may act as a corresponding server of the corresponding system, which thus also comprises at least one or more processors and memory, which are thus essentially similar, respectively, to the processor and memory of the previously described computing devices. By way of example, but not limitation, memory (machine-readable storage medium) may include non-volatile memory (NVRAM); random access memory (RAM); read-only memory (ROM); electrically erasable programmable read-only memory (EEPROM); flash memory or other memory technologies; CDROM, digital versatile disc (DVD), or other optical or holographic storage media; magnetic cassettes, magnetic tape, magnetic disk storage, or other magnetic storage devices; and any other storage medium that can be used to store and encode the desired information. However, memory includes, but is not limited to, a computer storage medium in the form of volatile or non-volatile memory, or a combination thereof. However, exemplary hardware devices include, but are not limited to, solid-state memory, hard disk drives, optical disk drives, and so on.Moreover, without limitation, the machine-readable storage medium (memory) is non-transient (permanent, non-transitive), so it does not include a temporary (transitive) propagating signal. Moreover, without limitation, the memory may store an exemplary environment in which, using computer commands or codes, including those stored in the server's memory, any previously described computer procedure executable by the processor of the computing device may be performed. Moreover, without limitation, the computing device, when not a thin client, contains one or more processors that are designed to execute computer commands or codes stored in the device's memory to ensure the execution of the aforementioned procedures.In this case, without being limited, the server may be essentially similar to a computer device, when it is not a thin client, and, accordingly, contain one or more processors, which are designed to execute computer commands or codes stored in the server memory in order to ensure the execution of the mentioned procedures. In this case, without being limited, any described system may also include a database (DB) 203. Such a DB may be, but not limited to: a hierarchical DB, a network DB, a relational DB, an object DB, an object-oriented DB, an object-relational DB, a spatial DB, a combination of two or more of the listed DBs, and the like. In this case, without being limited, the DB, at least, stores data, parameters, raw data, labeled data, modified data, machine learning models and other information in memory or in a suitable one. The memory of another computing device, connected to any of the aforementioned computing devices and / or to a server, which may be, but is not limited to, memory similar to any memory as previously shown, and which can be accessed via the server. Furthermore, without limitation, a server is provided that, in addition to the previously described functions, stores and facilitates the manipulation of computer commands or codes previously described in this document, which, accordingly, are not further described. Moreover, without limitation, the server, in addition to the previously described functions, can ensure the regulation of data exchange within the system. Moreover, without limitation, data exchange within the corresponding system is carried out via one or more data transmission networks 300.Data transmission networks may include, but are not limited to, one or more local area networks (LANs) and / or wide area networks (WANs), or may represent the Internet, an intranet, a virtual private network (VPN), or a combination thereof, and the like. A server may also, without limitation, provide a virtual computing environment to facilitate interaction between system components. A data transmission network serves to facilitate interaction between a computing device, a server, optionally a database, and optionally the previously described systems and other systems.Moreover, without limitation, a non-thin client computing device and / or server may be directly connected to the database using known wired and wireless communication methods and techniques, which, accordingly, are not described in detail below, or, without limitation, the database may be implemented in the memory of any computing device, including one that serves as a server. Moreover, without limitation, a suitable non-thin client computing device may act as a system server for other thin client computing devices. Most typically, without limitation, the components of the computing devices described herein and the server components are interconnected, including via a data bus.

[0033] This description of the claimed technical solution demonstrates only particular embodiments and does not limit other embodiments of its implementation, since other possible alternative embodiments, that do not go beyond the scope of the information set out in this application, must be obvious to a person of ordinary skill in the art, for whom the claimed technical solution is intended.

Claims

Invention formula 1. A method for generating an XR scene, executed by at least one processor of at least one mobile user device, which method comprises at least the following steps: a step of identifying the mobile user device; a step of obtaining data for generating the XR scene and placing the obtained data in the cache memory of the mobile user device; a step of generating a virtual part of the XR scene; a step of obtaining coordinates of the real part of the XR scene; a step of creating anchor marks for binding the virtual part of the XR scene to the coordinates of the real part of the XR scene; a step of obtaining coordinates of the mobile user device and its position and / or orientation in space and displaying the created XR scene taking into account the obtained coordinates and the position and / or orientation in space of the mobile user device; wherein when generating the XR scene, only one API suitable for generating the XR scene is used;wherein, based on the identification of the mobile user device, if necessary, a program code is provided which, when implemented by the processor of the mobile user device, at least ensures the possibility of at least partially using the said API suitable for generating an XR scene instead of the said API used by default.

2. The method according to paragraph 1, characterized in that the provision of said program code is ensured through an application distribution system.

3. The method according to claim 1, characterized in that after generating the XR scene, data is obtained from at least the accelerometer and gyroscope of the mobile user device for sequentially determining the position and / or orientation of the mobile user device in space; wherein, if necessary, the reproduction of the virtual part of the XR scene is corrected based on the obtained data from the accelerometer and gyroscope of the mobile user device.

4. The method according to claim 3, characterized in that after generating the XR scene, data from at least the lidar of the mobile user device is additionally obtained; wherein, if necessary, the reproduction of the virtual part of the XR scene is adjusted based on the obtained data from the accelerometer and gyroscope of the mobile user device and additional data from the lidar of the mobile user device.

5. The method according to claim 4, characterized in that when said mobile user device, which is the first mobile user device, is not equipped with a lidar, then the lidar data of the mobile user device is obtained using a second mobile user device equipped with a lidar.

6. The method according to any of paragraphs 1-5, characterized in that an environment mask is formed using the obtained anchor marks.

Citation Information

Patent Citations

  • System and method for augmented and virtual reality

    RU2621633C2

  • Computerized system and method for an extended reality (XR) progressive visualization interface

    US11328491B2

  • XR system and method for controlling the same

    US11734744B2

  • Extended reality anchor caching based on viewport prediction

    US20220254113A1

  • Extended reality augmentation of images and displayed objects

    US20240137391A1