Method and device for managing augmented reality space, and medium

Abstract

The invention aims to provide a method and equipment for managing an augmented reality space and a medium, and the method comprises the steps: responding to a space creation operation executed by a user in an augmented reality space management platform, and creating a first augmented reality space; establishing an association relationship between the first augmented reality space and at least one anchor point; and in response to an access triggering operation executed by the user for a first anchor point in the at least one anchor point, entering an augmented reality content editing page corresponding to the first anchor point, and presenting the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, determining first augmented reality content associated with the first anchor point and first spatial position information corresponding to the first augmented reality content according to content editing operation executed by the user on the augmented reality content editing page for at least one augmented reality resource; and determining first augmented reality data corresponding to the first augmented reality space according to the augmented reality content corresponding to each anchor point in the first augmented reality space and the spatial position information corresponding to the augmented reality content, so that the first augmented reality data corresponding to the first augmented reality space is obtained after user equipment enters the first augmented reality space. Based on the first augmented reality data, augmented reality content corresponding to one or more target anchor points in the first augmented reality space is displayed on a real scene picture of the user equipment in an overlapping mode, and the at least one anchor point comprises the one or more target anchor points.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of communication, and in particular to a technology for managing an augmented reality space. BACKGROUND

[0002] In recent years, with the rapid development of science and technology, AR (Augmented Reality) technology is becoming mature and gradually entering people's field of vision. How to create an augmented reality space and how to edit augmented reality data to meet users' AR needs have become a topic of concern. SUMMARY

[0003] An object of the present application is to provide a method, device and medium for managing an augmented reality space.

[0004] According to an aspect of the present application, a method for managing an augmented reality space is provided, the method comprising:

[0005] creating a first augmented reality space in response to a space creation operation performed by a user in an augmented reality space management platform;

[0006] establishing an association relationship between the first augmented reality space and at least one anchor point;

[0007] in response to an access trigger operation performed by the user on a first anchor point in the at least one anchor point, entering an augmented reality content editing page corresponding to the first anchor point, presenting the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determining first augmented reality content associated with the first anchor point and first spatial location information corresponding to the first augmented reality content according to a content editing operation performed by the user on at least one augmented reality resource on the augmented reality content editing page;

[0008] determining first augmented reality data corresponding to the first augmented reality space according to augmented reality content corresponding to each anchor point in the first augmented reality space and spatial location information corresponding to the augmented reality content, so that a user device, after entering the first augmented reality space, presents augmented reality content corresponding to one or more target anchor points in the first augmented reality space on a real scene picture of the user device based on the first augmented reality data, wherein the at least one anchor point includes the one or more target anchor points.

[0009] According to an aspect of the present application, a computer device for managing an augmented reality space is provided, the device comprising:

[0010] a processor; and

[0011] a memory arranged to store computer-executable instructions that, when executed, cause the processor to perform the following operations:

[0012] in response to a space creation operation performed by a user in an augmented reality space management platform, creating a first augmented reality space;

[0013] establishing an association between the first augmented reality space and at least one anchor point;

[0014] in response to an access triggering operation performed by the user with respect to a first anchor point of the at least one anchor point, entering an augmented reality content editing page corresponding to the first anchor point, presenting the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determining first augmented reality content associated with the first anchor point and first spatial location information corresponding to the first augmented reality content according to a content editing operation performed by the user with respect to at least one augmented reality resource on the augmented reality content editing page;

[0015] determining first augmented reality data corresponding to the first augmented reality space according to augmented reality content corresponding to each anchor point in the first augmented reality space and spatial location information corresponding to the augmented reality content, such that, after entering the first augmented reality space, the user device presents augmented reality content corresponding to one or more target anchor points in the first augmented reality space on a live view of the user device based on the first augmented reality data, wherein the at least one anchor point includes the one or more target anchor points.

[0016] According to an aspect of the present application, a computer-readable medium storing instructions is provided, which, when executed, cause a system to perform the following operations:

[0017] in response to a space creation operation performed by a user in an augmented reality space management platform, creating a first augmented reality space;

[0018] establishing an association between the first augmented reality space and at least one anchor point;

[0019] in response to an access triggering operation performed by the user with respect to a first anchor point of the at least one anchor point, entering an augmented reality content editing page corresponding to the first anchor point, presenting the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determining first augmented reality content associated with the first anchor point and first spatial location information corresponding to the first augmented reality content according to a content editing operation performed by the user with respect to at least one augmented reality resource on the augmented reality content editing page;

[0020] According to the augmented reality content corresponding to each anchor point in the first augmented reality space and the spatial position information corresponding to the augmented reality content, first augmented reality data corresponding to the first augmented reality space is determined, so that after the user equipment enters the first augmented reality space, the augmented reality content corresponding to one or more target anchor points in the first augmented reality space is presented on the real scene picture of the user equipment based on the first augmented reality data, and the at least one anchor point includes the one or more target anchor points.

[0021] According to an aspect of the present application, a network device for managing an augmented reality space is provided, and the device comprises:

[0022] A first module is configured to create a first augmented reality space in response to a space creation operation performed by a user in an augmented reality space management platform;

[0023] A second module is configured to establish an association relationship between the first augmented reality space and at least one anchor point;

[0024] A third module is configured to enter an augmented reality content editing page corresponding to a first anchor point in the at least one anchor point in response to an access trigger operation performed by the user on the first anchor point, present the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determine first augmented reality content associated with the first anchor point and first spatial position information corresponding to the first augmented reality content according to a content editing operation performed by the user on the augmented reality content editing page on at least one augmented reality resource;

[0025] A fourth module is configured to determine first augmented reality data corresponding to the first augmented reality space according to the augmented reality content corresponding to each anchor point in the first augmented reality space and the spatial position information corresponding to the augmented reality content, so that after the user equipment enters the first augmented reality space, the augmented reality content corresponding to one or more target anchor points in the first augmented reality space is presented on the real scene picture of the user equipment based on the first augmented reality data, and the at least one anchor point includes the one or more target anchor points.

[0026] Compared with the prior art, the application creates a first augmented reality space in response to a space creation operation performed by a user in an augmented reality space management platform; establishes an association relationship between the first augmented reality space and at least one anchor point; enters an augmented reality content editing page corresponding to a first anchor point in the at least one anchor point in response to an access trigger operation performed by the user on the first anchor point, presents the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, determines first augmented reality content associated with the first anchor point and first space position information corresponding to the first augmented reality content according to a content editing operation performed by the user on at least one augmented reality resource on the augmented reality content editing page; determines first augmented reality data corresponding to the first augmented reality space according to augmented reality content corresponding to each anchor point in the first augmented reality space and space position information corresponding to the augmented reality content, so that a user device presents augmented reality content corresponding to one or more target anchor points in the first augmented reality space on a real scene picture of the user device based on the first augmented reality data after entering the first augmented reality space, wherein the at least one anchor point includes the one or more target anchor points, so that a backstage staff can create an augmented reality space on a network device, edit augmented reality content in the augmented reality space, thereby generating augmented reality data, so that a user can view corresponding augmented reality content on a real scene picture through an interaction mode of the augmented reality space on a user device, thereby meeting the AR needs of the user. BRIEF DESCRIPTION OF DRAWINGS

[0027] Other features, objects, and advantages of the application will become more apparent from the following detailed description of non-limiting embodiments made with reference to the drawings:

[0028] Figure 1 A flow chart of a method for managing an augmented reality space according to one embodiment of the application is shown;

[0029] Figure 2 A network device structure diagram for managing an augmented reality space according to one embodiment of the application is shown;

[0030] Figure 3 An exemplary system that can be used to implement various embodiments described herein is shown.

[0031] The same or similar reference numerals in the drawings represent the same or similar components. DETAILED DESCRIPTION

[0032] The application is described in further detail below with reference to the drawings.

[0033] In one typical configuration of the present application, the terminal, the device of the service network and the trusted party each include one or more processors (e.g., a Central Processing Unit (CPU)), input / output interfaces, network interfaces, and memory.

[0034] The memory can include non-persistent memory and / or volatile memory, such as a random access memory (RAM) that stores dynamic data or data tables, and / or non-volatile memory, such as flash memory or read-only memory (ROM) that stores static data or firmware for the computing device. The memory is an example of computer-readable media.

[0035] Computer-readable media includes permanent and non-permanent, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PCM), programmable random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device.

[0036] The device referred to in the present application includes but is not limited to a user device, a network device, or a device formed by integrating a user device and a network device through a network. The user device includes but is not limited to any kind of mobile electronic product capable of human-computer interaction (for example, human-computer interaction through a touch panel), such as a smart phone, a tablet computer, etc. The mobile electronic product can adopt any operating system, such as an Android operating system, an iOS operating system, etc. The network device includes an electronic device capable of automatically performing numerical calculation and information processing according to a pre-set or stored instruction. The hardware of the network device includes but is not limited to a microprocessor, an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), a digital signal processor (DSP), an embedded device, etc. The network device includes but is not limited to a computer, a network host, a single network server, a plurality of network servers, or a cloud formed by a plurality of servers. The cloud is formed by a large number of computers or network servers based on cloud computing. The cloud computing is a kind of distributed computing, which is a virtual supercomputer formed by a group of loosely coupled computer clusters. The network includes but is not limited to the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless Ad Hoc network, etc. Preferably, the device can also be a program running on the user device, the network device, or a device formed by integrating a user device and a network device, a network device, a touch terminal, or a device formed by integrating a network device and a touch terminal through a network.

[0037] Of course, those skilled in the art should understand that the above device is only an example, and other existing or future devices, such as devices that can be applicable to the present application, should also be included in the protection scope of the present application, and are hereby included by reference.

[0038] In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise explicitly and specifically limited.

[0039] Figure 1A flow chart of a method for managing an augmented reality space according to an embodiment of the present application is shown. The method includes step S11, step S12, step S13 and step S14. In step S11, the network device creates a first augmented reality space in response to a space creation operation performed by a user in an augmented reality space management platform; in step S12, the network device establishes an association relationship between the first augmented reality space and at least one anchor point; in step S13, the network device enters an augmented reality content editing page corresponding to the first anchor point in response to an access trigger operation performed by the user on a first anchor point among the at least one anchor point, presents the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determines the first augmented reality content associated with the first anchor point and the first spatial position information corresponding to the first augmented reality content based on the content editing operation performed by the user on at least one augmented reality resource on the augmented reality content editing page; in step S14, the network device determines the first augmented reality data corresponding to the first augmented reality space based on the augmented reality content corresponding to each anchor point in the first augmented reality space and the spatial position information corresponding to the augmented reality content, so that after the user device enters the first augmented reality space, based on the first augmented reality data, the augmented reality content corresponding to one or more target anchor points in the first augmented reality space is superimposed on the real scene screen of the user device, wherein the at least one anchor point includes the one or more target anchor points.

[0040] In step S11, the network device creates a first augmented reality space in response to a space creation operation performed by a user in an augmented reality space management platform. In some embodiments, an augmented reality space refers to a virtual space, each of which can include one or more augmented reality contents (i.e., AR contents or virtual scene contents), including but not limited to marker information, file information, form information, application invocation information, real-time sensing information, other custom types of information, and the like, for superimposed presentation on a real scene picture of a user device. In some embodiments, the augmented reality space management platform (such as a cloud platform, a background, etc.) includes a plurality of functions, including but not limited to one or more of resource management, augmented reality space management, anchor point management, and the like, wherein the resource management is used to manage augmented reality resources (the types of resources including but not limited to one or more of pictures, videos, 3D models, file information, form information, application invocation information, real-time sensing information, other custom types, and the like), such as creating, classifying, searching, naming, previewing, and / or deleting resources, and the like, the augmented reality resources are used to determine augmented reality contents in an augmented reality space, the augmented reality space management is used to manage augmented reality spaces and configure augmented reality contents in the augmented reality spaces, such as creating an augmented reality space, deleting an augmented reality space, and / or information editing (such as anchor point editing, augmented reality resource editing), and the like, and the anchor point management is used to manage anchor points, such as creating an anchor point, deleting an anchor point, and / or editing an anchor point attribute, and the like. In some embodiments, a user needs to open a permission before being able to use a corresponding function in the augmented reality space management platform, for example, the user needs to open an augmented reality space management permission before being able to use the function of the augmented reality space management, when the permission is not opened, the user will not be able to consult and manage (create, delete, information editing, etc.) an augmented reality space list, nor be able to enter a certain augmented reality space for browsing or editing, the user needs to open a resource management permission before being able to use the function of the resource management, when the permission is not opened, the user will be restricted in terms of resource consultation, editing (creation, classification, search, naming, preview, deletion), and use, the user needs to open an anchor point management permission before being able to use the function of the anchor point management, the anchor point is a reference basis for the location of the augmented reality content display in the space, when the permission is not opened, the user will not be able to manage the anchor point, nor be able to enter a certain augmented reality space for browsing or editing.In some embodiments, a user can create a new augmented reality space or edit an already created augmented reality space in the augmented reality space management platform, the augmented reality space can include one or more columns of space name and cover, anchor point, exclusive resource, etc., wherein in some embodiments, the cover can be added by the space creator on the management platform when creating the augmented reality space, for example, by uploading pictures or taking pictures, etc., in other embodiments, the cover is made by constructing the augmented reality space on site, using the photo when the space is successfully constructed as the space cover, at the same time, this cover will be used for camera position reference when the space is positioned, allowing subsequent modification, the anchor point is the reference basis of the position of all or part of the augmented reality content displayed in the space in the current augmented reality space, which is generally the point cloud recognized by the space, the recorded picture, the GIS coordinate position, etc., the anchor point can be added by the space creator on the management platform when creating the augmented reality space, for example, one or more anchor points in the anchor point management of the management platform are associated, or one or more augmented reality anchor points are created (such as uploaded or generated), one space supports one or more anchor points, the exclusive resource refers to the resource list / list of the current augmented reality space, the exclusive resource can be added by the space creator on the management platform when creating the augmented reality space, for example, one or more resources in the resource management of the management platform are associated, or one or more resources are created (such as uploaded or generated), in some cases, if there is no resource list / list configured, the current space can use all the created augmented reality resources in the resource management of the management platform. Wherein, the space name and cover, anchor point, resource, etc. One or more columns in the augmented reality space can be determined by the space creator when creating the space, or can be determined or modified by other personnel after the creation is completed, which is not limited here.

[0041] In step S12, the network device establishes an association between the first augmented reality space and at least one anchor point. In some embodiments, a user can create at least one anchor point in the configuration page of the first augmented reality space, for example, upload or generate at least one anchor point, so that the first augmented reality space is associated with the at least one anchor point, or can also select at least one anchor point from one or more anchor points created in the configuration page, for example, select at least one anchor point from one or more anchor points in the anchor point management of the management platform, so that the first augmented reality space is associated with the at least one anchor point. In some embodiments, the user can also select the first augmented reality space in one or more augmented reality spaces created in the configuration page of a certain anchor point, for example, select the first augmented reality space in the configuration page (such as the editing page or the anchor point attribute page) of a certain anchor point in the anchor point management of the management platform, so that the first augmented reality space is associated with the at least one anchor point.

[0042] In step S13, the network device enters an augmented reality content editing page corresponding to a first anchor point in the at least one anchor point in response to an access triggering operation performed by the user on the first anchor point, presents the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determines first augmented reality content associated with the first anchor point and first spatial position information corresponding to the first augmented reality content according to a content editing operation performed by the user on at least one augmented reality resource on the augmented reality content editing page. The first augmented reality content is used to represent the first anchor point associated augmented reality content of the first augmented reality space, which can be one augmented reality content or multiple augmented reality contents without limitation. In some embodiments, the user can select an anchor point (the first anchor point) in the at least one anchor point for editing of the augmented reality content (for example, click an editing button corresponding to the anchor point, etc.), at which time the augmented reality content editing page (for example, an editor page) corresponding to the anchor point is entered. Alternatively, the user can directly edit the augmented reality content for the first augmented reality space (for example, click an editing button corresponding to the space, etc.), at which time the augmented reality content editing page (for example, an editor page) corresponding to the first anchor point in the at least one anchor point is entered. The first anchor point can be an anchor point randomly determined in the at least one anchor point, or can also be an anchor point ranked first in a certain specific ordering manner in the at least one anchor point. In some embodiments, the first anchor point (for example, a sparse point cloud, a picture, etc.) or the three-dimensional model (for example, a dense point cloud, a three-dimensional reconstruction model, etc.) corresponding to the first anchor point is presented on the augmented reality content editing page. In particular, if the first anchor point is a null anchor point, the null anchor point has no content, and the null anchor point is presented on the augmented reality content editing page. It can be understood that the actual content is not presented on the augmented reality content editing page. In some embodiments, after the user enters the augmented reality content editing page corresponding to the first anchor point, one or more determined augmented reality contents corresponding to the first anchor point in the first augmented reality space are displayed on the page, and the augmented reality contents corresponding to other anchor points in the first augmented reality space are not displayed.In some embodiments, on the page, the user can directly use all the created augmented reality resources in the augmented reality space management platform (e.g., the augmented reality resources in the resource management of the management platform), or can only use the augmented reality resources added to the first augmented reality space before, or further needs to select some of the created augmented reality resources in the management platform as the augmented reality resources available to the space, or adds the augmented reality resources on the page, e.g., the user uploads the augmented reality resources in the augmented reality content editing page, and the augmented reality content editing page displays the identification information (e.g., resource name information, resource icon information, resource content information, and / or resource type information, etc.) of the augmented reality resources available to the space. In some embodiments, there is a virtual scene coordinate system on the augmented reality content editing page, and the user can add (e.g., drag, etc.) a certain available augmented reality resource to a certain position in the virtual scene coordinate system, thereby determining the added augmented reality resource as a first augmented reality content corresponding to a first anchor in the first augmented reality space. In some embodiments, after the user adds a certain available augmented reality resource to a certain position in the virtual scene coordinate system, a control component appears on the augmented reality resource (e.g., by selecting the resource to appear a control component, or automatically appearing a control component, etc.), and the user can control the position, rotation angle, and size of the augmented reality resource through the control component, or after the user adds a certain available augmented reality resource to a certain position in the virtual scene coordinate system, the augmented reality content editing page presents the attribute parameters (e.g., the attributes of each augmented reality resource are presented after selecting the resource, or automatically presented) of the augmented reality resource in the virtual scene coordinate system, such as the position information, rotation angle information, and size information, and the user can edit these information, thereby determining the edited augmented reality resource as a first augmented reality content corresponding to a first anchor, and directly using the position information of the augmented reality content in the virtual scene coordinate system as the spatial position information of the augmented reality content, or further using the relative position information of the augmented reality content relative to the first anchor as the spatial position information of the augmented reality content, etc. In some embodiments, the page displays the identification information (e.g., resource name, resource icon information, resource content information, and / or resource type information, etc.) of all the determined augmented reality contents corresponding to the first anchor in the first augmented reality space, and the user can quickly select to rename or delete, or further edit a certain augmented reality content (e.g., adjust the position information, rotation angle information, size information, etc.).In some embodiments, the augmented reality resource can also be associated with a target object (such as an industrial device, etc.), so that the relevant data of the target object is taken as the content of the augmented reality resource, for example, real-time data of the target object is obtained from a device management system, a third-party information system, and / or a big data center server, etc., and the real-time data is taken as the content of the augmented reality resource, for example, is associated in the resource management of the management platform, or is associated in the augmented reality content editing page, so that the augmented reality content is the relevant data of the target object and is superimposed and displayed in the real scene picture.

[0043] In step S14, the network device determines the first augmented reality data corresponding to the first augmented reality space according to the augmented reality content corresponding to each anchor point in the first augmented reality space and the spatial position information corresponding to the augmented reality content, so that the user device, after entering the first augmented reality space, superimposes and presents the augmented reality content corresponding to one or more target anchor points in the first augmented reality space on the real scene picture of the user device based on the first augmented reality data, wherein the at least one anchor point includes the one or more target anchor points. In some embodiments, the first augmented reality data corresponding to the first augmented reality space can be determined according to the augmented reality content corresponding to each anchor point in the first augmented reality space and the spatial position information corresponding to the augmented reality content, or the first augmented reality data further includes parameter information of each anchor point in the first augmented reality space, which includes but is not limited to at least one of the following: anchor point identification, anchor point name, anchor point type, resource address of the anchor point, position of the anchor point in the virtual scene coordinate system, rotation angle information of the augmented reality content, size information, etc. In some embodiments, the network device provides the first augmented reality data to the corresponding user device, for example, the network device sends the first augmented reality data to the user device after the user device is connected to the network or the corresponding application is started, for another example, the network device sends the first augmented reality data in response to the request of the user device, in some embodiments, the user device can trigger the download of the first augmented reality data corresponding to the first augmented reality space in a manual manner, for example, the user clicks the first augmented reality space data download button in the user interface, and then the first augmented reality data corresponding to the first augmented reality space is downloaded. In some embodiments, the user can trigger the download of the first augmented reality data corresponding to the first augmented reality space in an automatic manner, for example, when the user enters the first augmented reality space (for example, the user manually selects to enter the first augmented reality space, for another example, the user carries the user device into the physical space of the first augmented reality space (for example, the user device matches the Bluetooth, GPS, wifi of the physical space of the first augmented reality space through Bluetooth, GPS, wifi, or the user device recognizes the anchor point associated with the first augmented reality space, etc.), and then the user enters the first augmented reality space in a manual or automatic manner, etc.), the first augmented reality data corresponding to the first augmented reality space is downloaded. The user device includes but is not limited to mobile phones, iPads / Pads, AR smart wearable devices (such as AR glasses), etc.In some embodiments, the way of entering the first augmented reality space includes but is not limited to that the user manually selects to enter the first augmented reality space on the user device in one or more augmented reality spaces, detecting the current real-time position of the user device in the real scene, if the current real-time position is located in the physical space corresponding to the first augmented reality space, then manually or automatically entering the first augmented reality space, wherein if the physical space is associated with the first augmented reality space and other augmented reality spaces, then manually selecting to enter the first augmented reality space or automatically entering the augmented reality space with the highest priority (such as previously sorting the augmented reality spaces based on a predetermined strategy, wherein the predetermined strategy can be sorting according to access time, sorting according to task relevance, sorting according to priority, etc., which are only examples and are not limited herein) and the like, wherein the current real-time position of the user device can be determined according to GPS, Bluetooth, WiFi and other positioning, or the current real-time position of the user device can also be determined by anchor point recognition of the real-time camera picture of the user device through positioning algorithms (such as SLAM - Simultaneous Localization and Mapping, VIO - Visual Odometry, VPS - Visual Positioning System, 2D recognition, etc.), and then determining whether the user is located in the physical space corresponding to the first augmented reality space according to the current real-time position. In some embodiments, after the user device enters the first augmented reality space, the live environment can be collected (for example, by the camera of the user device to take live pictures), and the real-time pose information of the user in the real scene can be obtained based on the real-time camera picture taken by the camera of the user device, through the positioning technology of SLAM, VIO, VPS, 2D recognition and the anchor point information corresponding to the first augmented reality space, wherein the positioning technology can be recognized locally or through the cloud, for example, the user device sends the real-time camera picture to the network device, the network device performs feature extraction and pose estimation, and then sends the estimated result information to the user device. In some embodiments, the foregoing positioning algorithms can be used alone or in combination, which are not limited herein, and based on the first augmented reality data, the presentation position of the augmented reality content corresponding to at least one anchor point of one or more anchor points corresponding to the first augmented reality space in the real scene picture of the user device is calculated (for example, according to the position of a certain augmented reality content in the virtual coordinate system and the current real-time pose of the user device, the presentation position of the augmented reality content in the real scene picture is calculated, or according to the relative position of a certain augmented reality content relative to the anchor point corresponding thereto and the current real-time pose of the user device, the presentation position of the augmented reality content in the real scene picture is calculated, etc.), and the augmented reality content is presented on the real scene picture of the user device according to the presentation position.The augmented reality content can be presented on the real scene picture. The display device of the user equipment can display the real scene picture captured by the camera of the user equipment, and the augmented reality content can be presented on the real scene picture displayed by the display device (corresponding to the video perspective mode). Alternatively, the display device of the user equipment does not display the real scene picture captured by the camera of the user equipment, and the display device only presents the augmented reality content. The user of the user equipment can see the real scene picture through the display device, so that the augmented reality content is presented on the real scene picture (corresponding to the optical perspective mode). In some embodiments, after entering the first augmented reality space, the display device automatically triggers the display of the augmented reality content corresponding to each anchor point in the first augmented reality space, or the anchor point needs to be identified according to the collected scene environment, and only the augmented reality content corresponding to the identified anchor point in the first augmented reality space is displayed, and the augmented reality content corresponding to other anchor points in the first augmented reality space is not displayed. In some embodiments, for the anchor point of the null anchor point type, the corresponding augmented reality content is automatically displayed without identification.

[0044] In some embodiments, the method further comprises: the network device creating one or more anchor points in response to an anchor point creation operation performed by the user in the augmented reality space management platform; wherein the one or more anchor points comprise at least one of the following: a null anchor point; a point cloud; a picture; a geographic coordinate position. In some embodiments, the anchor point creation operation can be that the user uploads an already created anchor point in the augmented reality space management platform, for example, the user uploads a locally generated or downloaded anchor point in the anchor point management of the management platform, or the user generates a corresponding anchor point according to the picture or video resource uploaded by the user in the augmented reality space management platform. In some embodiments, the anchor points in the anchor point management are unique. In some embodiments, the same anchor point can be associated with multiple augmented reality spaces, and one augmented reality space can be associated with multiple anchor points. In some embodiments, the anchor point type includes but is not limited to a null anchor point (without identification of the anchor point), a point cloud, a picture, a geographic coordinate position (a GIS coordinate position), etc. In some embodiments, for a certain anchor point associated in the augmented reality space, the user can edit the offset parameters (including translation, rotation, and scale) of the anchor point to realize the overall offset of the anchor point and the augmented reality content corresponding to the anchor point.

[0045] In some embodiments, the method further includes: in response to a model uploading operation performed by the user on a second anchor point of the one or more anchor points in the augmented reality space management platform, the network device sets the model uploaded by the user as a three-dimensional model corresponding to the second anchor point. In some embodiments, if an anchor point is a point cloud type, the user can upload a three-dimensional model (e.g., a dense point cloud, a three-dimensional reconstruction model, etc.) corresponding to the anchor point in the augmented reality space management platform, so that the user can directly view the three-dimensional model on the anchor point corresponding to the augmented reality content editing page after entering the page, and edit the augmented reality resources based on the three-dimensional model, thereby determining the augmented reality content corresponding to the anchor point.

[0046] In some embodiments, the method further includes: in response to a screening setting operation performed by the user on a third anchor point of the one or more anchor points in the augmented reality space management platform, the network device sets identification screening information corresponding to the third anchor point, which is used for the user device to screen at least one anchor point to be identified from a plurality of anchor points. In some embodiments, for an associated anchor point in the augmented reality space, the user can edit the identification screening information of the anchor point. After entering a certain reality scene, the user can first screen the anchor points in the augmented reality space according to the identification information obtained by the user device in the reality scene (e.g., obtained from the device located in the reality scene through Bluetooth or WiFi, etc.), that is, match the identification information with the identification screening information of the anchor points, to obtain at least one anchor point matched with the identification information, and only perform anchor point identification on the at least one anchor point, without the need to perform anchor point identification on other anchor points corresponding to the augmented reality space, thereby improving the positioning speed and accuracy in the case of multiple anchor points.

[0047] In some embodiments, the identification screening information includes at least one of the following: GPS screening information; Bluetooth screening information; WiFi screening information; time period screening information. In some embodiments, the GPS screening information corresponds to GPS location information. The GPS location information of the user equipment is obtained and matched with the GPS screening information (such as a certain geographic location or area, etc.) corresponding to the anchor point. When the GPS location information of the user equipment is located within a certain geographic area, the anchor point corresponding to the certain geographic area is screened out for anchor point identification. The identification information corresponding to the Bluetooth screening information can be information obtained from a Bluetooth beacon device located in a real scene through Bluetooth. The Bluetooth of the user equipment is matched with the Bluetooth screening information (such as a certain Bluetooth beacon) corresponding to the anchor point. When the Bluetooth of the user equipment is connected with the certain Bluetooth beacon, the anchor point corresponding to the certain Bluetooth beacon is screened out for anchor point identification. The identification information corresponding to the WiFi screening information can be information obtained from a WiFi beacon device located in a real scene through WiFi. The wireless network of the user equipment is matched with the WiFi screening information (such as a certain wireless network beacon) corresponding to the anchor point. When the wireless network of the user equipment is connected with the certain wireless network beacon, the anchor point corresponding to the certain wireless network beacon is screened out for anchor point identification. In some embodiments, the identification screening information can also be a time period. The current time of the user equipment is obtained and matched with the time period screening information (such as a certain time point or time period, etc.) corresponding to the anchor point. When the current time of the user equipment is located within a certain time period, the anchor point corresponding to the certain time period is screened out for anchor point identification.

[0048] In some embodiments, the step S12 includes: in response to an anchor point configuration operation performed by the user on the first augmented reality space in the augmented reality space management platform, the network device acquires at least one anchor point selected by the user from the one or more anchor points, and establishes an association relationship between the first augmented reality space and the at least one anchor point. In some embodiments, the user can select at least one anchor point from the created one or more anchor points as an anchor point associated with the first augmented reality space for the first augmented reality space.

[0049] In some embodiments, the step S12 includes: in response to a space association operation performed by the user on at least one anchor point from the one or more anchor points for the first augmented reality space in the augmented reality space management platform, the network device establishes an association relationship between the first augmented reality space and the at least one anchor point. In some embodiments, the user can select a first augmented reality space from the created multiple augmented reality spaces as a space associated with a certain anchor point from the created one or more anchor points.

[0050] In some embodiments, the method further comprises: the network device creating one or more augmented reality resources in response to a resource creation operation performed by the user in the augmented reality space management platform; wherein the one or more augmented reality resources comprise at least one of the following: marker information; file information; form information; application invocation information; real-time sensing information; and other custom types of information. In some embodiments, the resource creation operation can be that the user uploads an already created augmented reality resource in the augmented reality space management platform, for example, the user uploads a locally generated or downloaded augmented reality resource in the resource management of the management platform, or the user generates a corresponding augmented reality resource according to the relevant information uploaded by the user in the augmented reality space management platform. In some embodiments, the marker information can include arrow, freehand, circle, geometric shape, and other identification information, or the marker information can also include corresponding multimedia file information, such as pictures, videos, 3D models, PDF files, office documents, and various types of files. In some embodiments, the augmented reality resource can be form information, the augmented reality resource can also be application invocation information, which is used to execute relevant instructions of the application, such as opening the application, invoking specific functions of the application (such as making a call, opening a link), or the augmented reality resource can also be real-time sensing information, which is used to connect a sensing device (such as a sensor) and obtain sensing data of a target object (such as an industrial equipment), or the augmented reality resource can also be custom type information. Those skilled in the art should understand that the foregoing resource types are only examples and are not limited.

[0051] In some embodiments, the method further comprises: the network device obtaining at least one augmented reality resource corresponding to the first augmented reality space selected by the user from the one or more augmented reality resources in response to a resource configuration operation performed by the user in the augmented reality space management platform for the first augmented reality space. In some embodiments, the user can select at least one augmented reality resource from the created one or more augmented reality resources as the augmented reality resource dedicated to the first augmented reality space, and in some embodiments, the user can only use the augmented reality resource dedicated to the space to determine the corresponding augmented reality content on the augmented reality content editing page corresponding to the first anchor point, and cannot use other augmented reality resources to determine the corresponding augmented reality content, and in other embodiments, the user can also add augmented reality resources to determine the corresponding augmented reality content on the augmented reality content editing page corresponding to the first anchor point.

[0052] In some embodiments, the method further includes: in response to the user performing a follow attribute editing operation on the first augmented reality content on the augmented reality content editing page, the network device sets a follow screen attribute of the first augmented reality content. In some embodiments, the user can perform a follow attribute editing operation on the first augmented reality content corresponding to the first anchor point that has been added to the first augmented reality space on the augmented reality content editing page, and set the follow screen attribute of the first augmented reality content, which includes follow and not follow. If set to follow, the fixed display position of the first augmented reality content on the display screen of the user device (for example, top left, bottom left, top right, bottom right, center, etc.) also needs to be set. Subsequently, the user device will present the first augmented reality content at the fixed display position on the display screen of the user device, that is, the presentation position of the first augmented reality content is fixed and does not change with the real-time pose of the user device at the time. If set to not follow, the presentation position of the first augmented reality content is not fixed and changes with the real-time pose of the user device at the time. The number of first augmented reality contents can be one or more. When the number of first augmented reality contents is more than one, only part of the first augmented reality contents can be set to have the follow screen attribute, or all of the first augmented reality contents can be set to have the follow screen attribute, which is not limited herein.

[0053] In some embodiments, the method further includes: in response to the user performing an interaction configuration operation on the first augmented reality content on the augmented reality content editing page, the network device sets an interaction event corresponding to the first augmented reality content, so that after the user device enters the first augmented reality space, if it is detected that the first augmented reality content triggers the interaction event, the third augmented reality content is hidden or displayed on the real scene picture. The number of the first augmented reality content can be one or more, and only part of the first augmented reality content corresponding to the interaction event can be set, such as selecting one of the first augmented reality content to set the corresponding interaction event, or all the first augmented reality content corresponding to the interaction event can be set, such as setting the corresponding interaction event for each first augmented reality content, which is not limited herein. In some embodiments, the user can set the interaction event corresponding to the first augmented reality content added to the first augmented reality space and the corresponding event response, which includes but is not limited to single click, double click, long press, etc., so that after the user device enters the first augmented reality space, if it is detected that the interaction event corresponding to the first augmented reality content is triggered (for example, it is detected that the user clicks the first augmented reality content), the event response corresponding to the interaction event is executed, which includes hiding or displaying the third augmented reality content on the real scene picture, wherein the third augmented reality content can be the same object as the first augmented reality content, or it can also be one or more specified augmented reality contents in the first augmented reality space except the first augmented reality content.

[0054] In some embodiments, the method further includes: in response to the user performing a script configuration operation on the augmented reality content editing page, the network device sets a script file corresponding to the first augmented reality space, so that after the user device enters the first augmented reality space, the script file is executed, wherein the script file is used to control the augmented reality content in the first augmented reality space. In some embodiments, the user can enrich the interaction events in the space by adding a script file in the first augmented reality space, and the script file is saved and applied in the current space. The script file is a global control for all augmented reality contents in the first augmented reality space, and is applicable to all anchors in the first augmented reality space. The script file includes but is not limited to display logic of the augmented reality content in the first augmented reality space (for example, displaying one or more augmented reality contents at a specific time, hiding one or more augmented reality contents at a specific time, etc.), operation logic (for example, performing what interaction event and its corresponding event response on a certain augmented reality content, performing an interaction event at a specific time, etc.), etc.

[0055] In some embodiments, the method further comprises: the network device setting the content initialization mode corresponding to the first augmented reality content in response to the content initialization mode setting operation performed by the user on the first anchor point; wherein the content initialization mode comprises any one of the following: anchor point based placement, live scene based placement, and screen based placement. In some embodiments, the user can set the content initialization mode of all the first augmented reality content corresponding to the first anchor point, for example, by setting the content initialization mode of the first augmented reality content in the configuration page (such as an editing page or an anchor point attribute page) of the first anchor point in the anchor point management of the management platform, by setting the content initialization mode after associating the first anchor point on the interface for creating the first augmented reality space by the space creator of the management platform, by setting the content initialization mode on the first augmented reality space interface of the management platform after the first augmented reality space is created and associated with the first anchor point, and the like. The content initialization mode determines the initial display pose of the augmented reality content on the real scene picture. When the user device needs to present the augmented reality content corresponding to the first anchor point, the user device determines the corresponding initial display pose according to the content initialization mode of the augmented reality content and presents the augmented reality content on the real scene picture of the user device. The content initialization mode includes but is not limited to anchor point based placement, live scene based placement, and screen based placement. Anchor point based placement refers to that the user device recognizes the anchor point and displays the augmented reality content corresponding to the anchor point according to the position of the anchor point in the real scene picture. The user can configure the relative relationship (position, size, rotation, and the like) between the anchor point and the augmented reality content on the augmented reality content editing page corresponding to the anchor point. Live scene based placement refers to that the augmented reality content is anchored in the live environment (i.e., a real scene). Screen based placement refers to that the augmented reality content is fixed on the display screen of the user device (without tracking effect).

[0056] In some embodiments, the content initialization method includes anchor point placement; wherein, the method further includes: the network device sets the following method corresponding to the first augmented reality content in response to the user's virtual scene following method setting operation performed on the first anchor point; wherein, the following method includes any of the following: following the anchor point; following the space. In some embodiments, if the user sets the content initialization method of the first augmented reality content corresponding to the first anchor point to anchor point placement, the user can further set the tracking method corresponding to the first augmented reality content, and the tracking method includes but is not limited to the following anchor point method, the following space method, etc. For example, the content tracking method of the first augmented reality content is set in the configuration page (such as the edit page or the anchor point property page) of the first anchor point in the anchor point management of the management platform. For example, the content tracking method is set after the first anchor point is associated on the interface of the first augmented reality space created by the space creator of the management platform. For example, after the first augmented reality space is created and associated with the first anchor point, the content tracking method is set on the first augmented reality space interface of the management platform, etc. The following anchor point method means that the augmented reality content always follows the corresponding anchor point for display, and the anchor point must remain in the position set by the user. The augmented reality content will be displayed only when the anchor point is in the real scene screen of the device. Otherwise, if the anchor point is not in the real scene screen, the augmented reality content will not be displayed. For example, when the anchor point is a 2D picture, the 2D recognition algorithm is used for positioning, and the augmented reality content follows the 2D picture for display. For example, the augmented reality content is displayed around the 2D picture. At this time, the 2D picture needs to appear in the camera screen. When the 2D picture does not appear in the camera screen, the augmented reality content is not displayed; the following space method means that the augmented reality content is always displayed in the real scene screen. Even if the anchor point moves away from the real scene screen briefly and relatively stably, the augmented reality content continues to be displayed. For example, 2D recognition and SLAM algorithms are used for positioning. When the 2D picture does not appear in the camera screen, the augmented reality content is still displayed in the real scene screen. This is suitable for when the user moves in the scene or the augmented reality content exceeds (is larger than) the 2D picture.

[0057] In some embodiments, the content initialization manner comprises on-site placement; wherein the method further comprises: the network device setting the generation manner corresponding to the first augmented reality content in response to the user performing a virtual scene generation manner setting operation on the first anchor point; wherein the generation manner comprises any one of the following: preset perspective automatic generation; on-site manual generation. In some embodiments, if the user sets the content initialization manner of the first augmented reality content corresponding to the first anchor point as on-site placement, the user can further set the generation manner corresponding to the first augmented reality content, which is used to represent the specific position of the augmented reality content in the on-site environment (i.e. the real scene). The generation manner includes but is not limited to: preset perspective automatic generation, on-site manual generation, etc. The preset perspective automatic generation means that after the user obtains the real scene picture (for example, the user device captures the picture of the real scene through the camera, etc.), the augmented reality content is automatically positioned in the real scene (real scene picture) according to the preset perspective (for example, the augmented reality content is superimposed and displayed in the picture captured by the camera on the display screen, or superimposed and displayed on the display screen of the user device, so that the augmented reality content is superimposed and displayed in the real scene through the display screen), and the tracking effect is realized. The on-site manual generation means that after the user obtains the real scene picture and scans the real scene (such as the desktop, the ground, etc.), the user manually selects (such as clicks, etc.) the position in the screen, displays the augmented reality content at the position, and realizes the tracking effect.

[0058] In some embodiments, the generation manner comprises preset perspective automatic generation; wherein the method further comprises: the network device determining the transformation relationship between the virtual scene coordinate system and the real scene coordinate system in response to the user performing an editing operation on the virtual scene coordinate system on the augmented reality content editing page, so that the user device determines the display pose of the first augmented reality content in the real scene picture according to the pose of the first augmented reality content in the virtual scene coordinate system and the transformation relationship. In some embodiments, if the generation manner corresponding to the first augmented reality content corresponding to the first anchor point is preset perspective automatic generation, the user can perform an editing operation on the virtual scene coordinate system on the augmented reality content editing page. The editing operation includes but is not limited to controlling the display position and angle of the virtual scene coordinate system in the editor. According to the display position and angle, the position and angle of the virtual scene coordinate system relative to the real scene coordinate system (i.e. the transformation relationship between the virtual scene coordinate system and the real scene coordinate system) can be determined. So that when the user device needs to present the first augmented reality content, it can determine the display pose of the first augmented reality content in the real scene picture according to the pose of the first augmented reality content in the virtual scene coordinate system and the transformation relationship, and superimpose and present the first augmented reality content on the real scene picture according to the display pose.

[0059] In some embodiments, the method further includes: presenting, by the network device, first identification information of the at least one anchor point and second identification information of the augmented reality content corresponding to each anchor point on the augmented reality content editing page. In some embodiments, the identification information (e.g., anchor point name, etc.) of all anchor points in the first augmented reality space and the identification information (e.g., resource name of the augmented reality resource, etc.) of the augmented reality content corresponding to each anchor point in the first augmented reality space can be directly presented on the augmented reality content editing page corresponding to the first anchor point. In some embodiments, these information can not be directly presented on the augmented reality content editing page corresponding to the first anchor point, but in response to a specific operation performed by the user, the identification information of all anchor points in the first augmented reality space is presented, and then in response to an expansion trigger operation performed by the user on one of the anchor points, the identification information of the augmented reality content corresponding to the anchor point in the first augmented reality space is presented.

[0060] In some embodiments, the method further includes: in response to the user performing an access trigger operation on another anchor point in the at least one anchor point other than the first anchor point on the augmented reality content editing page, the network device cancels the presentation of the first anchor point or the three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, cancels the presentation of the augmented reality content corresponding to the first anchor point, presents the other anchor point or the three-dimensional model corresponding to the other anchor point, and presents the augmented reality content associated with the other anchor point. In some embodiments, the user can perform an access trigger operation on another anchor point associated with the first augmented reality space other than the first anchor point on the augmented reality content editing page corresponding to the first anchor point, and the augmented reality content corresponding to the first anchor point is canceled on the page and is changed to present the other anchor point or the three-dimensional model corresponding to the other anchor point, and the augmented reality content corresponding to the other anchor point is presented.

[0061] In some embodiments, the method further comprises: in response to a call operation or a call answering operation performed by the user on the second user device in the augmented reality space management platform, establishing a video call connection between the network device and the second user device, and presenting a second real scene picture corresponding to the second user device; in response to the user entering a second augmented reality space corresponding to the second user device, based on second augmented reality data corresponding to the second augmented reality space, presenting target augmented reality content in the second augmented reality space on the second real scene picture. In some embodiments, the user can view a list of currently callable personnel in the address book in the augmented reality space management platform, and can call a specified person (e.g., a second user) in the list, or the augmented reality space management platform can also display the call state of other users (e.g., the second user), and the user can choose to answer or reject. In some embodiments, in response to the call operation or the call answering operation performed by the user on the second user device, a video call connection between the network device and the second user device is established, and a second real scene picture taken by a camera of the second user device is presented in the augmented reality space management platform. The user can enter a second augmented reality space corresponding to a real scene where the second user device is located (e.g., by anchor point recognition on the second camera picture to enter the second augmented reality space, or by manually selecting to enter the second augmented reality space, or by entering the second augmented reality space after the second user agrees, etc.), and based on second augmented reality data corresponding to the second augmented reality space, a presentation position of augmented reality content in the second augmented reality space in the second real scene picture is determined, and the augmented reality content in the second augmented reality space is presented on the second real scene picture according to the presentation position. The augmented reality content in the second augmented reality space presented by superimposition refers to the augmented reality content corresponding to the anchor point recognized in the second augmented reality space. For example, the second augmented reality space corresponds to multiple anchor points, when an A anchor point is recognized, a presentation position of the augmented reality content corresponding to the A anchor point in the second real scene picture is determined, and the augmented reality content is presented on the second real scene picture according to the presentation position. When a B anchor point is recognized during the movement of the user device, a presentation position of the augmented reality content corresponding to the B anchor point in the second real scene picture is determined, and the augmented reality content is presented on the second real scene picture according to the presentation position.In some embodiments, the user can call multiple other users simultaneously, or also receive calls from multiple users simultaneously, or also receive a call from at least one other user while calling at least one other user, i.e., the user equipment can simultaneously establish a video call connection with multiple second user equipments, at this time multiple second real scene pictures respectively taken by the cameras of the second user equipments are presented on the user equipment, and the user can select one of the multiple second real scene pictures to enter the second augmented reality space corresponding to the real scene where the selected second real scene picture is located.

[0062] In some embodiments, the step of superimposing and presenting the target augmented reality content in the second augmented reality space on the second real scene picture based on the second augmented reality data corresponding to the second augmented reality space in response to the user entering the second augmented reality space corresponding to the second user equipment comprises: determining whether the second user equipment has entered the second augmented reality space in response to the user entering the second augmented reality space corresponding to the second user equipment; if yes, superimposing and presenting the target augmented reality content in the second augmented reality space on the second real scene picture based on the second augmented reality data corresponding to the second augmented reality space; otherwise, sending a space entry request about the second augmented reality space to the second user equipment, and if a confirmation response corresponding to the space entry request returned by the second user equipment is received, superimposing and presenting the target augmented reality content in the second augmented reality space on the second real scene picture based on the second augmented reality data corresponding to the second augmented reality space. In some embodiments, if the user selects to enter the second augmented reality space corresponding to the real scene where the second user equipment is located, it is determined whether the second user equipment has currently entered the second augmented reality space, if yes, the user equipment can directly enter the second augmented reality space, and if not, the user equipment sends a request to the second user equipment to enter the second augmented reality space, the second user enters the second augmented reality space based on the request, and returns a confirmation response to the user equipment, so that the user equipment enters the second augmented reality space.

[0063] In some embodiments, the method further comprises: in response to a content editing operation performed by the user in the second augmented reality space, the network device updates the target augmented reality content, and / or updates the second spatial position information corresponding to the target augmented reality content; and according to the updated second augmented reality content and / or the updated second spatial position information, the network device updates the second augmented reality data corresponding to the second augmented reality space. In some embodiments, the second augmented reality space supports an editing mode and a browsing mode. In the editing mode, the user can edit the augmented reality content (including adding, deleting, editing (e.g., filling in a form), interactive events, following attribute editing, position adjustment, angle adjustment, size adjustment, etc.), the user device updates the augmented reality content in the second augmented reality space according to the editing operation, and / or updates the second spatial position information corresponding to the augmented reality content. The second spatial position information can be the position information of the augmented reality content in the virtual scene coordinate system, or can also be the relative position information of the augmented reality content relative to the corresponding anchor point in the second augmented reality space, etc. Then, according to the updated second augmented reality content and / or the updated second spatial position information, the network device updates the second augmented reality data corresponding to the second augmented reality space, and synchronizes the updated second augmented reality data to the second user device, so that the second user device updates the augmented reality content superimposed and presented on the real scene picture of the second user device according to the updated second augmented reality data. In the browsing mode, the user can browse the augmented reality content, such as playing a video, or viewing a document or a model.

[0064] In some embodiments, during a video call between the network device and one or more second user devices, the user can perform various types of collaboration with one or more second users. The user can directly initiate a whiteboard, and each user can perform annotation and drawing collaboration on the whiteboard. The annotation can switch colors and sizes, and the current annotation content can be saved. Each user can initiate spatial annotation or freeze screen (the freeze screen is similar to the whiteboard, and the current screenshot of the video picture can be used as the background picture of the whiteboard) for interaction for a certain video picture. In the spatial annotation function, the color and size of the laser pointer can be adjusted.

[0065] Figure 2A network device structure diagram for managing an augmented reality space is shown according to one embodiment of the present application, which includes a first module 11, a second module 12, a third module 13 and a fourth module 14. The first module 11 is configured to create a first augmented reality space in response to a space creation operation performed by a user in an augmented reality space management platform; the second module 12 is configured to establish an association between the first augmented reality space and at least one anchor point; the third module 13 is configured to enter an augmented reality content editing page corresponding to a first anchor point of the at least one anchor point in response to an access trigger operation performed by the user on the first anchor point, present the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determine first augmented reality content associated with the first anchor point and first spatial location information corresponding to the first augmented reality content according to a content editing operation performed by the user on the augmented reality content editing page for at least one augmented reality resource; and the fourth module 14 is configured to determine first augmented reality data corresponding to the first augmented reality space according to augmented reality content corresponding to each anchor point in the first augmented reality space and spatial location information corresponding to the augmented reality content, so that a user device superimposes and presents augmented reality content corresponding to one or more target anchor points in the first augmented reality space on a real scene of the user device based on the first augmented reality data after entering the first augmented reality space, wherein the at least one anchor point includes the one or more target anchor points.

[0066] The first module 11 is configured to create a first augmented reality space in response to a space creation operation performed by a user in an augmented reality space management platform. In some embodiments, an augmented reality space refers to a virtual space, each of which can include one or more augmented reality contents (i.e., AR contents or virtual scene contents), which include but are not limited to marker information, file information, form information, application invocation information, real-time sensing information, other custom types of information, and the like, for superimposed presentation on a real scene picture of a user device. In some embodiments, the augmented reality space management platform (e.g., a cloud platform, a background, etc.) includes a plurality of functions, including but not limited to one or more of resource management, augmented reality space management, anchor point management, and the like, wherein the resource management is configured to manage augmented reality resources (the types of resources include but are not limited to one or more of pictures, videos, 3D models, file information, form information, application invocation information, real-time sensing information, other custom types, and the like), such as creating, classifying, searching, naming, previewing, and / or deleting resources, and the like, the augmented reality resources are used to determine augmented reality contents in an augmented reality space, the augmented reality space management is configured to manage augmented reality spaces and configure augmented reality contents in the augmented reality spaces, such as creating an augmented reality space, deleting an augmented reality space, and / or information editing (e.g., anchor point editing, augmented reality resource editing), and the like, and the anchor point management is configured to manage anchor points, such as creating an anchor point, deleting an anchor point, and / or editing an anchor point attribute, and the like. In some embodiments, a user needs to open a permission before being able to use a corresponding function in the augmented reality space management platform, for example, the user needs to open an augmented reality space management permission before being able to use the function of the augmented reality space management, when the permission is not opened, the user will not be able to consult and manage (create, delete, information editing, etc.) an augmented reality space list, nor be able to enter a certain augmented reality space for browsing or editing, the user needs to open a resource management permission before being able to use the function of the resource management, when the permission is not opened, the user will be restricted in terms of resource consultation, editing (creation, classification, search, naming, preview, deletion), and use, the user needs to open an anchor point management permission before being able to use the function of the anchor point management, the anchor point is a reference basis for the location of the augmented reality content display in a space, when the permission is not opened, the user will not be able to manage the anchor point, nor be able to enter a certain augmented reality space for browsing or editing.In some embodiments, a user can create a new augmented reality space or edit an already created augmented reality space in the augmented reality space management platform, the augmented reality space can include one or more columns of space name and cover, anchor point, exclusive resource, etc., wherein in some embodiments, the cover can be added by the space creator on the management platform when creating the augmented reality space, for example, by uploading pictures or taking pictures, etc., in other embodiments, the cover is the picture taken when the space is successfully constructed, which is used as the space cover and provides camera position reference for space positioning, allowing subsequent modification, the anchor point is the reference basis for the position of all or part of the augmented reality content displayed in the space in the current augmented reality space, which is generally the point cloud recognized by the space, the recorded picture, the GIS coordinate position, etc., the anchor point can be added by the space creator on the management platform when creating the augmented reality space, for example, one or more anchor points in the anchor point management of the management platform are associated, or one or more augmented reality anchor points are created (such as uploaded or generated), one space supports one or more anchor points, the exclusive resource refers to the resource list / list of the current augmented reality space, which can be added by the space creator on the management platform when creating the augmented reality space, for example, one or more resources in the resource management of the management platform are associated, or one or more resources are created (such as uploaded or generated), in some cases, if no resource list / list is configured, the current space can use all the created augmented reality resources in the resource management of the management platform. Wherein the space name and cover, anchor point, resource, etc. One or more columns in the augmented reality space can be determined by the space creator when creating the space, or can be determined or modified by other personnel after the creation is completed, which is not limited here.

[0067] A second module 12 is configured to establish an association between the first augmented reality space and at least one anchor point. In some embodiments, a user can create at least one anchor point in the configuration page of the first augmented reality space, for example, upload or generate at least one anchor point, so that the first augmented reality space is associated with the at least one anchor point, or can also select at least one anchor point from one or more anchor points created in the configuration page, for example, select at least one anchor point from one or more anchor points in the anchor point management of the management platform, so that the first augmented reality space is associated with the at least one anchor point. In some embodiments, the user can also select the first augmented reality space in one or more augmented reality spaces created in the configuration page of a certain anchor point, for example, select the first augmented reality space in the configuration page (such as the editing page or the anchor point attribute page) of a certain anchor point in the anchor point management of the management platform, so that the first augmented reality space is associated with the at least one anchor point.

[0068] a third module 13 configured to, in response to an access triggering operation performed by the user on a first anchor point in the at least one anchor point, enter an augmented reality content editing page corresponding to the first anchor point, present the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determine first augmented reality content associated with the first anchor point and first spatial position information corresponding to the first augmented reality content according to a content editing operation performed by the user on the augmented reality content editing page on at least one augmented reality resource. In some embodiments, the user can select a certain anchor point (the first anchor point) in the at least one anchor point for editing of the augmented reality content (e.g., click an editing button corresponding to the anchor point, etc.), at which time the augmented reality content editing page (e.g., an editor page) corresponding to the anchor point is entered. Alternatively, the user can directly edit the augmented reality content for the first augmented reality space (e.g., click an editing button corresponding to the space, etc.), at which time the augmented reality content editing page (e.g., an editor page) corresponding to a certain anchor point (the first anchor point) in the at least one anchor point is entered. The first anchor point can be a randomly determined anchor point in the at least one anchor point, or can be an anchor point ranked first in a certain specific ranking manner in the at least one anchor point. In some embodiments, the first anchor point (e.g., a sparse point cloud, a picture, etc.) or the three-dimensional model (e.g., a dense point cloud, a three-dimensional reconstruction model, etc.) corresponding to the first anchor point is presented on the augmented reality content editing page. In particular, if the first anchor point is a null anchor point, the null anchor point has no content, and the null anchor point is presented on the augmented reality content editing page. It can be understood that no content is actually presented on the augmented reality content editing page. In some embodiments, after the user enters the augmented reality content editing page corresponding to the first anchor point, one or more determined augmented reality contents corresponding to the first anchor point in the first augmented reality space are displayed on the page, and augmented reality contents corresponding to other anchor points in the first augmented reality space are not displayed.In some embodiments, the user can directly use all the created augmented reality resources in the augmented reality space management platform (e.g., the augmented reality resources in the resource management of the management platform) on the page, or only use the augmented reality resources added for the first augmented reality space before, or further select some of the created augmented reality resources in the management platform as the augmented reality resources available for the space, or add augmented reality resources on the page, e.g., the user uploads augmented reality resources in the augmented reality content editing page, and the augmented reality content editing page displays the identification information (e.g., resource name information, resource icon information, resource content information, and / or resource type information, etc.) of the augmented reality resources available for the space. In some embodiments, there is a virtual scene coordinate system on the augmented reality content editing page, and the user can add (e.g., drag, etc.) a usable augmented reality resource to a certain position in the virtual scene coordinate system, thereby determining the added augmented reality resource as a first augmented reality content corresponding to a first anchor in the first augmented reality space. In some embodiments, after the user adds a usable augmented reality resource to a certain position in the virtual scene coordinate system, a control component appears on the augmented reality resource (e.g., by selecting the resource to appear a control component, or automatically appearing a control component, etc.), and the user can control the position, rotation angle, and size of the augmented reality resource through the control component, or after the user adds a usable augmented reality resource to a certain position in the virtual scene coordinate system, the augmented reality content editing page presents the position information, rotation angle information, size information, etc. of the augmented reality resource in the virtual scene coordinate system (e.g., by selecting the augmented reality resource to present, or automatically presenting the attribute parameters of each augmented reality resource), and the user can edit these information, thereby determining the edited augmented reality resource as a first augmented reality content corresponding to a first anchor, and directly using the position information of the augmented reality content in the virtual scene coordinate system as the spatial position information of the augmented reality content, or further using the relative position information of the augmented reality content relative to the first anchor as the spatial position information of the augmented reality content, etc. In some embodiments, the page displays the identification information (e.g., resource name, resource icon information, resource content information, and / or resource type information, etc.) of all the determined augmented reality contents corresponding to the first anchor in the first augmented reality space, and the user can quickly select to rename or delete, or further edit a certain augmented reality content (e.g., adjust the position information, rotation angle information, size information, etc.).In some embodiments, the augmented reality resource can also be associated with a target object (such as an industrial device, etc.), so that the relevant data of the target object is taken as the content of the augmented reality resource, for example, real-time data of the target object is obtained from a device management system, a third-party information system, and / or a big data center server, etc., and the real-time data is taken as the content of the augmented reality resource, for example, is associated in the resource management of the management platform, or is associated in the augmented reality content editing page, so that the augmented reality content is the relevant data of the target object and is superimposed and displayed in the real scene picture.

[0069] a fourth module 14 configured to determine first augmented reality data corresponding to the first augmented reality space according to the augmented reality content corresponding to each anchor point in the first augmented reality space and the spatial position information corresponding to the augmented reality content, so that the user device, after entering the first augmented reality space, presents the augmented reality content corresponding to one or more target anchor points in the first augmented reality space on the real scene of the user device based on the first augmented reality data, wherein the at least one anchor point includes the one or more target anchor points. In some embodiments, the first augmented reality data corresponding to the first augmented reality space can be determined according to the augmented reality content corresponding to each anchor point in the first augmented reality space and the spatial position information corresponding to the augmented reality content, or the first augmented reality data further includes parameter information of each anchor point in the first augmented reality space, which includes but is not limited to at least one of the following: anchor point identification, anchor point name, anchor point type, resource address of the anchor point, position of the anchor point in the virtual coordinate system, rotation angle information of the augmented reality content, size information, etc. In some embodiments, the network device provides the first augmented reality data to the corresponding user device, for example, the network device sends the first augmented reality data to the user device after the user device is connected to the network or the corresponding application is started, for another example, the network device sends the first augmented reality data in response to the request of the user device, in some embodiments, the user device can trigger the download of the first augmented reality data corresponding to the first augmented reality space in a manual manner, for example, the user clicks the first augmented reality space data download button in the user interface, and then the first augmented reality data corresponding to the first augmented reality space is downloaded. In some embodiments, the user can trigger the download of the first augmented reality data corresponding to the first augmented reality space in an automatic manner, for example, when the user enters the first augmented reality space (for example, the user manually selects to enter the first augmented reality space, for another example, the user carries the user device into the physical space of the first augmented reality space (for example, the user device matches the Bluetooth, GPS, wifi of the physical space of the first augmented reality space through Bluetooth, GPS, wifi, or the user device recognizes the anchor point associated with the first augmented reality space, etc.), and then the user enters the first augmented reality space in a manual or automatic manner, etc.), the first augmented reality data corresponding to the first augmented reality space is downloaded. The user device includes but is not limited to mobile phones, iPads / Pads, AR smart wearable devices (such as AR glasses), etc.In some embodiments, the way of entering the first augmented reality space includes but is not limited to that the user manually selects to enter the first augmented reality space on the user device in one or more augmented reality spaces, detecting the current real-time position of the user device in the real scene, if the current real-time position is located in the physical space corresponding to the first augmented reality space, then manually or automatically entering the first augmented reality space, wherein if the physical space is associated with the first augmented reality space and other augmented reality spaces, then manually selecting to enter the first augmented reality space or automatically entering the augmented reality space with the highest priority (such as previously sorting the augmented reality spaces based on a predetermined strategy, wherein the predetermined strategy can be sorting according to access time, sorting according to task relevance, sorting according to priority, etc., which are only examples and are not limited herein) and the like, wherein the current real-time position of the user device can be determined according to GPS, Bluetooth, WiFi and other positioning, or the current real-time position of the user device can also be determined by anchor point recognition of the real-time camera picture of the user device through positioning algorithms (such as SLAM - Simultaneous Localization and Mapping, VIO - Visual Odometry, VPS - Visual Positioning System, 2D recognition, etc.), and then determining whether the user is located in the physical space corresponding to the first augmented reality space according to the current real-time position. In some embodiments, after the user device enters the first augmented reality space, the live environment can be collected (for example, by the camera of the user device to take live pictures), and the real-time pose information of the user in the real scene can be obtained based on the real-time camera picture taken by the camera of the user device, through the positioning technology of SLAM, VIO, VPS, 2D recognition and the anchor point information corresponding to the first augmented reality space, wherein the positioning technology can be recognized locally or through the cloud, for example, the user device sends the real-time camera picture to the network device, the network device performs feature extraction and pose estimation, and then sends the estimated result information to the user device. In some embodiments, the foregoing positioning algorithms can be used alone or in combination, which are not limited herein, and based on the first augmented reality data, the presentation position of the augmented reality content corresponding to at least one anchor point of one or more anchor points corresponding to the first augmented reality space in the real scene picture of the user device is calculated (for example, according to the position of a certain augmented reality content in the virtual coordinate system and the current real-time pose of the user device, the presentation position of the augmented reality content in the real scene picture is calculated, or according to the relative position of a certain augmented reality content relative to the anchor point corresponding thereto and the current real-time pose of the user device, the presentation position of the augmented reality content in the real scene picture is calculated, etc.), and the augmented reality content is presented on the real scene picture of the user device according to the presentation position.Among them, the augmented reality content is superimposed on the real scene. It can be that the display device of the user device displays the real scene captured by the camera of the user device, and the augmented reality content is superimposed on the real scene displayed by the display device (corresponding to the video perspective mode). It can also be that the display device of the user device does not display the real scene captured by the camera of the user device, and the display device only presents the augmented reality content. The user of the user device can see the real scene through the display device, thereby realizing the superimposition of the augmented reality content in the real scene (corresponding to the optical perspective mode). In some embodiments, after entering the first augmented reality space, the augmented reality content corresponding to each anchor point in the first augmented reality space is automatically triggered to be displayed, or it is necessary to identify the anchor point according to the acquisition site environment, and only the augmented reality content corresponding to the identified anchor point in the first augmented reality space will be displayed, and the augmented reality content corresponding to other unidentified anchor points in the first augmented reality space will not be displayed. In some embodiments, for an anchor point whose anchor point type is an empty anchor point, the augmented reality content corresponding to the anchor point is automatically displayed without identification.

[0070] In some embodiments, the device is further configured to: create one or more anchor points in response to the user performing an anchor point creation operation in the augmented reality space management platform; wherein the one or more anchor points include at least one of the following: an empty anchor point; a point cloud; an image; a geographic coordinate position. Figure 1 The embodiments shown are the same or similar and therefore will not be described in detail, but are incorporated herein by reference.

[0071] In some embodiments, the device is further configured to: in response to the user performing a model upload operation on the augmented reality space management platform for a second anchor point among the one or more anchor points, set the model uploaded by the user as the three-dimensional model corresponding to the second anchor point. Figure 1 The embodiments shown are the same or similar and therefore will not be described in detail, but are incorporated herein by reference.

[0072] In some embodiments, the device is further configured to: in response to the user performing a filtering setting operation on a third anchor point among the one or more anchor points in the augmented reality space management platform, set identification filtering information corresponding to the third anchor point, wherein the identification filtering information is used for the user device to filter out at least one anchor point to be identified from the multiple anchor points. Figure 1 The embodiments shown are the same or similar and therefore will not be described in detail, but are incorporated herein by reference.

[0073] In some embodiments, the identification and screening information includes at least one of the following: GPS screening information; Bluetooth screening information; WiFi screening information; time period screening information.Figure 1 The embodiments shown are the same or similar, and thus will not be described again, and are included herein by reference.

[0074] In some embodiments, the second module 12 is configured to: in response to an anchor point configuration operation performed by the user in the augmented reality space management platform for the first augmented reality space, obtain at least one anchor point selected by the user from the one or more anchor points, and establish an association relationship between the first augmented reality space and the at least one anchor point. Here, the related operations are the same as or similar to those of the first module 12, and thus will not be described again, and are included herein by reference. Figure 1 The embodiments shown are the same or similar, and thus will not be described again, and are included herein by reference.

[0075] In some embodiments, the second module 12 is configured to: in response to a space association operation performed by the user in the augmented reality space management platform for the first augmented reality space with respect to at least one anchor point of the one or more anchor points, establish an association relationship between the first augmented reality space and the at least one anchor point. Here, the related operations are the same as or similar to those of the first module 12, and thus will not be described again, and are included herein by reference. Figure 1 The embodiments shown are the same or similar, and thus will not be described again, and are included herein by reference.

[0076] In some embodiments, the device is further configured to: in response to a resource creation operation performed by the user in the augmented reality space management platform, create one or more augmented reality resources; wherein the one or more augmented reality resources include at least one of the following: marker information; file information; form information; application invocation information; real-time sensing information; and other custom types of information. Here, the related operations are the same as or similar to those of the first module 12, and thus will not be described again, and are included herein by reference. Figure 1 The embodiments shown are the same or similar, and thus will not be described again, and are included herein by reference.

[0077] In some embodiments, the device is further configured to: in response to a resource configuration operation performed by the user in the augmented reality space management platform for the first augmented reality space, obtain at least one augmented reality resource corresponding to the first augmented reality space selected by the user from the one or more augmented reality resources. Here, the related operations are the same as or similar to those of the first module 12, and thus will not be described again, and are included herein by reference. Figure 1 The embodiments shown are the same or similar, and thus will not be described again, and are included herein by reference.

[0078] In some embodiments, the device is further configured to: in response to a follow attribute editing operation performed by the user in the augmented reality content editing page for the first augmented reality content, set a follow screen attribute corresponding to the first augmented reality content. Here, the related operations are the same as or similar to those of the first module 12, and thus will not be described again, and are included herein by reference. Figure 1 The embodiments shown are the same or similar, and thus will not be described again, and are included herein by reference.

[0079] In some embodiments, the device is further configured to: in response to an interaction configuration operation performed by the user on the augmented reality content editing page for the first augmented reality content, set an interaction event corresponding to the first augmented reality content, so that the user equipment hides or displays third augmented reality content on the real scene picture after entering the first augmented reality space if it is detected that the first augmented reality content triggers the interaction event. Here, the related operations are the same as or similar to those in the embodiments shown in the above Figure 1 and will not be described here, which are hereby incorporated by reference.

[0080] In some embodiments, the device is further configured to: in response to a script configuration operation performed by the user on the augmented reality content editing page, set a script file corresponding to the first augmented reality space, so that the user equipment executes the script file after entering the first augmented reality space, wherein the script file is used to control the augmented reality content in the first augmented reality space. Here, the related operations are the same as or similar to those in the embodiments shown in the above Figure 1 and will not be described here, which are hereby incorporated by reference.

[0081] In some embodiments, the device is further configured to: in response to a content initialization mode setting operation performed by the user for the first anchor point, set a content initialization mode corresponding to the first augmented reality content; wherein the content initialization mode includes any one of the following: anchor point based placement; live scene based placement; screen based placement. Here, the related operations are the same as or similar to those in the embodiments shown in the above Figure 1 and will not be described here, which are hereby incorporated by reference.

[0082] In some embodiments, the content initialization mode includes anchor point based placement; wherein the device is further configured to: in response to a virtual scene following mode setting operation performed by the user for the first anchor point, set a following mode corresponding to the first augmented reality content; wherein the following mode includes any one of the following: follow the anchor point; follow the space. Here, the related operations are the same as or similar to those in the embodiments shown in the above Figure 1 and will not be described here, which are hereby incorporated by reference.

[0083] In some embodiments, the content initialization mode includes live scene based placement; wherein the method further comprises: in response to a virtual scene generation mode setting operation performed by the user for the first anchor point, setting a generation mode corresponding to the first augmented reality content; wherein the generation mode includes any one of the following: preset perspective automatic generation; enter live scene manual generation. Here, the related operations are the same as or similar to those in the embodiments shown in the above Figure 1 and will not be described here, which are hereby incorporated by reference.

[0084] In some embodiments, the generation manner comprises preset perspective automatic generation; wherein the device is further configured to: in response to an editing operation performed by the user on the augmented reality content editing page for a virtual scene coordinate system, determine a transformation relationship between the virtual scene coordinate system and a real scene coordinate system, so that the user device determines a display pose of the first augmented reality content in the real scene according to a pose of the first augmented reality content in the virtual scene coordinate system and the transformation relationship. Here, the related operations are the same as or similar to those in the embodiments shown in the above, and thus will not be described herein by way of introduction. Figure 1 The related operations are the same as or similar to those in the embodiments shown in the above, and thus will not be described herein by way of introduction.

[0085] In some embodiments, the device is further configured to: present first identification information of the at least one anchor point and second identification information of the augmented reality content corresponding to each anchor point on the augmented reality content editing page. Here, the related operations are the same as or similar to those in the embodiments shown in the above, and thus will not be described herein by way of introduction. Figure 1 The related operations are the same as or similar to those in the embodiments shown in the above, and thus will not be described herein by way of introduction.

[0086] In some embodiments, the device is further configured to: in response to an access triggering operation performed by the user on the augmented reality content editing page for an anchor point other than the first anchor point in the at least one anchor point, cancel presentation of the first anchor point or a three-dimensional model corresponding to the first anchor point, cancel presentation of the augmented reality content corresponding to the first anchor point, present the other anchor point or a three-dimensional model corresponding to the other anchor point, and present augmented reality content associated with the other anchor point on the augmented reality content editing page. Here, the related operations are the same as or similar to those in the embodiments shown in the above, and thus will not be described herein by way of introduction. Figure 1 The related operations are the same as or similar to those in the embodiments shown in the above, and thus will not be described herein by way of introduction.

[0087] In some embodiments, the device is further configured to: in response to a call operation or an incoming call answering operation performed by the user for a second user device in the augmented reality space management platform, establish a video call connection between the network device and the second user device, and present a second real scene corresponding to the second user device; and in response to the user entering a second augmented reality space corresponding to the second user device, present target augmented reality content in the second augmented reality space on the second real scene based on second augmented reality data corresponding to the second augmented reality space. Here, the related operations are the same as or similar to those in the embodiments shown in the above, and thus will not be described herein by way of introduction. Figure 3 The related operations are the same as or similar to those in the embodiments shown in the above, and thus will not be described herein by way of introduction.

[0088] In some embodiments, the method further includes: in response to a content editing operation performed by the user in the second augmented reality space, updating the target augmented reality content and / or updating second spatial position information corresponding to the target augmented reality content; and updating second augmented reality data corresponding to the second augmented reality space according to the updated target augmented reality content and / or the updated second spatial position information. Figure 3 The above-mentioned embodiments and methods and devices are incorporated herein by reference.

[0089] In some embodiments, the device is further configured to: in response to a content editing operation performed by the user in the second augmented reality space, update the target augmented reality content and / or update second spatial position information corresponding to the target augmented reality content; and update second augmented reality data corresponding to the second augmented reality space according to the updated target augmented reality content and / or the updated second spatial position information.

[0090] In addition to the above-mentioned embodiments, the present application also provides a computer readable storage medium storing computer code, when the computer code is executed, the method of any one of the preceding embodiments is executed.

[0091] The present application also provides a computer program product, when the computer program product is executed by a computer device, the method of any one of the preceding embodiments is executed.

[0092] The present application also provides a computer device, the computer device includes:

[0093] one or more processors;

[0094] a memory for storing one or more computer programs;

[0095] when the one or more computer programs are executed by the one or more processors, the one or more processors implement the method of any one of the preceding embodiments.

[0096] ​An example system that can be used to implement various embodiments described in this application is shown;

[0097] As ​ shown, in some embodiments, system 300 can function as any of the devices in the various embodiments described. In some embodiments, system 300 can include one or more computer-readable media (e.g., system memory or NVM / storage 320) having instructions and one or more processors (e.g., processor(s) 305) coupled with the one or more computer-readable media and configured to execute the instructions to implement modules to perform the actions described in this application.

[0098] For one embodiment, system control module 310 can include any suitable interface controllers to provide for any suitable interface to at least one of processor(s) 305 and / or any suitable device or component in communication with system control module 310.

[0099] System control module 310 can include a memory controller module 330 to provide an interface to system memory 315. Memory controller module 330 can be a hardware module, a software module, and / or a firmware module.

[0100] System memory 315 can be used, for example, to load and store data and / or instructions for system 300. For one embodiment, system memory 315 can include any suitable volatile memory, such as suitable DRAM. In some embodiments, system memory 315 can include double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).

[0101] For one embodiment, system control module 310 can include one or more input / output (I / O) controllers to provide an interface to NVM / storage 320 and communication interface(s) 325.

[0102] For example, NVM / storage 320 can be used to store data and / or instructions. NVM / storage 320 can include any suitable non-volatile memory (e.g., flash memory) and / or can include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives (HDDs), one or more compact disk (CD) drives, and / or one or more digital versatile disk (DVD) drives).

[0103] NVM / storage 320 can include a storage resource that is physically part of the device on which system 300 is installed, or that is accessed via the device on a network, for example, via communication interface(s) 325.

[0104] The communication interface(s) 325 can provide an interface for the system 300 to communicate with one or more networks and / or any other suitable device. The system 300 can communicate wirelessly with one or more components of a wireless network in accordance with any of one or more wireless network standards and / or protocols.

[0105] For one embodiment, at least one of the processor(s) 305 can be packaged together with logic of one or more controllers of the system control module 310 (e.g., the memory controller module 330). For one embodiment, at least one of the processor(s) 305 can be packaged together with logic of one or more controllers of the system control module 310 to form a system in a package (SiP). For one embodiment, at least one of the processor(s) 305 can be integrated on the same die with logic of one or more controllers of the system control module 310. For one embodiment, at least one of the processor(s) 305 can be integrated on the same die with logic of one or more controllers of the system control module 310 to form a system on a chip (SoC).

[0106] In various embodiments, the system 300 can be, but is not limited to, a server, a workstation, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, the system 300 can have more or less components, and / or different architectures. For example, in some embodiments, the system 300 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including touch screen displays), non- volatile memory port, multiple antennas, a graphics chip, an application specific integrated circuit (ASIC), and speakers.

[0107] In addition to the methods and devices described in the above embodiments, the present application also provides a computer readable storage medium, the computer readable storage medium stores computer code, when the computer code is executed, the method of any one of the preceding is executed.

[0108] The present application also provides a computer program product, when the computer program product is executed by a computer device, the method of any one of the preceding is executed.

[0109] The present application also provides a computer device, the computer device comprises:

[0110] one or more processors;

[0111] a memory for storing one or more computer programs;

[0112] The one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the method of any one of the preceding claims.

[0113] It is noted that the present application can be implemented in software and / or in a combination of software and hardware, e.g., using application specific integrated circuits (ASIC), a general purpose computer or any other similar hardware devices. In one embodiment, the software program of the present application is implemented by the processor to perform the above-described steps or functions. Also, the software program of the present application (including related data structures) can be stored in a computer-readable recording medium, e.g., RAM memory, magnetic or optical drive or diskette, and so on. Additionally, some of the steps or functions can be implemented with hardware. For example, a circuitry can be used in place of software / hardware to implement the various steps or functions of the application.

[0114] In addition, some of the steps or functions of the present application can be implemented as computer program instructions programmed into a computer readable medium, which, when executed by a computer, cause the operation of the computer to invoke or provide the methods and / or technical solutions according to the present application. Those skilled in the art should understand that the form of the computer program instructions in the computer readable medium includes, but is not limited to, source files, executable files, installation package files, etc., and accordingly, the way of the computer program instructions executed by the computer includes, but is not limited to, the computer directly executing the instructions, or the computer executing the corresponding compiled program after compiling the instructions, or the computer reading and executing the instructions, or the computer executing the corresponding installed program after reading and installing the instructions. Here, the computer readable medium can be any available computer readable storage medium or communication medium accessible by the computer.

[0115] Communication media includes any medium to facilitate the transfer of a computer program from one place to another. A storage medium can include one or more types of computer-readable storage media. Computer-readable storage media include, but are not limited to, random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory, compact disk (CD) ROM or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information in a computer-readable format. Note that the computer-readable medium can be paper, if the program is presented on the paper in a printed form using a fixed data format. Note also that the computer-readable medium can be paper, if the program is presented on the paper in a printed form using a fixed data format. Note also that the computer-readable medium can be paper, if the program is presented on the paper in a printed form using a fixed data format.

[0116] By way of example and not limitation, computer-readable storage media may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer-readable storage media include, but are not limited to, volatile memory, such as random access memory (RAM, DRAM, SRAM); and non-volatile memory, such as flash memory, various read-only memories (ROM, PROM, EPROM, EEPROM), magnetic and ferromagnetic / ferroelectric memories (MRAM, FeRAM); and magnetic and optical storage devices (hard disks, magnetic tapes, CDs, DVDs); or other media now known or later developed that can store computer-readable information / data for use by a computer system.

[0117] Here, according to one embodiment of the present application, a device is included, which includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein, when the computer program instructions are executed by the processor, the device is triggered to run the methods and / or technical solutions based on the aforementioned multiple embodiments of the present application.

[0118] It is obvious to those skilled in the art that the present application is not limited to the details of the above-mentioned exemplary embodiments, and that the present application can be implemented in other specific forms without departing from the spirit or basic characteristics of the present application. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the present application is defined by the appended claims rather than the above description, and it is intended that all changes that fall within the meaning and scope of the equivalent elements of the claims are included in the present application. Any figure mark in the claims should not be regarded as limiting the claims involved. In addition, it is obvious that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices stated in the device claim can also be implemented by one unit or device through software or hardware. Words such as first and second are used to indicate names and do not indicate any particular order.

Claims

1. A method for managing an augmented reality space, applied to a network device, wherein, The method comprises: in response to a space creation operation performed by a user in an augmented reality space management platform, creating a first augmented reality space; establishing an association relationship between the first augmented reality space and at least one anchor point; in response to an access trigger operation performed by the user on a first anchor point in the at least one anchor point, entering an augmented reality content editing page corresponding to the first anchor point, presenting the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determining first augmented reality content associated with the first anchor point and first spatial location information corresponding to the first augmented reality content according to a content editing operation performed by the user on at least one augmented reality resource on the augmented reality content editing page; determining first augmented reality data corresponding to the first augmented reality space according to augmented reality content corresponding to each anchor point in the first augmented reality space and spatial location information corresponding to the augmented reality content, so that a user device, after entering the first augmented reality space, presents augmented reality content corresponding to one or more target anchor points in the first augmented reality space on a real scene picture of the user device based on the first augmented reality data, wherein the at least one anchor point includes the one or more target anchor points.

2. The method of claim 1, wherein, The method further comprises: in response to an anchor point creation operation performed by the user in the augmented reality space management platform, creating one or more anchor points; wherein the one or more anchor points include at least one of: an empty anchor point; a point cloud; a picture; a geographic coordinate position.

3. The method of claim 2, wherein, The method further comprises: in response to a model uploading operation performed by the user in the augmented reality space management platform on a second anchor point in the one or more anchor points, setting a model uploaded by the user as a three-dimensional model corresponding to the second anchor point.

4. The method of claim 2, wherein, The method further comprises: in response to a filtering setting operation performed by the user in the augmented reality space management platform on a third anchor point in the one or more anchor points, setting identification filtering information corresponding to the third anchor point, the identification filtering information being used by the user device to filter at least one anchor point to be identified from a plurality of anchor points.

5. The method of claim 4, wherein, The identification filtering information includes at least one of: GPS filtering information; Bluetooth filtering information; WiFi filtering information; time period filtering information.

6. The method of claim 2, wherein, The establishment of the association relationship between the first augmented reality space and at least one anchor point comprises: in response to an anchor point configuration operation performed by the user in the augmented reality space management platform on the first augmented reality space, obtaining at least one anchor point selected by the user from the one or more anchor points, and establishing an association relationship between the first augmented reality space and the at least one anchor point.

7. The method of claim 2, wherein, The establishment of the association relationship between the first augmented reality space and at least one anchor point comprises: In response to a spatial association operation performed by the user in the augmented reality space management platform on at least one of the one or more anchors for the first augmented reality space, an association relationship between the first augmented reality space and the at least one anchor is established.

8. The method of claim 1, wherein, The method further comprises: In response to a resource creation operation performed by the user in the augmented reality space management platform, one or more augmented reality resources are created; The one or more augmented reality resources comprise at least one of: marker information, file information, form information, application call information, real-time sensing information, and other custom types of information.

9. The method of claim 8, wherein, The method further comprises: In response to a resource configuration operation performed by the user in the augmented reality space management platform for the first augmented reality space, at least one augmented reality resource corresponding to the first augmented reality space is selected by the user from the one or more augmented reality resources.

10. The method of claim 1, wherein, The method further comprises: In response to a follow attribute editing operation performed by the user on the augmented reality content editing page for the first augmented reality content, a follow screen attribute corresponding to the first augmented reality content is set.

11. The method of claim 1, wherein, The method further comprises: In response to an interaction configuration operation performed by the user on the augmented reality content editing page for the first augmented reality content, an interaction event corresponding to the first augmented reality content is set, so that after the user device enters the first augmented reality space, if it is detected that the first augmented reality content is triggered to trigger the interaction event, a third augmented reality content is hidden or displayed on the real scene screen.

12. The method of claim 1, wherein, The method further comprises: In response to a script configuration operation performed by the user on the augmented reality content editing page, a script file corresponding to the first augmented reality space is set, so that after the user device enters the first augmented reality space, the script file is executed, wherein the script file is used to control the augmented reality content in the first augmented reality space.

13. The method of claim 1, wherein, The method further comprises: In response to a content initialization mode setting operation performed by the user for the first anchor, a content initialization mode corresponding to the first augmented reality content is set; The content initialization mode comprises any one of: anchor-based placement; on-site placement; screen-based placement.

14. The method of claim 13, wherein, The content initialization mode comprises anchor-based placement; The method further comprises: In response to a virtual scene follow mode setting operation performed by the user for the first anchor, a follow mode corresponding to the first augmented reality content is set; The follow mode comprises any one of: follow anchor; follow space.

15. The method of claim 13, wherein, The content initialization mode comprises on-site placement; The method further comprises: In response to a virtual scene generation mode setting operation performed by the user for the first anchor, a generation mode corresponding to the first augmented reality content is set; The generation mode comprises any one of: preset perspective automatic generation; enter the site and manually generate.

16. The method of claim 15, wherein, The generation mode comprises preset perspective automatic generation; The method further comprises: In response to an editing operation performed by the user on the augmented reality content editing page for a virtual scene coordinate system, a transformation relationship between the virtual scene coordinate system and a real scene coordinate system is determined, so that the user equipment determines a display pose of the first augmented reality content in the real scene according to a pose of the first augmented reality content in the virtual scene coordinate system and the transformation relationship.

17. The method of claim 1, wherein, The method further includes: presenting first identification information of the at least one anchor point and second identification information of augmented reality content corresponding to each anchor point on the augmented reality content editing page.

18. The method of claim 17, wherein, The method further includes: In response to an access trigger operation performed by the user on the augmented reality content editing page for an anchor point other than the first anchor point among the at least one anchor point, the first anchor point or the three-dimensional model corresponding to the first anchor point is no longer presented on the augmented reality content editing page, the augmented reality content corresponding to the first anchor point is no longer presented, and the other anchor point or the three-dimensional model corresponding to the other anchor point is presented, and the augmented reality content associated with the other anchor point is presented.

19. The method of claim 1, wherein, The method further includes: In response to a call operation or an incoming call operation performed by the user on the second user equipment in the augmented reality space management platform, a video call connection between the network equipment and the second user equipment is established, and a second real scene corresponding to the second user equipment is presented; In response to the user entering a second augmented reality space corresponding to the second user equipment, target augmented reality content in the second augmented reality space is presented on the second real scene based on second augmented reality data corresponding to the second augmented reality space.

20. The method of claim 19, wherein, The response to the user entering a second augmented reality space corresponding to the second user equipment, target augmented reality content in the second augmented reality space is presented on the second real scene based on second augmented reality data corresponding to the second augmented reality space, including: In response to the user entering a second augmented reality space corresponding to the second user equipment, it is determined whether the second user equipment has entered the second augmented reality space; If yes, target augmented reality content in the second augmented reality space is presented on the second real scene based on second augmented reality data corresponding to the second augmented reality space; Otherwise, a space entry request about the second augmented reality space is sent to the second user equipment, and if a confirmation response corresponding to the space entry request returned by the second user equipment is received, target augmented reality content in the second augmented reality space is presented on the second real scene based on second augmented reality data corresponding to the second augmented reality space.

21. The method of claim 19, wherein, The method further includes: In response to a content editing operation performed by the user in the second augmented reality space, the target augmented reality content is updated, and / or second spatial location information corresponding to the target augmented reality content is updated; According to the updated second augmented reality content and / or the updated second spatial position information, update second augmented reality data corresponding to the second augmented reality space.

22. A network device for managing an augmented reality space, wherein, The device comprises: A first module for creating a first augmented reality space in response to a spatial creation operation performed by a user in an augmented reality space management platform; A second module for establishing an association between the first augmented reality space and at least one anchor point; A third module for entering an augmented reality content editing page corresponding to a first anchor point of the at least one anchor point in response to an access trigger operation performed by the user on the first anchor point, presenting the first anchor point or a three-dimensional model corresponding to the first anchor point on the augmented reality content editing page, and determining first augmented reality content associated with the first anchor point and first spatial position information corresponding to the first augmented reality content according to a content editing operation performed by the user on the augmented reality content editing page on at least one augmented reality resource; A fourth module for determining first augmented reality data corresponding to the first augmented reality space according to augmented reality content corresponding to each anchor point in the first augmented reality space and spatial position information corresponding to the augmented reality content, so that a user device presents augmented reality content corresponding to one or more target anchor points in the first augmented reality space on a real scene of the user device based on the first augmented reality data after entering the first augmented reality space, wherein the at least one anchor point includes the one or more target anchor points.

23. A computer device for managing an augmented reality space, comprising a memory, a processor, and a computer program stored on the memory, wherein, The processor executes the computer program to implement the steps of the method of any one of claims 1-21.

24. A computer readable storage medium having stored thereon computer programs / instructions, characterized in that, The computer program / instructions, when executed by the processor, implement the steps of the method of any one of claims 1-21.

25. A computer program product comprising a computer program, characterised in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1-21. The computer program, when executed by the processor, implements the steps of the method of any one of claims 1-21.

Images