User permission receiving and releasing based on AR scene, display method and device, and AR equipment

Abstract

The application relates to a user permission collection and display method and device based on an AR scene, and an AR device, wherein the user permission collection method based on the AR scene is applied to a first client in a first AR device of a first user, the method comprises the following steps: generating a first AR space in response to a positioning operation of the first user; monitoring an authorization operation of the first user on a target second user; detecting whether the current first AR space includes a second user simulation object corresponding to the authorization operation in response to the authorization operation of the first user on the target second user; and sending authorization information of the target second user to a server when the current first AR space includes the second user simulation object corresponding to the authorization operation. The application reduces the operation steps of the second user during on-site visit, thereby effectively improving the visit experience of the user.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of AR (Augmented Reality) technology, in particular to a user permission collection and display method based on an AR scene, a device and an AR equipment. BACKGROUND

[0002] With the rapid development of society, there are more and more places for people to obtain information and exchange information, such as people can watch the exhibits displayed in museums, exhibitions and other places, and visit the exhibition of related products in factories, laboratories and other places. In these places, the exhibitors usually set different permissions for visitors of different identities to limit the different levels of information that visitors of different identities can learn. For example, ordinary visitors of museums and exhibitions can only watch the appearance of the exhibits and learn the general information such as the performance and purpose of the exhibits. For potential customers of the exhibits, in order to attract the potential customers to cooperate, some internal structures and working principles of the exhibits will be displayed to the potential customers.

[0003] In order to display the exhibits and products to the visitors, a display system is usually set up in the display place. In the prior art, the display system usually includes a terminal with an input device, a display screen and / or a playing device, and a background server. The visitors can select the content to be visited through the input device with the help of the exhibitors, and the exhibit images or videos are displayed on the display screen, and the visitors can also hear the explanation audio. In order to distinguish the corresponding content that can be watched by visitors of different identities, the usual way is to require the visitors to register an account and set a password before or during the visit, and the background server of the display system sets the corresponding permission for the user account according to the content registered at the time. The visitors input the account and password to the terminal when watching, and the background server determines the permission of the user according to the account information of the user, and displays the corresponding content on the terminal according to the permission. Some places are provided with AR display systems, and the visitors need to download a display APP on a mobile terminal such as a mobile phone, or watch digital resources such as virtual 3D exhibit models or text introduction information corresponding to their identity permissions through AR glasses.

[0004] No matter which display system, the visitors need to input the account information and password in the display place to watch the content corresponding to their permissions. For the visitors, the operation is complicated and affects the visiting effect. In addition, for the on-site interpreters of the exhibitors and the tour guides of the visitors, the on-site interpreters of the exhibitors and the tour guides of the visitors cannot play a role in reducing the operation of the visitors and reducing the influence of the complicated operation on the visiting effect. SUMMARY

[0005] In view of the technical problems in the prior art, the present application provides a user permission collection and display method and device based on an AR scene, and an AR device, which reduces user operation and improves user experience when displaying digital resources with permissions in an AR scene.

[0006] To solve the above technical problems, according to one aspect of the present application, a user permission collection and display method based on an AR scene is provided, which is applied to a first client in a first AR device of a first user, and includes the following steps:

[0007] A first AR space is generated in response to a positioning operation of the first user, and the first AR space is displayed on a display screen of the first AR device;

[0008] An authorization operation of the first user on a target second user is monitored;

[0009] In response to the authorization operation of the first user on the target second user, it is detected whether the current first AR space includes a second user simulation object corresponding to the authorization operation; and

[0010] When the current first AR space includes the second user simulation object corresponding to the authorization operation, it is confirmed that the authorization is valid, and authorization information of the target second user is sent to a server; the authorization information includes a target second user identifier or a target second user identifier and second permission information, and the second permission information includes a permission type and / or a level.

[0011] To solve the above technical problems, according to another aspect of the present application, a user permission collection and display method based on an AR scene is provided, which is applied to a server, and includes the following steps:

[0012] Authorization information of a first user on a target second user is received from a first client, wherein the authorization information includes a target second user identifier and second permission information, and the second permission information includes a permission type and / or a level; and

[0013] When the permission type in the second permission information is an open permission, when a digital resource request is received from a second client of the target second user, a digital resource corresponding to the permission level is obtained and sent to the second client, wherein the second client runs on a second AR device of the target second user.

[0014] To solve the above technical problems, according to another aspect of the present application, a display method based on an AR scene is provided, which is applied to a second client in a second AR device of a second user, and includes the following steps:

[0015] generate a second AR space in response to a positioning operation of the second user, and display the second AR space through a display screen of the second AR device;

[0016] request a digital resource from a server;

[0017] receive the digital resource authorized by the first user and corresponding to the second user's permission level from the server;

[0018] display the digital resource in the second AR space.

[0019] In another aspect, the application provides a user permission collection and release device based on an AR scene, which is applied to a first AR device of a first user and includes a first communication module, a first AR scene module, an authorization monitoring module, and an authorization confirmation module. The first communication module is configured to communicate with a server. The first AR scene module is configured to generate a first AR space in response to a positioning operation of the first user and display the first AR space through a display screen of the first AR device. The authorization monitoring module is configured to monitor an authorization operation of the first user on a target second user. The authorization confirmation module, connected to the authorization monitoring module, is configured to confirm that an authorization is valid when it is detected that a current first AR space includes a second user simulation object corresponding to the authorization operation in response to the authorization operation of the first user on the target second user, and send authorization information of the target second user to the server through the first communication module. The authorization information includes a target second user identifier and second permission information, and the second permission information includes a permission type and / or level.

[0020] In another aspect, the application provides a user permission collection and release device based on an AR scene, which is located at a server and includes a second communication module, an information processing module, and a data filtering module. The second communication module is configured to communicate with a client, receive authorization information of a first user on a target second user from a first client and a digital resource request from a second client of the target second user, and send a digital resource corresponding to a permission level to the second client. The information processing module, connected to the second communication module, is configured to extract a second user identifier and second permission information from the authorization information, and the second permission information includes one or more of a permission type and level. The data filtering module, connected to the second communication module and the information processing module, is configured to, when the permission type in the second permission information is an open permission, obtain a digital resource corresponding to the permission level when receiving a digital resource request from the second client of the target second user, and send the digital resource to the second client through the second communication module, wherein the second client runs on a second AR device of the target second user.

[0021] In another aspect, the present application provides an AR scene display device applied in a second AR device of a second user; comprising a third communication module, a second AR scene module and a resource management module, the third communication module is configured to communicate with a server; the second AR scene module is configured to generate a second AR space in response to a positioning operation of a first user, and display a received digital resource in the second AR space according to a received resource notification; the resource management module is connected with the third communication module and the second AR scene module, and is configured to request a digital resource from the server through the third communication module; receive and store a digital resource corresponding to a permission level of the second user sent from the server through the third communication module, and send a resource notification to the second AR scene module.

[0022] The present application authorizes the second user as a visitor by the first user as an operator or staff through the foregoing method and device, so that the second user can obtain the corresponding digital resource without any additional permission acquisition operation, thereby reducing the operation steps of the second user in the visit site and effectively improving the visit experience of the user. Moreover, the staff can set or grant the permission for the visitor at any time during the visit, and the server does not need to separately maintain the permission information of the second user, which is simple to handle and saves resources.

[0023] In another aspect, the present application provides an electronic device comprising a processor and a memory storing computer program instructions; the electronic device implements the AR scene-based user permission collection and release method of the foregoing first client or the AR scene-based display method of the second client or the AR scene-based user permission collection and release method of the foregoing server when executing the computer program instructions.

[0024] In another aspect, the present application provides a computer readable storage medium storing computer program instructions, the computer program instructions are executed by a processor to implement the AR scene-based user permission collection and release method of the foregoing first client or the AR scene-based display method of the second client or the AR scene-based user permission collection and release method of the foregoing server.

[0025] In another aspect, the present application provides a computer program product comprising computer program instructions, the computer program instructions are executed by a processor to implement the AR scene-based user permission collection and release method of the foregoing first client or the AR scene-based display method of the second client or the AR scene-based user permission collection and release method of the foregoing server.

[0026] In another aspect, the present application provides an AR device, comprising a processor, a memory, a display screen and a camera, wherein the memory stores computer program instructions, and the processor executes the computer program instructions in the memory to implement the AR scene-based user permission folding method of the first client or the AR scene display method of the second client. BRIEF DESCRIPTION OF DRAWINGS

[0027] In the following, the preferred embodiments of the present application will be further described in detail with reference to the accompanying drawings, in which:

[0028] Figure 1 is a schematic diagram of the overall architecture of a device according to an embodiment of the present application;

[0029] Figure 2 is a flowchart of an authorization processing method performed at the first client according to an embodiment of the present application;

[0030] Figure 3 is a flowchart of an authorization processing method performed at the server according to an embodiment of the present application; and

[0031] Figure 4 is a flowchart of an AR scene display method performed at the second client according to an embodiment of the present application;

[0032] Figure 5 is a schematic diagram of an authorization monitoring module in a user permission folding device in the first client according to an embodiment of the present application;

[0033] Figure 6 is a schematic diagram of an authorization monitoring module in a user permission folding device in the first client according to an embodiment of the present application;

[0034] Figure 7A is a schematic diagram of an information processing module of the server according to an embodiment of the present application;

[0035] Figure 7B is a schematic diagram of an information processing module of the server according to another embodiment of the present application;

[0036] Figure 8 is a schematic diagram of a data filtering module of the server according to an embodiment of the present application;

[0037] Figure 9 is a schematic diagram of a resource management module in an AR scene display device in the second client according to an embodiment of the present application;

[0038] Figure 10 is a flowchart of a permission folding method according to an embodiment of the present application;

[0039] Figure 11 is a method flowchart of user AR device according to another embodiment of the present application; and

[0040] Figure 12 is a principle block diagram of user AR device according to an embodiment of the present application. DETAILED DESCRIPTION

[0041] For the purpose of making the objects, technical solutions and advantages of embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0042] In the following detailed description, reference can be made to the various drawings that form a part of the present disclosure and are used to illustrate specific embodiments of the present application. In the drawings, like numerals describe generally similar components throughout the several drawings. The various embodiments of the present application are described in sufficient detail to enable those of ordinary skill in the art to make and use the technical solutions of the present application. It should be understood that other embodiments can be utilized and structural, logical, or electrical changes can be made to the embodiments of the present application.

[0043] In order to reduce the cumbersome operation of visitors obtaining visiting rights when visiting, and at the same time play the role of on-site staff, the present application provides an AR scene display method, a user right collection and release method, a device and an AR device. Specifically, Figure 1 is a schematic diagram of the overall architecture of the device according to an embodiment of the present application. In the present embodiment, the devices involved include a first AR device 1 used by an operator (staff, hereinafter referred to as a first user), a server 2 providing different right digital resources to users, and a second AR device 3 used by visitors (hereinafter referred to as a second user). Among them, when there are multiple staff, there are multiple corresponding first AR devices 1, and when there are multiple visitors, there are multiple corresponding second AR devices 3. A first client 10 is provided in the first AR device 1, which includes a user right collection and release device 100 based on an AR scene, a server 20 is provided in the server 2, which includes a user right collection and release device 200 based on an AR scene, and a second client 30 is provided in the second AR device 32, which includes an AR scene display device 300.

[0044] The AR scene-based user permission granting and revoking device 100 in the first client 10 is used to implement the granting and revoking of the corresponding permissions of the second user by the first user. It comprises a first communication module 101, a first AR scene module 102, an authorization monitoring module 103, and an authorization confirmation module 104. Among them, the first communication module 101 communicates with the server 20. The first AR scene module 102 generates a first AR space in response to the positioning operation of the first user, and displays the first AR space on the display screen 11 of the first AR device 1. The authorization monitoring module 103 monitors the authorization operation of the first user on the target second user, and the authorization confirmation module 104 is connected with the authorization monitoring module 103. In response to the authorization operation of the first user on the target second user, it is detected whether the current first AR space includes a second user simulation object corresponding to the authorization operation. When the current first AR space includes a second user simulation object corresponding to the authorization operation, the authorization information of the target second user is sent to the server 20 through the first communication module. The authorization information includes the target second user identifier and the second permission information, and the second permission information includes one or more of the permission type and the level. When the first user as a staff needs to grant corresponding permissions to the first user as a visitor, see Figure 2 , Figure 2 is the authorization method flowchart of the first user according to an embodiment of the present application, comprising the following steps:

[0045] Step S10, receiving the start operation of the first user. The first user can start the client 10 in the first AR device 1 through the start operation.

[0046] Step S11, positioning and generating a first AR space. Corresponding to Figure 1 the device architecture diagram in the first AR scene module 102 generates a first AR space based on the positioning operation of the first user. For example, the first user collects the current environment image through the camera of the first AR device 1, the first AR scene module 102 collects the environment image data based on the SLAM synchronous positioning and mapping technology, uses the corresponding positioning and mapping algorithm for data processing according to the information provided by the loop detection result, realizes the SLAM visual positioning, thereby obtaining the three-dimensional model of the current environment (hereinafter referred to as the first AR space), and sends it to the display screen 11 of the first AR device 1 for display.

[0047] Step S12, monitoring the authorization operation of the first user on the target second user. When the corresponding permission needs to be granted for a second user as a visitor, the first user can issue an authorization operation on the target second user. Corresponding to Figure 1 the architecture diagram of the authorization monitoring module 103 monitors the authorization operation of the first user on the target second user.

[0048] Step S13, determine whether the authorization operation is received, if the first user issues the authorization operation, execute step S14, if not, return to step S12. Corresponding to Figure 1 the architecture diagram, when the authorization monitoring module 103 monitors the authorization operation of the first user to the target second user, sends a notification to the authorization confirmation module 104.

[0049] Step S14, determine whether the first AR space has a corresponding simulation object, that is, the portrait in the first AR space. If so, send the authorization information of the target second user to the server in step S16, if the first AR space has no corresponding simulation object, send a reminder message in step S15. Corresponding to Figure 1 the architecture diagram, when the authorization confirmation module 104 receives the notification sent by the authorization monitoring module 103, detects whether the current first AR space includes the second user simulation object corresponding to the authorization operation, for example, it obtains the data of the current first AR space, and judges whether the data contains the simulation data of the person. If there is simulation data of the person, it is determined that the authorization operation is valid, otherwise it is invalid. If the authorization operation is valid, the authorization confirmation module 104 sends the authorization information of the target second user to the server. The authorization information includes the identification of the target second user or the identification of the target second user and the second permission information, the second permission refers to the permission set for the second user, and the second permission information includes the permission type and / or level, the permission type is, for example, open permission or withdraw permission.

[0050] In the above method, according to different settings, the authorization operation issued by the first user to the target second user can be various. For example, when the permission setting of digital resources is simple, for example, only including unauthorized resources and authorized resources, when the first user authorizes, only the identification of the target second user needs to be specified. When the permission setting is complex, such as multiple different levels of permissions, the first user needs to specify the permission level when authorizing.

[0051] Combined with Figure 1, the server 20 includes a user permission collection and release device 200 based on an AR scene, which includes a second communication module 201, an information processing module 202, and a data filtering module 203. The second communication module 201 communicates with the first client 10 and the second client 30, receives authorization information of the first user to the target second user from the first client 10 and a digital resource request from the second client 30 of the target second user, and sends the digital resource corresponding to the permission level to the second client 30. The information processing module 202 is connected with the second communication module 201, extracts the second user identifier and the second permission information from the authorization information, the second permission information includes one or more of the permission type and the level, and sends it to the data filtering module 203. The data filtering module 203 is connected with the second communication module 201 and the information processing module 202, when the permission type in the second permission information is open permission, when receiving the digital resource request from the second client 30 of the target second user, the digital resource corresponding to the permission level is obtained, and sent to the second client 30 through the second communication module 201, for specific authorization processing flow, see Figure 3 .

[0052] Figure 3 is an authorization processing method flowchart performed on the server according to an embodiment of the application, including the following steps:

[0053] Step S20, receiving and analyzing the information sent by the client. Since the server provides services for the first client 10 and the second client 30, when it receives the information sent by the client, the client identifier is obtained by analyzing the information, so that it can be determined whether the information is from the first client 10 or from the second client 30, and the specific content in the information is parsed.

[0054] Step S21, determine whether it is authorization information. When it is determined that the information is from the first client 10, it is determined whether it is authorization information of the first user to the target second user, if it is, step S22 is executed, if it is not, corresponding processing is executed in step S26.

[0055] Step S22, determine whether the permission type in the authorization information is open permission, if it is open permission, then in step S23, the digital resource corresponding to the permission level is obtained and sent to the target second client, and the authorization processing flow is ended; if it is not open permission, it means that the permission is withdrawn, then in step S24, a stop instruction is generated and sent to the target second client, and the authorization processing flow is ended.

[0056] For the second AR device of the second user, see Figure 1The client-side application includes an AR scene display device 300, which comprises a third communication module 301, a second AR scene module 302, and a resource management module 303. The third communication module 301 communicates with the server 20. The second AR scene module 302 generates a second AR space based on the positioning operation of the first user and displays received digital resources in the second AR space according to received resource notifications. The resource management module 303 is connected to the third communication module 301 and the second AR scene module 302. It requests digital resources from the server 20 through the third communication module; it receives and stores digital resources corresponding to the second user's permission level sent from the server 20 through the third communication module 301, and sends resource notifications to the second AR scene module 302. The specific AR scene display method is as follows: Figure 4 As shown, Figure 4 This is a flowchart of a method for displaying an AR scene using a second client according to an embodiment of the present invention, which includes the following steps:

[0057] Step S30: Receive the user's startup operation.

[0058] Step S31: Locate and generate the second AR space.

[0059] The above steps S30, 31 and Figure 2 The processing operations performed on the first client of the first user are the same, and will not be described again here. After the second client generates the second AR space, the second AR space is displayed on the display screen 31 of the second AR device 3.

[0060] Step S32: Request digital resources from server 20. It should be noted that this step can also be performed after step S30, that is, simultaneously with step S31.

[0061] Step S33: Receive digital resources authorized by the first user and corresponding to the permission level of the second user, sent from the server.

[0062] Step S34: Display the digital resource in the second AR space.

[0063] Through the above processing procedure, the second user can view the digital resources authorized by the first user through their second AR device.

[0064] In one embodiment, the first user includes the following steps when performing the authorization operation: querying the user permission list at the first client, the user permission list including at least the user identifier of the second user on site and the corresponding second permission information. After obtaining the user permission list, the first user finds the target second user from the user permission list and selects it. Then the first user makes the target second user appear in the first AR space through the first AR device held or worn by the first user. Then the first user makes an authorization action on the target second user, which can be customized by the first user and stored in the first client, for example, the first user customizes the open or closed palm of the five fingers as the initial action of the authorization action, and when the open or closed palm of the five fingers changes to the extended index finger and the other fingers are retracted, it is the specified action of the user authorization.

[0065] In this embodiment, in order to monitor the above-mentioned authorization operation of the first user, refer to Figure 5 , Figure 5 is the principle block diagram of the authorization monitoring module in the user permission receiving and releasing device in the first client according to one embodiment of the application. The authorization monitoring module 103a includes an authorization information acquisition unit 1031a, an authorization action acquisition unit 1032a, and an action pointing recognition unit 1033a. The authorization information acquisition unit 1031a acquires the user permission list in response to the permission query operation of the first user and provides it to the first user, such as displaying it through the display screen. When the first user selects a user identifier in the user permission list, the corresponding user identifier and the corresponding permission information are read out and combined together to form the authorization information of the target second user. The authorization action acquisition unit 1032a is used to acquire the authorization action information of the user, for example, by capturing the gesture image or video of the first user through the camera in the first AR device, such as taking a picture of the authorization action image of the first user every 0.1 seconds, or starting to take a video when the first user starts to make the action. If an image is taken, the position of each skeletal node of the user's palm in each image is analyzed to perform gesture recognition. If a video is taken, video frames are extracted from it for gesture recognition. The action pointing recognition unit 1033 is connected with the authorization action acquisition unit 1032a, recognizes the pointing direction of the authorization action in the first AR space, and sends the pointing direction to the authorization confirmation module. The authorization confirmation module generates a ray with the pointing direction, judges whether there is a simulated object of a person in the direction of the ray, and if there is, confirms that the authorization is valid, and sends the authorization information to the server 20 through the first communication module.

[0066] In another embodiment, when the first user performs the authorization operation, the first user can input the target second user and the permission information thereof through the first client, and at this time, the authorization information acquisition unit of the authorization monitoring module can acquire the authorization information of the target second user through the input content of the first user in the first AR device.

[0067] In another embodiment, when the first user performs the authorization operation, the first user does not need to determine the target second user and the permission thereof through the first client, and the first user only needs to make an authorization action to the target second user to be authorized. In order to enable the device 100 to recognize the authorization action, the first user can define the authorization action, for example, different gestures correspond to different permission types, for example, the initial action of permission opening and withdrawing is five-finger open or closed palm, when the five-finger open or closed palm changes to the index finger stretched out and the other fingers withdrawn, it is permission opening, and the index finger is raised to the target second user, and the number of fingers stretched out continues to represent the permission level; when the five-finger open or closed palm changes to the palm rotating to the back of the hand, it is permission withdrawal, and the palm is facing the second user action. In this embodiment, in order to monitor the above-mentioned authorization operation of the first user, refer to Figure 6 , Figure 6is a principle block diagram of an authorization monitoring module in a user permission collection and release device in a first client according to an embodiment of the present application, the authorization monitoring module 103b includes an authorization information acquisition unit 1031b, an authorization action acquisition unit 1032b, an action direction identification unit 1033b, an authorization type identification unit 1034b, a matching unit 1035b and a user identification unit 1036b. Wherein, the authorization action acquisition unit 1032b acquires the authorization action of the first user, obtains the gesture made by the first user, and sends the gesture information to the authorization type identification unit 1034b in one direction and to the action direction identification unit 1033b in the other direction. The authorization type identification unit 1034b identifies the type of the authorization action according to the definition of the first user, determines whether the permission is opened or withdrawn, and if the permission is opened, sends a notification to the matching unit 1035b. The matching unit 1035b queries the action type and permission matching table to determine the second permission information corresponding to the type of the authorization action, including the permission type and the permission level. The matching unit 1035b sends the second permission information to the authorization information acquisition unit 1031b. The action direction identification unit 1033 receives the gesture information and determines the action direction, and sends it to the authorization confirmation module 104, which generates a ray in the first AR space according to the action direction and acquires the image of the user in the direction of the ray, and sends the image of the user to the user identification unit 1036b, which identifies the image of the user to obtain the second user identification, and sends the second user identification to the authorization information acquisition unit 1031b. Wherein, in an embodiment, when the second user starts to visit, the second client can obtain the face image of the second user and upload it to the server, and the server sends the face image of the second user and its identity to the first client of the first user, so that the user identification unit 1036b can determine the identity of the second user through face recognition and comparison. The authorization information acquisition unit 1031b obtains the identity of the target second user from the user identification unit 1036b, and obtains the corresponding second permission information from the matching unit 1035b, and combines them to obtain the authorization information of the first user to the second user. In this embodiment, the authorization information acquisition unit 1031b sends the authorization information to the authorization confirmation module 104, which sends it to the server 20 through the first communication module 101. Of course, the authorization information acquisition unit 1031b can also send the authorization information to the server 20 through the first communication module 101.

[0068] Corresponding to the user permission collection and release device 200 based on the AR scene provided by the server 20, in an embodiment, it only determines the permission of the second user and provides digital resources based on the permission. As shown in Figure 7A Figure 7A ​Fig. 2 is a schematic diagram of a service end information processing module 202 according to an embodiment of the present application. In this embodiment, the information processing module 202 comprises an information extraction unit 2021, a permission type identification unit 2022 and an instruction generation unit 2023. The information extraction unit 2021 extracts information from the authorization information received by the second communication module 201, obtaining the second user identifier and the second permission information, and sends them to the permission type identification unit 2022. The permission type identification unit 2022 identifies the permission type in the second permission information, and when the permission type is open permission, sends the second permission information and the corresponding target second user identifier to the data filtering module 203; when the permission type is stop permission, sends a notification to the instruction generation unit 2023. The instruction generation unit 2023 generates a stop display instruction according to the notification sent by the permission type identification unit 2022, and sends it to the second client 30 of the target second user through the second communication module 201.

[0069] Figure 7BFig. 7 is a schematic diagram of the service end information processing module 202 according to another embodiment of the present application. In this embodiment, the information processing module 202 comprises an authentication unit 2024 in addition to the information extraction unit 2021, the permission type identification unit 2022 and the instruction generation unit 2023. The authentication unit 2024 is connected to the information extraction unit 2021 and identifies whether the first permission of the first user sending the authorization information matches the second permission in the authorization information when the information extraction unit 2021 extracts the first user identification. That is, when the information extraction unit 2021 extracts the authorization information received by the second communication module 201, it identifies the first user identification, the second user identification and the corresponding second permission information including the permission type and level from the authorization information. The authentication unit 2024 queries the first permission information of the first user in the internal database, wherein the first permission information includes the first user identification and the second permission type and level that the first user can authorize. In order to manage the right of the operator to open the permission of the visitor, different operators can be set different permissions to open the permission of the visitor. The present application distinguishes the permission of the visitor to watch the digital resource from the permission of the operator to open the permission of the visitor, and refers to the permission of the visitor to watch the digital resource as the second permission and refers to the permission of the first user to open the permission of the visitor as the first permission. The second permission information of the visitor to watch the digital resource includes the permission type and level, and different levels can receive different digital resources. The first permission information of the first user includes different first users who have the right to open or stop different levels of digital resources, and therefore the server stores the correspondence between the first permission information and the second permission information, such as the correspondence between the first user identification and the digital resource opening level, the digital resource stop. The digital resource opening level is also the second user permission level in the authorization information. Therefore, the authentication unit 2024 can determine whether the permission of the current first user matches the second permission information in the authorization information by querying the first permission information of the first user. If it matches, it is confirmed that the authorization information of the first user to the target second user is valid, otherwise the authorization information is invalid. In one embodiment, the authentication unit 2024 notifies the data filtering module 203 whether the current authorization information is valid or invalid. When the data filtering module 203 receives the second permission information and the corresponding target second user identification sent by the permission type identification unit 2022, it acquires the digital resource of the corresponding permission level and sends it to the second client according to the notification sent by the authentication unit 2024 when the current authorization information is valid, and refuses to acquire the digital resource of the corresponding permission level when the current authorization information is invalid, so that the server will not send the digital resource to the target second client. Correspondingly, the server will send a refusal notice to the first client of the first user.

[0070] By the above device and method, only the first user with the permission can open the permission of the second user to watch the digital resource of the corresponding level, and the security of the digital resource is ensured.

[0071] Figure 8 is a principle block diagram of a server data screening module according to an embodiment of the present application. In the embodiment, the data screening module 203 comprises a resource screening unit 2031 and a third permission unit 2032, wherein the resource screening unit 2031 is configured to acquire the digital resource corresponding to the second permission level. The third permission unit 2032 is configured to determine the third permission information of the second client to display the digital resource corresponding to the permission level according to the second permission information, wherein the third permission is the permission content corresponding to the second permission level and / or the digital resource. For example, for the visitor with the ordinary identity, the display time length can be set when the visitor visits the digital resource with high confidentiality, so that the visitor with the ordinary identity can watch the content of a higher level, and the content with high confidentiality is not exposed for a long time.

[0072] Correspondingly, as shown in Figure 9 , the second client 202 displays the digital resource corresponding to the second permission level according to the third permission information. Figure 9Fig. 3 is a schematic diagram of a resource management module in an AR scene display device according to an embodiment of the present application. The resource management module 303 comprises a request unit 3031, a resource storage unit 3032, and a permission processing unit 3033. The request unit 3031 generates a digital resource request, for example, when the second user starts the second client 30 or after the second AR space is generated. The request unit 3031 sends the digital resource request to the server 20 via the third communication module 301. The resource storage unit 3032 receives and stores the digital resource corresponding to the second user's permission level from the server 20 and generates a resource notification to the second AR scene module 302. The second AR scene module 302 displays the digital resource in the second AR scene. Meanwhile, the permission processing unit 3033 extracts third permission information from the received digital resource data. The third permission is the permission content corresponding to the second permission level and / or the digital resource. The permission processing unit 3033 determines the display mode of the digital resource according to the permission content in the third permission information. For example, when the permission content is the display duration, the permission processing unit 3033 starts a timer when the second AR scene module 302 starts displaying the digital resource. The display duration in the permission content is used as the timer period. When the timer reaches the timer period, the permission processing unit 3033 sends a notification to the second AR scene module 302, which stops displaying the digital resource. Further, the request unit 3031 can also receive a stop display instruction from the server 20 and send it to the second AR scene module 302, or the third communication module 301 of the second client 30 sends the stop display instruction from the server 20 to the second AR scene module 302.

[0073] Figure 10 Fig. 4 is a flowchart of a permission collection and release method according to an embodiment of the present application. In this embodiment, the first user as a staff and one or more second users as visitors are in a visiting place. In order for the second users to view the digital resources to be visited through their second AR devices, the following processing steps are included. For convenience of description, the following description does not emphasize which device completes each step, but generally uses the device as a basis for description to facilitate understanding of the processing process.

[0074] Step Sla, the first user performs an operation of starting the first client on the first AR device.

[0075] Step S1b, the first client on the first AR device provides a first client main interface.

[0076] Step S2a, the first user issues a positioning operation.

[0077] Step S2b, the first client on the first AR device generates the first AR space and displays it on the display screen of the first AR device.

[0078] At the same time of the above process, the second user also performs the same operation, i.e.

[0079] Step S1c, the second user performs the operation of starting the second client on the second AR device.

[0080] Step S1d, the second client on the second AR device provides the second client main interface.

[0081] Step S2c, the second user performs the operation of positioning.

[0082] Step S2d, the second client on the second AR device generates the second AR space and displays it on the display screen of the second AR device.

[0083] Step S3d, the second AR device sends a digital resource request to the server, which at least includes the second user identification.

[0084] The server receives the digital resource request sent by the second AR device in step S1e, identifies the second user identification therefrom, and checks whether the authorization information for the second user is received. If not, the server waits for the authorization information in step S2e.

[0085] When the first user needs to authorize the second user, the first user queries the user permission list in step S3a. At this time, the first AR device provides the user permission list and displays it on the display screen in step S3b.

[0086] In step S4a, the first user selects the target second user in the user permission list.

[0087] Step S4b, the first AR device obtains the authorization information.

[0088] In step S5a, the first user performs the authorization gesture to the target second user in the first AR space.

[0089] Step S5b, the first AR device obtains the gesture information, and identifies whether there is a simulated object corresponding to the gesture in the first AR space in step 6b. If there is, the first AR device sends the authorization information to the server in step S7b.

[0090] On the server, when the server receives the authorization information in step 3e, the authorization target second user identification is parsed to obtain the permission type and level.

[0091] At step S4e, the server filters the corresponding digital resource according to the level, and sends the digital resource to the corresponding second AR device at step S5e.

[0092] The second AR device receives and caches the data resource at step S4d, and displays the data resource in the second AR space at step S5d.

[0093] In the embodiment, the first user determines the target second user and the specific authority of the target second user through the user authority list, and sends the authorization information through the confirmation of the authorization gesture, so that the target second user can receive the digital resource sent by the server according to the authorization information. In the process, the first user as the operator and the staff authorizes the second user as the visitor, so that the second user can obtain the corresponding digital resource without any authority acquisition operation, and the staff can set the authority for the visitor at any time during the visit, and the server does not need to maintain the authority information of the second user separately, which is simple and saves the occupied resources.

[0094] Figure 11 is a flow chart of an authority receiving and releasing method according to another embodiment of the application. The application scenario of the embodiment is the same as that in Figure 10 , which will not be repeated here. The processing flow of the embodiment is described as follows.

[0095] Step S1f, the first user performs the operation of starting the first client on the first AR device.

[0096] Step S1g, the first client on the first AR device provides a first client main interface.

[0097] Step S2f, the first user performs the operation of positioning.

[0098] Step S2g, the first client on the first AR device generates a first AR space and displays it on the display screen of the first AR device.

[0099] At the same time as the above process, the second user also performs the same operation, that is,

[0100] Step S1h, the second user performs the operation of starting the second client on the second AR device.

[0101] Step S1k, the first client on the second AR device provides a second client main interface.

[0102] Step S2h, the second user performs the operation of positioning.

[0103] Step S2k, the second client on the second AR device generates a second AR space and displays it on the display screen of the second AR device.

[0104] Step S3k, the second AR device sends a digital resource request to the server, the request including at least the second user identifier.

[0105] The server receives the digital resource request sent by the second AR device in step S1m, identifies the second user identifier therefrom, and checks whether the authorization information for the second user is received. If not, the server waits for the authorization information in step S2m.

[0106] When the first user needs to authorize the second user, the first user issues an authorization action to the target second user in the first AR space in step S3f.

[0107] The first AR device acquires the authorization action information in step S3g, and identifies the authorization action type and the pointing direction in step S4g.

[0108] The first AR device determines the second permission information of the target second user according to the definition of the first user and the authorization action type in step S5g.

[0109] The first AR device identifies whether there is a simulation object in the pointing direction of the action in the first AR space in step S6g, and identifies the simulation object to obtain the identifier of the target second user in step S7g when it is determined that there is a simulation object.

[0110] The first AR device combines the identifier of the target second user and the second permission information to obtain the authorization information of the target second user by the first user in step S8g, and sends the authorization information to the server in step S9g.

[0111] The server receives and parses the authorization information to obtain the identifier of the target second user and the permission level thereof in step S3m, and filters the corresponding digital resource and the corresponding third permission information such as the display duration according to the permission level in step S4m.

[0112] The server sends the digital resource and the corresponding third permission information to the second AR device of the corresponding target second user in step S5m.

[0113] The second AR device receives and caches the digital resource in step S4k, and displays the digital resource in the second AR space and counts the time in step S5k. When the display duration in the third permission is reached in step S6k, the display of the digital resource is stopped.

[0114] In the embodiment, the first user as the staff can authorize the second user as the visitor only by an action, which is simple to operate, and various appropriate restrictions such as the display duration in the embodiment can be added when the digital resource is displayed to the second user.

[0115] ​According to another aspect of the present application, the present application further provides an electronic device comprising a processor and a memory storing computer program instructions; the electronic device implements the AR scene-based user permission collection and release method of the aforementioned client or the AR scene display method of the aforementioned server or the AR scene-based user permission collection and release method of the aforementioned server when executing the computer program instructions. Thus, the electronic device can be implemented as an AR device, such as Figure 12 as shown in the following, Figure 12 is a schematic block diagram of a user AR device according to an embodiment of the present application. The user AR device is, for example, the first AR device 1 or the second AR device 3 in Figure 1 . Taking the first AR device 1 as an example, the first AR device 1 comprises at least a display screen 11, a speaker 12, a memory 13, a processor 14, a network module 15, a camera 16 and various sensors 17 or functional modules. The memory 14 can be an internal memory or an external memory, which is used to store various data and program instruction sets. The network module 15 is used to connect to the Internet, so that the user AR device 1 can access the Internet, communicate with a server and obtain digital resources. The camera 16 can capture images and videos. The sensors 17 are, for example, one or more of a light sensor, a distance sensor, a gyroscope, an acceleration sensor, etc. The processor 14 executes the instructions in the memory 14 to complete the functions of the first client 10, including the user permission collection and release method provided by the AR scene-based user permission collection apparatus 100. When the electronic device is implemented as an AR device used by a second user, the processor 14 executes the instructions in the memory 14 to complete the functions of the second client 30, including the AR scene display method provided by the AR scene display apparatus 300. Specifically, the user AR device 1 or 3 can be implemented as a smartphone, a tablet computer, AR glasses or the like.

[0116] The electronic device can be implemented as a server or a server cluster, which comprises one or more processors and memories, etc., and the memories store computer program instructions, which can complete the functions of the aforementioned server when the processors execute the computer program instructions, including the AR scene-based user permission collection and release method.

[0117] The present application further provides a computer readable storage medium, which stores computer program instructions, and the computer program instructions correspond to the AR scene-based user permission collection and release method or the AR scene display method when executed by the processor of the aforementioned first AR device or the second AR device, respectively, or the AR scene-based user permission collection and release method when executed by the processor of the aforementioned server or server cluster.

[0118] The processor can include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or can be configured as one or more integrated circuits that implement embodiments of the present application.

[0119] The aforementioned memory or computer readable storage medium can include a mass storage for data or instructions. By way of example and not limitation, the memory can include a hard disk drive (HDD), a floppy disk drive, flash memory, an optical disc, a magneto-optical disc, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. Storage memory can be removable or non-removable (or fixed) as appropriate. Storage memory can be internal or external to the integrated gateway disaster recovery device as appropriate. In particular embodiments, the storage memory is a non-volatile solid state memory.

[0120] The present application also provides a computer program product comprising computer program instructions, which, when executed by a processor of the aforementioned first AR device or second AR device, respectively correspond to implement the AR scene-based user permission collection and release method or the AR scene-based display method, or the computer program instructions on the readable storage medium are executed by the processor in the aforementioned server or server cluster to implement the AR scene-based user permission collection and release method. Therefore, the computer program product includes but is not limited to the application installation package, application plug-in, applet that can run in some applications, and the like.

[0121] The above embodiments are only for illustrating the present application, and are not intended to limit the present application. Those skilled in the art can make various changes and modifications without departing from the scope of the present application. Therefore, all equivalent technical solutions shall belong to the scope of the present application.

Claims

1. A method for granting and revoking user permissions based on an AR scene, applied to a first client in a first AR device of a first user, comprising: generating a first AR space in response to a positioning operation of the first user, and displaying the first AR space on a display screen of the first AR device; monitoring an authorization operation of the first user on a target second user; in response to the authorization operation of the first user on the target second user, detecting whether the current first AR space includes a second user simulation object corresponding to the authorization operation; and confirming that the authorization is valid when the current first AR space includes the second user simulation object corresponding to the authorization operation, and sending authorization information of the target second user to a server; the authorization information includes a target second user identifier or a target second user identifier and second permission information, and the second permission information includes a permission type and / or level; wherein the monitoring of the authorization operation of the first user on the target second user comprises: obtaining an authorization action of the user; identifying a type of the authorization action, querying a motion type and permission matching table to determine second permission information corresponding to the type of the authorization action; and identifying a pointing direction of the authorization action in the first AR space; in response to the second user simulation object corresponding to the pointing direction of the authorization action in the first AR space, identifying the second user simulation object to obtain a target second user identifier; in response to a confirmation message of the first user, combining the target second user identifier and the corresponding second permission information into the authorization information. 2.The method of claim 1, wherein the step of monitoring the authorization operation of the first user on the target second user further comprises: in response to a permission query operation of the first user, obtaining a user permission list, wherein the user permission list at least includes a user identifier of the target second user and corresponding second permission information; in response to a selection operation of the first user on the target second user in the user permission list, obtaining authorization information of the first user on the target second user; obtaining authorization action information of the user; and identifying a pointing direction of the authorization action in the first AR space; correspondingly, confirming that the authorization is valid when the pointing direction of the authorization action in the first AR space corresponds to the second user simulation object. 3.The method of claim 1, wherein the step of monitoring the authorization operation of the first user on the target second user further comprises: obtaining authorization information of the first user on the target second user input in the first AR device; obtaining authorization action information of the user; and identifying a pointing direction of the authorization action in the first AR space; correspondingly, confirming that the authorization is valid when the pointing direction of the authorization action in the first AR space corresponds to the second user simulation object. 4.The method of any one of claims 2-3, wherein the authorization action is a gesture. ​ ​ 5. A method for releasing and withdrawing user permissions based on an AR scene, applied to a server, the server being in communication with a first client to which the method of any one of claims 1-4 is applied, the method for releasing and withdrawing user permissions based on an AR scene comprising: receiving authorization information of a first user of the first client to a target second user, wherein the authorization information comprises a target second user identifier and second permission information, and wherein the second permission information comprises a permission type and / or a permission level; and when the permission type in the second permission information is an open permission, upon receiving a digital resource request from a second client of the target second user, obtaining a digital resource corresponding to the permission level and sending the digital resource to the second client, wherein the second client is running on a second AR device of the target second user.

6. The method of claim 5, further comprising: when the permission type in the second permission information is a stop permission, sending a stop display instruction to the second client.

7. The method of claim 5 or 6, wherein after receiving the authorization information of the first user of the first client to the target second user, the method further comprises: identifying an identity of the first user; querying a first permission list to obtain first permission information of the first user, wherein the first permission list comprises a first user identifier and first permission information of the first user, and the first permission information comprises a second permission type and level that the first user can authorize; and in response to the first permission information of the first user matching the second permission information of the target second user sent by the first user, confirming that the authorization information of the first user to the target second user is valid; correspondingly, in response to the valid authorization information, when the permission type in the second permission information is an open permission, upon receiving a digital resource request from a second client of the target second user, obtaining a digital resource corresponding to the permission level and sending the digital resource to the second client.

8. The method of claim 5 or 6, wherein the third permission information comprising permission content corresponding to the second permission level and / or the digital resource is sent to the second client at the same time as the digital resource corresponding to the permission level.

9. The method of claim 8, wherein the permission content in the third permission information is a display duration.

10. A method for displaying an AR scene, applied to a second client in a second AR device of a second user, comprising: generating a second AR space in response to a positioning operation of the second user, and displaying the second AR space on a display screen of the second AR device; requesting a digital resource from a server; receiving a digital resource corresponding to a permission level of the second user sent by the first user from the server, the digital resource corresponding to the permission level of the second user being determined based on authorization information sent by a first client, and the first client being used to apply the method of any one of claims 1-4; and displaying the digital resource in the second AR space.

11. The method of claim 10, further comprising: receiving third permission information sent by the server; and ​ ​ When the digital resource is displayed in the second AR space, a display mode of the digital resource is determined according to the third permission information.

12. The method of claim 11, wherein, When the third permission information includes a display duration, the method further includes: counting time while the digital resource is displayed in the second AR space; and stopping displaying the digital resource in the second AR space in response to the counted time reaching a counted time period, wherein the counted time period is the display duration in the third permission information.

13. An AR scene-based user permission collection and release device applied in a first AR device of a first user, comprising: a first communication module configured to communicate with a server; a first AR scene module configured to generate a first AR space in response to a positioning operation of the first user, and display the first AR space through a display screen of the first AR device; an authorization monitoring module configured to monitor an authorization operation of the first user on a target second user; and an authorization confirmation module connected with the authorization monitoring module, configured to confirm that the authorization is valid when it is detected that a current first AR space includes a second user simulation object corresponding to the authorization operation in response to the authorization operation of the first user on the target second user, and send authorization information of the target second user to the server through the first communication module; the authorization information includes a target second user identifier and second permission information, and the second permission information includes a permission type and / or a level; wherein the authorization monitoring module comprises: an authorization action acquisition unit configured to acquire an authorization action of a user; an authorization type identification unit configured to identify a type of the authorization action; a matching unit connected with the authorization type identification unit, configured to query a motion type and permission matching table to determine second permission information corresponding to the type of the authorization action; and a motion direction identification unit connected with the authorization action acquisition unit, configured to identify a pointing direction of the authorization action in the first AR space; a user identification unit connected with the authorization confirmation module, configured to identify a second user simulation object in the pointing direction of the authorization action in the first AR space to obtain a target second user identifier; an authorization information acquisition unit configured to combine the target second user identifier and the corresponding second permission information into authorization information in response to a confirmation message of the first user. The authorization monitoring module comprises:

14. The apparatus of claim 13, wherein, an authorization information acquisition unit configured to acquire a user permission list in response to a permission query operation of the first user, wherein the user permission list at least includes a user identifier of a second user on site and corresponding second permission information, and acquire authorization information of the target second user by the first user in response to a selection operation of the first user on the target second user in the user permission list; correspondingly, the authorization confirmation module confirms that the authorization is valid when it is detected that the pointing direction of the authorization action in the first AR space corresponds to the second user simulation object. ​ 15. The apparatus of claim 14, wherein, The authorization information obtaining unit further obtains authorization information of a target second user in response to input content of the first user in the first AR device. 16.An AR scene-based user permission collection and release device located at a server, wherein the server communicates with a first client to which the method of any one of claims 1-4 is applied, and the AR scene-based user permission collection and release device comprises: a second communication module configured to communicate with the first client and a second client; an information processing module connected to the second communication module and configured to extract a second user identifier and second permission information including a permission type and / or level from authorization information of the target second user by a first user from the first client; and a data screening module connected to the second communication module and the information processing module and configured to, when the permission type in the second permission information is an open permission, obtain digital resources corresponding to the permission level and send the digital resources to the second client via the second communication module upon receiving a digital resource request from the second client of the target second user, wherein the second client runs on a second AR device of the target second user. 17.The device of claim 16, wherein the information processing module further comprises: an information extraction unit configured to extract a target second user identifier and second permission information from the authorization information; a permission type identification unit connected to the information extraction unit and configured to identify the permission type in the second permission information, and send the second permission information and the target second user identifier to the data screening module when the permission type is an open permission; send a notification to the instruction generation unit when the permission type is a stop permission; and an instruction generation unit connected to the permission type identification unit and configured to generate a stop display instruction based on the notification sent by the permission type identification unit and send the stop display instruction to the second client of the target second user via the second communication module. 18.The device of claim 17, wherein the information extraction unit further extracts a first user identifier, and the information extraction module further comprises an authentication unit connected to the information extraction unit and configured to authenticate whether the first permission of the first user sending the authorization information matches the second permission in the authorization information based on the first user identifier. 19.The device of claim 16, wherein the data screening module further comprises: a resource screening unit configured to obtain digital resources corresponding to the second permission level; and a third permission unit configured to determine third permission information of the second client displaying the digital resources corresponding to the permission level according to the second permission level or the type of the digital resources. 20.An AR scene display device applied to a second AR device of a second user, comprising: a third communication module configured to communicate with a server; ​ ​ a second AR scene module configured to generate a second AR space in response to the positioning operation of the first user, and display the received digital resource in the second AR space according to the received resource notification; and a resource management module connected with the third communication module and the second AR scene module, and configured to request the digital resource from the server through the third communication module; receive and store the digital resource corresponding to the authority level of the second user sent from the server through the third communication module, and send a resource notification to the second AR scene module; wherein the digital resource corresponding to the authority level of the second user is determined based on the authorization information sent from the first client, and the first client is configured to apply the method according to any one of claims 1-4.

21. The apparatus of claim 20, wherein the resource management module comprises: a request unit configured to generate a digital resource request; a resource storage unit configured to receive and store the digital resource corresponding to the authority level of the second user sent from the server, and generate a resource notification to the second AR scene module; and an authority processing unit configured to determine the display mode of the digital resource according to the third authority information when the third authority information sent from the server is received; wherein the third authority information comprises authority content corresponding to the second authority level and / or the type of digital resource.

22. An electronic device comprising a processor and a memory storing computer program instructions; the electronic device implements the AR scene-based user authority collection and release method according to any one of claims 1-4 when the computer program instructions are executed; or implements the AR scene-based user authority collection and release method according to any one of claims 5-9; or implements the AR scene display method according to any one of claims 10-12.

23. A computer readable storage medium storing computer program instructions, the computer program instructions being executed by a processor to implement the AR scene-based user authority collection and release method according to any one of claims 1-4; or implement the AR scene-based user authority collection and release method according to any one of claims 5-9; or implement the AR scene display method according to any one of claims 10-12.

24. A computer program product comprising computer program instructions, the computer program instructions being executed by a processor to implement the AR scene-based user authority collection and release method according to any one of claims 1-4; or implement the AR scene-based user authority collection and release method according to any one of claims 5-9; or implement the AR scene display method according to any one of claims 10-12. 25.An AR device comprising a processor, a memory, a display screen and a camera, wherein the memory has stored computer program instructions, and the processor implements the AR scene-based user permission collection and release method according to any one of claims 1-4 or the AR scene-based presentation method according to any one of claims 10-12 when executing the computer program instructions stored in the memory.

Images