Ar interaction method, device, electronic device and computer readable storage medium

Abstract

To provide an AR interaction method enabling finding valuable information in a constant time period to improve communication efficiency.SOLUTION: An AR interaction method comprises the steps of: In response to a real scene starting command output from a first user, displaying an AR real scene space in a graphical user interface and displaying, in a floating manner, a virtual object setting control; in response to an additional operation to the virtual object setting control by the first user, adding, into the AR real scene space, a first virtual object which is controlled by the first user and positioned in the vicinity of the first user; and receiving an interaction command which is output to the first virtual object from a second user having approached the first virtual object, then displaying a prompt message corresponding to the interaction command output from the second user on the graphical user interface, so that the first user performs information interaction with the second user according to the prompt message corresponding to the interaction command.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present application relates to the field of AR technology, and in particular to an AR interaction method, device, electronic device, and computer-readable storage medium. [Background technology]

[0002] With the spread of the Internet, the amount of data provided by the Internet is becoming larger and larger. Since people have limited time, how to find useful information for people from this huge amount of data is becoming important and is also a topic of interest for researchers.

[0003] In the related art, people usually use various information delivery apps such as news browsing apps, shopping apps, etc. In order to save users' time, these apps usually deliver to users content calculated by big data algorithms (content calculated by big data algorithms is usually considered to be content that users are interested in). For example, they classify all users according to their identity, and determine the information to be delivered to a target user according to the browsing content of other users belonging to the same type as the target user.

[0004] However, in practice, such a distribution method is not applicable in all cases. Summary of the Invention [Problem to be solved by the invention]

[0005] In view of this, an object of the present application is to provide an AR interaction method, device, electronic device, and computer-readable storage medium for improving the accuracy and efficiency of information delivery. [Means for solving the problem]

[0006] In a first aspect, an embodiment of the present application provides an AR interaction method, which includes the steps of: in response to a live-action activation command issued by a first user, displaying at least a part of an AR live-action space formed by superimposing a live-action image obtained by real-time shooting and a preset AR virtual object on a graphical user interface, and floatingly displaying a virtual object setting control on the graphical user interface; in response to an add operation on the virtual object setting control by the first user, adding a first virtual object located in the vicinity of the first user controlled by the first user to the AR live-action space; and after receiving an interaction command issued to the first virtual object from a second user approaching the first virtual object, displaying a presentation message corresponding to the interaction command issued by the second user on the graphical user interface, and the first user performing information interaction with the second user according to the presentation message corresponding to the interaction command.

[0007] In a first aspect, an embodiment of the present application provides a first possible embodiment of the first aspect, wherein the first virtual object is a virtual character controlled by a first user, and the method further includes a step of entering an information interaction interface for direct communication between the first user and a second user in response to a first response operation by the first user to the presentation message, and / or a step of floatingly displaying a simple interaction window in a graphical user interface for direct communication between the first user and a second user in response to a second response operation by the first user to the presentation message.

[0008] In a first possible embodiment of the first aspect, an embodiment of the present application provides a second possible embodiment of the first aspect, in which attribute information of a first virtual object is displayed in the vicinity of the first virtual object, and the attribute information of the first virtual object is determined based on one or more of information input by the first user, historical location information of the first user, historical trajectory information of the first user, and identity information of the first user.

[0009] In a first aspect, an embodiment of the present application provides a third possible embodiment of the first aspect, in which the step of adding a first virtual object controlled by a first user to the real-world space of the AR in response to an add operation on a virtual object setting control by a first user includes: a step of floating displaying the first virtual object waiting to be added in a graphical user interface in response to an add operation on a virtual object setting control by the first user; a step of controlling the first virtual object waiting to be added to move in the real-world space of the AR in response to a virtual object movement command issued by the first user; and a step of adding the first virtual object to the real-world space of the AR based on a current position in the real-world space of the first virtual object waiting to be added in response to a virtual object placement command issued by the first user.

[0010] In a third possible embodiment of the first aspect, an embodiment of the present application provides a fourth possible embodiment of the first aspect, in which the step of controlling in response to a virtual object movement command issued by the first user to move the first virtual object waiting to be added in the real-world space of the AR includes: controlling in response to a directional control command issued by the first user to a directional movement control in a virtual object setting control, to move the first virtual object in the real-world space of the AR; and / or controlling in response to a position selection command issued by the first user on a graphical user interface, to move the first virtual object in the real-world space of the AR.

[0011] In a first aspect, an embodiment of the present application provides a fifth possible embodiment of the first aspect, wherein the method further includes: in response to a radar activation command issued by a first user, displaying a radar scan image on which a mark of an AR virtual object is displayed on a graphical user interface, wherein a display position of the mark of the AR virtual object is determined based on a current position of the AR virtual object and a current position of the first user; in response to a position movement by the first user, calculating a relative position between the AR virtual object and the first user based on the current position of the AR virtual object and the current position of the first user; and updating the radar scan image according to the relative position.

[0012] In a fifth possible embodiment of the first aspect, examples of the present application provide a sixth possible embodiment of the first aspect, wherein a maximum display range of the radar scan image is greater than a maximum display range of the real-world space of the AR.

[0013] In a first aspect, the examples of the present application provide a seventh possible embodiment of the first aspect, wherein the method further includes allowing the second user to issue an interaction command to the first virtual object in response to a distance between the second user and the first virtual object being less than a predetermined value.

[0014] In a first aspect, the embodiment of the present application provides an eighth possible embodiment of the first aspect, wherein the first virtual object is a group communication area controlled by a first user, and the method further includes: in response to a third response operation by the first user to the presented message, entering a group chat interaction interface; and / or in response to a fourth response operation by the first user to the presented message, floating a group chat interaction window in the graphical user interface.

[0015] In an eighth possible embodiment of the first aspect, an embodiment of the present application provides a ninth possible embodiment of the first aspect, in which attribute information of the group communication area is displayed in the vicinity of the group communication area, and the attribute information of the first virtual object is introduction information of the group chat content input by the first user.

[0016] In a first aspect, the examples of the present application provide a tenth possible embodiment of the first aspect, wherein a real-time position of the first virtual object is updated based on a real-time position of the first user, causing the first virtual object to move to follow the first user, or the position of the first virtual object is always determined based on a position selected by the first user when adding the first virtual object to the AR real-world space.

[0017] In a first aspect, the embodiments of the present application provide an eleventh possible embodiment of the first aspect, wherein a position of the first virtual object is always determined based on a position selected by a first user when adding the first virtual object to the AR real-world space, and the method further includes: in response to a distance between the first virtual object and the first user being greater than a predetermined distance, removing the first virtual object from the AR real-world space; or in response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space; or in response to no interaction command to the first virtual object from another user until the predetermined time has elapsed, removing the first virtual object from the AR real-world space.

[0018] In a second aspect, an embodiment of the present application further provides another AR interaction method, which includes the steps of: in response to a live-action activation command issued by a second user, displaying at least a part of an AR live-action space including a first virtual object on a graphical user interface, the AR live-action space being formed by superimposing a live-action image obtained by shooting and a preset AR virtual object; and floatingly displaying a virtual object interaction control on the graphical user interface, the position of the first virtual object being determined according to a position at which the first user adds the first virtual object to the AR live-action space; calculating a distance between the second user and the first virtual object based on position information of the second user and position information of the first virtual object obtained in real time; and after the second user approaches the first virtual object, in response to an interaction command issued by the second user to the first virtual object, sending a prompt message corresponding to the interaction command to the first user, and the first user performing information interaction with the second user according to the prompt message corresponding to the interaction command.

[0019] In a second aspect, an embodiment of the present application provides a first possible embodiment of the second aspect, in which the first virtual object is a virtual character controlled by a first user, and after the first user performs a first response operation to the presented message, enters an information interaction interface for direct communication between the first user and a second user, and / or floats a simple interaction window in a graphical user interface for direct communication between the first user and a second user after the first user performs a second response operation to the presented message.

[0020] In a first possible embodiment of the second aspect, an embodiment of the present application provides a second possible embodiment of the second aspect, in which attribute information of a first virtual object is displayed in the vicinity of the first virtual object, and the attribute information of the first virtual object is determined based on one or more of information input by the first user, historical location information of the first user, historical trajectory information of the first user, and identity information of the first user.

[0021] In a second aspect, the embodiments of the present application provide a third possible embodiment of the second aspect, wherein the method further includes: in response to a radar activation command issued by a second user, displaying a radar scan image on which a mark of an AR virtual object is displayed on a graphical user interface, wherein a display position of the mark of the AR virtual object is determined based on a current position of the AR virtual object and a current position of the second user; in response to a position movement by the second user, calculating a relative position between the AR virtual object and the second user based on the current position of the AR virtual object and the current position of the second user; and updating the radar scan image according to the relative position.

[0022] In a third possible embodiment of the second aspect, examples of the present application provide a fourth possible embodiment of the second aspect, wherein a maximum display range of the radar scan image is greater than a maximum display range of the real-world space of the AR.

[0023] In a second aspect, examples of the present application provide a fifth possible embodiment of the second aspect, wherein the method further includes allowing the second user to issue an interaction command to the first virtual object in response to a distance between the second user and the first virtual object being less than a predetermined value.

[0024] In a second aspect, the present application provides a sixth possible embodiment of the second aspect, in which the step of responding to an interaction command issued to the first virtual object by a second user approaching the first virtual object and sending a prompting message corresponding to the interaction command to the first user includes the step of displaying the prompting message of the first virtual object on a graphical user interface after the second user approaches the first virtual object, and the prompting message represents an interaction command that the second user can issue to the first virtual object.

[0025] In a second aspect, the embodiment of the present application provides a seventh possible embodiment of the second aspect, in which the first virtual object is a group communication area controlled by a first user, and the method further includes: entering a group chat interaction interface after the first user performs a third response operation to the suggested message, and / or floating displaying a group chat interaction window in a graphical user interface after the first user performs a fourth response operation to the suggested message.

[0026] In a seventh possible embodiment of the second aspect, the embodiment of the present application provides an eighth possible embodiment of the second aspect, in which attribute information of the group communication area is displayed in the vicinity of the group communication area, and the attribute information of the first virtual object is introduction information of the group chat content input by the first user.

[0027] In a second aspect, the embodiments of the present application provide a ninth possible embodiment of the second aspect, in which a real-time position of the first virtual object is updated based on a real-time position of the first user, causing the first virtual object to move to follow the first user, or the position of the first virtual object is always determined based on a position selected by the first user when adding the first virtual object to the AR real-world space.

[0028] In a second aspect, the embodiments of the present application provide a tenth possible embodiment of the second aspect, in which a position of the first virtual object is always determined based on a position selected by a first user when adding the first virtual object to the AR real-world space, and the method further includes: in response to a distance between the first virtual object and the first user being greater than a predetermined distance, removing the first virtual object from the AR real-world space; or in response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space; or in response to no interaction command to the first virtual object from another user until the predetermined time has elapsed, removing the first virtual object from the AR real-world space.

[0029] In a third aspect, an embodiment of the present application further provides an AR interaction device, which includes: a first display module that, in response to a live-action activation command issued by a first user, displays at least a part of an AR live-action space formed by superimposing a live-action image obtained by real-time shooting and a preset AR virtual object on a graphical user interface, and displays a virtual object setting control in a floating manner on the graphical user interface; a first addition module that, in response to an addition operation on the virtual object setting control by the first user, adds a first virtual object located in the vicinity of the first user controlled by the first user to the AR live-action space; and a first interaction module that, after receiving an interaction command issued to the first virtual object from a second user approaching the first virtual object, displays a presentation message corresponding to the interaction command issued by the second user on the graphical user interface, and allows the first user to perform information interaction with the second user based on the presentation message corresponding to the interaction command.

[0030] In a third aspect, an embodiment of the present application provides a first possible embodiment of the third aspect, in which the first virtual object is a virtual character controlled by a first user, and the device further includes: a first response module that responds to a first response operation by the first user to the presented message and enters an information interaction interface for direct communication between the first user and a second user; and / or a second display module that responds to a second response operation by the first user to the presented message and displays a floating simplified interaction window in a graphical user interface for direct communication between the first user and a second user.

[0031] In a first possible embodiment of the third aspect, an embodiment of the present application provides a second possible embodiment of the third aspect, in which attribute information of a first virtual object is displayed in the vicinity of the first virtual object, and the attribute information of the first virtual object is determined based on one or more of information input by the first user, historical location information of the first user, historical trajectory information of the first user, and identity information of the first user.

[0032] In a third aspect, the embodiment of the present application provides a third possible embodiment of the third aspect, in which the first adding module adds a first virtual object controlled by the first user to the real-world space of the AR in response to an add operation on a virtual object setting control by a first user, specifically, in response to an add operation on a virtual object setting control by the first user, displays the first virtual object waiting to be added in a floating state on a graphical user interface, in response to a virtual object movement command issued by the first user, controls the first virtual object waiting to be added to be moved in the real-world space of the AR, and in response to a virtual object placement command issued by the first user, adds the first virtual object to the real-world space of the AR based on a current position of the first virtual object waiting to be added in the real-world space of the AR.

[0033] In a third possible embodiment of the third aspect, an embodiment of the present application provides a fourth possible embodiment of the third aspect, in which the first additional module controls to move a first virtual object waiting to be added in the real-world space of the AR in response to a virtual object movement command issued by a first user, specifically controls to move the first virtual object in the real-world space of the AR in response to a directional control command issued by the first user to a directional movement control in a virtual object setting control, and / or controls to move the first virtual object in the real-world space of the AR in response to a position selection command issued by the first user on a graphical user interface.

[0034] In a third aspect, the embodiments of the present application provide a fifth possible embodiment of the third aspect, in which the device further includes: a third display module that, in response to a radar activation command issued by a first user, displays a radar scan image on a graphical user interface, in which a mark of an AR virtual object is displayed, and a display position of the mark of the AR virtual object is determined based on a current position of the AR virtual object and a current position of the first user; a second calculation module that, in response to a position movement by the first user, calculates a relative position between the AR virtual object and the first user based on the current position of the AR virtual object and the current position of the first user; and a first update module that updates the radar scan image according to the relative position.

[0035] In a fifth possible embodiment of the third aspect, examples of the present application provide a sixth possible embodiment of the third aspect, wherein a maximum display range of the radar scan image is greater than a maximum display range of the real-world space of the AR.

[0036] In a third aspect, the present application examples provide a seventh possible embodiment of the third aspect, wherein the device further includes a first command issuing module configured to, in response to a distance between a second user and the first virtual object being less than a predetermined value, allow the second user to issue an interaction command to the first virtual object.

[0037] In a third aspect, the embodiment of the present application provides an eighth possible embodiment of the third aspect, in which the first virtual object is a group communication area controlled by a first user, and the device further includes: a second response module for entering a group chat interaction interface in response to a third response operation by the first user to the presented message, and / or a fourth display module for floatingly displaying a group chat interaction window in a graphical user interface in response to a fourth response operation by the first user to the presented message.

[0038] In an eighth possible embodiment of the third aspect, the embodiment of the present application provides a ninth possible embodiment of the third aspect, in which attribute information of the group communication area is displayed in the vicinity of the group communication area, and the attribute information of the first virtual object is introduction information of the group chat content input by the first user.

[0039] In a third aspect, the examples of the present application provide a tenth possible embodiment of the third aspect, wherein a real-time position of the first virtual object is updated based on a real-time position of the first user, causing the first virtual object to move to follow the first user, or the position of the first virtual object is always determined according to a position selected by the first user when adding the first virtual object to the AR real-world space.

[0040] In a third aspect, the present application provides an eleventh possible embodiment of the third aspect, in which a position of the first virtual object is always determined based on a position selected by a first user when adding the first virtual object to the AR real-world space, and the device further includes: a first deletion module that deletes the first virtual object from the AR real-world space in response to a distance between the first virtual object and the first user being greater than a predetermined distance; or a second deletion module that deletes the first virtual object from the AR real-world space in response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space; or a third deletion module that deletes the first virtual object from the AR real-world space in response to no interaction command for the first virtual object from another user until the predetermined time has elapsed.

[0041] In a fourth aspect, the embodiment of the present application further provides another AR interaction device, which responds to a live-action activation command issued by a second user, and displays at least a part of an AR live-action space including a first virtual object on a graphical user interface, the AR live-action space being formed by superimposing a live-action image obtained by shooting and a preset AR virtual object, and displays a virtual object interaction control in a floating manner on the graphical user interface, and the position of the first virtual object is determined based on the position when the first user adds the first virtual object to the AR live-action space. a second display module determined based on the position information of the second user and the position information of the first virtual object acquired in real time; a first calculation module calculating a distance between the second user and the first virtual object based on the position information of the second user and the position information of the first virtual object acquired in real time; and a second interaction module responding to an interaction command issued by the second user to the first virtual object after the second user approaches the first virtual object, transmitting a presentation message corresponding to the interaction command to the first user, so that the first user performs information interaction with the second user according to the presentation message corresponding to the interaction command.

[0042] In a fourth aspect, an embodiment of the present application provides a first possible embodiment of the fourth aspect, in which the first virtual object is a virtual character controlled by a first user, and after the first user performs a first response operation to the presented message, enters an information interaction interface for direct communication between the first user and a second user, and / or displays a floating simple interaction window in a graphical user interface for direct communication between the first user and a second user after the first user performs a second response operation to the presented message.

[0043] In a first possible embodiment of the fourth aspect, an embodiment of the present application provides a second possible embodiment of the fourth aspect, in which attribute information of a first virtual object is displayed in the vicinity of the first virtual object, and the attribute information of the first virtual object is determined based on one or more of information input by the first user, historical location information of the first user, historical trajectory information of the first user, and identity information of the first user.

[0044] In a fourth aspect, the embodiments of the present application provide a third possible embodiment of the fourth aspect, in which the device further includes: a fifth display module that, in response to a radar activation command issued by a second user, displays a radar scan image on a graphical user interface, in which a mark of an AR virtual object is displayed, and a display position of the mark of the AR virtual object is determined based on a current position of the AR virtual object and a current position of the second user; a third calculation module that, in response to a position movement by the second user, calculates a relative position between the AR virtual object and the second user based on the current position of the AR virtual object and the current position of the second user; and a second update module that updates the radar scan image based on the relative position.

[0045] In a third possible embodiment of the fourth aspect, examples of the present application provide a fourth possible embodiment of the fourth aspect, wherein a maximum display range of the radar scan image is greater than a maximum display range of the real-world space of the AR.

[0046] In a fourth aspect, examples of the present application provide a fifth possible embodiment of the fourth aspect, wherein the device further includes a second command issuing module configured to, in response to a distance between a second user and the first virtual object being less than a predetermined value, allow the second user to issue an interaction command to the first virtual object.

[0047] In a fourth aspect, the embodiment of the present application provides a sixth possible embodiment of the fourth aspect, in which the second interaction module, which responds to an interaction command issued by a second user approaching the first virtual object to the first virtual object and transmits a prompting message corresponding to the interaction command to the first user, specifically displays the prompting message of the first virtual object on a graphical user interface after the second user approaches the first virtual object, and the prompting message represents an interaction command that the second user can issue to the first virtual object.

[0048] In a fourth aspect, the embodiment of the present application provides a seventh possible embodiment of the fourth aspect, in which the first virtual object is a group communication area controlled by a first user, and the device further includes: a third response module for entering a group chat interaction interface after the first user performs a third response operation to the suggested message, and / or a sixth display module for floatingly displaying a group chat interaction window in a graphical user interface after the first user performs a fourth response operation to the suggested message.

[0049] In a seventh possible embodiment of the fourth aspect, the examples of the present application provide an eighth possible embodiment of the fourth aspect, in which attribute information of the group communication area is displayed in the vicinity of the group communication area, and the attribute information of the first virtual object is introduction information of the group chat content input by the first user.

[0050] In a fourth aspect, the present application provides a ninth possible embodiment of the fourth aspect, wherein a real-time position of the first virtual object is updated according to a real-time position of the first user, causing the first virtual object to move to follow the first user, or the position of the first virtual object is always determined based on a position selected by the first user when adding the first virtual object to the AR real-world space.

[0051] In a fourth aspect, the present application provides a tenth possible embodiment of the fourth aspect, in which a position of the first virtual object is always determined based on a position selected by a first user when adding the first virtual object to the AR real-world space, and the device further includes: a fourth deletion module that deletes the first virtual object from the AR real-world space in response to a distance between the first virtual object and the first user being greater than a predetermined distance; or a fifth deletion module that deletes the first virtual object from the AR real-world space in response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space; or a sixth deletion module that deletes the first virtual object from the AR real-world space in response to no interaction command for the first virtual object from another user until the predetermined time has elapsed.

[0052] In a fifth aspect, an embodiment of the present application further provides an electronic device, the electronic device comprising a processor, a memory storing readable commands executable by the processor, and a bus, wherein when the electronic device is operated, the processor communicates with the memory via the bus and executes the readable commands to perform steps according to any possible embodiment of the first or second aspect above.

[0053] In a sixth aspect, an embodiment of the present application further provides a computer readable storage medium storing a computer program which, when executed by a processor, performs steps according to any possible embodiment of the first or second aspect above.

[0054] The embodiments of the present application provide an AR interaction method, device, electronic device, and computer-readable storage medium. A first virtual object is provided in the vicinity of a first user, and the first virtual object is push-notified to a second user in the vicinity of the first virtual object. The second user can see the first virtual object through the smart terminal he is using, and can interact with the first user through the first virtual object. At this time, when the second user issues an interaction command for the first virtual object, a presentation message corresponding to the interaction command is push-notified to the first user, and the first user performs information interaction with the second user through the presentation message. Thus, a push notification aimed at interaction between the first user and the second user is realized. Since the first virtual object is located in the vicinity of the first user, and the second user can communicate with the first user after approaching the first virtual object, the second user is well aware that the first user is in the vicinity. In other words, the first user and the second user are located in the same area and the first user and the second user are paying attention to the same thing, so the interaction between the second user and the first user in this case is accurate. Therefore, the above push notification method contributes to improving the accuracy and efficiency of information delivery.

[0055] In order to make the above objectives, features and advantages of the present application more apparent, preferred embodiments will be described in detail below with reference to the drawings. [Brief description of the drawings]

[0056] In order to more clearly describe the technical solutions of the embodiments of the present application, the drawings necessary for describing the embodiments are briefly described below. The drawings described are only for illustrating some embodiments of the present application, and are not intended to limit the scope. Those skilled in the art can obtain other related drawings based on these drawings without using inventive abilities.

[0057] [Figure 1]1 shows a flowchart of an AR interaction method according to an embodiment of the present application. [Diagram 2] 1 shows a schematic diagram of an AR real-world space displayed on a graphical user interface according to an embodiment of the present application. [Diagram 3] FIG. 2 shows a schematic diagram of displaying a first virtual object in an AR real-world space according to an embodiment of the present application; [Figure 4] 1 shows a schematic diagram of a simple interaction window according to an embodiment of the present application; [Diagram 5] FIG. 2 illustrates a schematic diagram of a first virtual object in a floating state waiting to be added displayed on a graphical user interface according to an embodiment of the present application; [Figure 6] 1 shows a flowchart of another AR interaction method according to an embodiment of the present application. [Figure 7] 1 shows a schematic diagram of displaying a first virtual object and a second virtual object of a second user in an AR real-world space according to an embodiment of the present application; [Figure 8] 1 shows a schematic diagram of a radar scan image according to an embodiment of the present application. [Figure 9] 1 shows a schematic diagram of a planar search interface according to an embodiment of the present application; [Figure 10] 1 shows a schematic diagram of another AR real-world space according to an embodiment of the present application. [Figure 11] FIG. 13 illustrates a schematic diagram of a first virtual object in another waiting-to-be-added state according to an embodiment of the present application; [Figure 12] 1 illustrates a schematic diagram of a paper ball toss control, a greeting control, a like control, and a comment control according to an embodiment of the present application. [Figure 13] FIG. 2 illustrates a schematic diagram of hitting a first virtual object with a virtual hammer according to an embodiment of the present application. [Figure 14] 1 shows a structural schematic diagram of an AR interaction device according to an embodiment of the present application; [Figure 15] FIG. 2 shows a structural schematic diagram of another AR interaction device according to an embodiment of the present application. [Figure 16]1 shows a structural schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0058] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the embodiments of the present application will be described clearly and completely below with reference to the drawings. Of course, the described embodiments are only some of the embodiments of the present application, and do not include all of the embodiments. The components in the embodiments of the present application shown in the drawings can be arranged and designed in various arrangement methods. Therefore, the detailed description of the embodiments of the present application shown in the drawings below only shows selected embodiments of the present application, and does not limit the scope of the present application to be protected. All other embodiments obtained by those skilled in the art based on the embodiments of the present application without using inventive abilities are all within the scope of protection of the present application.

[0059] With the advancement of science and technology, people can communicate with the Internet (other people and AI) through various software, and can save time and improve work efficiency through remote communication realized by these software. However, people always have problems with communication efficiency. Since everyone has the same amount of free time, it is important to find more valuable information within a certain amount of time. Big data algorithms can push notifications of content that may interest users and other users, but if you expect to communicate with other users, you have no choice but to add friends first and then communicate with them. Some software provides a function like bottle mail, that is, you send a message to a random user yourself and wait for a reply from that user. This type of communication method does not require adding friends, but it is too random and therefore inefficient.

[0060] It should be noted in advance that the execution subject of the proposal of the present application may be a system consisting of a first smart terminal owned by a first user, a second smart terminal owned by a second user, and a server, or may be one smart terminal that the first user and the second user can use by logging in to their own accounts. In addition, the execution subject of the first embodiment may be the first smart terminal owned by the first user, and the execution subject of the second embodiment may be the second smart terminal owned by the second user. Here, the smart terminal may be a mobile smart terminal such as a mobile phone or a head-mounted AR (Augmented Reality) device (such as AR glasses).

[0061] In view of the above problems, embodiments of the present application provide an AR interaction method, an apparatus, an electronic device, and a computer-readable storage medium, which are described below with reference to the embodiments.

[0062] Example 1

[0063] In order to facilitate understanding of this embodiment, the AR interaction method disclosed in the embodiment of this application will be described in detail first. Figure 1 shows a flowchart of the AR interaction method according to the embodiment of this application. As shown in Figure 1, it includes the following steps:

[0064] S101: In response to a live-action start command issued by a first user, at least a portion of an AR live-action space formed by superimposing a live-action image captured in real time on a preset AR virtual object is displayed on a graphical user interface, and a virtual object setting control is displayed in a floating manner on the graphical user interface.

[0065] S102: In response to an addition operation on the virtual object setting control by the first user, a first virtual object controlled by the first user and located in the vicinity is added to the real-world space of the AR.

[0066] S103: After receiving an interaction command issued to the first virtual object from a second user who approaches the first virtual object, a prompt message corresponding to the interaction command issued by the second user is displayed on a graphical user interface, and the first user performs information interaction with the second user based on the prompt message corresponding to the interaction command.

[0067] In step S101, the first user can issue a live-action start command by any means. This live-action start command can be issued by means of a physical button, voice control, a virtual button, gaze control, a gesture command, or the like. Here, the physical button refers to a mechanical button provided on a smart terminal, such as a press button, a toggle button, or the like, which issues a command by physically displacing the button. Voice control is a method in which a user issues a command by speaking. For example, a user can issue a live-action start command by speaking "start AR mode". Of course, other contents may be used, and the specific contents are set in advance. A virtual button is a button that can only be displayed on a terminal (or may not be displayed in some cases). The user issues a live-action start command by tapping the virtual button, for example, by touch. Gaze control is a method in which a gaze sensor detects the movement of the user's gaze and issues a command. There are many other methods for issuing a live-action start command, which will not be described here.

[0068] Virtual buttons are usually used in handheld mobile terminals such as mobile phones. Gaze control is usually used in head-mounted mobile terminals such as AR glasses. Since the AR glasses and mobile phones can be used online, users can issue live action activation commands in various ways during use. In other words, the implementation subject of this solution may be a handheld mobile terminal, a head-mounted mobile terminal, or a system composed of a handheld mobile terminal and a head-mounted mobile terminal.

[0069] When a live-action activation command is issued, the live-action space of the AR is displayed on the graphical user interface. Since AR technology is a technology for blending virtual information with the real world, that is, a technology for overlaying virtual objects on the real world, only a part of the live-action space of the AR can be displayed. The graphical user interface also displays a virtual object setting control, which is usually always displayed on the live-action image so that the user can see and operate the virtual object setting control.

[0070] 2 is a schematic diagram of an AR real-world space displayed in a graphical user interface according to an embodiment of the present application. In the AR real-world space shown in FIG. 2, only real-world images and virtual object setting controls are displayed.

[0071] Predefined AR virtual objects (not shown in FIG. 2) in the real-life AR space generally come from two sources: user-defined and system-defined. User-defined objects may be interactive virtual objects such as ornaments or a first virtual object. System-defined objects are mainly virtual objects that are automatically formed without user-defined objects, such as auxiliary lines (e.g., auxiliary figures such as contour lines and frames to help the user identify real people or objects) and auxiliary information (e.g., text to introduce information about real people or objects to the user).

[0072] The real-life images may be directly captured in real time by the smart terminal, or the smart terminal may be a processing terminal and the image capture terminal may be a remote image capture device that is separate from the smart terminal and interacts with the smart terminal for information / data by wired or wireless means.

[0073] In step S102, the adding operation may be a touch control, a gaze control, a voice control, or a key control. After the first user performs the adding operation on the virtual object setting control, the first virtual object controlled by the first user is added to the real-life space of the AR. After the first virtual object is added to the real-life space of the AR, the first virtual object becomes visible to other users in the real-life space of the AR. FIG. 3 shows a schematic diagram of displaying a first virtual object in the real-life space of the AR according to an embodiment of the present application. As shown in FIG. 3, the first virtual object is a virtual character.

[0074] The first virtual object is provided in the vicinity of the first user, which is the core of this application. "Very close" refers to a position close to the first user, usually several meters to several tens of meters. Usually, "near" refers to a distance at which the user can speak and be heard by others. There are two methods for placing the first virtual object: manual and automatic. In the automatic method, after the user performs an addition operation, the system automatically selects a placement position, such as a position one meter in front of the user, a position one meter behind the user, or a nearby position previously set by the user. In other words, in the automatic placement, the user does not need to select a placement position, and does not need to temporarily edit the displayed attribute information. Manual placement will be described later.

[0075] In addition, the distance is defined by the following method: The real space is classified according to type, and the real space is divided into different regions. The user can place the first virtual object at any position within the region where the first user is currently located.

[0076] The type of area can be determined based on what can be done in that area. Specific types are, for example, beach, exhibition, office area, etc. Of course, each type can be further subdivided. For example, a beach can be divided into a water play area, a beach volleyball area, etc. Similarly, an exhibition can be specifically subdivided into areas with different exhibition contents, etc. Of course, a user can set the range represented by the type (for example, a user can set the entire exhibition area as one area, each booth in the exhibition as one area, or the entire area where the exhibition contents are the same and the exhibition positions are connected as one area), or the system can automatically set it. When automatically setting by the system, it is usually determined whether different areas are classified into one type depending on the relevance of what can be done in different areas. Of course, the size of the area also needs to be taken into consideration. Generally, if an area is too large or too small, it will not be appropriate, and one area is usually set to tens of square meters to hundreds of square meters. In other words, when the system automatically sets the area, the size of the area is a factor that must be considered, and if the area is too large or too small, there is no point in setting the area. If the area size is appropriate, it is determined whether multiple small areas can be combined into one large area (small areas that can make up a large area are adjacent to each other) mainly based on the relevance of what can be done with different small areas. If it is determined that multiple small areas can be combined into a large area, the user can place a first virtual object at any position within the large area.

[0077] At least the first virtual object is provided in the vicinity of the first user. The first virtual object may remain stationary after being provided, or may move following the first user.

[0078] The first virtual object may have various forms, specifically, two types: a form set by the first user and a form automatically set by the system. In the case of a form set by the first user, it may be any form, such as a character, a virtual human, or something visible in daily life. In the case of a form automatically set by the system, a choice is provided to the user based on the user's gender or a real image, or it is automatically generated.

[0079] In step S103, if another user (e.g., a second user) wants to communicate with the first user, he or she first approaches the first virtual object, and then issues an interaction command to the first virtual object, and a corresponding prompting message is displayed on the graphical user interface. In this case, if the first user also wants to communicate with the second user, he or she can start an information interaction with the second user. This information interaction refers to a temporary information interaction interface, friend addition, etc.

[0080] Here, due to the system restrictions, when the second user approaches the first virtual object, an interaction command can be issued. As a specific implementation method, it may be configured to request the second user to approach the first virtual object before sending the interaction command, and if the distance is too far, to present to the second user that the current distance is too far; if the distance between the second user and the first virtual object is too far, the user may be allowed to issue an interaction command, and when the distance becomes close enough, a presentation message may be displayed to the first user. In an extreme case, when the second user is far from the first virtual object, it may be configured to make the first virtual object invisible in the real-life space of the AR. Specifically, when implementing this application, a sufficient presentation message is given to the second user to inform the second user whether the second user is close enough to the first virtual object. For example, when the second user is far from the first virtual object, the entire image of the first virtual object may not be clearly visible (for example, the image of the first virtual object that is seen may be black and white, with only an outline, or without attribute information regarding the first virtual object), and the entire image of the first virtual object may be visible only when the second user is close to the first virtual object. In this way, the user is informed of when an interaction command can be issued. That is, in the method according to the present application, in response to the distance between the second user and the first virtual object being less than a predetermined value, the second user is permitted to issue an interaction command to the first virtual object.

[0081] The technical solution according to the present application provides a first virtual object in the vicinity of a first user, so that a second user can interact with the first user through the first virtual object. Such a method has at least the following advantages: 1. When the first virtual object is located in the vicinity of the first user and the second user approaches the first virtual object, the second user can interact with the first user, so the second user knows that the first user is in the vicinity, in other words, the first user and the second user are located in the same area. This indicates that the first user and the second user pay attention to the same thing, so the interaction between the second user and the first user is precise, thereby improving the precision of user interaction. 2. The first user adding the first virtual object in its vicinity represents that the first user wants to interact with other users. This is because the first user may want someone to help him or the first user may want to team up with other users to complete a certain event (an event that requires teaming up to complete). Therefore, the interaction between the second user and the first user in this case can accurately meet the needs of the first user. 3. Many introverted users are not good at face-to-face communication with other users, so the first user first interacts with the second user before communicating with other users face-to-face, thereby providing a mitigating measure for face-to-face communication. In this way, the interaction between the first user and other users is made easier, improving the interaction frequency of the entire user group and accelerating the spread of information. 4. This application adopts augmented reality technology as the basis of the technical solution, because it takes into consideration that AR technology is linked to reality. Before interacting with the first user, the second user can check the situation of the user about to interact, the environmental situation, and information that can be determined based on the environmental situation (for example, whether the difficulties encountered by the first user can be solved by himself, whether other users have already communicated with the first user, etc.) by observing the users around the first virtual object.This allows the second user to determine whether or not he or she wants to communicate with the first user, improving the accuracy of communication.

[0082] In the process of executing steps S101-S103, the first user and the second user may be in a friend-registered state (both users have added each other as friends in advance) or may not be in a friend-registered state (both users have not added each other as friends in advance). In other words, when executing these three steps, the friend registration state of the users does not affect the realization of the entire steps.

[0083] Based on the above proposal, if the first virtual object is a virtual character controlled by a first user, the method further includes the following steps:

[0084] S1041: In response to a first response operation by a first user to the presented message, enter an information interaction interface for direct communication between the first user and a second user, and / or S1042: In response to a second response operation by the first user to the presented message, display a floating simplified interaction window in the graphical user interface for direct communication between the first user and the second user.

[0085] Here, the first virtual object being a virtual character controlled by the first user indicates that the first user expects one-to-one communication. The specific form of the virtual character may be an animated human, a virtual human, or an animated character (e.g., an anime character, a cartoon character, or a game character).

[0086] Step S1041 shows that after the first user performs the first response operation, the first user enters an information interaction interface for private chat. This information interaction interface is overlaid on the originally displayed AR real-world space, and in some cases, the information interaction interface occupies the entire graphical user interface. In other words, after entering the information interaction interface, the first user only performs information interaction without operating on the AR real-world space.

[0087] Information interaction interfaces allow users to send and receive content such as text, images, and voice messages.

[0088] Step S1042 shows that after the first user performs the second response operation, the first user enters an information interaction interface for private chat. This information interaction interface uses a simple interaction window that is not overlaid on the originally displayed AR real-world space, but is displayed floating on the originally displayed AR real-world space. FIG. 4 shows a schematic diagram of a simple interaction window according to an embodiment of the present application. As shown in FIG. 4, the area of ​​this simple interaction window is smaller than the area of ​​the graphical user interface. In other words, the simple interaction window does not completely cover the image of the AR real-world space displayed on the graphical user interface.

[0089] Instead of the above interaction methods, there are other interaction methods. For example, when the first user performs a call operation on the presented message, the first user can directly talk to the second user. Also, for example, when the first user performs a friend addition operation on the presented message, the first user can send a friend request to the second user.

[0090] Also, for example, a paper ball control is displayed in the graphical user interface, and this paper ball control may be constantly displayed in the AR live-action image, or may be hidden when not in use. When a first user executes an operation to operate the paper ball control in response to a presented message, the contents of the paper ball become editable, and the first user can throw the paper ball having the edited information to a second user. The second user can see the edited information in the paper ball, and can communicate with the first user through the paper ball.

[0091] A greeting control is also displayed on the graphical user interface, and the greeting control may be constantly displayed on the AR live-action image, or may be hidden when not in use. The first user can perform a greeting operation on the presented message. Specifically, the first user can greet the virtual character of the second user by operating the greeting control. For example, the greeting control may be a virtual hammer control. When the first user operates the virtual hammer control on the virtual character of the second user, the virtual character of the second user is hit by the virtual hammer and reacts accordingly.

[0092] Furthermore, in order to allow the second user to more accurately determine whether to communicate with the first user, attribute information of the first virtual object is displayed near the first virtual object. The attribute information of the first virtual object is determined based on one or more of information input by the first user, historical location information of the first user, historical trajectory information of the first user, and identity information of the first user.

[0093] Here, the displayed attribute information clearly indicates that it is related to the first virtual object. For example, in order to indicate which first virtual object the attribute information is intended to describe, it is possible to display the attribute information together with an arrow pointing to the owner of the attribute information.

[0094] The information entered by the first user is either pre-entered by the user or entered in real time (the user can modify the displayed attribute information at any time). The first user can enter information about the next action to be taken (next action content), such as difficulties encountered at the current location or what the first user wants to do, or a self-introduction.

[0095] The first user's historical location information indicates locations the first user has reached in the past, and the first user's historical trajectory information indicates the first user's past travel routes, thereby enabling the second user to determine whether the first user has had a similar experience to the second user.

[0096] The identity information of the first user is personal information indicating the first user's occupation, gender, age, etc. This information can be automatically extracted by the system.

[0097] In this embodiment, the first user can set a state of the first virtual object. After the state setting is completed, the state of the first virtual object set by the first user is displayed near the first virtual object.

[0098] In one possible embodiment, execution of step S102 of adding a first virtual object controlled by the first user to the real-world space of the AR in response to an add operation on a virtual object setting control by the first user is realized as follows.

[0099] S1021: In response to an addition operation on a virtual object setting control by a first user, a first virtual object waiting to be added is displayed in a floating state on the graphical user interface.

[0100] S1022: In response to a virtual object movement command issued by the first user, the first virtual object waiting to be added is controlled to be moved in the real-world space of the AR.

[0101] S1023: In response to a virtual object placement command issued by the first user, the first virtual object is added to the real-world space of the AR based on a current position in the real-world space of the AR of the first virtual object waiting to be added.

[0102] 5 is a schematic diagram showing a floating display of a first virtual object waiting to be added on a graphical user interface according to an embodiment of the present application. In step S1021, as shown in FIG. 5, when a user performs an add operation on a virtual object setting control, the first virtual object waiting to be added is displayed at an initial position on the graphical user interface. The first virtual object waiting to be added may be displayed in a virtual image state, a bubble wrap state, or another incomplete state to inform the user that it is currently waiting to be added.

[0103] In step S1022, as shown in FIG. 5, the user can control the first virtual object waiting to be added to be moved in the currently displayed real-world space of the AR by issuing a virtual object movement command, thereby selecting where to place the first virtual object.

[0104] In step S1023, after the first user determines the placement position, the first user issues a virtual object placement command, and then the system adds the first virtual object to the AR real-world space according to the position currently selected by the user.

[0105] After the first virtual object is added to the AR real-world space, users who enter another AR real-world space can see the first virtual object.

[0106] Based on the above proposal, step S1022 of controlling the first virtual object waiting to be added to be moved in the real-world space of the AR in response to a virtual object movement command issued by the first user may be executed as follows.

[0107] S10221: In response to a directional control command issued by the first user on a directional movement control in a virtual object setting control, control the first virtual object to move in the real-world space of the AR, and / or S10222: In response to a position selection command issued by the first user on a graphical user interface, control the first virtual object to move in the real-world space of the AR.

[0108] In step S10221, as shown in FIG. 5, the direction control command is a drag operation, and the direction movement control is composed of a dragged control and a draggable area. If no command is issued to this direction control control, the dragged control in this direction control control is located at the center of the draggable area. If it is necessary to control the first virtual object to move in the real-world space of the AR, the first user drags the dragged control in the draggable area and controls the drag direction and drag distance of the dragged control to move the first virtual object in the real-world space of the AR. For example, when the first user drags the dragged control to the left, the first user controls the first virtual object to move to the left in the real-world space of the AR.

[0109] In step S10222, the first virtual object is controlled to move to the position selected by the first user in the graphical user interface in the real-world space of the AR, with the position selected by the first user in the graphical user interface being the movement position indicated by the position selection command. When the first user performs a slide operation in the graphical user interface, the first virtual object is controlled to move in the real-world space of the AR according to the slide trajectory in accordance with the slide trajectory.

[0110] In this embodiment, in the process of controlling the first user to move the first virtual object in the real-life space of the AR, if there are virtual objects of other users around the first user but are not displayed in the graphical user interface, a direction instruction control for instructing the moving direction of a device (e.g., a smart terminal) for taking a real-life image of the first user is displayed in the graphical user interface. When the first user moves the device for taking a real-life image according to the direction indicated by the direction instruction control, the virtual objects of other users around the first user can be displayed in the graphical user interface.

[0111] Because the part of the AR real-world space displayed in the graphical user interface is only a part of the whole AR real-world space, it is difficult for the user to see the whole virtual object through the part of the AR real-world space displayed. Therefore, the radar function is also added in this application. That is, the method according to this application further includes the following steps:

[0112] S1051: In response to a radar activation command issued by a first user, a radar scan image in which a mark of an AR virtual object is displayed is displayed on a graphical user interface. The display position of the mark of the AR virtual object is determined based on a current position of the AR virtual object and a current position of the first user.

[0113] S1052: In response to a positional movement by the first user, a relative position between the AR virtual object and the first user is calculated based on the current position of the AR virtual object and the current position of the first user.

[0114] S1053: Update the radar scan image according to the relative position.

[0115] In step S1051, the radar scan image is displayed in two ways. The first display method is to overlay the currently displayed part of the real-world space of the AR with the radar scan image, and the second display method is to display the radar scan image floating on the currently displayed part of the real-world space of the AR. In the first display method, it can be understood as jumping directly from the current interface to the interface of the radar scan image. The mark of the AR virtual object displayed on the radar scan image is usually a schematic diagram, and this AR virtual object may be the first virtual object described above, or may be an AR virtual object added by another user or the system.

[0116] Here, virtual objects of AR will be described. There are three types of virtual objects of AR: virtual objects of decorative AR, virtual objects of user interaction AR, and virtual objects of system interaction AR. A virtual object of decorative AR refers to a virtual object of AR that cannot interact with a user. Such virtual objects mainly play a decorative role or a presentation role, such as a tree that cannot interact with a user and an arrow that points in a direction (guiding the user's movement direction). A virtual object of user interaction AR is, for example, a first virtual object that different users can directly interact with. A virtual object of system interaction AR refers to a virtual object that allows a user to interact with a system, such as a treasure chest that can be opened to enter a lottery and a virtual pet that can be conversed with, that is, interacts with the system.

[0117] In addition to the AR virtual object, the radar scan image can also display the positions of other users and the relationship between the AR virtual object and the user. For example, it can be expressed by color. In short, the target user and the virtual object added by the target user are displayed similarly in the radar scan image. For example, the attribute information of the icon of the virtual object added by the target user and the icon of the target user are similar. For example, at least one of the color, shape, and structure of the icon is the same.

[0118] The display positions of the AR virtual object and the user in the radar scan image are determined by each of them and the current position of the first user. Here, since the positions of the AR virtual object, the user, and the first user may be different at different times, the current display positions of the AR virtual object, the user, and the first user in the radar scan image are determined by the current positions of the AR virtual object and the first user and the current positions of the user and the first user.

[0119] The purpose of adding the radar scan image is to provide another efficient observation method other than observing the AR virtual object with the naked eye through the partial AR real-life space displayed on the graphical user interface. Therefore, the maximum display range of the radar scan image is set to be larger than the maximum display range of the AR real-life space. Generally, AR virtual objects and users within a range of 300 to 1000 meters around can be displayed on the radar scan image, and the AR real-life space displayed on the graphical user interface is usually only several tens of meters (designed with the problem of information overlay in mind). Thus, the user can roughly grasp the position of other users or AR virtual objects on the radar scan image, move toward a specified target (other users or AR virtual objects), and when approaching the specified target (within several tens of meters from the target), observe the target through the AR real-life space displayed on the graphical user interface.

[0120] In order to increase the amount of information that can be provided by the radar scan image, it is also possible to display target attribute information on the radar scan image. For specific details of the attribute information, please refer to the above description.

[0121] One possible embodiment includes allowing the second user to issue an interaction command to the first virtual object in response to the distance between the second user and the first virtual object being less than a predetermined value, and not allowing the second user to issue an interaction command to the first virtual object if the distance between the second user and the first virtual object is not less than (or greater than) the predetermined value.

[0122] In one possible embodiment, when the first virtual object is a group communication area controlled by the first user, the present application further includes the following steps:

[0123] S1061: In response to a third response operation by the first user to the posted message, enter a group chat interaction interface; and / or S1062: In response to a fourth response operation by the first user to the posted message, float a group chat interaction window in the graphical user interface.

[0124] The fact that the first virtual object is a group communication area controlled by the first user indicates that the first user wants to perform one-to-many communication. The specific form of the group communication area can be an area occupied by virtual items such as a virtual sofa, a virtual building, etc. A second user or other users who discover this group communication area can enter this group communication area by entering directly or by applying to enter. When a user enters this group communication area, a presentation message is displayed to the first user to indicate that the user has entered a group chat. The group communication area allows multiple users to enter.

[0125] In step S1061, if the first user performs the third response operation, the first user can enter a group chat interaction interface. This group chat interaction interface is overlaid on the originally displayed AR real-world space, and in some cases, the group chat interaction interface can occupy the entire graphical user interface. In other words, when the first user enters the group chat interaction interface, the first user can perform information interaction with each user in the group communication area without operating on the AR real-world space. In the group chat interaction interface, content such as text, images, and voice messages can be sent and received between multiple users.

[0126] In step S1062, if the first user performs the fourth response operation, the first user can enter the group chat interaction window of the information group chat. This group chat interaction window is not overlaid on the originally displayed AR real-world space, but uses a group chat interaction window that is displayed floating on the originally displayed AR real-world space. The area of ​​this group chat interaction window is smaller than the area of ​​the graphical user interface. In other words, the group chat interaction window does not completely cover the image of the AR real-world space displayed on the graphical user interface.

[0127] In this case, the virtual character of the user who enters the group chat interaction interface or the group chat interaction window is located within the group communication area.

[0128] Furthermore, in order to allow the second user to more accurately determine whether to enter the group communication area and engage in group communication, attribute information of the group communication area is displayed near the group communication area. The attribute information of the first virtual object is introductory information of the group chat content input to the first user.

[0129] Here, the introduction information of the group chat contents includes group announcements, group names, exchange contents (e.g., exchanges of photography), etc. Users other than the first user (including the second user) can judge whether to enter this group communication area based on this attribute information. Only users in the group communication area can see the chat contents of each user in the group communication area, and users outside the group communication area cannot see the chat contents in the group communication area. When this first virtual object is retracted by the first user, the corresponding group chat is dissolved. The first user can remove any user in the group communication area from this group communication area. At the same time, the removed user is also removed from the group chat.

[0130] There are two methods for defining the position of the first virtual object: a moving and fixed method. In other words, in this application, the real-time position of the first virtual object is updated according to the real-time position of the first user, and the first virtual object moves while following the first user.

[0131] Alternatively, the position of the first virtual object is always determined by the position selected by the first user when adding the first virtual object to the AR real-world space.

[0132] When using the mobile method, the user does not need to frequently add the first virtual object to the AR real-world space, which is similar to adding a mobile tag to the user.

[0133] When using the fixed method, the user needs to place the first virtual object at a specific position. When using the fixed method, if the first user moves too far away from the first virtual object, the first virtual object can be controlled to be removed from the real-world space of the AR.

[0134] Because the number of first virtual objects generated by the fixed and moving methods is different, the system can selectively induce the user to add the first virtual objects in a specific manner, for example, when the system is under high load, the system may induce the user to use a moving first virtual object and display the first virtual object in a lower resolution.

[0135] When the first user exits this AR real-world space, in other words when the graphical user interface of the first user's smart terminal exits from the display of the AR real-world space, the position of the first virtual object is always determined according to the position selected by the first user when adding the first virtual object to the AR real-world space, as follows:

[0136] S1071: In response to the distance between the first virtual object and the first user being greater than a predetermined distance, the first virtual object is removed from the AR real-world space; or S1072: In response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space, the first virtual object is removed from the AR real-world space; or S1073: In response to no interaction command to the first virtual object from another user until the predetermined time has elapsed, the first virtual object is removed from the AR real-world space.

[0137] In step S1071, the position of the first virtual object is always determined according to the position selected by the first user when adding the first virtual object to the real-world space of the AR, so that the position of the first virtual object does not change when the first user leaves the real-world space of the AR. At this time, if the distance between the first virtual object and the first user is greater than a predetermined distance, the first virtual object is deleted from the real-world space of the AR.

[0138] In step S1072, timing is started from the time when the first virtual object is added to the AR real-world space, and when a predetermined time is reached, the first virtual object is deleted from the AR real-world space.

[0139] Based on the above, when performing step S101, a plane is first found, and then at least a part of the AR real-world space is displayed.

[0140] Example 2

[0141] Based on the same technical idea, the present application further provides another AR interaction method, which is described in detail below in the embodiments of the present application. Figure 6 shows a flowchart of another AR interaction method according to the embodiments of the present application. As shown in Figure 6, the method includes the following steps:

[0142] S201: In response to a live-action activation command issued by a second user, at least a portion of an AR live-action space including a first virtual object is displayed on a graphical user interface, the AR live-action space being formed by superimposing a live-action image obtained by shooting and a preset AR virtual object, and a virtual object interaction control is displayed as a floating object on the graphical user interface, and the position of the first virtual object is determined by the position at which the first user adds the first virtual object to the AR live-action space.

[0143] S202: Calculate a distance between the second user and the first virtual object based on position information of the second user and position information of the first virtual object acquired in real time.

[0144] S203: After the second user approaches the first virtual object, in response to an interaction command issued by the second user to the first virtual object, a presentation message corresponding to the interaction command is sent to the first user, and the first user performs information interaction with the second user based on the presentation message corresponding to the interaction command.

[0145] In step S201, the second user can issue a live-action start command by any means. This live-action start command can be issued by means of a physical button, voice control, a virtual button, gaze control, a gesture command, or the like. Here, the physical button refers to a mechanical button provided on a smart terminal, such as a press button, a toggle button, or the like, which issues a command by physically displacing the button. Voice control is a method in which a user issues a command by speaking. For example, a user can issue a live-action start command by speaking "start AR mode". Of course, other contents may be used, and the specific contents are set in advance. A virtual button is a button that can only be displayed on a terminal (or may not be displayed in some cases). The user issues a live-action start command by tapping the virtual button, for example, by touch. Gaze control is a method in which a gaze sensor detects the movement of the user's gaze and issues a command. There are many other methods for issuing a live-action start command, which will not be described here.

[0146] Virtual buttons are usually used in handheld mobile terminals such as mobile phones. Gaze control is usually used in head-mounted mobile terminals such as AR glasses. Since the AR glasses and mobile phones can be used online, users can issue live action activation commands in various ways during use. In other words, the implementation subject of this solution may be a handheld mobile terminal, a head-mounted mobile terminal, or a system composed of a handheld mobile terminal and a head-mounted mobile terminal.

[0147] When the second user issues a live-action activation command, at least a portion of the AR live-action space including the first virtual object is displayed in the graphical user interface of the second user. Since AR technology is a technology for blending virtual information with the real world, i.e., a technology for overlaying a virtual object on the real world, only a portion of the AR live-action space can be displayed. The graphical user interface also displays a virtual object setting control, which is typically constantly displayed on the live-action image so that the user can see and operate the virtual object setting control.

[0148] Predefined AR virtual objects in the real-life space of AR generally come from two sources: user-defined and system-defined. The user-defined may be an ornament or an interactable virtual object such as a first virtual object. The system-defined is mainly a virtual object that is automatically formed without user-defined, such as an auxiliary line (e.g., an auxiliary figure such as a contour line or a frame to help the user identify a real person or object) or auxiliary information (e.g., text to introduce information about a real person or object to the user).

[0149] The real-life images may be directly captured in real time by the smart terminal, or the smart terminal may be a processing terminal and the image capture terminal may be a remote image capture device that is separate from the smart terminal and interacts with the smart terminal for information / data by wired or wireless means.

[0150] In step S202, a real-time distance between the second user and the first virtual object is calculated based on the position information of the second user and the position information of the first virtual object acquired in real time, and it is determined whether this real-time distance is sufficiently small, i.e., whether the second user has approached the first virtual object.

[0151] In step S203, if the second user wants to communicate with the first user, the second user first approaches the first virtual object. The second user's approach to the first virtual object refers to the second user being in a position close to the first virtual object, usually several meters to several tens of meters. Usually, "proximity" refers to a distance where the user can speak and be heard by others. When the second user approaches the first virtual object and issues an interaction command to the first virtual object, a corresponding prompt message is displayed on the graphical user interface of the first user. In this case, if the first user also wants to communicate with the second user, the prompt message can start an information interaction with the second user. The information interaction refers to a temporary information interaction interface, friend addition, etc.

[0152] 7 is a schematic diagram showing a first virtual object and a second virtual object of a second user displayed in a real-world space of AR according to an embodiment of the present application. As shown in FIG. 7, when the second user approaches the first virtual object, the second virtual object of the second user approaches the first virtual object synchronously.

[0153] Here, due to the system restrictions, when the second user approaches the first virtual object, an interaction command can be issued. As a specific implementation method, it may be configured to request the second user to approach the first virtual object before sending the interaction command, and if the distance is too far, to present to the second user that the current distance is too far; if the distance between the second user and the first virtual object is too far, the user may be allowed to issue an interaction command, and when the distance becomes close enough, a presentation message may be displayed to the first user. In an extreme case, when the second user is far from the first virtual object, it may be configured to make the first virtual object invisible in the real-life space of the AR. Specifically, when implementing this application, a sufficient presentation message is given to the second user to inform the second user whether the second user is close enough to the first virtual object. For example, when the second user is far from the first virtual object, the entire image of the first virtual object may not be clearly visible (for example, the image of the first virtual object that is seen may be black and white, with only an outline, or without attribute information regarding the first virtual object), and the entire image of the first virtual object may be visible only when the second user is close to the first virtual object. In this way, the user is informed of when an interaction command can be issued. That is, in the method according to the present application, in response to the distance between the second user and the first virtual object being less than a predetermined value, the second user is permitted to issue an interaction command to the first virtual object.

[0154] The technical solution according to the present application provides a first virtual object in the vicinity of a first user, so that a second user can interact with the first user through the first virtual object. Such a method has at least the following advantages: 1. When the first virtual object is located in the vicinity of the first user and the second user approaches the first virtual object, the second user can interact with the first user, so the second user knows that the first user is in the vicinity, in other words, the first user and the second user are located in the same area. This indicates that the first user and the second user pay attention to the same thing, so the interaction between the second user and the first user is precise, thereby improving the precision of user interaction. 2. The first user adding the first virtual object in its vicinity represents that the first user wants to interact with other users. This is because the first user may want someone to help him or the first user may want to team up with other users to complete a certain event (an event that requires teaming up to complete). Therefore, the interaction between the second user and the first user in this case can accurately meet the needs of the first user. 3. Many introverted users are not good at face-to-face communication with other users, so the first user first interacts with the second user before communicating with other users face-to-face, thereby providing a mitigating measure for face-to-face communication. In this way, the interaction between the first user and other users is made easier, improving the interaction frequency of the entire user group and accelerating the spread of information. 4. This application adopts augmented reality technology as the basis of the technical solution, because it takes into consideration that AR technology is linked to reality. Before interacting with the first user, the second user can check the situation of the user about to interact, the environmental situation, and information that can be determined based on the environmental situation (for example, whether the difficulties encountered by the first user can be solved by himself, whether other users have already communicated with the first user, etc.) by observing the users around the first virtual object.This allows the second user to determine whether or not he or she wants to communicate with the first user, improving the accuracy of communication.

[0155] In the process of executing steps S201-S203, the first user and the second user may be in a friend-registered state (both users have added each other as friends in advance) or may not be in a friend-registered state (both users have not added each other as friends in advance). In other words, when executing these three steps, the friend registration state of the users does not affect the realization of the entire steps.

[0156] Based on the above proposal, when the first virtual object is a virtual character controlled by a first user, after the first user performs a first response operation to the presented message, an information interaction interface is entered for direct communication between the first user and a second user, and / or after the first user performs a second response operation to the presented message, a simple interaction window for direct communication between the first user and the second user is floated and displayed in the graphical user interface.

[0157] Here, the first virtual object being a virtual character controlled by the first user indicates that the first user expects one-to-one communication. The specific form of the virtual character may be an animated human, a virtual human, or an animated character (e.g., an anime character, a cartoon character, or a game character).

[0158] After the first user performs the first response operation, the smart terminal of the second user can enter an information interaction interface for private chat. This information interaction interface is overlaid on the originally displayed AR real-world space, and in some cases, the information interaction interface occupies the entire graphical user interface. In other words, after entering the information interaction interface, the first user only performs information interaction without operating on the AR real-world space. In the information interaction interface, the user can send and receive content such as text, image, and voice message.

[0159] After the first user performs the first response operation, the smart terminal of the second user can enter an information interaction interface for private chat. This information interaction interface uses a simple interaction window that is not overlaid on the originally displayed real-world space of the AR, but is displayed floating on the originally displayed real-world space of the AR. The area of ​​this simple interaction window is smaller than the area of ​​the graphical user interface. In other words, the simple interaction window does not completely cover the image of the real-world space of the AR displayed on the graphical user interface.

[0160] Instead of the above interaction methods, there are other interaction methods. For example, when the first user performs a call operation on the presented message, the first user can directly talk to the second user. Also, for example, when the first user performs a friend addition operation on the presented message, the first user can send a friend request to the second user.

[0161] Also, for example, a paper ball control is displayed in the graphical user interface, and this paper ball control may be constantly displayed in the AR live-action image, or may be hidden when not in use. When a first user executes an operation to operate the paper ball control in response to a presented message, the contents of the paper ball become editable, and the first user can throw the paper ball having the edited information to a second user. The second user can see the edited information in the paper ball, and can communicate with the first user through the paper ball.

[0162] A greeting control is also displayed on the graphical user interface, and the greeting control may be constantly displayed on the AR live-action image, or may be hidden when not in use. The first user can perform a greeting operation on the presented message. Specifically, the first user can greet the virtual character of the second user by operating the greeting control. For example, the greeting control may be a virtual hammer control. When the first user operates the virtual hammer control on the virtual character of the second user, the virtual character of the second user is hit by the virtual hammer and reacts accordingly.

[0163] Furthermore, in order to allow the second user to more accurately determine whether to communicate with the first user, attribute information of the first virtual object is displayed near the first virtual object. The attribute information of the first virtual object is determined based on one or more of information input by the first user, historical location information of the first user, historical trajectory information of the first user, and identity information of the first user.

[0164] Here, the displayed attribute information clearly indicates that it is related to the first virtual object. For example, in order to indicate which first virtual object the attribute information is intended to describe, it is possible to display the attribute information together with an arrow pointing to the owner of the attribute information.

[0165] The information entered by the first user is either pre-entered by the user or entered in real time (the user can modify the displayed attribute information at any time). The first user can enter information about the next action to be taken (next action content), such as difficulties encountered at the current location or what the first user wants to do, or a self-introduction.

[0166] The first user's historical location information indicates locations the first user has reached in the past, and the first user's historical trajectory information indicates the first user's past travel routes, thereby enabling the second user to determine whether the first user has had a similar experience to the second user.

[0167] The identity information of the first user is personal information indicating the first user's occupation, gender, age, etc. This information can be automatically extracted by the system.

[0168] In this embodiment, a first user can set a state of a first virtual object. After the state setting is completed, the state of the first virtual object set by the first user is displayed near the first virtual object. A second user can set a state of his / her own virtual object (e.g., a second virtual object). After the state setting is completed, the state of the second virtual object set by the second user is displayed near the second virtual object.

[0169] Since at least a part of the AR real-world space including the first virtual object displayed on the graphical user interface of the second user is only a part of the entire AR real-world space, it is difficult for the second user to see the entire virtual object through the displayed part of the AR real-world space. Therefore, a radar function is also added in this application. That is, the method according to this application further includes the following steps:

[0170] S2041: In response to a radar activation command issued by a second user, a radar scan image in which a mark of an AR virtual object is displayed is displayed on a graphical user interface. The display position of the mark of the AR virtual object is determined based on the current position of the AR virtual object and the current position of the second user.

[0171] S2042: In response to a positional movement by the second user, a relative position between the AR virtual object and the second user is calculated based on the current position of the AR virtual object and the current position of the second user.

[0172] S2043: Update radar scan image according to relative position.

[0173] In step S2041, the radar scan image is displayed in two ways. The first display method is to overlay the currently displayed part of the AR real space with the radar scan image, and the second display method is to display the radar scan image floating on the currently displayed part of the AR real space. In the first display method, it can be understood as jumping directly from the current interface to the radar scan image interface. The mark of the AR virtual object displayed on the radar scan image is usually a schematic diagram, and this AR virtual object may be the first virtual object described above, or may be an AR virtual object added by another user or the system.

[0174] Here, virtual objects of AR will be described. There are three types of virtual objects of AR: virtual objects of decorative AR, virtual objects of user interaction AR, and virtual objects of system interaction AR. A virtual object of decorative AR refers to a virtual object of AR that cannot interact with a user. Such virtual objects mainly play a decorative role or a presentation role, such as a tree that cannot interact with a user, or an arrow that points in a direction (guiding the user's movement direction). A virtual object of user interaction AR is, for example, a first virtual object that different users can directly interact with. A virtual object of system interaction AR refers to a virtual object that allows a user to interact with a system, such as a treasure chest that can be opened to enter a lottery, or a virtual pet that can be conversed with, that is, interacts with the system.

[0175] In addition to the AR virtual object, the radar scan image can also display the positions of other users and the relationship between the AR virtual object and the user. For example, it can be expressed by color. In short, the target user and the virtual object added by the target user are displayed similarly in the radar scan image. For example, the attribute information of the icon of the virtual object added by the target user and the icon of the target user are similar. For example, at least one of the color, shape, and structure of the icon is the same.

[0176] The display position of the AR virtual object in the radar scan image is determined by the current positions of the AR virtual object and the second user. Here, since the positions of the AR virtual object and the second user may be different at different times, the current display positions of the AR virtual object and the second user in the radar scan image are determined according to the current positions of the AR virtual object and the second user.

[0177] The purpose of adding the radar scan image is to provide another efficient observation method other than observing the AR virtual object with the naked eye through the partial AR real-life space displayed on the graphical user interface. Therefore, the maximum display range of the radar scan image is set to be larger than the maximum display range of the AR real-life space. Generally, AR virtual objects and users within a range of 300 to 1000 meters around can be displayed on the radar scan image, and the AR real-life space displayed on the graphical user interface is usually only several tens of meters (designed with the problem of information overlay in mind). Thus, the user can roughly grasp the position of other users or AR virtual objects on the radar scan image, move toward a specified target (other users or AR virtual objects), and when approaching the specified target (within several tens of meters from the target), observe the target through the AR real-life space displayed on the graphical user interface.

[0178] One possible embodiment includes allowing the second user to issue an interaction command to the first virtual object in response to the distance between the second user and the first virtual object being less than a predetermined value, and not allowing the second user to issue an interaction command to the first virtual object if the distance between the second user and the first virtual object is not less than (or greater than) the predetermined value.

[0179] In one possible embodiment, when executing step S203 of responding to an interaction command issued by the second user to the first virtual object after the second user approaches the first virtual object and sending a presentation message corresponding to the interaction command to the first user, the process is performed as follows.

[0180] After the second user approaches the first virtual object, a suggestion message of the first virtual object is displayed in the graphical user interface, the suggestion message representing an interaction command that can be issued by the second user to the first virtual object.

[0181] Here, the message presented by the first virtual object is, for example, an interaction control displayed on the graphical user interface of the second user. When the interaction control displayed on the graphical user interface of the second user includes a greeting control, a paper ball control, an add friend control, a call control, etc., the second user can issue a greeting command, a paper ball throwing command, an add friend command, a call command, etc. to the first virtual object. Here, for the greeting command and the paper ball throwing command, the corresponding contents of the first embodiment can be referred to.

[0182] In one possible embodiment, when the first virtual object is a group communication area controlled by the first user, the present application further includes the following steps:

[0183] S2051: After the first user performs a third response operation to the proposed message, enter a group chat interaction interface; and / or S2052: After the first user performs a fourth response operation to the proposed message, float a group chat interaction window in the graphical user interface.

[0184] In this embodiment, the first virtual object being a group communication area controlled by the first user represents that the first user wants to perform one-to-many communication. The specific form of the group communication area can be an area occupied by virtual items such as a virtual sofa, a virtual building, etc. The group communication area can include multiple users. When the second user wishes to enter the group communication area, the interaction command issued by the second user to the first virtual object may be a request command requesting to enter the group communication area, and the presentation message corresponding to the interaction command sent to the first user may be information that the second user wishes to enter the group communication area.

[0185] In step S2051, if the first user performs a third response operation on the presented message, the second user's graphical user interface is directly converted from the AR real-world space interface to a group chat interaction interface. This group chat interaction interface is overlaid on the originally displayed AR real-world space, and in some cases, the group chat interaction interface can occupy the entire graphical user interface. In other words, after entering the group chat interaction interface, the first user can perform information interaction with each user in the group communication area without operating on the AR real-world space. In the group chat interaction interface, content such as text, image, and voice message can be sent and received between multiple users.

[0186] In step S2052, if the first user performs the fourth response operation, the first user can enter the group chat interaction window of the information group chat. This group chat interaction window is not overlaid on the originally displayed AR real-world space, but uses a group chat interaction window that is displayed floating on the originally displayed AR real-world space. The area of ​​this group chat interaction window is smaller than the area of ​​the graphical user interface. In other words, the group chat interaction window does not completely cover the image of the AR real-world space displayed on the graphical user interface.

[0187] In this case, the virtual character of the user who enters the group chat interaction interface or the group chat interaction window is located within the group communication area.

[0188] Furthermore, in order to allow the second user to more accurately determine whether to enter the group communication area and engage in group communication, attribute information of the group communication area is displayed near the group communication area. The attribute information of the first virtual object is introductory information of the group chat content input to the first user.

[0189] Here, the introduction information of the group chat contents includes group announcements, group names, exchange contents (e.g., exchanges of photography), etc. The second user can determine whether to enter this group communication area based on this attribute information. Only users in the group communication area can see the chat contents of each user in the group communication area, and users outside the group communication area cannot see the chat contents in the group communication area. When this first virtual object is retracted by the first user, the corresponding group chat is dissolved. The first user can remove any user in the group communication area from this group communication area. At the same time, the removed user is also removed from the group chat.

[0190] There are two methods for defining the position of the first virtual object: a moving and fixed method. In other words, in this application, the real-time position of the first virtual object is updated according to the real-time position of the first user, and the first virtual object moves to follow the first user.

[0191] Alternatively, the position of the first virtual object is always determined by the position selected by the first user when adding the first virtual object to the AR real-world space.

[0192] When using the mobile method, the user does not need to frequently add the first virtual object to the AR real-world space, which is similar to adding a mobile tag to the user.

[0193] When using the fixed method, the user needs to place the first virtual object at a specific position. When using the fixed method, if the first user moves too far away from the first virtual object, the first virtual object can be controlled to be removed from the real-world space of the AR.

[0194] Because the number of first virtual objects generated by the fixed and moving methods is different, the system can selectively induce the user to add the first virtual objects in a specific manner, for example, when the system is under high load, the system may induce the user to use a moving first virtual object and display the first virtual object in a lower resolution.

[0195] When the first user exits this AR real-world space, in other words when the graphical user interface of the first user's smart terminal exits from the display of the AR real-world space, the position of the first virtual object is always determined according to the position selected by the first user when adding the first virtual object to the AR real-world space, as follows:

[0196] S2061: In response to a distance between the first virtual object and the first user being greater than a predetermined distance, the first virtual object is removed from the AR real-world space; or S2062: In response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space, the first virtual object is removed from the AR real-world space; or S2063: In response to no interaction command to the first virtual object from another user until the predetermined time has elapsed, the first virtual object is removed from the AR real-world space.

[0197] In step S2061, the position of the first virtual object is always determined according to the position selected by the first user when adding the first virtual object to the real-world space of the AR, so that the position of the first virtual object does not change when the first user leaves the real-world space of the AR. At this time, if the distance between the first virtual object and the first user is greater than a predetermined distance, the first virtual object is deleted from the real-world space of the AR.

[0198] In step S2062, timing is started from the time when the first virtual object is added to the AR real-world space, and when a predetermined time is reached, the first virtual object is deleted from the AR real-world space.

[0199] For ease of understanding, a specific example will be described below with reference to the contents of Example 1 and Example 2. Here, Figures 8 to 13 show the contents of this example.

[0200] In this example, a first user having a first smart terminal (e.g., a mobile phone) is in a real-world scene, e.g., an office, an outdoor area, etc. When the first user wants to communicate with strangers around him, he holds up the first smart terminal so that the camera of the first smart terminal is aimed at any place in the real-world scene.

[0201] Then, the first user issues a live-action launch command on the first smart device, which is specifically to open the original camera and the AR camera of the first smart device, where both the AR camera and the original camera are used.

[0202] At this time, a radar scan image is displayed on the graphical user interface of the first user. FIG. 8 shows a schematic diagram of a radar scan image according to an embodiment of the present application. As shown in FIG. 8, a mark of another AR virtual object in the vicinity of the first user (a small circle in a dark color shown in FIG. 8) is displayed on the radar scan image, and this mark indicates the position of the AR virtual object. The AR virtual object may be an AR virtual character or an AR virtual item added by another user, or may be an AR virtual item (e.g., a gift box) automatically added by the system. The display position of the mark of the AR virtual object on the radar scan image is determined based on the current position of the AR virtual object and the current position of the first user. The first user can check the position situation of the AR virtual object in the vicinity by this radar scan image.

[0203] Then, the graphical user interface automatically switches to a plane search interface, and Fig. 9 shows a schematic diagram of the plane search interface according to an embodiment of the present application. As shown in Fig. 9, the first user searches for a plane by shaking the first smart terminal according to the instruction arrow presented in the plane search interface, for example, searching for a plane such as a flat ground, a table top, etc. in a real-life scene.

[0204] 10 shows a schematic diagram of another AR real-world space according to an embodiment of the present application. After searching for a plane, as shown in FIG. 10, at least a part of the AR real-world space is displayed on the graphical user interface, and a virtual object setting control is displayed floating on the graphical user interface (a bubble-shaped control shown in FIG. 10). Here, the AR real-world space includes a part of the actual scene (grass, paved road, and trees shown in FIG. 10) of the real-world scene captured by the original camera, and AR virtual objects (the AR virtual mannequin and the AR virtual suitcase shown in FIG. 10) captured by the AR camera.

[0205] The first user taps a virtual object setting control in the graphical user interface (add operation), and a first virtual object waiting to be added is displayed floating on the graphical user interface. Fig. 11 shows a schematic diagram of another first virtual object waiting to be added according to an embodiment of the present application. As shown in Fig. 11, this first virtual object is composed of a virtual mannequin and a virtual sofa, and the first virtual object waiting to be added is displayed floating in the real-life space of the AR.

[0206] The first user drags the direction movement control in the virtual object setting control to issue a direction control command to the direction movement control and controls the first virtual object to move in the real-world space of the AR, and / or the first user taps an arbitrary position in the graphical user interface to generate a position selection command and controls the first virtual object to move in the real-world space of the AR.

[0207] After determining the placement position of the first virtual object in the real-world space of the AR, a performance state and a performance action are added to the first virtual object, and the first virtual object is further added to the real-world space of the AR.

[0208] A second user can also perform similar steps on a second smart device to place a second virtual object of the second user in the AR real-world space.

[0209] The first user adds the first virtual object to the real-world space of the AR and then controls the first virtual object to move in the real-world space of the AR. When the first user wants to check whether there are any AR virtual objects placed by other users around, the first user issues a radar activation command on the first smart terminal to display a radar scan image on which a mark of the AR virtual object is displayed on the graphical user interface. The display position of the mark of the AR virtual object is determined based on the current position of the AR virtual object and the current position of the first user. In response to the position movement by the first user, the relative position between the AR virtual object and the first user is calculated based on the current position of the AR virtual object and the current position of the first user. The radar scan image is updated based on the relative position. The first user can check whether there are any AR virtual objects placed by other users (including the second user) around him / her based on the updated radar scan image.

[0210] Similarly, when the second user wants to check whether there are any AR virtual objects placed by other users around him, he issues a radar activation command on the second smart terminal to display a radar scan image with a mark of the AR virtual object on the graphical user interface. The display position of the mark of the AR virtual object is determined based on the current position of the AR virtual object and the current position of the second user. In response to the position movement by the second user, the relative position between the AR virtual object and the second user is calculated based on the current position of the AR virtual object and the current position of the second user. The radar scan image is updated based on the relative position. The second user can check whether there are any AR virtual objects placed by other users (including the first user) around him based on the updated radar scan image.

[0211] When a moving second user approaches the first virtual object and wants to communicate with the first user, the second user can issue an interaction command to the first virtual object if the distance between the second user and the first virtual object is less than a predetermined value. At this time, a prompt message corresponding to the interaction command issued by the second user is displayed on the graphical user interface of the first user, and the first user can perform information interaction with the second user through the prompt message corresponding to the interaction command.

[0212] When the first virtual object is a virtual character controlled by the first user, if the interaction command issued by the second user is a chat command, the presented message corresponding to the interaction command issued by the second user and displayed on the graphical user interface of the first user may be the chat content. When the first user wants to chat with the second user, the presented message can be tapped (first response operation, e.g., clicked) to enter an information interaction interface for direct communication between the first user and the second user. And / or, the first user can tap (second response operation, e.g., double-click) on the presented message to display a floating simplified interaction window for direct communication between the first user and the second user on the graphical user interface.

[0213] FIG. 12 shows a schematic diagram of a paper ball tossing control, a greeting control, a like control, and a comment control according to an embodiment of the present application. As shown in FIG. 12, the content displayed in FIG. 12 is the content displayed in the graphical user interface of the second user, that is, the content of the interface seen by the second user. FIG. 12 specifically includes a paper ball control (i.e., a paper ball tossing control), a greeting control, a like control, a comment control, and a first virtual object.

[0214] The second user taps the paper ball control to generate a paper ball, and then edits the contents of the paper ball to obtain a paper ball having information. In this case, the interaction command may be a command to send the paper ball having information to the first user. A prompt message corresponding to the interaction command issued by the second user and displayed on the graphical user interface of the first user is for asking the first user whether to confirm the information of the paper ball sent from the second user. When the first user wants to confirm the information of the paper ball, the first user taps (a first response operation, for example, clicking) on ​​the prompt message to enter an information interaction interface for direct communication between the first user and the second user, and the information of the paper ball is displayed in the information interaction interface. And / or, the first user taps (a second response operation, for example, double-clicks) on the prompt message to cause a simple interaction window for direct communication between the first user and the second user to be displayed floating on the graphical user interface, and the information of the paper ball is displayed in the simple interaction window.

[0215] The second user can like the first virtual object by tapping the like control shown in Fig. 12. At this time, the interaction command is a like command, and the presentation message corresponding to the interaction command issued by the second user and displayed on the graphical user interface of the first user is intended to present to the first user that the second user has liked the first virtual object.

[0216] The second user can comment on the first virtual object by tapping the comment control shown in Fig. 12. At this time, the interaction command is a comment command, and a presentation message corresponding to the interaction command issued by the second user and displayed on the graphical user interface of the first user is intended to present to the first user that the second user has commented on the first virtual object. The first user can check the content of the comment by tapping this presentation message.

[0217] Here, a comment is different from a paper ball in that the content of the comment is visible to all users, but the content of the paper ball is visible only to the first and second users.

[0218] As shown in FIG. 12, the second user can interact with the first virtual object through the greeting control. After the second user taps the greeting control, the second user enters each sub-control included in the greeting control. FIG. 13 shows a schematic diagram of hitting the first virtual object with a virtual hammer according to an embodiment of the present application. As shown in FIG. 13, the sub-controls included in the greeting control are specifically a virtual hammer control, a virtual bear control, and a virtual brain control.

[0219] Next, a virtual hammer control will be taken as an example. As shown in Fig. 13, when the second user taps the virtual hammer control, the issued interaction command is to hit the first virtual object with the virtual hammer. At this time, the presented message received by the first user is information indicating that the second user has hit the first virtual object with the virtual hammer.

[0220] When the first virtual object is a group communication area controlled by a first user, the group communication area may be an area configured by a virtual item. For example, when the virtual item is a virtual sofa, the group communication area is a sofa area configured by the virtual sofa. In this case, the real-life space of the AR displayed on the graphical user interface of the first user includes a virtual item (e.g., a virtual sofa). When a second user approaches the first virtual object, the real-life space of the AR displayed on the graphical user interface of the second user may also include the virtual item.

[0221] When the second user approaches this group communication area (i.e., an area configured by virtual items), the second virtual object of the second user also approaches this group communication area in synchronization. At this time, the second user can determine whether to enter this group communication area by checking attribute information displayed in the vicinity of this group communication area. If the second user wishes to enter this group communication area, he or she issues an interaction command to the group communication area. This interaction command may be a request command requesting to enter the group communication area. At this time, the presentation message received by the first user is request information requesting to enter the group communication area of ​​the second user. When the first user performs an entry permission operation on this presentation message, the second virtual object of the second user can enter this group communication area. At this time, the second user can see the chat contents of each user in this group communication area. This group communication area may accommodate virtual objects of multiple users.

[0222] The real-time position of the first virtual object is updated according to the real-time position of the first user, causing the first virtual object to move in a manner that follows the first user.

[0223] Alternatively, the position of the first virtual object is always determined according to the position selected by the first user when adding the first virtual object to the real-world space of the AR.

[0224] In a case where the position of the first virtual object is always determined according to the position selected by the first user when the first user adds the first virtual object to the real-life space of the AR, when the graphical user interface of the first user leaves the display of the real-life image of the AR and the distance between the first virtual object and the first user is greater than a predetermined distance, the first virtual object is deleted from the real-life space of the AR. Alternatively, when a predetermined time has elapsed since the first virtual object was added to the real-life space of the AR, the first virtual object is deleted from the real-life space of the AR. Alternatively, when there has been no interaction command for the first virtual object from another user until the predetermined time has elapsed, the first virtual object is deleted from the real-life space of the AR.

[0225] Example 3

[0226] Based on the similar technical idea, the present application further provides an AR interaction device, and Fig. 14 shows a structural schematic diagram of the AR interaction device according to an embodiment of the present application. As shown in Fig. 14, the device includes the following modules:

[0227] The first display module 1401 is configured to respond to a live-action activation command issued by the first user, to display at least a portion of an AR live-action space formed by superimposing a live-action image captured in real time on a pre-set AR virtual object on a graphical user interface, and to display a virtual object setting control in a floating manner on the graphical user interface.

[0228] The first addition module 1402 is configured to add a first virtual object controlled by the first user and located in the vicinity of the first user to the AR real-world space in response to an addition operation by the first user on a virtual object setting control.

[0229] The first interaction module 1403 is configured to receive an interaction command issued to the first virtual object from a second user approaching the first virtual object, and then display a prompt message corresponding to the interaction command issued by the second user on a graphical user interface, so that the first user performs information interaction with the second user according to the prompt message corresponding to the interaction command.

[0230] Optionally, the first virtual object is a virtual character controlled by a first user, and the device further includes a first response module for entering an information interaction interface for direct communication between the first user and a second user in response to a first response operation by the first user to the presented message, and / or a second display module for floatingly displaying a simple interaction window in a graphical user interface for direct communication between the first user and a second user in response to a second response operation by the first user to the presented message.

[0231] Optionally, attribute information of the first virtual object is displayed in the vicinity of the first virtual object, and the attribute information of the first virtual object is determined based on one or more of information input by the first user, historical location information of the first user, historical trajectory information of the first user, and identity information of the first user.

[0232] Optionally, the first adding module 1402, which adds a first virtual object controlled by the first user to the real-world space of the AR in response to an add operation on a virtual object setting control by the first user, specifically, in response to an add operation on a virtual object setting control by the first user, displays the first virtual object waiting to be added in a floating state on a graphical user interface, in response to a virtual object movement command issued by the first user, controls the first virtual object waiting to be added to be moved in the real-world space of the AR, and in response to a virtual object placement command issued by the first user, adds the first virtual object to the real-world space of the AR according to a current position of the first virtual object waiting to be added in the real-world space of the AR.

[0233] Optionally, the first adding module 1402 controls the first virtual object waiting to be added to be moved in the real-world space of the AR in response to a virtual object movement command issued by the first user, specifically controls the first virtual object to be moved in the real-world space of the AR in response to a directional control command issued by the first user to a directional movement control in a virtual object setting control, and / or controls the first virtual object to be moved in the real-world space of the AR in response to a position selection command issued by the first user on a graphical user interface.

[0234] Optionally, the device further comprises a display module:

[0235] The third display module is configured to respond to a radar activation command issued by the first user and to display a radar scan image on a graphical user interface, the radar scan image displaying a mark of an AR virtual object, and a display position of the mark of the AR virtual object is determined based on a current position of the AR virtual object and a current position of the first user.

[0236] The second calculation module is configured to calculate a relative position between the AR virtual object and the first user based on a current position of the AR virtual object and a current position of the first user in response to a position movement by the first user.

[0237] A first update module is configured to update the radar scan image according to the relative position.

[0238] Optionally, a maximum display range of the radar scan image is greater than a maximum display range of an AR real-world space.

[0239] Optionally, the apparatus further includes a first command issuing module that, in response to a distance between the second user and the first virtual object being less than a predetermined value, allows the second user to issue an interaction command to the first virtual object.

[0240] Optionally, the first virtual object is a group communication area controlled by a first user, and the device further includes: a second response module for entering a group chat interaction interface in response to a third response operation by the first user to the presented message; and / or a fourth display module for floatingly displaying a group chat interaction window in a graphical user interface in response to a fourth response operation by the first user to the presented message.

[0241] Optionally, attribute information of the group communication area is displayed near the group communication area, and the attribute information of the first virtual object is introduction information of the group chat contents input by the first user.

[0242] Optionally, the real-time position of the first virtual object is updated based on a real-time position of the first user, causing the first virtual object to move to follow the first user, or the position of the first virtual object is always determined based on a position selected by the first user when adding the first virtual object to the AR real-world space.

[0243] Optionally, the position of the first virtual object is always determined based on a position selected by a first user when adding the first virtual object to the AR real-world space, and the device further includes a first deletion module that deletes the first virtual object from the AR real-world space in response to a distance between the first virtual object and the first user being greater than a predetermined distance, or a second deletion module that deletes the first virtual object from the AR real-world space in response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space, or a third deletion module that deletes the first virtual object from the AR real-world space in response to no interaction command for the first virtual object from another user until the predetermined time has elapsed.

[0244] Example 4

[0245] Based on the similar technical idea, the present application further provides another AR interaction device, and Fig. 15 shows a structural schematic diagram of another AR interaction device according to an embodiment of the present application. As shown in Fig. 15, the device includes the following modules:

[0246] The second display module 1501 is configured to respond to a live-action activation command issued by the second user, and to display at least a portion of the AR live-action space including a first virtual object on a graphical user interface, the at least a portion being formed by superimposing a live-action image obtained by shooting and a preset AR virtual object, and to display a floating virtual object interaction control on the graphical user interface, wherein the position of the first virtual object is determined by the position at which the first user adds the first virtual object to the AR live-action space.

[0247] The first calculation module 1502 is configured to calculate a distance between the second user and the first virtual object based on position information of the second user and position information of the first virtual object obtained in real time.

[0248] The second interaction module 1503 is configured to respond to an interaction command issued by the second user to the first virtual object after the second user approaches the first virtual object, to send a presentation message corresponding to the interaction command to the first user, and to cause the first user to perform information interaction with the second user according to the presentation message corresponding to the interaction command.

[0249] Optionally, the first virtual object is a virtual character controlled by a first user, and after the first user performs a first response operation to the suggested message, enters an information interaction interface for direct communication between the first user and a second user, and / or displays a floating simple interaction window in a graphical user interface for direct communication between the first user and a second user after the first user performs a second response operation to the suggested message.

[0250] Optionally, attribute information of the first virtual object is displayed in the vicinity of the first virtual object, and the attribute information of the first virtual object is determined based on one or more of information input by the first user, historical location information of the first user, historical trajectory information of the first user, and identity information of the first user.

[0251] Optionally, the apparatus includes the following modules:

[0252] The fifth display module is configured to respond to a radar activation command issued by the second user by displaying a radar scan image on a graphical user interface, the radar scan image displaying a mark of an AR virtual object, and a display position of the mark of the AR virtual object is determined based on a current position of the AR virtual object and a current position of the second user.

[0253] The third calculation module is configured to calculate, in response to a position movement by a second user, a relative position between the AR virtual object and the second user based on a current position of the AR virtual object and a current position of the second user.

[0254] A second update module is configured to update the radar scan image based on the relative position.

[0255] Optionally, a maximum display range of the radar scan image is greater than a maximum display range of an AR real-world space.

[0256] Optionally, the apparatus further includes a second command issuing module configured to, in response to a distance between the second user and the first virtual object being less than a predetermined value, allow the second user to issue an interaction command to the first virtual object.

[0257] Optionally, the second interaction module 1503 responds to an interaction command issued by the second user to the first virtual object after the second user approaches the first virtual object, and sends a prompting message corresponding to the interaction command to the first user. Specifically, after the second user approaches the first virtual object, the second interaction module 1503 displays a prompting message of the first virtual object on a graphical user interface, where the prompting message represents an interaction command that the second user can issue to the first virtual object.

[0258] Optionally, the first virtual object is a group communication area controlled by a first user, and the device further includes a third response module for entering a group chat interaction interface after the first user performs a third response operation to the suggested message, and / or a sixth display module for floatingly displaying a group chat interaction window in a graphical user interface after the first user performs a fourth response operation to the suggested message.

[0259] Optionally, attribute information of the group communication area is displayed near the group communication area, and the attribute information of the first virtual object is introduction information of the group chat contents input by the first user.

[0260] Optionally, the real-time position of the first virtual object is updated based on a real-time position of the first user, causing the first virtual object to move to follow the first user, or the position of the first virtual object is always determined based on a position selected by the first user when adding the first virtual object to the AR real-world space.

[0261] Optionally, the position of the first virtual object is always determined based on a position selected by a first user when adding the first virtual object to the AR real-world space, and the device further includes a fourth deletion module that deletes the first virtual object from the AR real-world space in response to a distance between the first virtual object and the first user being greater than a predetermined distance, or a fifth deletion module that deletes the first virtual object from the AR real-world space in response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space, or a sixth deletion module that deletes the first virtual object from the AR real-world space in response to no interaction command for the first virtual object from another user until the predetermined time has elapsed.

[0262] Example 5

[0263] 16 shows a structural schematic diagram of an electronic device according to an embodiment of the present application. The electronic device includes a processor 1601, a memory 1602 storing readable commands executable by the processor 1601, and a bus 1603, and when the electronic device executes the above information processing method, the processor 1601 communicates with the memory 1602 via the bus 1603 and executes the readable commands to execute steps of the AR interaction method described in the first embodiment.

[0264] Example 6

[0265] Example 4 of the present application further provides a computer-readable storage medium, which stores a computer program that, when executed by the processor 1601, performs the steps of the AR interaction method described in Example 1.

[0266] For ease and simplicity of description, the specific operating processes of the above-described apparatus, electronic device and computer-readable storage medium will not be described here, since those skilled in the art can refer to the corresponding processes in the above method embodiments.

[0267] The apparatus and method described in some embodiments provided by the present application may be realized in other ways. The above-described apparatus embodiments are merely illustrative, and the module divisions are merely logical functional divisions, and may be other divisions in actual implementation. For example, multiple modules or components may be combined or integrated into another system, or some features may be omitted or not implemented. In addition, the shown or discussed mutual couplings or direct couplings or communication connections may be indirect couplings or communication connections through some interfaces, devices or units, and may be electrical, mechanical, or other types of connections.

[0268] The units described above as separate parts may or may not be physically separate. The components shown as units may or may not be physical units, i.e., they may be located in the same location or distributed among multiple network units. Some or all of the units can be selected according to actual requirements to achieve the purpose of the proposed embodiment.

[0269] In addition, each functional unit in each embodiment of the present application may be integrated into a single processing unit, may function as an independent physical entity, or two or more units may be integrated into a single unit.

[0270] The functions can be realized in the form of a software functional unit and stored in a processor-executable non-volatile computer-readable storage medium when sold or used as an independent product. From this understanding, the technical solution of the present application itself, or a part that can contribute to the prior art, or a part of the technical solution can be realized in the form of a software product. The computer software product is stored in a storage medium and includes a number of commands for a computer device (such as a personal computer, a server, or a network device) to execute all or part of the steps of the method in each embodiment of the present application. The storage medium includes various media capable of storing program code, such as a USB disk, a portable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0271] Finally, it should be noted that the above examples are merely specific embodiments for explaining the technical solutions of the present application, and do not limit the present application, so the scope of protection of the present application is not limited thereto. Although the above examples are used to describe the present application in detail, it goes without saying that those skilled in the art can propose improvements or modifications to the technical solutions described in the above examples within the technical scope of the present application, or make equivalent substitutions for some of the technical features therein. The essence of the corresponding technical solutions of these improvements, modifications or substitutions does not deviate from the spirit and scope of the technical solutions according to the examples of the present application, and all of them belong to the scope of protection of the present application. Therefore, the scope of protection of the present application should be consistent with the scope of the claims. [Explanation of symbols]

[0272] 1401 First display module 1402 1st Additional Module 1403 First Interaction Module 1501 Second display module 1502 First Calculation Module 1503 Second Interaction Module 1601 Processor 1602 Memory 1603 Bus

Claims

1. Responding to a real-life activation command issued by the first user, displaying at least a part of an AR real-life space formed by superimposing a real-life image obtained by real-time shooting and a preset AR virtual object on a graphical user interface, and displaying a virtual object setting control in a floating manner on the graphical user interface; adding a first virtual object controlled by a first user and located in the vicinity of the first user to the real-world space of the AR in response to an addition operation on a virtual object setting control by the first user; receiving an interaction command issued to the first virtual object from a second user approaching the first virtual object, displaying a prompt message corresponding to the interaction command issued by the second user on a graphical user interface, and allowing the first user to perform information interaction with the second user according to the prompt message corresponding to the interaction command; 13. An AR interaction method comprising:

2. the first virtual object is a virtual character controlled by a first user; In response to a first response operation by a first user to the presented message, entering an information interaction interface for direct communication between the first user and a second user; and / or and displaying a floating simplified interaction window for direct communication between the first user and the second user on the graphical user interface in response to a second response operation by the first user to the presented message. The AR interaction method according to claim 1 , characterized in that:

3. Attribute information of the first virtual object is displayed in the vicinity of the first virtual object, and the attribute information of the first virtual object is determined based on one or more of information input by the first user, historical position information of the first user, historical trajectory information of the first user, and identity information of the first user. The AR interaction method according to claim 2 .

4. The step of adding a first virtual object controlled by the first user to the real-world space of the AR in response to an addition operation on a virtual object setting control by the first user includes: A step of floatingly displaying a first virtual object in a waiting state for addition on the graphical user interface in response to an addition operation on a virtual object setting control by a first user; Responding to a virtual object movement command issued by the first user, control is performed so that the first virtual object waiting to be added is moved in the real-world space of the AR; and adding a first virtual object to the real-world space of the AR based on a current position in the real-world space of the AR of the first virtual object waiting to be added in response to a virtual object placement command issued by the first user. The AR interaction method according to claim 1 , characterized in that:

5. The step of controlling the first virtual object waiting to be added to be moved in the real-world space of the AR in response to the virtual object movement command issued by the first user includes: a step of controlling the first virtual object to move in the real-world space of the AR in response to a direction control command issued by the first user to a direction movement control in the virtual object setting control; and / or and controlling the first virtual object to move in the real-world space of the AR in response to a position selection command issued by the first user on the graphical user interface.

5. The AR interaction method according to claim 4, further comprising:

6. Responding to a radar activation command issued by a first user, a radar scan image in which a mark of an AR virtual object is displayed is displayed on a graphical user interface, and a display position of the mark of the AR virtual object is determined based on a current position of the AR virtual object and a current position of the first user; Calculating a relative position between the AR virtual object and the first user based on a current position of the AR virtual object and a current position of the first user in response to a position movement by a first user; and updating the radar scan image based on the relative position. The AR interaction method according to claim 1 , characterized in that:

7. The maximum display range of the radar scan image is greater than the maximum display range of the real-world space of the AR. The AR interaction method according to claim 6, characterized in that

8. The method further includes allowing the second user to issue an interaction command to the first virtual object in response to a distance between the second user and the first virtual object being less than a predetermined value. The AR interaction method according to claim 1 , characterized in that:

9. the first virtual object is a group communication area controlled by a first user; entering a group chat interaction interface in response to a third response operation by the first user to the presented message; and / or and displaying a group chat interaction window in a floating manner on the graphical user interface in response to a fourth response operation by the first user to the suggested message. The AR interaction method according to claim 1 , characterized in that:

10. Attribute information of the group communication area is displayed near the group communication area, and the attribute information of the first virtual object is introduction information of the group chat content input by the first user. The AR interaction method according to claim 9 .

11. a real-time position of the first virtual object is updated based on a real-time position of the first user to cause the first virtual object to move in a manner that follows the first user; or The position of the first virtual object is always determined based on a position selected by a first user when adding the first virtual object to the real-world space of the AR. The AR interaction method according to claim 1 , characterized in that:

12. The position of the first virtual object is always determined based on a position selected by a first user when adding the first virtual object to the real-world space of the AR; In response to a distance between a first virtual object and a first user being greater than a predetermined distance, removing a first virtual object from the AR real-world space; or In response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space, removing the first virtual object from the AR real-world space; or and in response to the absence of an interaction command from another user to the first virtual object until a predetermined time has elapsed, deleting the first virtual object from the real-life space of the AR. The AR interaction method according to claim 1 , characterized in that:

13. a step of displaying, in response to a live-action start command issued by a second user, at least a part of the AR live-action space including a first virtual object, the live-action space being formed by superimposing a live-action image obtained by shooting and a preset AR virtual object, on a graphical user interface, and displaying a virtual object interaction control in a floating manner on the graphical user interface, the position of the first virtual object being determined by the position at which the first user adds the first virtual object to the AR live-action space; Calculating a distance between the second user and the first virtual object based on position information of the second user and position information of the first virtual object acquired in real time; After the second user approaches the first virtual object, in response to an interaction command issued by the second user to the first virtual object, a prompt message corresponding to the interaction command is sent to the first user, and the first user performs information interaction with the second user according to the prompt message corresponding to the interaction command.

13. An AR interaction method comprising:

14. the first virtual object is a virtual character controlled by a first user; After the first user performs a first response operation to the suggested message, enter an information interaction interface for direct communication between the first user and a second user; and / or After the first user performs a second response operation to the suggested message, a simple interaction window for direct communication between the first user and the second user is displayed in a floating manner on the graphical user interface.

14. The AR interaction method according to claim 13,

15. Attribute information of the first virtual object is displayed in the vicinity of the first virtual object, and the attribute information of the first virtual object is determined based on one or more of information input by the first user, historical position information of the first user, historical trajectory information of the first user, and identity information of the first user.

15. The AR interaction method according to claim 14,

16. Responding to a radar activation command issued by a second user, a radar scan image in which a mark of an AR virtual object is displayed is displayed on a graphical user interface, and a display position of the mark of the AR virtual object is determined based on a current position of the AR virtual object and a current position of the second user; Responding to a positional movement by a second user, calculating a relative position between the AR virtual object and the second user based on a current position of the AR virtual object and a current position of the second user; and updating the radar scan image based on the relative position.

14. The AR interaction method according to claim 13,

17. The maximum display range of the radar scan image is greater than the maximum display range of the real-world space of the AR.

17. The AR interaction method according to claim 16,

18. The method further includes allowing the second user to issue an interaction command to the first virtual object in response to a distance between the second user and the first virtual object being less than a predetermined value.

14. The AR interaction method according to claim 13,

19. The step of responding to an interaction command issued to the first virtual object by a second user approaching the first virtual object and transmitting a presentation message corresponding to the interaction command to the first user includes: and displaying a suggestion message of the first virtual object on the graphical user interface after the second user approaches the first virtual object, the suggestion message representing an interaction command that the second user can issue to the first virtual object.

14. The AR interaction method according to claim 13,

20. the first virtual object is a group communication area controlled by a first user; entering a group chat interaction interface after the first user performs a third response operation to the suggested message; and / or and displaying a group chat interaction window in a floating manner on the graphical user interface after the first user performs a fourth response operation on the suggested message.

14. The AR interaction method according to claim 13,

21. Attribute information of the group communication area is displayed near the group communication area, and the attribute information of the first virtual object is introduction information of the group chat content input by the first user.

21. The AR interaction method according to claim 20,

22. a real-time position of the first virtual object is updated based on a real-time position of the first user to cause the first virtual object to move in a manner that follows the first user; or The position of the first virtual object is always determined based on the position selected by the first user when adding the first virtual object to the real-world space of the AR.

14. The AR interaction method according to claim 13,

23. The position of the first virtual object is always determined based on a position selected by a first user when adding the first virtual object to the real-world space of the AR; In response to a distance between a first virtual object and a first user being greater than a predetermined distance, removing a first virtual object from the AR real-world space; or In response to a predetermined time having elapsed since the first virtual object was added to the AR real-world space, removing the first virtual object from the AR real-world space; or and in response to the absence of an interaction command from another user to the first virtual object until a predetermined time has elapsed, deleting the first virtual object from the real-life space of the AR.

14. The AR interaction method according to claim 13,

24. a first display module that, in response to a real-life activation command issued by a first user, displays, on a graphical user interface, at least a part of an AR real-life space formed by superimposing a real-life image obtained by real-time shooting and a preset AR virtual object, and displays a virtual object setting control in a floating manner on the graphical user interface; a first adding module that adds a first virtual object controlled by a first user and located in the vicinity of the first user to the real-world space of the AR in response to an adding operation on a virtual object setting control by the first user; a first interaction module, which receives an interaction command issued to the first virtual object from a second user approaching the first virtual object, and then displays a prompt message corresponding to the interaction command issued by the second user on a graphical user interface, and allows the first user to perform information interaction with the second user according to the prompt message corresponding to the interaction command; 1. An AR interaction device comprising:

25. a second display module that, in response to a live-action start command issued by a second user, displays on a graphical user interface at least a part of the AR live-action space including a first virtual object, the part being formed by superimposing a live-action image obtained by shooting and a preset AR virtual object, and displays a virtual object interaction control in a floating manner on the graphical user interface, the position of the first virtual object being determined based on the position at which the first user adds the first virtual object to the AR live-action space; a first calculation module that calculates a distance between the second user and the first virtual object based on position information of the second user and position information of the first virtual object acquired in real time; a second interaction module that responds to an interaction command issued by the second user to the first virtual object after the second user approaches the first virtual object, and transmits a prompt message corresponding to the interaction command to the first user, so that the first user performs information interaction with the second user according to the prompt message corresponding to the interaction command; 1. An AR interaction device comprising:

26. An electronic device, A processor, a memory storing readable commands executable by the processor, and a bus, wherein when the electronic device is operated, the processor communicates with the memory via the bus and executes the readable commands to perform the steps of the AR interaction method according to any one of claims 1 to 12 or claims 13 to 23.

1. An electronic device comprising:

27. A computer program is stored which, when executed by a processor, performs the steps of the AR interaction method according to any one of claims 1 to 12 or claims 13 to 23. A computer-readable storage medium comprising:

Images