Interaction method, terminal device and server based on augmented reality (AR)

Abstract

The present invention relates to an interactive method based on augmented reality (AR), a terminal device, a server, a readable storage medium, and a computer program product. The method comprises: a terminal device obtains the identity information ID and location information of a first person through a designated device that appears in a nearby area, wherein the designated device is carried by the first person, and the ID of the designated device is bound to the ID of the first person; the terminal device sends the ID and location information of the first person to a server, so that the server displays a first AR tag near the first person, wherein the first AR tag includes the number of first-category icons and the number of second-category icons corresponding to the first person. Utilizing the embodiments of the present application, it is possible to associate human behavior in the real world with network operations, extend people's interactions from the network to the real world, and record and quantify human behavior.

Description

Technical Field

[0001] The present invention relates to the field of augmented reality and Internet technology, and in particular to an interactive method based on augmented reality (AR), a terminal device, a server, a readable storage medium, and a computer program product. Background Art

[0002] Currently, the functionality of electronic devices is constantly expanding, and the ways in which group members interact are becoming increasingly diverse, enriching people's social interactions. For example, on common social platforms, friends can express their appreciation for each other through comments or likes. On other internet platforms (such as e-commerce platforms), comments and likes are now also possible even between non-friends, fostering interaction among platform users and helping to strengthen user stickiness. However, these social methods all share a commonality: they are limited to the online level. When extended to real-world groups, they lack similar interactive methods and are unable to foster similar interactions between both acquaintances and strangers within the group. Summary of the Invention

[0003] In view of this, the present application proposes an interactive method, terminal device, server, readable storage medium and computer program product based on augmented reality (AR) to solve at least one technical problem.

[0004] An embodiment of the present application proposes an interactive method based on augmented reality (AR), which is applied to a terminal device, comprising: the terminal device obtains the identity information ID and positioning information of a first person through a designated device appearing in a nearby area, wherein the designated device is carried by the first person, and the ID of the designated device is bound to the ID of the first person; the terminal device sends the ID and positioning information of the first person to a server, so that the server displays a first AR tag near the first person, wherein the first AR tag includes the number of first-category icons and the number of second-category icons corresponding to the first person; if the terminal device receives a first-category operation for the first person, the number of first-category icons in the first AR tag is updated; if the terminal device receives a second-category operation for the first person, the number of second-category icons in the first AR tag is updated; during a learning activity, the terminal device obtains the ID of a second person participating in the learning activity and sends it to the server, so that the server displays a second AR tag near the second person, wherein the second AR tag includes the number of first-category icons and the number of second-category icons corresponding to the second person, and learning progress information during the learning activity, and the learning progress information includes information about learning files that the second person has browsed during the learning activity.

[0005] Optionally, when the user of the terminal device determines that the first person has committed the first type of behavior, the first type of operation is performed on the first person through the terminal device; when the user of the terminal device determines that the first person has committed the second type of behavior, the second type of operation is performed on the first person through the terminal device.

[0006] Optionally, the learning file includes at least one of the following: a text file, an audio file, a video file, and an answer file.

[0007] Optionally, the designated device is a badge equipped with a wireless communication module and a positioning module.

[0008] Optionally, specify that the device is an electronic product.

[0009] Optionally, it also includes: the terminal device sends the multiple learning tasks to the server, so that the server sends the multiple learning tasks to the terminal devices of each corresponding person respectively.

[0010] Optionally, it also includes: the terminal device displays the location of the third person on the map, and when the terminal device receives a trigger operation for the third person, displays a third AR tag near the third person, and the third AR tag includes at least one of the following: the number of first-category icons corresponding to the third person, the number of second-category icons, and learning progress information during the learning activity.

[0011] Optionally, the method further includes: the terminal device sending the registration information of the person to the server, where the registration information includes: person ID information, information of the learning activity group to which the person belongs, and current learning progress information.

[0012] Optionally, the first type of operation includes a like operation, and the first type of icon includes a like icon; the second type of operation includes a disapprove operation, and the second type of icon includes a disapprove icon.

[0013] The present application also provides an augmented reality (AR)-based interactive method, which is applied to a server, comprising: receiving an ID and location information of a first person sent by a terminal device, determining a number of first-category icons and a number of second-category icons corresponding to the first person based on the ID of the first person, and displaying a first AR tag near the first person based on the location information, the AR tag including the number of first-category icons and the number of second-category icons of the first person; wherein the ID and location information of the first person are sent to the terminal device by a designated device carried by the first person, and the ID of the first person is bound to the ID of the designated device; the server updates the number of first-category icons and the number of second-category icons in the first AR tag based on first-category operations and second-category operations received by the terminal device for the first person; during a learning activity, the server receives an ID of a second person participating in the learning activity sent by the terminal device, obtains the number of first-category icons, the number of second-category icons, and learning progress information corresponding to the second person during the learning activity based on the ID of the second person, and displays a second AR tag near the second person, wherein the second AR tag includes the number of first-category icons, the number of second-category icons, and learning progress information corresponding to the second person during the learning activity, the learning progress information including information about learning files browsed by the second person during the learning activity.

[0014] Optionally, it also includes: the server receives the registration information of the personnel sent by the terminal device, the registration information includes: personnel ID information, information of the learning activity group to which they belong, and current learning progress information; after successful registration, the server associates a list of the number of first-category icons and a list of the number of second-category icons for each person, which is used to update the number of first-category icons and the number of second-category icons corresponding to each person.

[0015] Optionally, it also includes: the server obtains the learning progress information of the personnel during the learning activity from the outside; wherein the learning file includes at least one of the following: text file, audio file, video file, answer file.

[0016] Optionally, it also includes: the server receives information about multiple learning tasks sent by a designated terminal device, and sends the multiple learning tasks to the terminal devices of each corresponding person respectively.

[0017] Optionally, it also includes: during the learning activity, the server generates data analysis results based on the learning progress information of multiple people during the learning activity, and displays them on at least one terminal device in the form of AR images.

[0018] Optionally, the designated device is a badge equipped with a wireless communication module and a positioning module.

[0019] An embodiment of the present application further provides a terminal device, comprising: a processor and a memory storing computer program instructions; when the terminal device executes the computer program instructions, the method as described in any one of the above items is implemented.

[0020] An embodiment of the present application further provides a server, comprising: a processor and a memory storing computer program instructions; when the server executes the computer program instructions, any of the methods described above is implemented.

[0021] An embodiment of the present application further provides a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, any of the methods described above is implemented.

[0022] An embodiment of the present application further provides a computer program product, which includes computer program instructions. When the computer program instructions are executed by a processor, any of the methods described above is implemented.

[0023] By using the embodiments of the present application, the geographic locations of people in the surrounding area can be easily determined, AR tags can be generated for the people, and superimposed on the space near the people. When it is found that the people have done good things, operations can be performed through the terminal device, such as giving a thumbs up to the person. Similarly, the person can comment on the good or bad behavior of others. Through this processing method, the behavior of people in the real world can be associated with network operations, so that people's interactions can be extended from the network to the real world. People's behavior can be recorded and quantified, and to a certain extent, people's behavior can be standardized or constrained; and during the learning activity, the data recorded according to the behavior of the people can be sorted, and the sorting results can be used as a reference for evaluation, making the sorting results more accurate and quantifiable; in addition, during the learning activity, new interactive content is added, that is, the learning progress information of each member during the learning activity. The learning progress information during the learning activity can objectively display the learning progress of each member, so that there is a basis for arranging the next task, and the learning content can be arranged reasonably, thereby improving the efficiency of knowledge learning during the learning activity. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Below, the preferred embodiments of the present invention will be further described in detail with reference to the accompanying drawings, in which:

[0025] Figure 1 This is a flowchart of an interactive method based on augmented reality (AR) proposed in an embodiment of the present application;

[0026] Figure 2 It is a scene diagram of the interactive method based on augmented reality (AR) proposed in an embodiment of the present application;

[0027] Figure 3is a schematic diagram of a badge proposed in an embodiment of the present application;

[0028] Figure 4 This is a flowchart of an interactive method based on augmented reality (AR) proposed in an embodiment of the present application;

[0029] Figure 5 is a schematic diagram of an activity flow during a learning activity proposed in an embodiment of the present application; and

[0030] Figure 6 A hardware structure diagram of an embodiment of the electronic device provided by the present application is shown. DETAILED DESCRIPTION

[0031] The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that the purpose of providing these embodiments is to make the principles and spirit of the present application clearer and more thorough, so that those skilled in the art can better understand and implement the principles and spirit of the present application. The exemplary embodiments provided herein are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments herein, all other embodiments obtained by those of ordinary skill in the art without creative work are within the scope of protection of this application.

[0032] Those skilled in the art will appreciate that the embodiments of the present application may be implemented as a system, apparatus, device, method, computer-readable storage medium, or computer program product. Therefore, the present disclosure may be implemented in at least one of the following forms: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0033] According to the implementation mode of the present application, the present application requests protection for an interactive method, terminal device, server, computer-readable storage medium and computer program product based on augmented reality (AR).

[0034] In this document, terms such as first and second are used only to distinguish one entity (or operation) from another entity (or operation) and do not require or imply any order or relationship between these entities (or operations). In this document, elements (such as parts, components, processes, steps) defined by the phrase "comprising..." do not exclude the existence of other elements in addition to the listed elements, that is, other elements not explicitly listed may also be included. In this document, any elements and their quantities in the drawings are for illustration only and not for limitation. Any nomenclature in the drawings is for distinction only and does not have any limiting meaning.

[0035] The following describes the principles and spirit of the present application in detail with reference to several exemplary or representative embodiments of the present application.

[0036] Figure 1 This is a flow chart of an interactive method based on augmented reality (AR) proposed in accordance with an embodiment of the present application. Figure 1 The embodiment of the present application proposes an interactive method based on augmented reality (AR), which is applied to a terminal device and includes the following steps:

[0037] S101: The terminal device obtains the identity information ID and location information of the first person through a designated device that appears in a nearby area, wherein the designated device is carried by the first person, and the ID of the designated device is bound to the ID of the first person.

[0038] S102: The terminal device sends the ID and location information of the first person to the server, so that the server displays a first AR tag near the first person, wherein the first AR tag includes the number of first-category icons and the number of second-category icons corresponding to the first person.

[0039] S103: If the terminal device receives a first type of operation for the first person, the number of first type icons in the first AR tag is updated; if the terminal device receives a second type of operation for the first person, the number of second type icons in the first AR tag is updated.

[0040] S104: During the learning activity, the terminal device obtains the ID of the second person participating in the learning activity and sends it to the server, so that the server displays a second AR tag near the second person. The second AR tag includes the number of first-category icons and the number of second-category icons corresponding to the second person and the learning progress information during the learning activity. The learning progress information includes information about the learning files that the second person has browsed during the learning activity.

[0041] According to an embodiment of the present application, in step S101, a first person appears near a user of a terminal device, and the first person carries a designated device that can send the first person's identity ID and location information to the terminal device.

[0042] In some embodiments, the designated device is an electronic device equipped with a wireless communication module and a positioning module. For example, it can be a badge worn by a person that has been processed and equipped with a Bluetooth module and a GPS module. Of course, it can also be any other type of smart terminal device. The ID of the first person is bound to the ID of the designated device. When the first person carrying the designated device appears near the terminal device, the designated device can automatically send the first person's ID and location information to the terminal device. The terminal device can then receive the first person's ID and location information and notify the terminal user.

[0043] In step S102, the terminal device sends the received identity ID and location information of the first person to the server. In some embodiments, the server pre-stores the number of first-category icons and the number of second-category icons corresponding to the identity ID of the first person. When the server receives the identity ID of the first person sent by the terminal device, the server can find the corresponding number of first-category icons and the number of second-category icons based on the identity ID of the first person, and display the number of first-category icons and the number of non-first-category icons in the form of AR images near the first person based on the location information of the first person. The AR image can be a first AR tag, such as an AR image floating near the first person.

[0044] In step S103, the terminal device may receive a first-category operation or a second-category operation for the first person. In some embodiments, optionally, when the terminal device receives these operations, the terminal device responds to these operations by sending a signal to the server to change the number of first-category icons or the number of second-category icons. The server updates the number of first-category icons and the number of second-category icons corresponding to the first person's identity ID stored on the server, and sends the changed number of first-category icons and the number of second-category icons to the vicinity of the first person. At this time, the number of first-category icons and the number of second-category icons displayed in the first AR tag near the first person are updated. In some embodiments, optionally, the terminal device responds to the first-category operation or the second-category operation by directly processing and updating the number of first-category icons and the number of second-category icons in the first AR tag, and sends the changed number of first-category icons and the number of second-category icons in the first AR tag to the server so that they correspond to the first person's ID.

[0045] As an example, the first category of icons could be the number of likes or virtual flowers received by the first person, indicating the amount of positive feedback the first person has received. Conversely, the second category of icons could be the number of disapprovals or withered virtual flowers received, indicating the amount of negative feedback the first person has received. The first and second category icons are derived from the number of interactions with the first person's behavior, and can measure the number of good deeds and bad behaviors the first person has performed.

[0046] In step S104, during the active learning period, all active members of the learning activity carry a terminal device, and the server is able to determine the location of the person based on the positioning information sent by the terminal device. The terminal device sends the ID of the member during the learning activity to the server. The server finds the number of first-category icons, the number of second-category icons, and the learning progress information during the learning activity corresponding to the second person's ID based on the second person's ID. In some embodiments, the student sends the identity information and the student ID in the knowledge learning APP during the learning activity to the terminal device through registration. The terminal device binds the person's ID to the student ID in the knowledge learning APP during the learning activity and grants certain permissions. When the terminal device sends the person's ID to the server, the server is able to obtain the person's number of first-category icons, the number of second-category icons, and the learning progress information in the knowledge learning APP during the learning activity based on the person's ID information and the student ID in the knowledge learning APP during the learning activity. The server is able to display the number of first-category icons, the number of second-category icons, and the learning progress information during the learning activity in the form of a second AR tag near the person.

[0047] During the learning period, each member can also send various requests to other members through the terminal device, such as learning sharing requests, question-answering competition requests, etc., and members can interact with each other in various forms.

[0048] The method proposed in the embodiment of the present application enables the number of first-category icons and second-category icons of a person to be displayed in the form of AR effects near him, so that other people around him can view it. The people around him can also like or perform second-category operations on the person. Even strangers can discover and evaluate each other, thereby making more accurate records of the behavior of the people on a larger scale. In addition, during the learning activity, the people can be sorted according to the number of first-category icons, the number of second-category icons and the learning progress information during the learning activity, and the sorting results can be used as a reference for evaluation, making the sorting results more accurate and quantifiable.

[0049] In some embodiments, optionally, when the user of the terminal device determines that the first person has committed the first type of behavior, the first type of operation is performed on the first person through the terminal device; when the user of the terminal device determines that the first person has committed the second type of behavior, the second type of operation is performed on the first person through the terminal device. The first type of behavior can be good behaviors such as helping others and returning lost property, that is, behaviors that can bring positive effects. In contrast, the second type of behavior can be some uncivilized behaviors such as littering and not observing order, that is, behaviors that can bring negative effects. In some embodiments, optionally, the first type of operation can be the user of the terminal device clicking on a like icon displayed in the form of an AR image. Similarly, the second type of operation can be the user of the terminal device clicking on a disapproval icon displayed in the form of an AR image.

[0050] Figure 2 It is a scene diagram of the interactive method based on augmented reality AR proposed in the embodiment of this application. Figure 2 As shown in the figure, the scene shown in the figure is that during a learning activity, using the interactive method based on augmented reality AR provided by the embodiment of the present application, members during the learning activity can see the second AR tag displayed near other members during the learning activity. In some embodiments, the first AR tag is the same as the second AR tag. Figure 2 In the figure, a second AR tag 202 is displayed near the second person 201, and the second AR tag includes the following content: the name of the second person 201, the number of years of participation in the learning activity, whether the learning task of this month is completed, the number of first-category icons, the number of disapprovals, and the video of this month's learning. Among them, the learning task of this month can be a learning task sent by the administrator to each member during the learning activity. Alternatively, the learning task of this month can also be a learning task issued by the learning APP during the learning activity. In addition, the second AR tag also includes a like icon 203 and a disapprove icon 204. In some embodiments, the like icon can be a smiley face, and the disapproval icon can be a crying face icon. This application does not specifically limit the form of the like icon. As long as the icon can be operated according to the behavior of the person, it is within the scope of protection of this application.

[0051] In the interactive method based on augmented reality AR provided in the embodiment of the present application, the learning files during the learning activity include at least one of the following: text files, audio files, video files, and answer files. During the learning activity, the server can obtain the learning progress information corresponding to the second person during the learning activity based on the ID of the second person, and the learning progress information during the learning activity includes the learning file information that the second person has browsed during the learning activity. In some embodiments, optionally, the server can obtain the learning content of the second person in the knowledge learning APP during the learning activity based on the student number of the knowledge learning APP during the learning activity that is bound to the second person's ID, such as the learning videos that have been learned, the articles that have been learned, the exercises that have been completed, etc.

[0052] In some embodiments, optionally, when the first person only carries a designated device, the terminal device may also receive the first person's ID sent by the designated device carried by the first person. In a specific application scenario, the designated device may be a badge equipped with a wireless communication module and a positioning module. Figure 3 This is a schematic diagram of a badge proposed in an embodiment of the present application. Figure 3 As shown, a chip is implanted in the badge 301. When the badge 301 is buckled with the magnetic buckle 302 of the badge, Bluetooth is automatically turned on and connected to the terminal device of the first person. The first person uploads his or her identity information to the terminal device, and the terminal device receives the identity information and sends it to the server.

[0053] In some embodiments, the terminal device may optionally send multiple learning tasks to the server, so that the server can send the multiple learning tasks to the terminal devices of each corresponding person. For example, during a learning activity, the administrator of the learning activity group can use the terminal device to send learning tasks to learning members and can also use the terminal device to view the learning progress of each learning member.

[0054] In some examples, optionally, the terminal device displays the location of a third person on a map, and when the terminal device receives a trigger operation for the third person, a third AR tag is displayed near the third person, and the third AR tag includes at least one of the following: the number of first-category icons corresponding to the third person, the number of second-category icons, and learning progress information during the learning activity. When other people appear around the user of the terminal device, the location and distribution of multiple people can be displayed on the electronic map on the terminal device. The user of the terminal device can click on the location of the person they want to view on the map to see the AR tag displayed near the person, wherein the AR tag may include the number of first-category icons corresponding to the person, the number of second-category icons, and learning progress information during the learning activity.

[0055] In some embodiments, the terminal device optionally sends the person's registration information to the server. The registration information includes: person ID information, information about the learning activity group to which the person belongs, and current learning progress information. The person's information is uploaded to the terminal device and transmitted to the server when the person registers. The person's relevant information is bound to the person's ID. When the server receives the person's ID sent by the terminal device, it can obtain the number of first-category icons and second-category icons bound to the person's ID, as well as learning progress information during the learning activity, and display this information in the form of AR images.

[0056] In some embodiments, registered persons can participate in the AR-based interactive process of the aforementioned embodiment, and unregistered persons cannot participate in the AR-based interactive process of the aforementioned embodiment.

[0057] Correspondingly, Figure 4 This is a flow chart of an interactive method based on augmented reality (AR) proposed in accordance with an embodiment of the present application. Figure 4 As shown, the method is applied to the server and includes the following steps:

[0058] S401: The server receives the ID and positioning information of the first person sent by the terminal device, determines the number of first-category icons and the number of second-category icons corresponding to the first person based on the ID of the first person, and displays a first AR tag near the first person based on the positioning information. The AR tag includes the number of first-category icons and the number of second-category icons of the first person; wherein, the ID and positioning information of the first person are sent to the terminal device by a designated device carried by the first person, and the ID of the first person is bound to the ID of the designated device.

[0059] S402: The server updates the number of first-category icons and the number of second-category icons in the first AR tag according to the first-category operation and the second-category operation received by the terminal device for the first person.

[0060] S403: During the learning activity, the server receives the ID of the second person participating in the learning activity sent by the terminal device, obtains the number of first-category icons, the number of second-category icons, and the learning progress information during the learning activity corresponding to the second person according to the ID of the second person, and displays a second AR tag near the second person, wherein the second AR tag includes the number of first-category icons, the number of second-category icons, and the learning progress information during the learning activity corresponding to the second person, and the learning progress information during the learning activity includes information about the learning files that the second person has browsed during the learning activity.

[0061] According to an embodiment of the present application, in step S401, a first person appears near a user of a terminal device, and the first person carries a designated device that can send the first person's identity ID and location information to the terminal device. In some embodiments, the designated device is an electronic device equipped with a wireless communication module and a positioning module. For example, it can be a badge worn by a person, which is processed and equipped with a Bluetooth module and a GPS module, an electronic watch, etc., or other types of smart terminal devices. The first person's ID is bound to the ID of the designated device. When the first person appears near the terminal device with the designated device, the designated device can automatically send the first person's identity ID and location information to the terminal device. The terminal device can receive the first person's identity ID and location information and prompt the user of the terminal device.

[0062] The terminal device sends the received identity ID and location information of the first person to the server. In some embodiments, the server pre-stores the number of first-category icons and the number of second-category icons corresponding to the first person's identity ID. When the server receives the identity ID of the first person sent by the terminal device, the server can find the corresponding number of first-category icons and the number of second-category icons based on the identity ID of the first person, and display the number of first-category icons and the number of second-category icons in a first AR tag near the first person based on the location information of the first person. The AR image can be the first AR tag, such as an AR image floating near the first person.

[0063] In step S402, when the terminal device receives these operations, the terminal device responds to these operations and sends information on changing the number of first-category icons or the number of second-category icons to the server. The server updates the number of first-category icons and the number of second-category icons corresponding to the first person's identity ID stored in the server, and sends the changed number of first-category icons and the number of second-category icons to the vicinity of the first person. At this time, the number of first-category icons and the number of second-category icons displayed in the first AR tag near the first person are updated.

[0064] As an example, the first category of icons could be the number of likes or virtual flowers received by the first person, indicating the number of positive feedback received. Conversely, the second category of icons could be the number of disapprovals or withered virtual flowers received, indicating the number of negative feedback received. The first and second category icons are derived from the number of interactions with the first person's behavior, and can measure the number of good deeds and bad behaviors of the first person.

[0065] In step S403, during the learning activity, all members of the activity carry a terminal device, and the server can determine the location of the person based on the positioning information sent by the terminal device. The terminal device sends the ID of the member during the learning activity to the server. The server finds the number of first-category icons, the number of second-category icons, and the learning progress information during the learning activity corresponding to the second person's ID based on the second person's ID. In some embodiments, the person sends his or her identity information and the student ID number in the knowledge learning app during the learning activity to the terminal device through registration. The terminal device binds the person's ID to his or her student ID number in the knowledge learning app during the learning activity and grants certain permissions. When the terminal device sends the person's ID to the server, the server can obtain the person's number of first-category icons, the number of second-category icons, and the learning progress information during the learning activity in the knowledge learning app based on the person's ID information and the student ID number in the knowledge learning app during the learning activity. The server can display the number of first-category icons, the number of second-category icons, and the learning progress information during the learning activity in the form of a second AR tag near the person.

[0066] During the learning activity, each member can also send various requests to other members during the learning activity through the terminal device, such as learning sharing requests, answering competition requests, etc., and members can interact with each other in various forms. The method proposed in the embodiment of the present application enables the number of first-category icons and second-category icons of a person to be displayed in the form of AR effects near him, making it easy for other people around him to view. People around him can also like or perform second-category operations on the person. Even strangers can discover and evaluate each other, thereby recording the behavior of people on a larger scale and more accurately. In addition, during the learning activity, people can be sorted according to the number of first-category icons, the number of second-category icons, and the learning progress information during the learning activity. The sorting results are used as a reference for evaluation, making the sorting results more accurate and quantifiable. In some embodiments, optionally, when the user of the terminal device determines that the first person has committed the first-category behavior, the first-category operation is performed on the first person through the terminal device; when the user of the terminal device determines that the first person has committed the second-category behavior, the second-category operation is performed on the first person through the terminal device. The first-category behavior can be good behavior such as helping others and returning lost property, that is, behavior that can bring positive influence. In contrast, the second type of behavior may be uncivilized behavior such as littering and disobeying order, i.e., behavior that can have a negative impact. In some embodiments, optionally, the first type of operation may be the user of the terminal device clicking a like icon displayed in the form of an AR image, and similarly, the second type of operation may be the user of the terminal device clicking a disapprove icon displayed in the form of an AR image.

[0067] In some embodiments, optionally, the server receives registration information of a person sent by a terminal device, the registration information including: person ID information, information of the learning activity group to which the person belongs, and information on the current learning progress during the learning activity; after successful registration, the server associates a list of the number of first-category icons and a list of the number of second-category icons for each person, which is used to update the number of first-category icons and the number of second-category icons corresponding to each person.

[0068] In some embodiments, optionally, the server obtains the learning progress information of the person during the learning activity from the outside; wherein, the learning files during the learning activity include at least one of the following: text files, audio files, video files, and answer files. During the learning activity, the server can obtain the learning progress information corresponding to the second person during the learning activity based on the ID of the second person, and the learning progress information during the learning activity includes the learning file information that the second person has browsed during the learning activity. In some embodiments, optionally, the server can obtain the learning content of the second person in the knowledge learning APP during the learning activity based on the student number of the knowledge learning APP during the learning activity bound to the second person's ID, such as the learning videos that have been learned, the articles that have been learned, the exercises that have been completed, etc.

[0069] In some embodiments, optionally, the server receives information about multiple learning tasks sent by a designated terminal device, and sends the multiple learning tasks to the terminal devices of each corresponding person respectively.

[0070] In some embodiments, optionally, during a learning activity, the server generates data analysis results based on the learning progress information of multiple people during the learning activity, and displays them on at least one terminal device in the form of AR images. The server can retrieve the members of the learning activity and analyze their learning progress information, and can summarize the analysis results, so that the administrator during the learning activity can grasp the learning progress of each member. When most members complete the learning tasks within the predetermined time, it can be determined whether the assigned learning tasks are too heavy or too few. For example, the data analysis results may include the following:

[0071] 1. 98% of students completed the assigned learning content.

[0072] 2. Three people were praised as volunteers: Zhang San, Li Si, and Zhao Wu.

[0073] 3. One person was stepped on for queuing in an uncivilized manner; Wang Liu.

[0074] In some embodiments, the designated device can optionally be a badge equipped with a wireless communication module and a positioning module. In specific application scenarios, the designated device can be a badge equipped with a wireless communication module and a positioning module. A chip can be implanted in the first person's badge. When the magnetic buckle docks with the badge, it automatically activates Bluetooth and connects to the first person's terminal device. The first person uploads their identity information to the terminal device, which then receives the identity information and sends it to the server.

[0075] In a specific application scenario, the terminal device can be a mobile phone with a "personnel interaction app" installed. Phone 1 receives Person 1's registered identity information and the student ID number of the knowledge learning app during the learning activity, and then sends this information to the server for storage. Phone 1 binds Person 1's identity information to the ID of Person 1's smart badge. The smart badge includes a wireless communication module that can transmit its ID to nearby mobile phones, such as Person 2's phone 2, using, for example, Bluetooth.

[0076] The smart badge also includes a positioning module (such as a GPS module), which can report its own location information to the server; the server can send the badge positioning information within a specific range to a specific mobile phone, for example, display the badge location on a mobile phone map, and Person 2's mobile phone 2 receives the ID and positioning information of Person 1's smart badge 1. Mobile phone 2 will prompt that Person 1 appears nearby. Person 2 uses mobile phone 2 to scan the surrounding people, can identify Person 1, and enhance the display of AR tags near Person 1. In Person 2's mobile phone 2, icons of likes and crying faces are displayed in AR form next to Person 1, and these icons of likes and crying faces are bound to Person 1's identity information.

[0077] When person 2 recognizes that person 1 has engaged in inappropriate behavior, person 2 can click on person 1's crying face icon. Person 2's phone recognizes this action and sends it to the server. The server updates the number of crying faces of person 1, and the server sends the updated number back to person 2's phone. The number of crying faces in person 1's AR tag is updated. Similarly, when person 2 recognizes that person 1 has engaged in good behavior, person 2 can click on person 1's like icon. At this time, the number of the first category icon of person 1 displayed in AR form on person 2's phone will be updated and increased by 1.

[0078] During learning activities, participants can use their devices to see AR tags around other participants. These tags can display various information, including the number of likes and sad faces. The group administrator or managers can configure the content to be learned. Everyone will receive a learning notification, and during meetings, AR displays will show the learning and non-learning status.

[0079] Figure 5 This is a schematic diagram of an activity flow during a learning activity according to an embodiment of the present application. Figure 5 As shown, the badge with the implanted chip is connected to the terminal device via Bluetooth, and the personnel can perform the following operations on the terminal device: register in the "Personnel Interaction APP", fill in the personnel's name, age, the learning activity group to which they belong, and the student number of the learning APP during the learning activity, and the terminal device sends the personnel information to the server. The server will analyze and process the collected personnel information, the number of likes and rejections of the personnel, the learning tasks assigned by the learning activity group administrator, and the completion status data. Afterwards, in the branch meeting, open the "Personnel Interaction APP" to display the situation of all personnel in the learning activity group in AR form. The learning activity group administrator can display the following content when opening the "Personnel Interaction APP": the location distribution of the learning activity group personnel, where each point in the electronic map represents a person, and you can click on the AR form to view details; the data analysis results of the learning activity group:

[0080] 1. 98% of students completed the assigned learning content.

[0081] 2. Three people were praised as volunteers: Zhang San, Li Si, and Zhao Wu.

[0082] 3. One person was stepped on for queuing in an uncivilized manner; Wang Liu.

[0083] 4. The person who made the most progress in the learning APP this month during the learning activity is: Sun Qi, with an increase of 1,000 points.

[0084] ······

[0085] In addition, the displayed content can also include a learning reminder button during the learning activity. Clicking the button can enable knowledge learning. During the learning activity meeting, the terminal device can see the AR tags displayed around each person, such as Figure 2 As shown, the AR tag may include the person's name, the number of years of participation in the learning activity, the score in the learning APP during the learning activity, whether the learning task of this month is completed, the number of likes and the cumulative number of likes, and the most recently learned audio file, etc.

[0086] If the administrator wants to query the specific learning content of a certain person 3, the administrator clicks on person 3 on the terminal device. The server will match the identity information of person 3 with the student ID of the learning APP during a certain learning activity, obtain the learning content information of person 3 in the APP, and feed the information back to the administrator's mobile phone.

[0087] Person 2's phone can perform facial recognition based on Person 1's photo stored on the server. It can also locate Person 1's location using a badge (displaying Person 1's location on the phone's map). Person 1's learning progress information can also be displayed in augmented reality next to or above Person 1 on Person 2's phone. Learning activity group administrators can assign learning tasks through the person interaction app and access individual members' learning progress for aggregated data.

[0088] An embodiment of the present application further proposes a terminal device, which includes: a processor and a memory storing computer program instructions; when the terminal device executes the computer program instructions, it implements the interactive method based on augmented reality (AR) as described in any of the above items.

[0089] An embodiment of the present application further proposes a server, comprising: a processor and a memory storing computer program instructions; when the server executes the computer program instructions, the interactive method based on augmented reality (AR) as described in any of the above items is implemented.

[0090] An embodiment of the present application further proposes a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, an interactive method based on augmented reality (AR) as described above is implemented.

[0091] An embodiment of the present application further provides a computer program product, which includes computer program instructions. When the computer program instructions are executed by a processor, an interactive method based on augmented reality (AR) as described above is implemented.

[0092] Figure 6 A hardware structure diagram of an embodiment of the electronic device provided by the present application is shown.

[0093] like Figure 6 As shown, the electronic device may include a processor 601 and a memory 602 storing computer program instructions.

[0094] Specifically, the processor 601 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0095] The memory 602 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 602 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory 602 may include removable or non-removable (or fixed) media. Where appropriate, the memory 602 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 602 is a non-volatile solid-state memory.

[0096] The memory may include read-only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical / tangible memory storage devices. Thus, generally, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.

[0097] The processor 601 reads and executes computer program instructions stored in the memory 602 to implement any one of the interactive methods based on augmented reality (AR) in the above embodiments.

[0098] In one example, the electronic device may further include a communication interface 603 and a bus 610. As shown in FIG5 , the processor 601, the memory 602, and the communication interface 603 are connected and communicate with each other via the bus 610. The electronic device in the embodiment of the present application may be a server or other computing device, or a cloud server.

[0099] The communication interface 603 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0100] Bus 610 includes hardware, software or both, and the components of online data flow metering equipment are coupled to each other. For example, and not limitation, bus can include accelerated graphics port (AGP) or other graphics bus, enhanced industry standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industry standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 610 can include one or more buses. Although the present application embodiment describes and shows a specific bus, the application considers any suitable bus or interconnection.

[0101] In addition, in conjunction with the interactive method based on augmented reality (AR) in the above embodiments, embodiments of the present application may provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by a processor, any of the interactive methods based on augmented reality (AR) in the above embodiments is implemented.

[0102] It should be understood that the present application is not limited to the specific configurations and processes described above and illustrated in the figures. For the sake of brevity, a detailed description of known methods is omitted here. In the above embodiments, several specific steps are described and illustrated as examples. However, the method process of the present application is not limited to the specific steps described and illustrated. Those skilled in the art can make various changes, modifications, and additions, or change the order of the steps after understanding the spirit of the present application.

[0103] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application-specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. The machine-readable medium can include a non-transient computer-readable storage medium, such as an electronic circuit, a semiconductor memory device, a ROM, a flash memory, an erasable ROM (EROM), a floppy disk, a CD-ROM, an optical disc, a hard disk, an optical fiber medium, and the machine-readable medium can also include a radio frequency (RF) link, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0104] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps. In other words, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0105] Aspects of the present disclosure have been described above with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor or a field programmable logic circuit. It is also understood that each box in the block diagram and / or flowchart and the combination of the boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0106] The above description is only a specific embodiment of the present application. Those skilled in the art will clearly understand that for the convenience and brevity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the scope of protection of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the scope of protection of the present application.

Claims

1. An interactive method based on augmented reality (AR), characterized in that: Applied to a first terminal device, the method includes: The first terminal device obtains the identity information ID and location information of the first person through a designated device that appears in the nearby area, wherein the designated device is a badge equipped with a wireless communication module and a positioning module, and the badge is carried by the first person, and the ID of the badge is bound to the ID of the first person; The first terminal device sends the ID and location information of the first person to the server, so that the server displays the number of like icons and the number of disapproval icons in the form of AR images on the first terminal device near the first person, and the number of like icons and the number of disapproval icons come from the number of times other registered persons click on the icons in response to the behavior of the first person, wherein, when other persons determine that the first person has done something that can bring positive influence in the real world, they click on the like icon for the first person on their own terminal devices, and the first terminal device updates the number of like icons for the first person when receiving the like information; when other persons determine that the first person has done something that can bring negative influence in the real world, they click on the disapproval icon for the first person on their own terminal devices, and the first terminal device updates the number of disapproval icons for the first person when receiving the disapproval information; During the learning activity, the first terminal device obtains the ID of the second person participating in the learning activity and sends it to the server, so that the server displays the number of like icons, the number of disapprove icons and learning progress information corresponding to the second person during the learning activity near the second person, and the learning progress information includes information about the learning files that the second person has browsed during the learning activity.

2. The method according to claim 1, characterized in that The learning file includes at least one of the following: a text file, an audio file, a video file, and a question-answering file.

3. The method according to claim 1, characterized in that Also includes: The first terminal device sends multiple learning tasks to the server, so that the server sends the multiple learning tasks to the terminal devices of each corresponding person respectively.

4. The method according to claim 3, characterized in that Also includes: The first terminal device displays the location of the third person on the map. When the first terminal device receives a trigger operation for the third person, the number of like icons, the number of disapprove icons, and the learning progress information corresponding to the third person during the learning activity are displayed near the third person.

5. The method according to any one of claims 1 to 4, characterized in that Also includes: The first terminal device sends the registration information of the person to the server, where the registration information includes: person ID information, information of the learning activity group to which the person belongs, and current learning progress information.

6. A terminal device, characterized in that: The terminal device includes: a processor and a memory storing computer program instructions; when the terminal device executes the computer program instructions, the method according to any one of claims 1 to 5 is implemented.

7. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer program instructions, which implement the method according to any one of claims 1 to 5 when executed by a processor.

8. A computer program product, characterized in that The method comprises computer program instructions, which implement the method according to any one of claims 1 to 5 when executed by a processor.

Images