Interactive information display method, device, system, equipment and computer storage medium

Abstract

The embodiments of the present disclosure disclose an interactive information display method, apparatus, system, device and computer storage medium. The interactive information display method is applied to a first terminal and may include: acquiring a real-scene image; when a unique identification object is included in the real-scene image, providing an interactive interface corresponding to the unique identification object on the real-scene image; and responding to an interactive information display instruction to display the interactive information on the interactive interface.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of information display technology, and in particular, to an interactive information display method, device, system, equipment and computer storage medium. Background Art

[0002] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It can apply computer-generated text, images, three-dimensional models, music, video and other virtual information to the real world through a variety of technical means, and combine and interact with real-world scenes, thereby enhancing the real world.

[0003] As augmented reality technology becomes more and more popular, its applications are also diversified, enabling a more interactive and intelligent experience. The interactive interface of AR technology in the existing technology is not associated with the content in the current real-life image during interaction, the richness of the interactive interface is low, and the interactive information is directly displayed without triggering conditions. The interactive information is also displayed when it is not necessary, which will cause server performance to decline and cause confusion in the interactive interface. Summary of the invention

[0004] In view of this, the embodiments of the present disclosure hope to provide an interactive information display method, device, system, equipment and computer storage medium; which can solve the technical problems of low richness of interactive interface, decreased server performance due to failure to set trigger conditions, and chaotic interactive interface.

[0005] The technical solution of the embodiment of the present disclosure is implemented as follows:

[0006] In a first aspect, an embodiment of the present disclosure provides an interactive information display method, which is applied to a first terminal, and the method includes:

[0007] Collect real-life images;

[0008] When the real scene image includes a unique identification object, providing an interactive interface corresponding to the unique identification object on the real scene image;

[0009] In response to the interactive information display instruction, the interactive information is displayed on the interactive interface.

[0010] In some examples, the responding to the interactive information display instruction and displaying the interactive information on the interactive interface includes:

[0011] In response to the interaction information display instruction generated based on the environment information of the first terminal, the interaction information is displayed on the interaction interface.

[0012] In some examples, the environmental information includes temperature information;

[0013] The step of responding to the interactive information display instruction generated based on the environment information of the first terminal and displaying the interactive information on the interactive interface includes:

[0014] In response to the temperature information satisfying the first preset condition, generating the interactive information display instruction;

[0015] In response to the interactive information display instruction, interactive information related to the temperature information is provided on the interactive interface.

[0016] In some examples, the environmental information includes a number of temperature sources in contact with the first terminal;

[0017] The step of responding to the interactive information display instruction generated based on the environment information of the first terminal and displaying the interactive information on the interactive interface includes:

[0018] In response to the number of temperature sources being greater than a first preset threshold, generating the interactive information display instruction;

[0019] In response to the interactive information display instruction, the interactive information is displayed on the interactive interface.

[0020] In some examples, the responding to the interactive information display instruction and displaying the interactive information on the interactive interface includes:

[0021] In response to an interactive information display instruction corresponding to the operation generated when the number of second terminals receiving the same operation as the first terminal within a preset time period is greater than a second preset threshold, interactive information corresponding to the operation is displayed on the interactive interface.

[0022] In some examples, when the real scene image includes a unique identification object, providing an interactive interface corresponding to the unique identification object on the real scene image includes:

[0023] Acquire the current location of the first terminal, and determine a unique identification object corresponding to the current location based on the current location;

[0024] The real scene image is identified, and when the real scene image includes the unique identification object, an interactive interface corresponding to the unique identification object is provided on the real scene image.

[0025] In some examples, the method further includes: obtaining location information of the first terminal and a camera direction when the first terminal captured the real-scene image;

[0026] Determine, according to the location information, a target direction of the uniquely identified object relative to the first terminal;

[0027] When the camera direction is the same as the target direction, it is determined that the real scene image includes the unique identification object.

[0028] In some examples, displaying the interaction information on the interaction interface includes:

[0029] The image information of the uniquely identified object photographed in real time by the second terminal is displayed on the interactive interface.

[0030] In some examples, the method further includes:

[0031] The historical interaction information that meets the second preset condition and is sent by the second terminal is displayed on the interaction interface.

[0032] In some examples, displaying, on the interaction interface, historical interaction information sent by the second terminal and meeting the second preset condition includes:

[0033] Obtaining the current time when the first terminal captures the real scene image;

[0034] The historical interaction information within a first preset time from the current time is displayed on the interaction interface.

[0035] In some examples, the method further includes:

[0036] The real-time interaction information sent by the second terminal and meeting the third preset condition is displayed on the interaction interface.

[0037] In some examples, displaying on the interactive interface the real-time interaction information sent by the second terminal that meets the third preset condition includes:

[0038] Acquire the current location of the first terminal;

[0039] The real-time interaction information sent by the second terminal within a preset distance from the current location is displayed on the interaction interface.

[0040] In some examples, the uniquely identified object is a target celestial body; the method further includes:

[0041] The relevant information of the target celestial body is displayed on the interactive interface.

[0042] In a second aspect, the embodiments of the present disclosure provide an interactive information display method, which is applied to a server, including:

[0043] Receiving a real scene image sent by the first terminal;

[0044] Identify the real scene image, and when the real scene image includes a unique identification object, send an interactive interface generation instruction to the first terminal, so that the first terminal generates an interactive interface corresponding to the unique identification object on the real scene image;

[0045] An interaction information display instruction is sent to the first terminal, so that the first terminal can display the interaction information on the interaction interface.

[0046] In some examples, sending the interaction information display instruction to the first terminal includes:

[0047] receiving environment information of the first terminal;

[0048] The interactive information display instruction is generated based on the environment information of the first terminal and sent to the first terminal.

[0049] In some examples, the method further includes:

[0050] Receiving, by the first terminal, an interactive information acquisition instruction corresponding to the interactive information display instruction;

[0051] The interaction information is sent to the first terminal based on the interaction information acquisition instruction, so that the first terminal displays the interaction information on the interaction interface.

[0052] In a third aspect, an embodiment of the present disclosure provides an interactive information display device, which is applied to a first terminal, and the device includes:

[0053] A collection module, used for collecting real scene images;

[0054] a response module, configured to provide an interactive interface corresponding to the unique identification object on the real scene image when the real scene image includes the unique identification object;

[0055] The display module is used to respond to the interactive information display instruction and display the interactive information on the interactive interface.

[0056] In a fourth aspect, an embodiment of the present disclosure provides an interactive information display device, which is applied to a server, and the device includes:

[0057] A receiving module, used for receiving a real scene image sent by the first terminal;

[0058] a generating module, configured to identify the real scene image, and when the real scene image includes a unique identification object, send an interactive interface generating instruction to the first terminal, so that the first terminal generates an interactive interface corresponding to the unique identification object on the real scene image;

[0059] The sending module is used to send an interaction information display instruction to the first terminal, so that the first terminal can display the interaction information on the interaction interface.

[0060] In a fifth aspect, an embodiment of the present disclosure provides an electronic device, comprising: a processor and a memory; the processor is used to execute instructions stored in the memory to implement the interactive information display method described in the first aspect or the second aspect.

[0061] In a sixth aspect, an embodiment of the present disclosure provides a computer storage medium, wherein the storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the interactive information display method as described in the first aspect or the second aspect.

[0062] In a seventh aspect, an embodiment of the present disclosure provides an interactive information display system, including a first terminal and a server, wherein:

[0063] The first terminal is used to collect real-scene images and send them to the server;

[0064] The server is used to receive the real scene image, identify the real scene image, and send an interactive interface generation instruction to the first terminal when the real scene image includes a unique identification object;

[0065] The first terminal is used to generate instructions based on the interactive interface, and provide an interactive interface corresponding to the unique identification object on the real scene image;

[0066] The server is used to send an interactive information display instruction to the first terminal;

[0067] The first terminal is used to respond to the interaction information display instruction and display the interaction information on the interaction interface.

[0068] The disclosed embodiments provide a method, apparatus, system, device and computer storage medium for displaying interactive information; by providing an interactive interface corresponding to the unique identification object on the real scene image when the unique identification object is included in the real scene image, on the one hand, the personalization of the interactive interface and the richness of the interactive interface can be improved. On the other hand, the interactive interface corresponds to the unique identification object, which can optimize data management and facilitate the management of interactive data in the interactive interface. On the other hand, before displaying the interactive information, a trigger condition is set, that is, an interactive information display instruction, which avoids the technical problems of server performance degradation and interactive interface confusion caused by directly displaying all interactive information, optimizes resource utilization, improves the relevance of the interactive interface displaying interactive information, and can enhance user participation. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] Figure 1A schematic diagram of a system architecture that can implement the above-mentioned interactive information display method provided in an embodiment of the present disclosure.

[0070] Figure 2 A flowchart of an interactive information display method applied to a first terminal provided in an embodiment of the present disclosure.

[0071] Figure 3 A schematic diagram showing temperature-related interactive information provided by an embodiment of the present disclosure.

[0072] Figure 4 Another schematic diagram showing temperature-related interactive information provided in an embodiment of the present disclosure.

[0073] Figure 5 A schematic diagram of a generation condition of an interactive information display instruction provided in an embodiment of the present disclosure.

[0074] Figure 6 A schematic diagram of another interactive information display instruction generation condition provided in an embodiment of the present disclosure.

[0075] Figure 7 A schematic diagram showing historical interaction information and sending time provided in an embodiment of the present disclosure.

[0076] Figure 8 A schematic diagram of differentially displaying historical interaction information and real-time interaction information provided by an embodiment of the present disclosure.

[0077] Fig. 9 A schematic diagram of multiple terminal interactions provided in an embodiment of the present disclosure.

[0078] Fig.10 A flowchart of an interactive information display method applied to a server provided in an embodiment of the present disclosure.

[0079] Fig.11 A data flow diagram of a first terminal and a server provided in an embodiment of the present disclosure.

[0080] Fig.12 An architecture diagram of an interactive information display system provided in an embodiment of the present disclosure.

[0081] Fig.13 A schematic diagram of the structure of an interactive information display device applied to a first terminal provided in an embodiment of the present disclosure.

[0082] Fig.14 A schematic diagram of the structure of an interactive information display device applied to a server provided in an embodiment of the present disclosure.

[0083] Fig.15 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure.

[0084] The above drawings show clear embodiments of the present disclosure, which will be described in more detail below. These drawings and text descriptions are not intended to limit the scope of the present disclosure in any way, but to illustrate the concepts of the present disclosure to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0085] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0086] The interaction in AR technology is mainly achieved through equipment, software and sensors. The equipment needs to have a camera module and a display device, the software is responsible for processing tasks such as image recognition and superposition of virtual and reality, and the sensors are used to capture the user's movements, environment, location information and other instruments and implement adjustments to the superimposed virtual information.

[0087] When displaying the interactive interface, the AR technology in the prior art is not associated with the objects in the real-life image, resulting in a low degree of personalization of the interactive interface in the prior art. In addition, when displaying interactive information on the interactive interface, it is displayed directly, which displays a lot of unnecessary information, reduces the user's sense of participation, and causes the displayed interactive interface to be more confusing.

[0088] Based on the above shortcomings, the present invention provides an interactive information display method. Figure 1 A schematic diagram of a system architecture that can implement the above-mentioned interactive information display method provided for an embodiment of the present disclosure. The system architecture 100 may include a first terminal 110 and a server 120. Among them, the first terminal 110 may be a terminal device such as a smart phone, a tablet computer, a desktop computer, a laptop computer, etc., and the server 120 generally refers to a background system that provides services related to the control method of the first terminal device in this exemplary embodiment, and may be a cluster formed by one server or multiple servers. The first terminal 110 and the server 120 may be connected via a wired or wireless communication link to perform data interaction.

[0089] The first terminal 110 interacts with the above-mentioned server 120 to implement the interactive information display method disclosed in the embodiment of the present disclosure, wherein the first terminal 110 is used to collect real-scene images and send them to the server 120; the server 120 receives the real-scene images and identifies the real-scene images, and when the real-scene images include a unique identification object, sends an interactive interface generation instruction to the first terminal 110; the first terminal 110 provides an interactive interface corresponding to the unique identification object on the real-scene image based on the interactive interface generation instruction; the first terminal 110 sends a trigger operation to the server 120, so that the server 120 generates an interactive information display instruction according to the trigger operation, and sends the interactive information display instruction to the first terminal 110; the first terminal 110 responds to the interactive information display instruction and displays the interactive information on the interactive interface.

[0090] In some examples, when the first terminal is connected to the server, the server needs to verify the authority information of the first terminal. After the verification is completed, the connection between the first terminal and the server is completed to enable the first terminal to interact with the server.

[0091] It should be noted that the first terminal and the second terminal of the present disclosure are two terminal devices with the same or different structures, and both can be terminal devices such as smart phones, tablet computers, desktop computers, and laptop computers. The first terminal and the second terminal are both connected to the above-mentioned server via wired or wireless means.

[0092] Based on this, the present disclosure first provides an interactive information display method. Figure 2 A flowchart of an interactive information display method is shown, which can be applied to the first terminal mentioned above, wherein the interactive information display method may include steps S210 to S230.

[0093] In step S210, a real scene image is collected.

[0094] In an example implementation of the present disclosure, a real-scene image can be captured by a camera module of the first terminal, wherein the real-scene image is an image of the real world captured by the camera module, represents the physical world captured by the camera module, and may include natural landscapes, urban environments, the starry sky, and celestial bodies in the starry sky, etc.

[0095] In step S220, when the real scene image includes a unique identification object, an interactive interface corresponding to the unique identification object is provided on the real scene image.

[0096] After obtaining the above-mentioned real-scene image, determine whether the above-mentioned real-scene image includes a unique identification object, wherein the unique identification object can be a prominent and unique identifier of the preset area where the above-mentioned first terminal is located. For example, if the above-mentioned preset area is the earth, then the above-mentioned unique identification object can be a celestial body, such as the moon, the North Star, constellations, etc. If the above-mentioned preset area is a certain area, such as the surrounding area of ​​​​Mt. Huashan, then the above-mentioned unique identification object can be Mt. Huashan.

[0097] In some examples, image recognition may be performed on the real-scene image to determine whether the real-scene image includes a unique identification object. Specifically, feature extraction may be performed on the real-scene image to obtain a target feature image of the real-scene image. Then, based on the target feature image, a query may be made in the repository as to whether a reference feature image having a similarity with the target feature image greater than a similarity threshold is included. If included, it may be determined that the real-scene image includes a unique identification object.

[0098] In some examples, when determining that the real scene image includes a unique identification object, an interactive interface may be generated on the real scene image.

[0099] The interactive interface is superimposed on the real scene image, and is used to display interactive information. The interactive interface corresponds to the unique identification object, that is, when other terminals capture the same unique identification object, they will also display the interactive interface. In other words, when different terminals capture the same unique identification object, the interactive interfaces displayed by different terminals are related. This allows multiple users to interact on the interactive interface, or for interaction with artificial intelligence on the interactive interface.

[0100] Among them, the above-mentioned interactive interface can be a graphical user interface covering the entire real-scene image, but will not obscure the real-scene image. The interactive interface can also be set in a partial area of ​​the real-scene image. The specific location can be customized based on user needs and will not be repeated in this example implementation.

[0101] In step S230, in response to the interactive information display instruction, the interactive information is displayed on the interactive interface.

[0102] In an example implementation of the present disclosure, the first terminal may respond to an interaction information display instruction and display interaction information on the interaction interface. The interaction information display instruction may be sent by the server or generated by the first terminal, which will not be elaborated in this example implementation.

[0103] After receiving the above-mentioned interactive information display instruction, the interactive information related to the above-mentioned interactive information display instruction can be displayed on the above-mentioned interactive interface.

[0104] In some examples, the above-mentioned interaction information display instruction is an instruction for instructing to trigger the display of interaction information. After receiving the above-mentioned interaction information display instruction, all interaction information corresponding to the interaction interface is displayed.

[0105] The interactive information display method provided by the embodiment of the present disclosure can improve the personalization and richness of the interactive interface by providing an interactive interface corresponding to the unique identification object on the real scene image when the unique identification object is included in the real scene image. On the other hand, the interactive interface corresponds to the unique identification object, which can optimize data management and facilitate the management of interactive data in the interactive interface. On the other hand, before displaying the interactive information, a trigger condition, i.e., an interactive information display instruction, is set, which avoids the technical problems of server performance degradation and interactive interface confusion caused by directly displaying all interactive information, optimizes resource utilization, improves the relevance of the interactive interface displaying interactive information, and can enhance user participation.

[0106] It should be noted that when determining whether the real scene image includes a unique identification object, the current location of the first terminal can be first obtained, and the unique identification object can be determined based on the current location. Specifically, the repository can include a mapping relationship between multiple geographical areas and unique identification objects. If the current location is within multiple geographical areas in the repository, the unique identification object corresponding to the geographical area can be determined as the unique identification object corresponding to the current location.

[0107] After determining the unique identification object, the real scene image can be identified and it can be determined whether the real scene image includes the unique identification object. Specifically, features can be extracted from the real scene image to obtain a feature image. Based on the feature image, it is queried in the repository whether the unique identification object corresponding to the feature image is included. If included, it is determined that the real scene image includes the unique identification object. If not, it is determined that the real scene image does not include the unique identification object.

[0108] In other example implementations, the camera direction of the first terminal when capturing the real-scene image and the location information of the first terminal may also be collected, and whether the real-scene image includes a unique identification object may be determined based on the camera direction, location information and the real-scene image.

[0109] Among them, the unique identification object of the area where the first terminal is located and the target direction of the first terminal are determined according to the above-mentioned location information. When the camera direction of the first terminal is the same as the target direction, when the unique identification object cannot be identified in the above-mentioned real-scene image, it can also be assumed that the real-scene image of the first terminal includes the above-mentioned unique identification object. When the visual field conditions are poor, the interactive interface can also be displayed to the user. At this time, the displayed interactive information can include a clear picture corresponding to the above-mentioned unique identification object. When the user cannot take a clear picture of the unique identification object, a clear picture of the unique identification object can be displayed to the user through the interactive interface.

[0110] For example, when the above-mentioned unique identification object is the sun, user A captures a picture of a total solar eclipse, but user B is unable to capture the picture of the total solar eclipse due to weather reasons. However, the camera of user B's first terminal is facing the sun, and he hopes to capture the picture of the total solar eclipse. At this time, it can be determined that the picture taken by user B's first terminal includes the sun, and an interactive interface is provided to user B's first terminal, and the content captured by user A in real time is displayed on the interactive interface.

[0111] In some examples, the interactive information display instruction is generated based on the environmental information of the first terminal, wherein the environmental information of the first terminal may include temperature information of the first terminal, the number of temperature sources, sound information, etc.

[0112] In some examples, the first terminal may be provided with a temperature sensor, a microphone, etc. for collecting the above-mentioned environmental information.

[0113] The first terminal may generate an interactive information display instruction based on the temperature information. Specifically, the first terminal may generate the interactive information display instruction in response to the temperature information satisfying the first preset condition, wherein the first preset condition may be customized based on user needs and will not be elaborated in this example implementation.

[0114] Specifically, the first preset condition may be that the temperature in the temperature information is within a temperature range. For example, the temperature in the temperature information is greater than or equal to 30 degrees Celsius and less than or equal to 40 degrees Celsius. For example, the temperature in the temperature information is greater than or equal to 0 degrees Celsius and less than or equal to 10 degrees Celsius.

[0115] After obtaining the interactive information display instruction generated based on the temperature information, the first terminal may display the interactive information related to the temperature information on the interactive interface based on the interactive information display instruction.

[0116] For example, refer to Figure 3When the temperature in the above temperature information is greater than or equal to 30 degrees Celsius and less than or equal to 40 degrees Celsius, a flame pattern can be displayed on the above interactive interface, or interactive information about the hot weather sent by the second terminal can be displayed, such as text information such as "It's so hot here", "Why is it so hot", or emoticons representing hot weather, etc., and the current temperature can be displayed at the same time.

[0117] For another example, refer to Figure 4 When the temperature in the above temperature information is greater than or equal to 0 degrees Celsius and less than or equal to 10 degrees Celsius, a pattern of ice and snow can be displayed on the above interactive interface, or interactive information about the cold weather sent by the second terminal can be displayed, such as text information such as "It's so cold here", "Shivering", or emoticons representing coldness.

[0118] It should be noted that the above-mentioned temperature-related interaction information may be sent by other users or automatically generated by the server, which will not be described in detail in this example implementation.

[0119] In some examples, the environmental information may include the number of temperature sources contacted by the first terminal, wherein the number of temperature sources contacted by the first terminal may be used to characterize the number of fingers of the user in contact with the first terminal, and when the number of temperature sources is greater than a first preset threshold, an interactive information display instruction is generated.

[0120] Among them, the above-mentioned first preset threshold can be 3, 4 or more, which will not be elaborated here.

[0121] In some examples, after the unique identification object is photographed, prompt information on how to display the interaction information may be displayed on the interaction interface. Specifically, Figure 5 , displaying “Four fingers touch both sides of the terminal to display interactive information” on the interactive interface.

[0122] Optionally, when detecting the number of fingers in contact with the first terminal, the number may be collected based on a pressure sensor. The specific acquisition method may be customized based on user needs and is not specifically limited in this example implementation.

[0123] In some examples, the server may detect the number of second terminals that receive the same operation as the first terminal within a preset time period, that is, the sum of the number of operations sent by the first terminal and the number of operations sent by the second terminal received by the server within the preset time period.

[0124] When the number of the second terminals is greater than the second preset threshold, the server generates an interactive information display instruction, wherein the specific number of the second preset threshold can be customized based on user needs and is not described in detail in this example implementation. For example, the second preset threshold can be 60, 80 or more.

[0125] Specifically, refer to Figure 6 , the total number of received operations and the number of interactive information display instructions required can be displayed on the interactive interface, wherein the required number is the number of the second preset threshold plus 1. For example, when the second preset threshold is 80, the required number is 81. When the total number of operations is greater than or equal to the required number, the server generates an interactive information display instruction and sends it to the first terminal. The first terminal displays the interactive information on the interactive interface based on the interactive information display instruction.

[0126] In some example embodiments, reference Figure 7 The interactive interface can also display historical interaction information sent by the second terminal and meeting the second preset condition, wherein the above-mentioned second preset condition can be within the first preset time from the current time, that is, the historical interaction information sent by the second terminal within the first preset time from the current time is displayed on the interactive interface.

[0127] Among them, the first preset time can be customized based on user needs, such as 10 minutes, 1 day, one month, etc., which will not be described in detail in this example implementation.

[0128] The above historical interaction information may be voice, image, text, emoticon package, etc., and may also include redeemable interaction information such as red envelopes and lucky bags. The specific form may also be customized based on user needs.

[0129] It should be noted that when displaying historical interaction information, special effects can be added to the historical interaction information based on the current environmental information. For example, if the historical interaction information is text and the temperature in the current environmental information is high, special effects can be added to the text, such as adding flame effects.

[0130] Optionally, when displaying historical interaction information, the sending time of the historical interaction information may also be displayed, such as Figure 7 As shown, the sending time is added at a specific position of the historical interaction information. The specific position may be before or after the historical interaction information, etc., which is not specifically limited in this example implementation.

[0131] In some example implementations, real-time interaction information that meets the second preset condition and is sent by the second terminal may also be displayed on the above interaction interface. For example, real-time interaction information sent by the second terminal within a preset distance from the current location may be displayed on the interaction interface. The above preset distance may be 1 km, 2 km, etc., or may be customized according to user needs. The above second preset condition may also be customized based on user needs, which will not be described in detail in this example implementation.

[0132] It should be noted that the interactive interface may also include an interactive information sending function. For example, an input box is set up in which the user can enter the interactive information to be sent. Optionally, the input box may also output data information such as images, voices, emoticons, etc., which will not be elaborated here.

[0133] Optional, see Figure 8 The interactive interface can display historical interaction information and real-time interaction information at the same time. When displaying the above historical interaction information and real-time interaction information at the same time, the historical interaction information and the real-time interaction information can be displayed differently. For example, different colors of text are used to display the above historical interaction information and the real-time interaction information, or a real-time border is added to the above real-time interaction information; for another example, different display backgrounds are set for the above real-time interaction information. The specific form of differentiated display can also be customized according to user needs, which will not be described in detail in this example implementation. Differentiated display is convenient for users to distinguish, so that users can give priority to replying to real-time interaction information.

[0134] In some example implementations, relevant information corresponding to the above-mentioned unique identification object can also be displayed on the above-mentioned interactive interface, wherein the above-mentioned relevant information can be a related introduction, related allusions, etc. of the above-mentioned unique identification object. For example, if the above-mentioned unique identification object is the moon, the origin of the moon and allusions about the moon, such as "Chang'e Flying to the Moon", can be displayed on the above-mentioned interactive interface. The specific content of the relevant information can also be customized according to user needs, which will not be elaborated in this example implementation.

[0135] Optionally, multiple users can interact in the above interactive interface, refer to Fig. 9 Taking the moon as an example, the user of the first terminal is regarded as user A, and the user of one of the second terminals is regarded as user B. User A and user B can interact in real time in the interactive interface.

[0136] The interactive information display method provided in this embodiment can improve the personalization and richness of the interactive interface by providing an interactive interface corresponding to the unique identification object on the real scene image when the real scene image includes a unique identification object. On the other hand, the interactive interface corresponds to the unique identification object, which can optimize data management and facilitate the management of interactive data in the interactive interface. On the other hand, before displaying the interactive information, a trigger condition, that is, an interactive information display instruction, is set to avoid the technical problems of server performance degradation and chaotic interactive interface caused by directly displaying all interactive information, optimize resource utilization, improve the relevance of interactive information displayed on the interactive interface, and enhance user participation. Further, an interactive information display instruction is generated based on environmental information. When the environmental information includes temperature information, interactive information related to the temperature information is displayed on the interactive interface, which can improve the diversity of information displayed on the interactive interface, and the generation method of the interactive instruction is associated with the environmental information, so that the interactive information displayed on the interactive interface is associated with the user's environment, and the interactive information that is easy for the user to identify is displayed to the user, thereby improving the user experience.

[0137] Furthermore, the present disclosure also provides an interactive information display method, which is applied to the server, referring to Fig.10 , may include steps S1010 to S1030.

[0138] In step S1010, a real scene image sent by a first terminal is received.

[0139] In an example implementation of the present disclosure, the server may receive a real scene image sent by the first terminal. The acquisition of the real scene image may refer to the interactive information display method applied to the first terminal, which will not be described in detail herein.

[0140] In step S1020, the real scene image is identified, and when the real scene image includes a unique identification object, an interactive interface generation instruction is sent to the first terminal, so that the first terminal generates an interactive interface corresponding to the unique identification object on the real scene image.

[0141] In an example implementation of the present disclosure, the server may identify the real-scene image, and when identifying that the real-scene image includes a unique identification object, send an interactive interface generation instruction to the first terminal, so that the first terminal generates an interactive interface based on the interactive interface generation instruction.

[0142] The specific recognition process of the real scene image has been described in detail in the interactive information display method applied to the first terminal, so it will not be repeated here.

[0143] Among them, the above-mentioned interactive interface can be a graphical user interface covering the entire real-scene image, but will not obscure the real-scene image. The interactive interface can also be set in a partial area of ​​the real-scene image. The specific location can be customized based on user needs and will not be repeated in this example implementation.

[0144] In step S1030, an interaction information display instruction is sent to the first terminal, so that the first terminal can display the interaction information on the interaction interface.

[0145] In some example implementations of the present disclosure, the server may generate an interactive information display instruction and send it to the first terminal.

[0146] Optionally, the server may receive the environment information sent by the first terminal, generate an interactive information display instruction based on the environment information, and send the interactive information display instruction to the first terminal.

[0147] Specifically, the process of generating the interactive information display instruction based on the environmental information may refer to the interactive information display method applied to the first terminal, which will not be described in detail here.

[0148] In some example implementations, the first terminal may generate an interaction information acquisition instruction based on the interaction information display instruction, and the server sends interaction information to the first terminal according to the interaction information acquisition instruction, so that the first terminal displays the interaction information on the interaction interface.

[0149] Refer to the following Fig.11 The interaction process between the first terminal and the server is described, which may specifically include steps S1110 to 1180.

[0150] In step S1110, the first terminal collects a real scene image and sends the real scene image to the server.

[0151] In step S1120, the server receives the real scene image, identifies the real scene image, generates an interactive interface generation instruction when the real scene image includes a unique identification object, and sends the interactive interface generation instruction to the first terminal;

[0152] In step S1130, the first terminal generates an interactive interface according to the interactive interface generation instruction;

[0153] In step S1140, the first terminal obtains environmental information and sends the environmental information to the server.

[0154] In step S1150, the server generates an interactive information display instruction according to the environmental information, and sends the environmental information interactive instruction to the first terminal.

[0155] In some examples, if the above interaction information is stored in the first terminal, step S1180 is executed; if the above interaction information is stored in the server, step S1160 is first executed, and then step S1170 is executed.

[0156] In step S1160, the first terminal responds to the interaction information display instruction and generates an interaction information acquisition instruction.

[0157] In step S1170, the server sends the interaction information to the first terminal according to the interaction information acquisition instruction.

[0158] In step S1180, the interaction information is displayed on the interaction interface.

[0159] It should be noted that the specific contents of step S1110 to step S11080 have been described in detail above, and therefore will not be repeated here.

[0160] Furthermore, the present disclosure also provides an interactive information display system, which may include a first terminal and a server, wherein the first terminal is used to collect real-scene images and send them to the server; the server is used to receive the real-scene images and identify the real-scene images, and when the real-scene images include a unique identification object, send an interactive interface generation instruction to the first terminal; the first terminal is used to provide an interactive interface corresponding to the unique identification object on the real-scene image based on the interactive interface generation instruction; the server is used to send an interactive information display instruction to the first terminal; and the first terminal is used to respond to the interactive information display instruction and display the interactive information on the interactive interface.

[0161] Reference Fig.12 The first terminal 110 may include a data processing unit 111, an information input unit 112, an audio and video playback unit 113, an image acquisition unit 114, a gyroscope 115, a magnetometer 116, a positioning unit 118, a display unit 117, etc., wherein the information input unit 112 is used to input voice, text, image and other data, the audio and video playback unit 113 is used to play audio and video data, the image acquisition unit 111 includes a camera module for capturing real-scene images, the gyroscope 115 and the geomagnetic pole 116 can be used to capture information such as the camera direction of the first terminal, the positioning unit 118 is used to obtain the location information of the first terminal, and the display unit 117 is used to display the captured real-scene images and the above-mentioned interactive interface.

[0162] The server 120 is connected to the first terminal 110 and can also be connected to multiple second terminals, where the second terminal is a terminal device of another user with the same or different structure as the first terminal. In other words, the interaction process between the second terminal and the server is the same as that of the first terminal.

[0163] The server 120 may also connect to a third-party data server 130 to obtain data from the third-party data server 130. The specific data content included in the third-party data server 130 may be customized based on user needs, and is not specifically limited in this example.

[0164] Furthermore, the present disclosure also provides an interactive information display device, referring to Fig.13 As shown, the interactive information display device 1300 may include a collection module 1310 , a response module 1320 and a display module 1330 .

[0165] in:

[0166] The acquisition module 1310 may be used to acquire a real scene image. The response module 1320 may be used to provide an interactive interface corresponding to the unique identification object on the real scene image when the real scene image includes a unique identification object. The display module 1330 may be used to respond to an interactive information display instruction and display interactive information on the interactive interface.

[0167] In some examples, the display module 1330 may also be configured to display the interaction information on the interaction interface in response to an interaction information display instruction generated based on the environment information of the first terminal.

[0168] In some examples, the environmental information includes temperature information, and the display module 1330 can also be used to generate an interactive information display instruction in response to the temperature information satisfying a first preset condition; in response to the interactive information display instruction, provide interactive information related to the temperature information on the interactive interface.

[0169] In some examples, the environmental information includes the number of temperature sources in contact with the first terminal. The display module 1330 can also be used to generate an interactive information display instruction in response to the number of temperature sources being greater than a first preset threshold; and display the interactive information on the interactive interface in response to the interactive information display instruction.

[0170] In some examples, display module 1330 can also be used to respond to an interactive information display instruction corresponding to the operation generated when the number of second terminals that receive the same operation as the first terminal within a preset time period is greater than a second preset threshold, and display the interactive information corresponding to the operation on the interactive interface.

[0171] In some examples, the response module 1320 can also be used to obtain the current location of the first terminal, and determine the unique identification object corresponding to the current location based on the current location; identify the real-scene image, and when the unique identification object is included in the real-scene image, provide an interactive interface corresponding to the unique identification object on the real-scene image.

[0172] In some examples, the interactive information display device 1300 can also be used to obtain the location information of the first terminal and the camera direction of the first terminal when capturing the real-scene image; determine the target direction of the uniquely identified object relative to the first terminal based on the location information; and when the camera direction is the same as the target direction, determine that the real-scene image includes the uniquely identified object.

[0173] In some examples, the display module 1330 may also be used to display image information of a uniquely identified object captured in real time by the second terminal on the interactive interface.

[0174] In some examples, the interaction information display device 1300 can also be used to display historical interaction information that meets the second preset condition and is sent by the second terminal on the interaction interface.

[0175] In some examples, the interactive information display device 1300 can also be used to obtain the current time when the first terminal captures the real-scene image; and display the historical interactive information within a first preset time from the current time on the interactive interface.

[0176] In some examples, the interactive information display device 1300 can also be used to display the real-time interactive information sent by the second terminal that meets the third preset condition on the interactive interface.

[0177] In some examples, the interactive information display device 1300 can also be used to obtain the current location of the first terminal; and display the real-time interactive information sent by the second terminal within a preset distance from the current location on the interactive interface.

[0178] In some examples, the interactive information display device 1300 can also be used to display relevant information of the target celestial body on the interactive interface.

[0179] Furthermore, the present disclosure also provides an interactive information display device, referring to Fig.14 As shown, the interactive information display device 1400 may include a receiving module 1410 , a generating module 1420 and a sending module 1430 .

[0180] in:

[0181] The receiving module 1410 is used to receive a real-scene image sent by the first terminal; the generating module 1420 is used to identify the real-scene image, and when the real-scene image includes a unique identification object, send an interactive interface generation instruction to the first terminal, so that the first terminal generates an interactive interface corresponding to the unique identification object on the real-scene image; the sending module 1430 is used to send an interactive information display instruction to the first terminal, so that the first terminal can display the interactive information on the interactive interface.

[0182] In some examples, the sending module 1430 may also be used to receive environmental information of the first terminal; generate an interactive information display instruction based on the environmental information of the first terminal, and send the instruction to the first terminal.

[0183] In some examples, the interactive information display device 1400 can also be used to receive an interactive information acquisition instruction corresponding to the interactive information display instruction from the first terminal; send interactive information to the first terminal based on the interactive information acquisition instruction, so that the first terminal displays the interactive information on the interactive interface.

[0184] Please refer to Fig.15 , which shows a structural block diagram of an electronic device provided by an exemplary embodiment of the present disclosure. In some examples, the electronic device may be at least one of a smart phone, a smart watch, a desktop computer, a laptop, a virtual reality terminal, an augmented reality terminal, a wireless terminal, and a laptop computer. The electronic device has a communication function and can access a wired network or a wireless network. The electronic device may generally refer to one of a plurality of terminals, and those skilled in the art may know that the number of the above terminals may be more or less. It is understandable that the electronic device undertakes the calculation and processing work of the technical solution of the present disclosure, and the embodiments of the present disclosure are not limited to this.

[0185] It should be understood that the above-mentioned device embodiments are only illustrative, and the device of the present disclosure can also be implemented in other ways. For example, the division of units / modules in the above-mentioned embodiments is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.

[0186] In addition, unless otherwise specified, each functional unit / module in each embodiment of the present disclosure may be integrated into one unit / module, or each unit / module may exist physically separately, or two or more units / modules may be integrated together. The above-mentioned integrated unit / module may be implemented in the form of hardware or in the form of a software program module.

[0187] If the integrated unit / module is implemented in the form of hardware, the hardware may be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes but is not limited to transistors, memristors, etc. If not specifically stated, the processor may be any appropriate hardware processor, such as a CPU, a GPU, an FPGA, a DSP, an ASIC, etc. If not specifically stated, the storage unit may be any appropriate magnetic storage medium or magneto-optical storage medium, such as a resistive random access memory RRAM (Resistive Random Access Memory), a dynamic random access memory DRAM (Dynamic Random Access Memory), a static random access memory SRAM (Static Random-Access Memory), an enhanced dynamic random access memory EDRAM (Enhanced Dynamic Random Access Memory), a high-bandwidth memory HBM (High-Bandwidth Memory), a hybrid memory cube HMC (Hybrid Memory Cube), etc.

[0188] If the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the various embodiments of the present disclosure. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk, etc. Various media that can store program codes.

[0189] like Fig.15 As shown, the electronic device 1500 may include: at least one processor 1510 , a memory 1520 , and a communication interface 1530 .

[0190] The memory 1520 is used to store programs. Specifically, the programs may include program codes, and the program codes include computer operation instructions.

[0191] The memory 1520 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0192] The processor 1510 is used to execute the computer-executable instructions stored in the memory 1520 to implement the interactive information display method described in the aforementioned method embodiment. The processor 1510 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present disclosure.

[0193] The electronic device 1500 may also include a communication interface 1530, so that it can communicate and interact with external devices through the communication interface 1530. In a specific implementation, if the communication interface 1530, the memory 1520 and the processor 1510 are implemented independently, the communication interface 1530, the memory 1520 and the processor 1510 can be connected to each other through a bus and complete the communication between each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.

[0194] Optionally, in a specific implementation, if the communication interface 1530, the memory 1520 and the processor 1510 are integrated on a chip, the communication interface 1530, the memory 1520 and the processor 1510 can complete communication through an internal interface.

[0195] The present disclosure also provides a computer-readable storage medium, which may include: a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a disk or an optical disk, and other media that can store program codes. Specifically, the computer-readable storage medium stores program instructions, and the program instructions are used for the interactive information display method in the above-mentioned embodiment.

[0196] The embodiments of the present disclosure also provide a computer program product, which includes computer instructions stored in a computer-readable storage medium; a processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes to implement the interactive information display methods of the above-mentioned embodiments.

[0197] Those skilled in the art should be aware that in one or more of the above examples, the functions described in the embodiments of the present disclosure can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any media that facilitates the transmission of computer programs from one place to another. Storage media can be any available media that can be accessed by general or special-purpose computers.

[0198] In the above embodiments, the description of each embodiment has its own emphasis. For the part not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0199] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the inventions claimed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not claimed in the present disclosure.

[0200] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for displaying interactive information, It is characterized in that Applied to a first terminal, the method includes: Collect real-life images; When the real scene image includes a unique identification object, providing an interactive interface corresponding to the unique identification object on the real scene image, wherein the unique identification object is a unique identifier in a preset area where the first terminal is located; In response to the interactive information display instruction, the interactive information is displayed on the interactive interface; The method further comprises: Acquire location information of a first terminal and a camera direction when the first terminal captures the real scene image; Determine, according to the location information, a target direction of the uniquely identified object relative to the first terminal; When the unique identification object cannot be identified in the real scene image, if the camera direction is the same as the target direction, it is determined that the real scene image includes the unique identification object.

2. The method according to claim 1, It is characterized in that The responding to the interactive information display instruction and displaying the interactive information on the interactive interface includes: In response to the interaction information display instruction generated based on the environment information of the first terminal, the interaction information is displayed on the interaction interface.

3. The method according to claim 2, It is characterized in that The environmental information includes temperature information; The step of responding to the interactive information display instruction generated based on the environment information of the first terminal and displaying the interactive information on the interactive interface includes: In response to the temperature information satisfying the first preset condition, generating the interactive information display instruction; In response to the interactive information display instruction, interactive information related to the temperature information is provided on the interactive interface.

4. The method according to claim 2, It is characterized in that The environmental information includes the number of temperature sources in contact with the first terminal; The step of responding to the interactive information display instruction generated based on the environment information of the first terminal and displaying the interactive information on the interactive interface includes: In response to the number of temperature sources being greater than a first preset threshold, generating the interactive information display instruction; In response to the interactive information display instruction, the interactive information is displayed on the interactive interface.

5. The method according to claim 1, It is characterized in that The responding to the interactive information display instruction and displaying the interactive information on the interactive interface includes: In response to an interactive information display instruction corresponding to the operation generated when the number of second terminals receiving the same operation as the first terminal within a preset time period is greater than a second preset threshold, interactive information corresponding to the operation is displayed on the interactive interface.

6. The method according to claim 1, It is characterized in that When the real scene image includes a unique identification object, providing an interactive interface corresponding to the unique identification object on the real scene image includes: Acquire the current location of the first terminal, and determine a unique identification object corresponding to the current location based on the current location; The real scene image is identified, and when the real scene image includes the unique identification object, an interactive interface corresponding to the unique identification object is provided on the real scene image.

7. The method according to claim 1, It is characterized in that The displaying of the interactive information on the interactive interface includes: The image information of the uniquely identified object photographed in real time by the second terminal is displayed on the interactive interface.

8. The method according to claim 1, It is characterized in that The method further comprises: The historical interaction information that meets the second preset condition and is sent by the second terminal is displayed on the interaction interface.

9. The method according to claim 8, It is characterized in that The displaying, on the interactive interface, the historical interaction information that meets the second preset condition and is sent by the second terminal includes: Obtaining the current time when the first terminal captures the real scene image; The historical interaction information within a first preset time from the current time is displayed on the interaction interface.

10. The method according to claim 1, It is characterized in that The method further comprises: The real-time interaction information sent by the second terminal and meeting the third preset condition is displayed on the interaction interface.

11. The method according to claim 10, It is characterized in that The displaying, on the interaction interface, the real-time interaction information sent by the second terminal that meets the third preset condition includes: Acquire the current location of the first terminal; The real-time interaction information sent by the second terminal within a preset distance from the current position is displayed on the interaction interface.

12. The method according to claim 1, It is characterized in that The unique identification object is a target celestial body; the method further comprises: The relevant information of the target celestial body is displayed on the interactive interface.

13. A method for displaying interactive information, It is characterized in that Applied to the server, including: Receiving a real scene image sent by the first terminal; Identify the real scene image, and when the real scene image includes a unique identification object, send an interactive interface generation instruction to the first terminal, so that the first terminal generates an interactive interface corresponding to the unique identification object on the real scene image, wherein the unique identification object is a unique identifier in a preset area where the first terminal is located; Sending an interaction information display instruction to the first terminal, so that the first terminal can display the interaction information on the interaction interface; The method further comprises: Acquire location information of a first terminal and a camera direction when the first terminal captures the real scene image; Determine, according to the location information, a target direction of the uniquely identified object relative to the first terminal; When the unique identification object cannot be identified in the real scene image, if the camera direction is the same as the target direction, it is determined that the real scene image includes the unique identification object.

14. The method according to claim 13, It is characterized in that The sending the interactive information display instruction to the first terminal includes: receiving environment information of the first terminal; The interactive information display instruction is generated based on the environment information of the first terminal and sent to the first terminal.

15. The method according to claim 13 or 14, It is characterized in that The method further comprises: Receiving, by the first terminal, an interactive information acquisition instruction corresponding to the interactive information display instruction; The interaction information is sent to the first terminal based on the interaction information acquisition instruction, so that the first terminal displays the interaction information on the interaction interface.

16. An interactive information display device, It is characterized in that Applied to a first terminal, the device includes: A collection module, used for collecting real scene images; a response module, configured to provide an interactive interface corresponding to a unique identification object on the real scene image when the real scene image includes the unique identification object, wherein the unique identification object is a unique identifier in a preset area where the first terminal is located; A display module, used to respond to the interactive information display instruction and display the interactive information on the interactive interface; The device is also used for: Acquire location information of a first terminal and a camera direction when the first terminal captures the real scene image; Determine, according to the location information, a target direction of the uniquely identified object relative to the first terminal; When the unique identification object cannot be identified in the real scene image, if the camera direction is the same as the target direction, it is determined that the real scene image includes the unique identification object.

17. An interactive information display device, It is characterized in that Applied to the server, the device comprises: A receiving module, used for receiving a real scene image sent by the first terminal; a generating module, configured to identify the real scene image, and when the real scene image includes a unique identification object, send an interactive interface generating instruction to the first terminal, so that the first terminal generates an interactive interface corresponding to the unique identification object on the real scene image, wherein the unique identification object is a unique identifier in a preset area where the first terminal is located; a sending module, configured to send an interaction information display instruction to the first terminal, so that the first terminal can display the interaction information on the interaction interface; The device is also used for: Acquire location information of a first terminal and a camera direction when the first terminal captures the real scene image; Determine, according to the location information, a target direction of the uniquely identified object relative to the first terminal; When the unique identification object cannot be identified in the real scene image, if the camera direction is the same as the target direction, it is determined that the real scene image includes the unique identification object.

18. An electronic device, It is characterized in that The electronic device comprises: a processor and a memory; the processor is used to execute instructions stored in the memory to implement the interactive information display method as described in any one of claims 1 to 12 or any one of claims 13 to 15.

19. A computer storage medium, It is characterized in that The storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the interactive information display method as described in any one of claims 1 to 12 or any one of claims 13 to 15.

20. An interactive information display system, It is characterized in that It includes a first terminal and a server, wherein: The first terminal is used to collect real-scene images and send them to the server; The server is used to receive the real scene image, identify the real scene image, and send an interactive interface generation instruction to the first terminal when the real scene image includes a unique identification object, wherein the unique identification object is a unique identifier in a preset area where the first terminal is located; The first terminal is used to generate instructions based on the interactive interface, and provide an interactive interface corresponding to the unique identification object on the real scene image; The server is used to send an interactive information display instruction to the first terminal; The first terminal is used to respond to the interactive information display instruction and display the interactive information on the interactive interface; The server is further used to obtain the location information of the first terminal and the direction of the camera when the first terminal captures the real scene image; Determine, according to the location information, a target direction of the uniquely identified object relative to the first terminal; When the unique identification object cannot be identified in the real scene image, if the camera direction is the same as the target direction, it is determined that the real scene image includes the unique identification object.

Images