Interactive processing method, device, equipment and storage medium

By using environment acquisition components and interactive virtual elements in the interactive processing method, the problems of cumbersome interaction operations and poor information transmission effect in the prior art are solved, and a more intuitive and efficient interactive experience is achieved.

CN114935973BActive Publication Date: 2025-02-25BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210374813.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-11
Publication Date
2025-02-25
Estimated Expiration
2042-04-11

AI Technical Summary

Technical Problem

In the prior art, interactive operations are more cumbersome, and the information transmission effect of interactive content is poor.

Method used

By responsive to the trigger operation of the target interaction mode, acquisition direction information and image information of the environment acquisition component are obtained, interactive virtual elements for pointing to media resources are obtained, and interactive pictures, including interactive virtual elements and scene pictures are displayed.

Benefits of technology

Reduces the number of screens for users to manually operate the user interface and improves the information transmission effect of interactive content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114935973B_ABST
    Figure CN114935973B_ABST
Patent Text Reader

Abstract

The present disclosure relates to an interactive processing method, device, equipment and storage medium. The method obtains first environmental information by responding to a trigger operation for a target interactive mode; the first environmental information includes the collection direction information and first image information of the environment collection component, and the first image information is used to indicate the scene screen collected by the environment collection component; obtains a first interactive virtual element for pointing to a first media resource; the first media resource matches the collection direction information; and displays an interactive screen corresponding to the target interactive mode, the interactive screen including the first interactive virtual element and the scene screen corresponding to the first image information. In this way, the interaction is achieved through the environment collection component, thereby reducing the number of times the user manually operates the screen of the user interface and improving the information transmission effect of the interactive content.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to an interactive processing method, device, equipment and storage medium. Background Art

[0002] With the development of Internet technology, the interaction between users and applications is becoming more and more frequent.

[0003] In the related art, users interact with applications by, for example, sliding the screen, clicking icons, moving the mouse, typing on the keyboard, etc. However, these interactive operations are mainly aimed at interacting with the user interface of the application, the interactive operations are relatively cumbersome, and the information transmission effect of the interactive content is poor. Summary of the invention

[0004] The present disclosure provides an interactive processing method, device, equipment and storage medium to at least solve at least one problem in the related art that the interactive operation is relatively cumbersome and the information transmission effect of the interactive content is poor. The technical solution of the present disclosure is as follows:

[0005] According to a first aspect of an embodiment of the present disclosure, there is provided an interactive processing method, comprising:

[0006] In response to a trigger operation for a target interaction mode, first environment information is obtained; the first environment information includes acquisition direction information of the environment acquisition component and first image information, and the first image information is used to indicate a scene image acquired by the environment acquisition component;

[0007] Acquire a first interactive virtual element for pointing to a first media resource; the first media resource matches the acquisition direction information;

[0008] An interactive screen corresponding to the target interactive mode is displayed, wherein the interactive screen includes the first interactive virtual element and a scene screen corresponding to the first image information.

[0009] As an optional implementation manner, in response to a trigger operation for a target interaction mode, obtaining the first environment information includes:

[0010] In response to a trigger operation for a target interaction mode, initiating an environment acquisition component;

[0011] Acquire first image information collected by the environment collection component;

[0012] First environment information is obtained based on the collection direction information of the environment collection component and the first image information.

[0013] As an optional implementation manner, obtaining the first interactive virtual element for pointing to the first media resource includes:

[0014] Acquiring terminal location information of a target terminal; the target terminal is a terminal that executes the target interactive mode;

[0015] Determining a first media resource based on the collection direction information and the terminal location information;

[0016] Based on the resource display information corresponding to the first media resource, a first interactive virtual element for pointing to the first media resource is obtained.

[0017] As an optional implementation, the first interactive virtual element includes at least one of a content sub-element for representing media content information, a distance sub-element for representing the distance relationship between a resource location corresponding to the first media resource and a location of an environment acquisition component, and an interaction sub-element for representing interactive information of the first media resource.

[0018] As an optional implementation manner, before displaying the interactive screen corresponding to the target interactive mode, the method further includes:

[0019] Obtain resource location information corresponding to each of the first media resources corresponding to the first interactive virtual element;

[0020] Determining the display attributes of the first interactive virtual elements corresponding to each of the first media resources based on the location distance information between the resource location information of the first media resource and the terminal location information of the target terminal; the target terminal is a terminal executing the target interactive mode;

[0021] An interactive screen corresponding to the target interactive mode is generated according to each of the first interactive virtual elements, the first image information and the display attributes.

[0022] As an optional implementation, the display attribute includes a display position and / or a display size; the display size is negatively correlated with the position distance information;

[0023] The generating an interactive screen corresponding to the target interactive mode according to each of the first interactive virtual elements, the first image information and the display attribute comprises:

[0024] According to the display position, each of the first interactive virtual elements is sequentially combined with the scene screen corresponding to the first image information to generate an interactive screen corresponding to the target interactive mode; and / or

[0025] According to the display size, each of the first interactive virtual elements is combined with the scene screen corresponding to the first image information in sequence to generate an interactive screen corresponding to the target interactive mode.

[0026] As an optional implementation, the method further includes:

[0027] In response to the position movement information of the environment acquisition component, second environment information is obtained in real time; the second environment information includes updated acquisition direction information of the environment acquisition component and second image information, and the second image information is used to indicate the scene picture acquired by the environment acquisition component;

[0028] Acquire a second interactive virtual element for pointing to a second media resource; the second media resource is associated with the updated collection direction information of the environment collection component and / or the terminal location information of the target terminal;

[0029] Based on the scene picture corresponding to the second interactive virtual element and the second image information, the interactive picture is dynamically updated.

[0030] As an optional implementation manner, when the interactive screen further includes a direction display element for representing the location of the resource, the method further includes:

[0031] During the movement of the environment collection component, the direction pointing icon in the direction display element moves synchronously with the collection direction corresponding to the collection direction information corresponding to the environment collection component.

[0032] As an optional implementation, the method further includes:

[0033] In response to a triggering operation on a target interactive virtual element in the interactive screen, media resource information corresponding to the target interactive virtual element is displayed; the target interactive virtual element belongs to an element set corresponding to the first interactive virtual element.

[0034] According to a second aspect of an embodiment of the present disclosure, there is provided an interactive processing device, including:

[0035] A first acquisition module is configured to execute a trigger operation in response to a target interaction mode to obtain first environmental information; the first environmental information includes acquisition direction information of the environmental acquisition component and first image information, and the first image information is used to indicate a scene image acquired by the environmental acquisition component;

[0036] A second acquisition module is configured to acquire a first interactive virtual element pointing to a first media resource; the first media resource matches the acquisition direction information;

[0037] The display module is configured to display an interactive screen corresponding to the target interactive mode, wherein the interactive screen includes the first interactive virtual element and a scene screen corresponding to the first image information.

[0038] As an optional implementation, the first acquisition module is specifically configured to execute:

[0039] In response to a trigger operation for a target interaction mode, initiating an environment acquisition component;

[0040] Acquire first image information collected by the environment collection component;

[0041] First environment information is obtained based on the collection direction information of the environment collection component and the first image information.

[0042] As an optional implementation, the second acquisition module is specifically configured to execute:

[0043] Acquiring terminal location information of a target terminal; the target terminal is a terminal that executes the target interactive mode;

[0044] Determining a first media resource based on the collection direction information and the terminal location information;

[0045] Based on the resource display information corresponding to the first media resource, a first interactive virtual element for pointing to the first media resource is obtained.

[0046] As an optional implementation, the first interactive virtual element includes at least one of a content sub-element for representing media content information, a distance sub-element for representing the distance relationship between a resource location corresponding to the first media resource and a location of an environment acquisition component, and an interaction sub-element for representing interactive information of the first media resource.

[0047] As an optional implementation, the device further includes:

[0048] A location acquisition module, configured to execute acquisition of resource location information corresponding to each of the first media resources corresponding to the first interactive virtual element;

[0049] an attribute determination module configured to determine the display attribute of the first interactive virtual element corresponding to each of the first media resources based on the location distance information between the resource location information of the first media resource and the terminal location information of the target terminal; the target terminal is a terminal executing the target interactive mode;

[0050] The processing module is configured to generate an interactive screen corresponding to the target interactive mode according to each of the first interactive virtual elements, the first image information and the display attributes.

[0051] As an optional implementation, the display attribute includes a display position and / or a display size; the display size is negatively correlated with the position distance information. The processing module includes:

[0052] A first processing unit is configured to combine each of the first interactive virtual elements with the scene screen corresponding to the first image information in sequence according to the display position to generate an interactive screen corresponding to the target interactive mode; and / or

[0053] The second processing unit is configured to combine each of the first interactive virtual elements with the scene screen corresponding to the first image information in sequence according to the display size, so as to generate an interactive screen corresponding to the target interactive mode.

[0054] As an optional implementation, the device further includes:

[0055] A third acquisition module is configured to execute in response to the position movement information of the environment acquisition component to obtain second environment information in real time; the second environment information includes updated acquisition direction information of the environment acquisition component and second image information, and the second image information is used to indicate the scene picture acquired by the environment acquisition component;

[0056] A fourth acquisition module is configured to acquire a second interactive virtual element for pointing to a second media resource; the second media resource is associated with the updated acquisition direction information of the environment acquisition component and / or the terminal location information of the target terminal;

[0057] The display update module is configured to dynamically update the interactive screen based on the scene screen corresponding to the second interactive virtual element and the second image information.

[0058] As an optional implementation manner, when the interactive screen further includes a direction display element for representing the location of the resource, the device further includes:

[0059] The synchronous adjustment module is configured to execute, during the movement of the environment collection component, the synchronous movement of the direction pointing icon in the direction display element and the collection direction corresponding to the collection direction information corresponding to the environment collection component.

[0060] As an optional implementation, the device further includes:

[0061] The interactive module is configured to execute a trigger operation on a target interactive virtual element in the interactive screen and display media resource information corresponding to the target interactive virtual element; the target interactive virtual element belongs to an element set corresponding to the first interactive virtual element.

[0062] According to a third aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the interactive processing method as described in any of the above-mentioned embodiments.

[0063] According to a fourth aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0064] processor;

[0065] a memory for storing instructions executable by the processor;

[0066] The processor is configured to execute the instructions to implement the interactive processing method as described in any of the above embodiments.

[0067] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, the computer program product comprising a computer program, and the computer program, when executed by a processor, implements the interactive processing method provided in any one of the above-mentioned embodiments.

[0068] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects:

[0069] The disclosed embodiment obtains first environmental information in response to a trigger operation for a target interactive mode; the first environmental information includes the collection direction information of the environmental collection component and the first image information, the first image information is used to indicate the scene screen collected by the environmental collection component; obtains a first interactive virtual element for pointing to a first media resource; the first media resource matches the collection direction information; and displays an interactive screen corresponding to the target interactive mode, the interactive screen including the first interactive virtual element and the scene screen corresponding to the first image information. In this way, by introducing an environmental collection component and establishing an association between the environmental collection component and the target interactive mode, the interaction is achieved through the environmental collection component, thereby reducing the number of times the user manually operates the screen of the user interface. In addition, since the displayed interactive screen includes the scene screen collected by the environmental collection component and the interactive virtual element corresponding to the media resource matching the collection direction information, more interactive resource information is displayed, thereby improving the information transmission effect of the interactive content.

[0070] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] The drawings herein are incorporated into the specification and constitute a part of the present disclosure, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0072] Figure 1 The invention is a system architecture diagram showing a method for processing application interactions according to an exemplary embodiment.

[0073] Figure 2 The present invention is a flowchart of an interactive processing method according to an exemplary embodiment.

[0074] Figure 3 The present invention is a flowchart of another interactive processing method according to an exemplary embodiment.

[0075] Figure 4 The present invention is a flowchart of another interactive processing method according to an exemplary embodiment.

[0076] Figure 5 The present invention is a flowchart of another interactive processing method according to an exemplary embodiment.

[0077] Figure 6 The present invention is a flowchart of another interactive processing method according to an exemplary embodiment.

[0078] Figure 7 The present invention is a flowchart of another interactive processing method according to an exemplary embodiment.

[0079] Figure 8 It is a schematic diagram of an interface of an interactive processing method according to an exemplary embodiment.

[0080] Fig. 9 The present invention is a block diagram of an interactive processing device according to an exemplary embodiment.

[0081] Fig.10 It is a block diagram of another interactive processing device according to an exemplary embodiment.

[0082] Fig.11 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0083] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0084] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0085] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for display, data for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.

[0086] Figure 1 is a system architecture diagram of an application interaction processing method according to an exemplary embodiment. Figure 1 , the architecture diagram may include a terminal 110 , a terminal 120 and a server 130 .

[0087] The terminal 110 or the terminal 120 may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart wearable device, a digital assistant, an augmented reality device, a virtual reality device, etc. It should be understood that the terminal 110 may generally refer to one of a plurality of terminals, and the terminal 120 may generally refer to another of a plurality of terminals. This embodiment only takes the terminal 110 and the terminal 120 as examples.

[0088] The server 130 can provide interactive data processing services for the terminal 110 and the terminal 120. As an example only, the server 130 can be, but is not limited to, an independent server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, intermediate services, domain name services, security services, and basic cloud computing services such as big data and artificial intelligence platforms.

[0089] The terminal 110 and the terminal 120 may be directly or indirectly connected to the server 130 via wired or wireless communication, which is not limited in the embodiments of the present disclosure.

[0090] Terminal 110 and terminal 120 may be respectively installed with a client capable of realizing a target interactive function, and the target interaction may include video interaction, live broadcast interaction, game interaction, shopping interaction, etc. The client may be a pre-installed client, a web client, a mini-program, etc. The client of terminal 110 may communicate data with the environment acquisition component, and interaction may be realized through the environment acquisition component. The environment acquisition component may be mounted on terminal 110, or may be connected to terminal 110 by wireless or wired means for contactless communication.

[0091] Taking video interaction as an example, terminal 120 may be a terminal used by a video publisher, and uploads video resources through a server; terminal 110 may be a terminal used by a video viewer. The client on terminal 110 may obtain first environment information by responding to a trigger operation for a target interaction mode, by calling an environment acquisition component, the first environment information includes acquisition direction information and first image information of the environment acquisition component, and obtains a first interactive virtual element used by the first environment to point to a first media resource, the first media resource may be a video resource published by terminal 120; then, an interactive screen corresponding to the target interaction mode is displayed, the interactive screen includes the first interactive virtual element and a scene screen corresponding to the first image information, to achieve interaction.

[0092] It should be noted that the system architecture diagram of the application interaction processing method disclosed in the present invention is not limited to this, and may also include Figure 1 The embodiments of the present disclosure are not limited to the devices with a greater or lesser number.

[0093] The interactive processing method provided in the embodiment of the present disclosure may be implemented by the client on the terminal 110 alone, or may be implemented by the client and the server on the terminal in collaboration.

[0094] Figure 2 FIG. 1 is a flow chart showing an interactive processing method according to an exemplary embodiment. Figure 2 As shown, the interactive processing method can be applied to an electronic device, and the electronic device is taken as a client on the terminal 110 in the above implementation environment diagram as an example for explanation, and includes the following steps.

[0095] In step S201, in response to a trigger operation for a target interaction mode, first environmental information is obtained; the first environmental information includes acquisition direction information of an environmental acquisition component and first image information.

[0096] Optionally, the target interaction mode may be an interaction mode that the user wants to trigger. Exemplarily, the target interaction mode may be bound to a target control, and a trigger operation such as clicking the target control may be performed to start the corresponding target interaction mode to obtain the first environment information. The first environment information may be used to characterize the environment information of the current scene that needs to be interacted. The current scene may be a real scene, such as a shopping mall, an office, a tourist attraction, etc.

[0097] The first environmental information includes acquisition direction information of the environment acquisition component and first image information.

[0098] The environment acquisition component can be used to collect the scene picture of the current scene. As an example only, the environment acquisition component may include a camera component mounted in the terminal, such as a camera. As another example, the environment acquisition component may include an external camera component that is not set in the terminal, and the terminal may communicate data directly or indirectly with the external camera component in a wireless or wired manner to obtain the first environment information corresponding to the external camera component. For example, the external camera component may include a camera, a camcorder, etc., and may also include a smart device with a camera function, and the smart device may include but is not limited to smart wearable devices, smart home devices, etc.

[0099] The collection direction information of the environment collection component can be used to characterize the collection direction when the environment collection component collects the current real scene. The collection direction may include but is not limited to east, south, west, north, southwest, northwest, northeast and other directions. The collection direction can be determined by the direction sensor of the environment collection component. As an example only, the direction sensor may include but is not limited to a gyroscope and the like.

[0100] The first image information is used to indicate the scene picture collected by the environment collection component. Exemplarily, taking the environment collection component as a camera component as an example, the first image information may be the scene picture information currently captured by the camera component.

[0101] In an optional implementation manner, in response to a trigger operation for a target interaction mode, obtaining the first environment information includes:

[0102] In response to a trigger operation for a target interaction mode, initiating an environment acquisition component;

[0103] Acquire first image information collected by the environment collection component;

[0104] First environment information is obtained based on the collection direction information of the environment collection component and the first image information.

[0105] Optionally, when it is necessary to start the target interaction mode, the target interaction mode can be started by triggering the target control. When it is determined that the client enters the target interaction mode, if it is detected that the environment acquisition component is not turned on, and the client has the startup permission for the environment acquisition component, the environment acquisition component is automatically turned on to call the environment acquisition component to collect the picture of the current scene. The first image information collected in real time by the environment acquisition component is obtained, and the first environment information is generated in combination with the collection direction information of the environment acquisition component. If it is detected that the environment acquisition component is already turned on, the first image information collected in real time by the environment acquisition component is directly obtained, and the first environment information is generated in combination with the collection direction information of the first image information.

[0106] In the above embodiment, by responding to the trigger operation for the target interaction mode, the environment acquisition component is automatically activated, and the connection between the environment acquisition component and the target interaction mode is established, thereby reducing the manual operation steps of the screen in the user interface and improving the diversity of interaction forms. In addition, the first environment information is determined based on the image information and acquisition direction information collected by the activated environment acquisition component, reducing the time consumption of transmitting the interaction intermediate data between different devices and improving the interaction efficiency.

[0107] In step S203, a first interactive virtual element for pointing to a first media resource is obtained; the first media resource matches the acquisition direction information.

[0108] Optionally, the first media resource refers to resource content that needs to be interactively displayed. The first media resource may be a short video, live broadcast, article, commodity, or other resource. As an example only, a live broadcast may be content that is being broadcast, and a short video may be a video released in the last few hours or days. The number of first media resources may be one or more.

[0109] The first media resource is matched with the collection direction information, that is, for different collection direction information, the corresponding first media resource is different. Exemplarily, if the collection direction corresponding to the collection direction information is the first collection direction, the first media resources matching the first collection direction include {A1, A2...An}, if the collection direction corresponding to the collection direction information is the second collection direction, the first media resources matching the second collection direction include {B1, B2...Bm}, where n and m are positive integers.

[0110] In an alternative embodiment, if Figure 3 As shown, the obtaining of the first interactive virtual element for pointing to the first media resource includes:

[0111] In step S301, the terminal location information of the target terminal is obtained.

[0112] The target terminal is a terminal that executes the target interactive mode. The target terminal here can be Figure 1 The terminal 110 with the client installed is shown in FIG. The terminal location information is used to represent the geographical location of the target terminal.

[0113] In step S303, a first media resource is determined based on the collection direction information and the terminal location information.

[0114] Optionally, after the client obtains the terminal location information of the target terminal it carries, it can determine the target media resource location that meets the conditions based on the acquisition direction information and the terminal location information. The target media resource location may belong to a projection area M formed by taking the location of the target terminal as the vertex a and the acquisition direction corresponding to the acquisition direction information as the projection direction. As an example only, the projection area M may be an area in the shape of a fan or triangle. The target media resource location may refer to a resource publishing location or a resource positioning location of a media resource covered in the projection area. Next, based on the determined target media resource location, a first media resource with a matching location may be determined from a storage location such as a media resource library.

[0115] Optionally, in the target application scenario, the distance between the boundary of the projection area M and the vertex a may be less than or equal to a preset distance threshold, and the preset distance threshold may include but is not limited to 100m, 500m, 3km, 5km, etc. The target application scenario may include but is not limited to scenarios such as "people nearby" and "same city". The preset distance threshold may be determined based on the number of screened first media resources. The preset distance threshold may be inversely proportional to the number of first media resources. Specifically, if the number of screened first media resources is large, the corresponding preset distance threshold is smaller; conversely, the corresponding preset distance threshold is larger.

[0116] Optionally, an azimuth angle may be set for each collection direction, for example, an azimuth angle of 30°. The media resources within the area projected by the azimuth angle are the corresponding first media resources. In the case where the azimuth angle corresponding to the first collection direction and the azimuth angle corresponding to the second direction do not overlap, the first media resources corresponding to the two collection directions may be different. In the case where the azimuth angle corresponding to the first collection direction and the azimuth angle corresponding to the second collection direction overlap, the first media resources corresponding to the two collection directions may overlap, that is, the first media resources corresponding to the two collection directions have the same partial media resources.

[0117] In step S305, based on the resource display information corresponding to the first media resource, a first interactive virtual element for pointing to the first media resource is obtained.

[0118] Optionally, the resource display information is used to represent resource related information that needs to be displayed on the interactive screen. Taking the first media resource as a video resource as an example, the resource display information may include but is not limited to at least one of the content cover, interactive information, content description information, distance, relationship chain, resource status, etc. of the media resource.

[0119] Among them, the content cover of the media resource may refer to the cover image of the media resource; the interactive information may include the number of reposts, the number of likes, the number of plays, the number of online viewers, etc. of the first media resource; the content description information may include the title of the media resource, etc.; the distance may refer to the distance between the location point corresponding to the first media resource and the location of the target terminal; the relationship chain may refer to the relationship between the object account corresponding to the first media resource and the object account corresponding to the target terminal, such as "Followed", "My Friends", etc.; the resource status may refer to the current status of the media resource, such as "Live", "End of Live", "Near XX Hours", "Popular", etc.

[0120] After obtaining the resource display information corresponding to the first media resource, at least one resource display information corresponding to the first media resource can be combined to generate a first interactive virtual element for pointing to the first media resource. Accordingly, the generated first interactive virtual element may include at least one of a content sub-element for representing media content information, a distance sub-element for representing the distance relationship between the resource location corresponding to the first media resource and the location of the environment acquisition component, and an interactive sub-element for representing the interactive information of the first media resource. As an example only, the content sub-element corresponds to at least one of the content cover, content description information, and resource status in the resource display information, the distance sub-element corresponds to the distance in the resource display information, and the interactive sub-element corresponds to at least one of the interactive information and relationship chain in the resource display information.

[0121] The number of first interactive virtual elements matches the number of first media resources, each first interactive virtual element is bound to the corresponding first media resource, and the bound first media resource can be linked to through the first interactive virtual element. The first interactive virtual element can be in the form of a card, a pop-up window, a floating box, etc.

[0122] In the above embodiment, the first media resource is determined by collecting direction information and terminal location information, and the first media resource is associated with the collection direction information and the terminal location information. By changing at least one of the two, the first media resource can be changed, and then the first interactive virtual element displayed in the interactive screen is adjusted, which reduces the operation steps of the screen in the user interface and improves the interactive flexibility and interactive effect. In addition, based on the resource display information corresponding to the first media resource, the first interactive virtual element used to point to the first media resource is obtained, so that the first interactive virtual element carries richer resource information in the interactive screen, and then intuitively displays the resource content and location of the corresponding media resource, further reducing the operation steps of the screen in the user interface and improving the delivery effect of the interactive content.

[0123] In another optional implementation, the obtaining of the first interactive virtual element for pointing to the first media resource may include: the client may search for a preset number of first media resources whose publishing locations match the collection direction only according to the collection direction corresponding to the collection direction information, and obtain the first interactive virtual element for pointing to the first media resource according to the resource display information corresponding to the first media resource. Specifically, the first media resource matches the collection direction information, that is, for different collection direction information, the corresponding first media resource is different.

[0124] In another optional implementation, the obtaining of the first interactive virtual element for pointing to the first media resource may include: obtaining the first interactive virtual element for pointing to the first media resource from the server. Specifically, the server may first obtain the terminal location information and the collection direction information sent by the target terminal, and then determine the first media resource based on the collection direction information and the terminal location information; and determine the first interactive virtual element for pointing to the first media resource based on the resource display information corresponding to the first media resource, and send the first interactive virtual element to the client corresponding to the terminal, so that the client obtains the first interactive virtual element for pointing to the first media resource.

[0125] It should be noted that, here, the specific content of the first media resource is determined by the server, and the specific content of the first interactive virtual element is determined by referring to the above implementation mode, which will not be described in detail here.

[0126] In step S205, an interactive screen corresponding to the target interactive mode is displayed, where the interactive screen includes a first interactive virtual element and a scene screen corresponding to the first image information.

[0127] In an optional embodiment, the client can combine the first interactive virtual element with the scene screen corresponding to the first image information, generate an interactive screen corresponding to the target interactive mode and render it for display. The interactive screen can combine and display the first interactive virtual element and the scene screen corresponding to the first image information. Among them, the scene screen can be used to represent the shooting screen of the current scene. For example, the shooting screen can include but is not limited to shopping mall screens, office screens, tourist attraction screens, etc. The first interactive virtual element can be combined with the scene screen by embedding, fusion, stacking, suspension, etc. The first interactive virtual element may include at least one of a content sub-element for representing media content information, a distance sub-element for representing the distance relationship between the resource location corresponding to the first media resource and the location of the environment acquisition component, and an interactive sub-element for representing the interactive information of the first media resource. The sub-elements in the first interactive virtual element can be displayed in a nested, fused, spaced, and distributed manner.

[0128] In another alternative embodiment, if Figure 4 As shown, before displaying the interactive screen corresponding to the target interactive mode, the method further includes:

[0129] In step S401, resource location information corresponding to each first media resource corresponding to the first interactive virtual element is obtained.

[0130] The resource location information is used to characterize the geographical location of the target location corresponding to the media resource. As an example only, the target location may be the publishing location of the media resource, the location of the media resource, etc. The number of the first interactive virtual elements is the same as the number of the first media resources, and the resource location information corresponding to different first media resources may be the same or different.

[0131] In step S403, based on the location distance information between the resource location information of the first media resource and the terminal location information of the target terminal, the display attributes of the first interactive virtual elements corresponding to the first media resources are determined.

[0132] The target terminal is a terminal that executes the target interactive mode. The target terminal here can be Figure 1 The terminal 110 on which the client is installed is shown in FIG.

[0133] Optionally, the location distance information between the resource location information of each first media resource and the terminal location information of the target terminal can be calculated, and the display attribute of the first interactive virtual element corresponding to each first media resource can be determined based on the location distance information. The location distance information can be used to represent the relative location information between the publishing location of the media resource and the current location of the target terminal. The display attribute reflects the display status of the first interactive virtual element on the interactive screen.

[0134] In step S405, an interactive screen corresponding to the target interactive mode is generated according to each first interactive virtual element, the first image information and the display attribute.

[0135] The display attribute may include a display style, which may be used to characterize the display style of the first interactive virtual element. For example, the display position, arrangement style, etc. of each sub-element in the first interactive virtual element corresponding to each media resource.

[0136] Optionally, the display attribute may further include a display position and / or a display size. The display position is used to reflect the position of the first interactive virtual element in the interactive screen, such as the upper left corner, the center point, the lower right corner, etc. of the interactive screen. The display size is used to reflect the visual size of the first interactive virtual element in the interactive screen.

[0137] The above-mentioned embodiment generates an interactive screen corresponding to the target interactive mode according to each first interactive virtual element, the first image information and the display attribute, and improves the display effect of the interactive screen and increases the interactive interest by introducing the display attribute.

[0138] Correspondingly, such as Figure 5 As shown, in the case where the display attribute includes a display position and / or a display size, generating an interactive screen corresponding to the target interactive mode according to each first interactive virtual element, the first image information and the display attribute includes:

[0139] In step S501, each first interactive virtual element is combined with a scene screen corresponding to the first image information in sequence according to the display position to generate an interactive screen corresponding to the target interactive mode.

[0140] Optionally, each first interactive virtual element may be combined with the scene screen corresponding to the first image information in sequence according to the position of each first interactive virtual element in the display position, to generate an interactive screen corresponding to the target interactive mode. The combination method includes but is not limited to embedding, fusion, stacking, suspension, etc.

[0141] Optionally, the display orientation of each first interactive virtual element in the interactive screen can match the relative position of the publishing point of the corresponding first media resource and the target terminal. The relative position can be the position offset azimuth and the position offset distance. For example, the publishing point of the first media resource p1 is 100 meters away from the target terminal at 5° north, and the publishing point of the second media resource p2 is 300 meters away from the target terminal at 30° north. Then, the first interactive virtual element corresponding to the first media resource p1 is at s1 meters away from the interactive screen at 5° north, and the first interactive virtual element corresponding to the first media resource p2 is at s2 meters away from the interactive screen at 30° north, where s1 can be smaller than s2.

[0142] In step S503, each first interactive virtual element is combined with the scene screen corresponding to the first image information in sequence according to the display size to generate an interactive screen corresponding to the target interactive mode.

[0143] Optionally, each first interactive virtual element may be combined with the scene screen corresponding to the first image information in sequence according to the display size corresponding to each first interactive virtual element to generate an interactive screen corresponding to the target interactive mode. The combination method includes but is not limited to embedding, fusion, stacking, suspension, etc.

[0144] In an optional implementation, the display size may be negatively correlated with the distance size corresponding to the position distance information. That is, the larger the distance corresponding to the position distance information, the smaller the display size of the first interactive virtual element in the interactive screen; conversely, the larger the display size of the first interactive virtual element in the interactive screen. In this way, each interactive virtual element in the interactive screen is displayed by displaying the display size, achieving differentiated display of media resources and improving interactive display effects.

[0145] It should be noted that, in the above step S501 and step S503, the two can be executed separately or simultaneously, and the present disclosure does not specifically limit the execution order of the two.

[0146] In practical applications, just as an example, Figure 8 As shown, for the user interface on the left, the user interface can display a map interaction screen in map mode, and the right side displays an interactive screen in target interaction mode. The map interaction screen includes a target control 810. By clicking the target control 810 and starting the interactive mode switching instruction, the environment acquisition component (such as the rear camera) can be activated to take effect in the target interaction mode. In the target interaction mode, the camera shoots toward a certain direction a of the real scene to obtain a real scene screen. According to the direction of the camera and the location of the terminal, media resources (such as videos, live content, etc.) within the direction angle (such as 30°) and a preset distance nearby (such as 3km nearby) of the direction a can be recalled, and based on the resource display information of the recalled media resource, the first interactive virtual element for pointing to the first media resource is determined to display the interactive screen.

[0147] like Figure 8 As shown, the interactive screen includes a live scene screen 820 and a plurality of first interactive virtual elements 830 displayed in the form of content cards, and the first interactive virtual elements 830 include sub-elements such as media cover, content description, and distance. Figure 8 As shown, these sub-elements are displayed in a mutually spaced manner. Specifically, the sub-element corresponding to "content description" is displayed below the sub-element corresponding to "media cover", and the sub-element corresponding to "distance" is displayed below the sub-element corresponding to "content description", and the sub-element corresponding to "distance" can also be connected to "content description" through a connecting line. In addition, Figure 8 The sub-element corresponding to the "media cover" in the video may also display sub-elements such as "live broadcast" and "32,000 people watching". The cover size of the content card corresponding to the first interactive virtual element 830 is related to the distance from the terminal. Figure 8 As shown, the closer the publishing position corresponding to the first interactive virtual element is to the terminal, the larger the cover of the corresponding content card is; conversely, the smaller it is.

[0148] In the above embodiment, by responding to a trigger operation for a target interactive mode, first environmental information is obtained; the first environmental information includes the acquisition direction information of the environmental acquisition component and the first image information, and the first image information is used to indicate the scene screen collected by the environmental acquisition component; a first interactive virtual element for pointing to a first media resource is obtained; the first media resource matches the acquisition direction information; and an interactive screen corresponding to the target interactive mode is displayed, and the interactive screen includes the first interactive virtual element and the scene screen corresponding to the first image information. In this way, by introducing an environmental acquisition component and establishing an association between the environmental acquisition component and the target interactive mode, interaction is achieved through the environmental acquisition component, thereby reducing the number of times the user manually operates the screen of the user interface; because the displayed interactive screen includes the scene screen collected by the environmental acquisition component and the interactive virtual element corresponding to the media resource matching the acquisition direction information, more interactive resource information is displayed, thereby improving the information transmission effect of the interactive content.

[0149] In an alternative embodiment, if Figure 6 As shown, the method also includes:

[0150] In step S601, in response to the position movement information of the environment acquisition component, second environment information is obtained in real time; the second environment information includes updated acquisition direction information of the environment acquisition component and second image information, and the second image information is used to indicate the scene picture acquired by the environment acquisition component.

[0151] The position movement information indicates the position change of the environment acquisition component. If it is detected that the environment acquisition component has moved forward and backward, left and right, or rotated, it is determined that the environment acquisition component has changed its position, and the position movement information of the environment acquisition component is generated.

[0152] For example, at time t1, if the collection direction of the environment collection component is the first collection direction (for example, facing north), and the user only moves the environment collection component forward or backward, or left or right, then at time t2, its collection direction is still the first collection direction (for example, facing north), but the terminal position information of the terminal carried by the environment collection component has changed, for example, position a has changed to position b, then it is necessary to re-search the corresponding second media resource based on position b and the first collection direction, and then obtain the corresponding second interactive virtual element based on the re-searched second media resource.

[0153] At time t1, if the collection direction of the environment collection component is the first collection direction (for example, north), and the user only rotates the environment collection component 90° clockwise, then at time t3, the terminal location information of the terminal carried by the environment collection component has not changed, for example, it is still position a, but the collection direction has been updated and adjusted to the second collection direction (for example, east), then it is necessary to re-search the corresponding second media resource based on position a and the second collection direction.

[0154] Since the location of the environment collection component changes, the environment information collected by the environment collection component also changes, and accordingly, the acquisition of the second media resource also changes, and it is necessary to re-acquire the second interactive virtual element for pointing to the second media resource. The second media resource is associated with the updated collection direction information of the environment collection component and / or the terminal location information of the target terminal.

[0155] In step S603, a second interactive virtual element for pointing to a second media resource is obtained.

[0156] If the location of the environment collection component changes, the environment information collected by the environment collection component also changes, that is, if the collection space of the environment collection component changes, the second media resource in the collection space also changes, and the second media resource needs to be re-acquired to determine the second interactive virtual element based on the re-acquired second media resource. The second media resource is associated with the updated collection direction information of the environment collection component and / or the terminal location information of the target terminal.

[0157] It should be noted that the method for obtaining the second interactive virtual element is similar to the method for obtaining the first interactive virtual element, which will not be described in detail here.

[0158] In step S605, the interactive screen is dynamically updated based on the scene screen corresponding to the second interactive virtual element and the second image information.

[0159] In an optional implementation, the client can combine the second virtual element and the collection scene screen corresponding to the second image information collected by the environment collection component, generate a new interactive screen in real time, and replace the previous interactive screen with the new interactive screen, and display the dynamically updated interactive screen in the user interface. The updated interactive screen can combine and display the collection scene screen corresponding to the second interactive virtual element and the second image information. Among them, the collection scene screen can be used to represent the shooting screen of the current scene. For example, the shooting screen can include but is not limited to shopping mall screens, office screens, tourist attraction screens, etc. During the update process of the interactive screen, the interactive virtual elements in the interactive screen are dynamically updated. For example, the content sub-elements, distance sub-elements, and interaction sub-elements corresponding to the interactive virtual elements change dynamically according to the situation of the media resources.

[0160] In another optional embodiment, updating the interactive screen based on the second virtual element and the second image information collected by the environment collection component may include: obtaining resource location information corresponding to each second media resource corresponding to the second interactive virtual element; determining the display attributes of the second interactive virtual elements corresponding to each second media resource based on the location distance information between the resource location information of the second media resource and the terminal location information of the target terminal; the target terminal is a terminal that executes the target interactive mode; according to the display attributes, combining each second interactive virtual element with the second image information to generate an updated interactive screen; and displaying the updated interactive screen.

[0161] It should be noted that the specific details of the above steps S601 and S603 can be found in the above implementation manner and will not be repeated here.

[0162] The above-mentioned embodiment changes the search position and / or orientation of the environment acquisition component for content resources by moving the environment acquisition component, thereby being able to quickly find media resources in different orientations or search positions, thereby reducing the frequency of user operations on the screen in the user interface, improving interaction efficiency, and enriching the interaction forms, which is conducive to improving user stickiness.

[0163] In addition, when the user drives the environment collection component mounted on the terminal to move together in a real scene by walking, for example, the media resources displayed in the interactive screen are updated synchronously with the user's walking trajectory. Since the element layout of each first interactive virtual element in the interactive screen matches the actual geographical location distribution of the corresponding first media resource, the position distribution of the interactive virtual elements displayed in the interactive screen can help the user quickly find the publication location of the corresponding media resource in the actual geographical location, achieve the response from online to offline scenes, improve the interactive effect, further improve the information transmission effect of the interactive content, and also enhance the interactive fun and immersion.

[0164] In an optional implementation manner, when the interactive screen further includes a direction display element for representing the location of the resource, the method further includes:

[0165] During the movement of the environment collection component, the direction pointing icon in the direction display element moves synchronously with the collection direction corresponding to the collection direction information corresponding to the environment collection component.

[0166] Optionally, continue as Figure 8As shown, the interactive screen may also include a direction display element 840 for representing the resource location. The direction display element 840 may be a thumbnail of the resource location, and the thumbnail includes a direction pointing icon 841. During the movement of the environment acquisition component, the direction pointing icon moves synchronously with the acquisition direction corresponding to the acquisition direction information of the environment acquisition component. For example, if the acquisition direction of the environment acquisition component changes from a first acquisition direction to a second acquisition direction, the pointing head of the direction pointing icon 841 changes from the first acquisition direction to the second acquisition direction. Optionally, the direction display element 840 may also include resource distribution conditions, such as Figure 8 The white dots distributed in the direction display element 840 shown in the figure can represent the resource distribution. The more dots there are, the more media resources there are in that direction. On the contrary, the fewer dots there are, the more media resources there are in that direction. Figure 8 For example only, the design shape and display position of the directional display element are not limited to Figure 8 as shown in .

[0167] The above method is implemented by setting a direction display element for representing the resource location in the interactive screen, and during the movement of the environment collection component, the direction pointing icon in the direction display element moves synchronously with the collection direction corresponding to the collection direction information of the environment collection component. This makes it convenient for users to quickly understand the actual movement of the environment collection component and the location of the media resources, thereby improving the interaction effect and efficiency.

[0168] In an alternative embodiment, if Figure 7 As shown, the method also includes:

[0169] In step S701, in response to a triggering operation on a target interactive virtual element in an interactive screen, media resource information corresponding to the target interactive virtual element is displayed; the target interactive virtual element belongs to an element set corresponding to the first interactive virtual element.

[0170] Optionally, after the client displays the interactive screen, the user can perform a trigger operation such as clicking on the target virtual element in the interactive screen, and can enter the media resource interface corresponding to the target virtual element to display the media resource information corresponding to the target virtual element. The media resource information may include the playback content information of the media resource, the user information of the media resource, etc. The target interactive virtual element belongs to the element set corresponding to the first interactive virtual element.

[0171] The above-mentioned embodiment further improves the interactive effect by displaying the media resource information corresponding to the target interactive virtual element in response to the triggering operation of the target interactive virtual element in the interactive screen.

[0172] Regarding the method in the above embodiment, the specific manner of each step has been described in detail in the embodiment of the above method, and will not be elaborated here.

[0173] Fig. 9 is a block diagram of an interactive processing device according to an exemplary embodiment. Fig. 9 , the device comprises:

[0174] The first acquisition module 910 is configured to execute a trigger operation in response to a target interaction mode to obtain first environmental information; the first environmental information includes acquisition direction information and first image information of the environment acquisition component, and the first image information is used to indicate the scene image acquired by the environment acquisition component;

[0175] The second acquisition module 920 is configured to acquire a first interactive virtual element pointing to a first media resource; the first media resource matches the acquisition direction information;

[0176] The display module 930 is configured to display an interactive screen corresponding to the target interactive mode, wherein the interactive screen includes the first interactive virtual element and a scene screen corresponding to the first image information.

[0177] As an optional implementation, the first acquisition module is specifically configured to execute:

[0178] In response to a trigger operation for a target interaction mode, initiating an environment acquisition component;

[0179] Acquire first image information collected by the environment collection component;

[0180] First environment information is obtained based on the collection direction information of the environment collection component and the first image information.

[0181] As an optional implementation, the second acquisition module is specifically configured to execute:

[0182] Acquiring terminal location information of a target terminal; the target terminal is a terminal that executes the target interactive mode;

[0183] Determining a first media resource based on the collection direction information and the terminal location information;

[0184] Based on the resource display information corresponding to the first media resource, a first interactive virtual element for pointing to the first media resource is obtained.

[0185] As an optional implementation, the first interactive virtual element includes at least one of a content sub-element for representing media content information, a distance sub-element for representing the distance relationship between a resource location corresponding to the first media resource and a location of an environment acquisition component, and an interaction sub-element for representing interactive information of the first media resource.

[0186] As an optional implementation, the device further includes:

[0187] A location acquisition module, configured to execute acquisition of resource location information corresponding to each of the first media resources corresponding to the first interactive virtual element;

[0188] an attribute determination module configured to determine the display attribute of the first interactive virtual element corresponding to each of the first media resources based on the location distance information between the resource location information of the first media resource and the terminal location information of the target terminal; the target terminal is a terminal executing the target interactive mode;

[0189] The processing module is configured to generate an interactive screen corresponding to the target interactive mode according to each of the first interactive virtual elements, the first image information and the display attributes.

[0190] As an optional implementation, the display attribute includes a display position and / or a display size; the display size is negatively correlated with the position distance information. The processing module includes:

[0191] A first processing unit is configured to combine each of the first interactive virtual elements with the scene screen corresponding to the first image information in sequence according to the display position to generate an interactive screen corresponding to the target interactive mode; and / or

[0192] The second processing unit is configured to combine each of the first interactive virtual elements with the scene screen corresponding to the first image information in sequence according to the display size, so as to generate an interactive screen corresponding to the target interactive mode.

[0193] As an optional implementation, the device further includes:

[0194] A third acquisition module is configured to execute in response to the position movement information of the environment acquisition component to obtain second environment information in real time; the second environment information includes updated acquisition direction information of the environment acquisition component and second image information, and the second image information is used to indicate the scene picture acquired by the environment acquisition component;

[0195] A fourth acquisition module is configured to acquire a second interactive virtual element for pointing to a second media resource; the second media resource is associated with the updated acquisition direction information of the environment acquisition component and / or the terminal location information of the target terminal;

[0196] The display update module is configured to dynamically update the interactive screen based on the scene screen corresponding to the second interactive virtual element and the second image information.

[0197] As an optional implementation manner, when the interactive screen further includes a direction display element for representing the location of the resource, the device further includes:

[0198] The synchronous adjustment module is configured to execute, during the movement of the environment collection component, the synchronous movement of the direction pointing icon in the direction display element and the collection direction corresponding to the collection direction information corresponding to the environment collection component.

[0199] As an alternative embodiment, continue as Fig.10 As shown, the device also includes:

[0200] The interactive module 940 is configured to execute a trigger operation on a target interactive virtual element in the interactive screen and display media resource information corresponding to the target interactive virtual element; the target interactive virtual element belongs to an element set corresponding to the first interactive virtual element.

[0201] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0202] Fig.11 is a block diagram of an electronic device according to an exemplary embodiment. Fig.11 The electronic device includes a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to implement the steps of any interactive processing method in the above-mentioned embodiments when executing the instructions stored in the memory.

[0203] The electronic device may be a terminal, a server or a similar computing device. For example, the electronic device is a terminal. Fig.11 is a block diagram of an electronic device for interactive processing according to an exemplary embodiment. Specifically:

[0204] The terminal may include components such as an RF (Radio Frequency) circuit 1110, a memory 1120 including one or more computer-readable storage media, an input unit 1130, a display unit 1140, a sensor 1150, an audio circuit 1160, a WiFi (wireless fidelity) module 1170, a processor 1180 including one or more processing cores, and a power supply 1190. Those skilled in the art will appreciate that Fig.11 The terminal structure shown in the figure does not constitute a limitation on the terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0205] The RF circuit 1110 can be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information of the base station, it is handed over to one or more processors 1180 for processing; in addition, the data related to the uplink is sent to the base station. Generally, the RF circuit 1110 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a user identity module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, etc. In addition, the RF circuit 1110 can also communicate with the network and other terminals through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), etc.

[0206] The memory 1120 can be used to store software programs and modules, and the processor 1180 executes various functional applications and data processing by running the software programs and modules stored in the memory 1120. The memory 1120 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, application programs required for functions, etc.; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 1120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 1120 may also include a memory controller to provide the processor 1180 and the input unit 1130 with access to the memory 1120.

[0207] The input unit 1130 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 1130 may include a touch-sensitive surface 1131 and other input devices 1132. The touch-sensitive surface 1131, also known as a touch display screen or touch pad, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch-sensitive surface 1131), and drive corresponding connection devices according to a pre-set program. Optionally, the touch-sensitive surface 1131 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 1180, and can receive and execute commands sent by the processor 1180. In addition, the touch-sensitive surface 1131 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 1131, the input unit 1130 may further include other input devices 1132. Specifically, the other input devices 1132 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.

[0208] The display unit 1140 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the terminal, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 1140 may include a display panel 1141. Optionally, the display panel 1141 may be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, the touch-sensitive surface 1131 may cover the display panel 1141. When the touch-sensitive surface 1131 detects a touch operation on or near it, it is transmitted to the processor 1180 to determine the type of touch event, and then the processor 1180 provides corresponding visual output on the display panel 1141 according to the type of touch event. Among them, the touch-sensitive surface 1131 and the display panel 1141 can be two independent components to realize input and output functions, but in some embodiments, the touch-sensitive surface 1131 and the display panel 1141 can also be integrated to realize input and output functions.

[0209] The terminal may also include at least one sensor 1150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1141 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 1141 and / or the backlight when the terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the terminal posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can be configured in the terminal, they will not be repeated here.

[0210] The audio circuit 1160, the speaker 1161, and the microphone 1162 can provide an audio interface between the user and the terminal. The audio circuit 1160 can transmit the received audio data to the speaker 1161 after converting the received audio data into an electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 1162 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1160 and converted into audio data, and then the audio data is processed by the output processor 1180 and sent to, for example, another terminal through the RF circuit 1110, or the audio data is output to the memory 1120 for further processing. The audio circuit 1160 may also include an earplug jack to provide communication between an external headset and the terminal.

[0211] WiFi is a short-range wireless transmission technology. The terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1170, which provides users with wireless broadband Internet access. Fig.11 A WiFi module 1170 is shown, but it is understandable that it is not an essential component of the terminal and can be omitted as needed without changing the essence of the invention.

[0212] The processor 1180 is the control center of the terminal, and uses various interfaces and lines to connect various parts of the entire terminal. By running or executing software programs and / or modules stored in the memory 1120, and calling data stored in the memory 1120, the processor 1180 performs various functions of the terminal and processes data, thereby monitoring the terminal as a whole. Optionally, the processor 1180 may include one or more processing cores; preferably, the processor 1180 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 1180.

[0213] The terminal also includes a power supply 1190 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the processor 1180 through a power management system, so that the power management system can manage charging, discharging, power consumption management, etc. The power supply 1190 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0214] Although not shown, the terminal may also include a camera, a Bluetooth module, etc., which will not be described in detail herein. Specifically in this embodiment, the terminal also includes a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors. The one or more programs include instructions for executing the virtual resource claiming method provided in the above method embodiment.

[0215] In an exemplary embodiment, a computer storage medium is also provided. When instructions in the computer storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the steps of the method provided in any one of the above embodiments.

[0216] In an exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program / instruction, and the computer program / instruction is executed by a processor to implement the method provided in any of the above embodiments. Optionally, the computer program is stored in a computer-readable storage medium. The processor of the electronic device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the electronic device performs the method provided in any of the above embodiments.

[0217] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM) and memory bus dynamic RAM (RDRAM).

[0218] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0219] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An interactive processing method, characterized in that: include: In response to a triggering operation for a target interaction mode, obtaining first environment information; The first environment information includes collection direction information of the environment collection component and first image information, and the first image information is used to indicate the scene picture collected by the environment collection component; Acquire a first interactive virtual element for pointing to a first media resource; The first media resource matches the collection direction information, and the first media resources corresponding to different collection direction information are at least partially different; Displaying an interactive screen corresponding to the target interactive mode, wherein the interactive screen includes the first interactive virtual element and a scene screen corresponding to the first image information; The step of acquiring a first interactive virtual element for pointing to a first media resource includes: Acquiring terminal location information of a target terminal; the target terminal is a terminal that executes the target interactive mode; Based on the collection direction information and the terminal location information, determining a first media resource; the first media resource is resource content that needs to be interactively displayed; Based on the resource display information corresponding to the first media resource, a first interactive virtual element for pointing to the first media resource is obtained.

2. The method according to claim 1, characterized in that The obtaining of the first environment information in response to the triggering operation for the target interaction mode includes: In response to a trigger operation for a target interaction mode, initiating an environment acquisition component; Acquire first image information collected by the environment collection component; First environment information is obtained based on the collection direction information of the environment collection component and the first image information.

3. The method according to claim 1, characterized in that The first interactive virtual element includes at least one of a content sub-element for representing media content information, a distance sub-element for representing the distance relationship between a resource location corresponding to the first media resource and a location of an environment acquisition component, and an interaction sub-element for representing interactive information of the first media resource.

4. The method according to any one of claims 1 to 3, characterized in that: Before displaying the interactive screen corresponding to the target interactive mode, the method further includes: Obtain resource location information corresponding to each of the first media resources corresponding to the first interactive virtual element; Determining the display attributes of the first interactive virtual elements corresponding to each of the first media resources based on the location distance information between the resource location information of the first media resource and the terminal location information of the target terminal; the target terminal is a terminal executing the target interactive mode; An interactive screen corresponding to the target interactive mode is generated according to each of the first interactive virtual elements, the first image information and the display attributes.

5. The method according to claim 4, characterized in that The display attribute includes a display position and / or a display size; the display size is negatively correlated with the distance size corresponding to the position distance information; The generating an interactive screen corresponding to the target interactive mode according to each of the first interactive virtual elements, the first image information and the display attribute comprises: According to the display position, sequentially combining each of the first interactive virtual elements with the scene screen corresponding to the first image information to generate an interactive screen corresponding to the target interactive mode; and / or According to the display size, each of the first interactive virtual elements is combined with the scene screen corresponding to the first image information in sequence to generate an interactive screen corresponding to the target interactive mode.

6. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to the position movement information of the environment acquisition component, second environment information is obtained in real time; the second environment information includes updated acquisition direction information of the environment acquisition component and second image information, and the second image information is used to indicate the scene picture acquired by the environment acquisition component; Acquire a second interactive virtual element for pointing to a second media resource; the second media resource is associated with the updated collection direction information of the environment collection component and / or the terminal location information of the target terminal; Based on the scene picture corresponding to the second interactive virtual element and the second image information, the interactive picture is dynamically updated.

7. The method according to any one of claims 1 to 3, characterized in that: In the case where the interactive screen further includes a direction display element for representing the location of the resource, the method further includes: During the movement of the environment collection component, the direction pointing icon in the direction display element moves synchronously with the collection direction corresponding to the collection direction information corresponding to the environment collection component.

8. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to a triggering operation on a target interactive virtual element in the interactive screen, media resource information corresponding to the target interactive virtual element is displayed; the target interactive virtual element belongs to an element set corresponding to the first interactive virtual element.

9. An interactive processing device, characterized in that: include: A first acquisition module is configured to execute a trigger operation in response to a target interaction mode to obtain first environment information; The first environment information includes collection direction information of the environment collection component and first image information, and the first image information is used to indicate the scene picture collected by the environment collection component; A second acquisition module is configured to execute acquisition of a first interactive virtual element for pointing to a first media resource; The first media resource matches the collection direction information, and the first media resources corresponding to different collection direction information are at least partially different; A display module is configured to display an interactive screen corresponding to the target interactive mode, wherein the interactive screen includes the first interactive virtual element and a scene screen corresponding to the first image information; The second acquisition module is specifically configured to execute: Acquiring terminal location information of a target terminal; the target terminal is a terminal that executes the target interactive mode; Based on the collection direction information and the terminal location information, determining a first media resource; the first media resource is resource content that needs to be interactively displayed; Based on the resource display information corresponding to the first media resource, a first interactive virtual element for pointing to the first media resource is obtained.

10. The device according to claim 9, characterized in that The first acquisition module is specifically configured to execute: In response to a trigger operation for a target interaction mode, initiating an environment acquisition component; Acquire first image information collected by the environment collection component; First environment information is obtained based on the collection direction information of the environment collection component and the first image information.

11. The device according to claim 9, characterized in that The first interactive virtual element includes at least one of a content sub-element for representing media content information, a distance sub-element for representing the distance relationship between a resource location corresponding to the first media resource and a location of an environment acquisition component, and an interaction sub-element for representing interactive information of the first media resource.

12. The device according to any one of claims 9 to 11, characterized in that: The device also includes: A location acquisition module, configured to acquire resource location information corresponding to each of the first media resources corresponding to the first interactive virtual element; an attribute determination module configured to determine the display attribute of the first interactive virtual element corresponding to each of the first media resources based on the location distance information between the resource location information of the first media resource and the terminal location information of the target terminal; the target terminal is a terminal executing the target interactive mode; The processing module is configured to generate an interactive screen corresponding to the target interactive mode according to each of the first interactive virtual elements, the first image information and the display attributes.

13. The device according to claim 12, characterized in that The display attributes include display position and / or display size; The display size is negatively correlated with the position distance information; the processing module includes: A first processing unit is configured to combine each of the first interactive virtual elements with the scene screen corresponding to the first image information in sequence according to the display position to generate an interactive screen corresponding to the target interactive mode; and / or The second processing unit is configured to execute, according to the display size, combining each of the first interactive virtual elements with the scene screen corresponding to the first image information in sequence to generate an interactive screen corresponding to the target interactive mode.

14. The device according to any one of claims 9 to 11, characterized in that: The device also includes: A third acquisition module is configured to execute, in response to the position movement information of the environment acquisition component, to obtain second environment information in real time; the second environment information includes updated acquisition direction information of the environment acquisition component and second image information, and the second image information is used to indicate the scene picture acquired by the environment acquisition component; A fourth acquisition module is configured to acquire a second interactive virtual element for pointing to a second media resource; the second media resource is associated with the updated acquisition direction information of the environment acquisition component and / or the terminal location information of the target terminal; The display update module is configured to dynamically update the interactive screen based on the scene screen corresponding to the second interactive virtual element and the second image information.

15. The device according to any one of claims 9 to 11, characterized in that: In the case where the interactive screen further includes a direction display element for representing the location of the resource, the device further includes: The synchronous adjustment module is configured to execute, during the movement of the environment collection component, the synchronous movement of the direction pointing icon in the direction display element and the collection direction corresponding to the collection direction information corresponding to the environment collection component.

16. The device according to any one of claims 9 to 11, characterized in that: The device also includes: The interactive module is configured to execute a trigger operation on a target interactive virtual element in the interactive screen and display media resource information corresponding to the target interactive virtual element; the target interactive virtual element belongs to an element set corresponding to the first interactive virtual element.

17. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the interactive processing method as described in any one of claims 1 to 8.

18. A computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the interactive processing method as described in any one of claims 1 to 8.

19. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the interactive processing method according to any one of claims 1 to 8 is implemented.

Citation Information

Patent Citations

  • LBS (location based service)-based augmented reality positioning method and device

    CN107450088A

  • Method for displaying information of augmented reality and terminal thereof

    KR1020120032336A