Method and device for interface interaction, equipment, storage medium and program product

Abstract

According to the embodiment of the invention, a method, a device and equipment for interface interaction, a storage medium and a program product are provided. The method comprises the steps that in response to the fact that a media content item comprises content matched with a first object, interactive interface elements are presented in a first interface used for presenting the media content item, and the interactive interface elements indicate first object information of the first object; and in response to triggering of the interactive interface element, switching from the first interface to a second interface, and presenting a first group of objects matched with the first object in the second interface.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and particularly to methods, apparatuses, electronic devices, computer-readable storage media, and computer program products for interface interaction. Background Art

[0002] With the rapid development of the Internet, more and more applications are designed to provide various services to users. For example, an application can provide a search service to a user. The application can provide media content items to the user, and the media content items can include any suitable type of content such as images, texts, videos, audios, etc. If the content of the media content item is associated with an object, it is desirable to improve the efficiency of the user obtaining object information of the object. Summary of the Invention

[0003] In a first aspect of the present disclosure, there is provided a method for interface interaction. The method includes: in response to a media content item including content matching a first object, presenting an interactive interface element in a first interface for presenting the media content item, where the interactive interface element indicates first object information of the first object; and in response to a trigger of the interactive interface element, switching from the first interface to a second interface, where a first group of objects matching the first object is presented in the second interface.

[0004] In a second aspect of the present disclosure, there is provided an apparatus for interface interaction. The apparatus includes: an element presentation module configured to, in response to a media content item including content matching a first object, present an interactive interface element in a first interface for presenting the media content item, where the interactive interface element indicates first object information of the first object; and an interface switching module configured to, in response to a trigger of the interactive interface element, switch from the first interface to a second interface, where a first group of objects matching the first object is presented in the second interface.

[0005] In a third aspect of the present disclosure, there is provided an electronic device. The device includes at least one processor; and at least one memory, the at least one memory being coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the electronic device to execute the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, there is provided a computer-readable storage medium. Computer-executable instructions are stored on the computer-readable storage medium, and when the computer-executable instructions are executed by a processor, the method of the first aspect is implemented.

[0007] In a fifth aspect of the present disclosure, a computer program product is provided. The computer program product includes computer-executable instructions, which, when executed by a processor, implement the method according to the first aspect of the present disclosure.

[0008] It should be understood that the content described in this content part is not intended to define the key features or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In combination with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more obvious. In the drawings, the same or similar reference numerals denote the same or similar elements, where:

[0010] Figure 1 A schematic diagram showing an example environment in which the embodiments of the present disclosure can be implemented;

[0011] Figures 2A to 2J An example interface for interface interaction according to some embodiments of the present disclosure;

[0012] Figure 3 A flowchart showing a method for interface interaction according to some embodiments of the present disclosure;

[0013] Figure 4 An exemplary structural block diagram showing a device for interface interaction according to some embodiments of the present disclosure; and

[0014] Figure 5 A block diagram showing an electronic device in which one or more embodiments of the present disclosure can be implemented. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0015] The embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0016] In the description of the embodiments of the present disclosure, the term "including" and its like should be understood as an open inclusion, that is, "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". There may also be other explicit and implicit definitions hereinafter.

[0017] In this document, unless otherwise specified, performing a step "in response to A" does not mean that the step is immediately performed after "A", but may include one or more intermediate steps.

[0018] It can be understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of the corresponding laws, regulations and related provisions.

[0019] It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, usage scopes, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner according to relevant laws and regulations.

[0020] For example, when a user's active request is received, a prompt message is sent to the user to clearly prompt the user that the operation requested by the user will require the acquisition and use of the user's personal information, so that the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, an application program, a server or a storage medium that performs the operations of the technical solution of the present disclosure according to the prompt message.

[0021] As an optional but non-limiting implementation manner, the manner of sending a prompt message to the user in response to receiving the user's active request may be, for example, in the form of a pop-up window, and the prompt message may be presented in text in the pop-up window. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0022] It can be understood that the above process of notifying and obtaining the user's authorization is only illustrative and does not limit the implementation manner of the present disclosure. Other manners that meet the relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0023] In the present disclosure, "trigger" refers to one or more interaction operations of the user on the terminal device. Further, these interaction operations may be triggered within the same user interface / pop-up window or within different user interfaces / pop-up windows. The present disclosure is not limited in this regard.

[0024] In the present disclosure, "object" may refer to any entity or virtual object, including but not limited to, physical or virtual goods, media works, etc.

[0025] As briefly mentioned above, an application can provide media content items to a user, and the media content items can include any suitable type of content such as images, text, videos, audio, etc. In some scenarios, the creator or publisher of a media content item can add an object associated with the media content item. Taking the object as a commodity as an example, some media content items can include a link to the commodity. The user can trigger the link to view the object associated with the media content item. This method requires pre - configuration by the publisher / creator. Although it can ensure the efficiency of the user obtaining the content associated with the media content item, the application scenarios are limited. In other scenarios, if the media content item is not associated with an object, the user can manually try to search for the object name, object image, etc. to search for the object that appears in the media content item. This method requires multiple interactions by the user and will affect the efficiency of the user searching for the object.

[0026] In view of this, the present disclosure proposes an improved solution for interface interaction. According to the solution of the embodiments of the present disclosure, in response to the media content item including content matching a first object, an interactive interface element is presented in a first interface for presenting the media content item. The interactive interface element indicates first object information of the first object. In response to the triggering of the interactive interface element, a switch is made from the first interface to a second interface. A first set of objects matching the first object is presented in the second interface.

[0027] In this way, in the case where the media content item includes content matching an object, an interactive interface element can be presented in the presentation interface of the media content item, and the interactive interface element indicates the object information of the object matching the content in the media content item. The user can trigger the interactive interface element to obtain a search result matching the object in the interactive interface element, and the search result includes at least the object matching the content in the media content item. Thus, there is no need for the content publisher to set the media content item and the object by itself, nor does the user need to search by himself. The search result can be provided to the user through a simple interaction, which can improve the efficiency of the user obtaining information.

[0028] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In this example environment 100, an instance of an application 120 is installed in a terminal device 110. The user 140 can interact with the application 120 via an attached device of the terminal device 110. Similarly, the user 140 can interact with the application 120 via the terminal device 110 and / or an attached device of the terminal device 110.

[0029] In some embodiments, the application 120 can be any suitable application that can provide services associated with media content items for the user 140. Media content items can also be referred to as media content, media items, content items, etc. Services associated with media content items can include browsing, commenting, forwarding, creating (e.g., shooting and / or editing), publishing, etc. of media content items. Media content items can include one or more types of content, such as videos, images, gifs, image sets, audio, text, etc.

[0030] In Figure 1 the environment 100, if the application 120 is active, the terminal device 110 can present the interface 150 of the application 120. The interface 150 can include various types of interfaces that the application 120 can provide, such as a content presentation interface, a search interface, a query interface, a search result presentation interface, etc.

[0031] In some embodiments, the terminal device 110 communicates with the server 130 to implement the supply of services of the application 120. The terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 is also capable of supporting any type of interface for the user (such as a "wearable" circuit, etc.).

[0032] The server 130 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. The server 130 can, for example, include computing systems / servers, such as mainframes, edge computing nodes, computing devices in a cloud environment, etc.

[0033] It should be understood that the structures and functions of the various elements in the environment 100 are described only for exemplary purposes, without implying any limitation on the scope of the present disclosure.

[0034] Some example embodiments of the present disclosure will be further described with reference to the accompanying drawings. The interface interaction method involved in the present disclosure can be implemented on the terminal device 110. It should be noted that the operations performed by the terminal device 110 can specifically be performed by relevant applications (such as application 115) installed on the terminal device 110. Some operations described with reference to the terminal device 110 may require the assistance of the server 130 to complete.

[0035] It should be understood that the interfaces shown in the drawings are merely examples, and various interface designs can actually exist. Each graphical element in the interface can have different arrangements and different visual representations, one or more of which can be omitted or replaced, and there can also be one or more other elements. The embodiments of the present disclosure are not limited in this regard.

[0036] Figures 2A to 2J Example interfaces 200A to 200J for interface interaction according to some embodiments of the present disclosure are shown. The interfaces shown in example interfaces 200A to 200J can be presented at the terminal device 110. For ease of discussion, the example interfaces 200A to 200J will be described with reference to Figure 1 environment 100. The terminal device 110 can be used for interaction by receiving operations of an associated user (such as user 140) to present corresponding interaction results.

[0037] In environment 100, the terminal device 110 presents an interface 150 of application 120. In some cases, the interface 150 presented by the terminal device 110 can be a content presentation interface of application 120 (which can also be referred to as the first interface, presentation interface, etc. for example), and media content items are presented in the content presentation interface. In some embodiments, the content presentation interface can be an interface for presenting media content items and other relevant information to the user. A set of media content items that can be presented in the content presentation interface can include various types of media content items. The media content items to be presented in a specific content presentation interface can be determined according to the application design requirements. The specific media content items to be displayed and their numbers will vary in different scenarios.

[0038] In some embodiments, the content presentation interface can include the home page of application 120, or a recommended home page among a set of home page interfaces of application 120. The recommended data shown to the user on the recommended home page is sometimes also referred to as the recommended information stream. In some embodiments, the content presentation interface can also include a specific content presentation interface of application 120, which can be used to present media content items published by a specific user for example. That is, the media content items presented by the terminal device 110 in the first interface can be media content items in the information stream or recommended stream of application 120, or media content items published by a specific user.

[0039] The terminal device 110 may present an interactive interface element in a first interface for presenting a media content item in response to the media content item including content matching a first object. In some embodiments, the terminal device 110 may determine whether the media content item is configured to be associated with a specified object. If it is determined that the media content item is configured to be associated with the specified object, the first interface for presenting the media content item will include a link to the specified object. In this case, to ensure the simplicity of the interface, the terminal device 110 may present the interactive interface element only in the first interface for presenting media content items that are not configured to be associated with the specified object. That is, the terminal device 110 may present only one of the link to the object and the interactive interface element. Of course, in some embodiments, the terminal device 110 may also present the interactive interface element regardless of whether the media content item is configured to be associated with the specified object.

[0040] The terminal device 110 may, for example, determine that the media content item matches the first object in response to determining that the text of the media content item includes information such as the name, description, etc. of the first object. The terminal device 110 may, for example, determine that the media content item matches the first object in response to the image / video frame of the media content item including information such as the image, logo, chart, etc. of the first object. The terminal device 110 may also, for example, determine that the media content item matches the first object in response to the publisher of the media content item being associated with the first object (for example, the user who publishes the media content item is the store of the first object). Only some examples are shown here, and the present disclosure does not limit the specific manner of determining the matching between the media content item and the first object.

[0041] In some embodiments, the terminal device 110 may directly present an interactive interface element in the first interface for presenting a media content item in response to the media content item including content matching a first object. In this case, the terminal device 110 may directly present the interactive interface element proposed herein in response to the media content item starting to be presented in the first interface. In some embodiments, the terminal device 110 may also present the interactive interface element in the first interface in response to the presentation duration of the media content item in the first interface reaching a specified threshold. This is because after the current media content item is presented for a period of time, it means that the user may be more interested in the content in the media content item. As an example, referring to Figure 2A and Figure 2B , the terminal device 110 may, in response to the media content item being presented in the first interface, default to presenting the example interface 200A, and the example interface 200A does not include an interactive interface element. The terminal device 110 may switch to presenting the example interface 200B in response to the presentation duration of the media content item in the first interface reaching a specified threshold. The example interface 200B includes an interactive interface element 210.

[0042] The interactive interface elements presented in the first interface may indicate first object information of the first object. The first object information may, for example, indicate the name, description, image, price, source party, etc. of the first object. In some embodiments, the first object information may include a search term corresponding to the first object. The terminal device 110 may, for example, present search results matching the search term in response to receiving a search operation for the search term. The search results may at least include the first object.

[0043] The terminal device 110 may determine the search term corresponding to the first object in any suitable manner. In some embodiments, the terminal device 110 may determine a set of target objects associated with a media content item based on the content identifier of the media content item (which may be represented, for example, as the GID of the media content item), and this set of target objects may at least include the first object. The terminal device 110 may, for example, identify the content of the media content item in response to the media content item being published, and determine a set of target objects associated with the media content item based on the content. The terminal device 110 may store the set of target objects in association with the content identifier of the media content item (for example, stored in a dataset).

[0044] The terminal device 110 may query a set of target objects associated with the media content item that matches the content identifier from the dataset based on the content identifier of the media content item. The terminal device 110 may determine the search term corresponding to the first object based on the description information of the set of target objects. The description information of the set of target objects may include any suitable information such as the names, captions, text descriptions, comments, etc. of the respective target objects in the set. The terminal device 110 may, for example, perform operations such as analysis, clustering, summarization, etc. on the description information of the set of target objects to determine the search term corresponding to the first object. Such a way of determining the search term may be referred to as a "text search" method, for example.

[0045] In some embodiments, the terminal device 110 may extract a first image from the content of the media content item that matches the first object. The first image may be an image / video frame (for example, a screenshot) corresponding to the content of the media content item that matches the first object, or an image segment of such an image / video frame that matches the first object. As an example, if the first image is product A, the first image may be an image of the media content item that includes product A, or an image segment intercepted from this image that includes product A.

[0046] The terminal device 110 can determine a set of target objects that match the first object from a set of candidate objects based on the degree of match between the first image and the candidate images corresponding to the respective candidate objects. For example, the terminal device 110 can determine at least one candidate object with the highest degree of match in the set of candidate objects as a set of target objects that match the first object. The terminal device 110 can determine the search term corresponding to the first object based on the description information of the set of target objects. Such a way of determining the search term can be referred to as an "image search" method, for example.

[0047] Regarding the presentation manner of the interactive interface element, in some embodiments, the terminal device 110 can present the interactive interface element in different visual styles based on the manner of determining the search term. For example, the terminal device 110 can present different elements in the interactive interface element for different manners. As an example, the terminal device 110 can present the interactive interface element 210 shown in the example interface 200B in response to determining the search term by using the "text search" method, and the interactive interface element 210 includes the element 211. For example, the terminal device 110 can present other elements different from the element 211 in the interactive interface element 210 in response to determining the search term by using the "image search" method.

[0048] In some embodiments, the terminal device 110 can present the interactive interface element in a first state during a first time period, and in the first state, the interactive interface element indicates the first object information. The terminal device 110 can present the interactive interface element in a second state during a second time period. In the second state, the interactive interface element indicates the first object information and additional object information, that is, the object information displayed in the second state is more than the object information displayed in the first state. The first state can correspond to the collapsed state of the interactive interface element, and the second state can correspond to the expanded state of the interactive interface element. The second time period can be a time period after the first time period. For example, the first time period can be the first 10 seconds before presenting the media content item, and the second time period can be from the 10th second to the end of presenting the media content item when presenting the media content item.

[0049] The first state and the second state of the interactive interface element can be switched over time. As an example, refer to Figure 2B and Figure 2C, the terminal device 110 can present the example interface 200B within the first time period and present the example interface 200C within the second time period. In the example interface 200B, the interactive interface element 210 is initially in the first state, which can indicate the search term corresponding to the first object (such as the text "casual shirt" shown in the figure). After a period of time, in the example interface 200C, the interactive interface element 210 is in the second state. In addition to the search term corresponding to the first object, the interactive interface element 210 can also indicate the image 213 corresponding to the first object, the price information of the first object, etc.

[0050] The first state and the second state of the interactive interface element can be switched according to user triggers. In some embodiments, the interactive interface element may further include a state switching control. The terminal device 110 can respond to the trigger received for the state switching control and switch the state of the interactive interface element (such as switching between the first state and the second state). As an example, the interactive interface element 210 in the example interface 200B includes a control 212, and the terminal device 110 can respond to the trigger received for the control 212 and switch to presenting the interactive interface element 210 in the example interface 200C.

[0051] In some embodiments, the terminal device 110 can also respond to the trigger for collapsing the interactive interface element and switch back from the second state to presenting the interactive interface element in the first state. Continuing to refer to Figure 2C , the interactive interface element 210 in the example interface 200C includes a control 214. The terminal device 110 can determine that the trigger for collapsing the interactive interface element 210 is received in response to the trigger received for the control 214 (such as the user clicking on the control 214). The terminal device 110 can then respond to the trigger for collapsing the interactive interface element 210 and switch to presenting the collapsed interactive interface element 210 in the example interface 200B. Further, in the collapsed state, the terminal device 110 can determine that the trigger for expanding the interactive interface element 210 is received in response to the trigger received for the control 214 again (such as the user clicking on the control 214 again). The terminal device 110 can then respond to the trigger for expanding the interactive interface element 210 and switch to the expanded interactive interface element 210.

[0052] In some embodiments, the first interface may further include description information associated with the media content item, and the description information may include the copywriting, introduction, etc. of the media content item. Since the size of the first interface is limited, if there is a large amount of such description information, the terminal device 110 may only present a part of the description information and, in response to receiving a trigger of a control associated with the description information, present the complete description information. In some embodiments, to ensure the simplicity of the first interface as much as possible, when presenting the interactive interface elements in the second state, the terminal device 110 may also, in response to receiving a trigger of a control associated with the description information, switch to presenting the interactive interface elements in the first state.

[0053] As an example, referring to Figure 2D and Figure 2E , the terminal device 110 presents the interactive interface elements 210 in the second state in the example interface 200D. The terminal device 110 may, in response to receiving a trigger of the control 201 associated with the description information of the media content item in the example interface 200D, switch to presenting the example interface 200E. The terminal device 110 presents the complete description information in the example interface 200E and presents the interactive interface elements 210 in the first state.

[0054] Regarding the method of state switching of the interactive interface elements, in some embodiments, the terminal device 110 may, in response to meeting the state switching requirements (such as reaching the second time period, receiving a trigger of the state switching control, etc.), directly switch from presenting the interactive interface elements in the first state to presenting the interactive interface elements in the second state. In some embodiments, the terminal device 110 may also, in response to meeting the state switching requirements, dynamically switch from presenting the interactive interface elements in the first state to presenting the interactive interface elements in the second state.

[0055] Referring to Figure 2B , Figure 2C and Figure 2F , taking the second time period as the next time period after the first time period as an example, the terminal device 110 may, in response to the presentation duration reaching near the end of the first time period (i.e., the start of the second time period), switch from presenting the example interface 200B to presenting the example interface 200F. In the example interface 200F, the terminal device 110 may present at least a part of the additional object information (such as presenting the image 213).

[0056] In some embodiments, the terminal device 110 may first present the image 213 in a smaller size, and as the duration increases, gradually increase the size of the image 213, and in response to the size of the image 213 reaching a predetermined size (such as the size indicated by the interactive interface element in the second state), keep the size of the image 213 unchanged. In some embodiments, the terminal device 110 may also gradually increase the additional object information in the interactive interface element as the presentation duration increases. The terminal device 110 may then present the example interface 200C in response to the size of the image 213 reaching the predetermined size and the additional object information being completely presented.

[0057] In some embodiments, a media content item may include multiple content segments. For example, if the media content item is a video, the video may include multiple video segments, and each video segment may correspond to a content segment. If the media content item is an image set, the image set may include multiple images, and each image may correspond to a content segment. Different content segments may be matched with different objects. As an example, the media content item may include a first content segment matched with a first object and a second content segment matched with a second object. The terminal device 110 may present different content in the interactive interface element for different content segments. For example, in the case where the currently presented content belongs to the first content segment, the interactive interface element may indicate the first object information of the first object, and in the case where the currently presented content belongs to the second content segment, the interactive interface element may indicate the second object information of the second object.

[0058] Reference Figure 2G and Figure 2H , in the case where the media content item is a video, the terminal device 110 may also present a progress bar 203 of the media content item. The progress bar 203 may indicate which video segment the currently presented content belongs to, the current playback progress, etc. In some embodiments, the progress bar 203 may include distinguishing elements for different content segments. For example, the progress bar 203 in the example interface 200G includes 3 black circles, and each circle is used to distinguish two different content segments, and these 3 circles may indicate that the media content item includes 4 content segments. Referring to the example interface 200G, in the case where the currently played content belongs to the first content segment, the terminal device 110 may present the object information of the object corresponding to the first content segment in the interactive interface element 210. Referring to the example interface 200H, in the case where the currently played content belongs to the second content segment, the terminal device 110 may update the interactive interface element 210, and the updated interactive interface element 210 presents the object information of the object corresponding to the second content segment.

[0059] The terminal device 110 can switch from the first interface to the second interface in response to a trigger on an interactive interface element in the first interface, where a set of objects matching the object in the interactive interface element is presented in the second interface. This set of objects can be searched based on the search term in the interactive interface element. The object in the interactive interface element can be presented, for example, at a specified position in the second interface (such as the first position in a set of objects in the second interface). The terminal device 110 can also present, for example, indication information corresponding to the object in the interactive interface element in the second interface to indicate the association between the object and the media content item. For example, the terminal device 110 can present the indication text "Same as the video" at the object in the interactive interface element.

[0060] As an example, if the interactive interface element indicates the first object information of the first object, the terminal device 110 can switch from the first interface to the second interface in response to a trigger on the interactive interface element in the first interface, and present a first set of objects matching the first object in the second interface. The first object can be presented at the first position of the first set of objects. If the interactive interface element indicates the second object information of the second object, the terminal device 110 can switch from the first interface to the second interface in response to a trigger on the interactive interface element in the first interface, and present a second set of objects matching the second object in the second interface. The second object can be presented at the first position of the second set of objects.

[0061] In some embodiments, the content included in the second interface corresponding to search terms determined in different ways is different. As an example, referring to Figure 2C and Figure 2I , when the search term in the interactive interface element 210 in the example interface 200C is determined based on the "text search" method, the terminal device 110 can switch to the second interface shown in the example interface 200I in response to a trigger on the interactive interface element 210. The example interface 200I can include a search box 222, and the search box 222 can include the search term shown in the interactive interface element 210 (i.e., "casual shirt").

[0062] The example interface 200I can include a set of objects matching the object corresponding to the interactive interface element 210 (i.e., the object 223 corresponding to the image 213). The example interface 200I can also include a label 224, and the label 224 is used to present the indication information corresponding to the object 223 (such as the text "Same as the video") to indicate the association between the object 223 and the media content item in the example interface 200C.

[0063] As an example, referring to Figure 2C and Figure 2JWhen the search term in the interactive interface element 210 in the example interface 200C is determined based on the "image search" method, the terminal device 110 can switch to the second interface shown in the example interface 200J in response to the triggering of the interactive interface element 210. The example interface 200J may include at least one image segment of the images in the media content items shown in the example interface 200C that match the object in the interactive interface element.

[0064] It can be understood that the image that matches the object in the interactive interface element may include at least one object, and if there is only one object, then this object is also the object that matches the object in the interactive interface element. When the image that matches the object in the interactive interface element includes multiple objects, the object in the interactive interface element may be the object with the largest proportion and the most prominent in this image.

[0065] At least one image segment in the example interface 200J may respectively correspond to these at least one object. For example, the example interface 200J may include an image segment 231, an image segment 232, and an image segment 233, and these three image segments may be different parts intercepted from the same image / video frame.

[0066] The image segment that matches the object shown in the interactive interface element 210 in the example interface 200C may be presented at a specified position (such as the first position, such as the upper left corner of the interface) of the at least one image segment, and this image segment may be selected by default. For example, the interactive interface element 210 corresponds to the object "casual shirt", and the image segment 231 corresponding to the object "casual shirt" is presented at the first position of the three image segments. The example interface 200J can present a group of objects corresponding to a video segment each time.

[0067] The terminal device 110 can present a group of objects corresponding to the selected image segment in the example interface 200J, and this group of objects is searched based on the selected image segment. The terminal device 110 can, for example, determine that the selection of an image segment is received in response to receiving the triggering of a certain image segment, and update the example interface 200J to present a group of objects corresponding to this object in the example interface 200J when this image segment is different from the currently selected image segment.

[0068] As an example, the terminal device 110 may default to presenting a set of images corresponding to the object "casual shirt" (i.e., the image segment 231). The terminal device 110 may update the example interface 200J in response to receiving a trigger for another image segment different from the image segment 231 (such as the image segment 232). In the updated example interface 200J, the image segment 232 is in a selected state, and a set of objects corresponding to the object (such as the object "trousers") corresponding to the image segment 232 may be presented in the updated example interface 200J.

[0069] In some embodiments, the terminal device 110 may also switch back from the second interface to the first interface in response to detecting a trigger for interface backtracking in the second interface. In some embodiments, the second interface may include a return control. The terminal device 110 may determine that a trigger for interface backtracking is received and switch back from the second interface to the first interface in response to receiving a trigger for the return control. In some embodiments, the terminal device 110 may also determine that a trigger for interface backtracking is received and switch back from the second interface to the first interface in response to receiving a sliding operation in a predetermined direction (such as a horizontal rightward sliding operation) in the second interface. The present disclosure does not limit the specific trigger for interface backtracking.

[0070] As an example, referring to Figure 2I and Figure 2J , the example interface 200I includes a return control 221. The terminal device 110 may return to present the first interface shown in the example interface 200C in response to receiving a trigger for the return control 221 in the example interface 200I. The example interface 200J includes a return control 213. The terminal device 110 may return to present the first interface shown in the example interface 200C in response to a trigger for the return control 213. The terminal device 110 may also return to present the first interface shown in the example interface 200C in response to receiving a sliding operation in a predetermined direction (such as a horizontal rightward sliding operation) in the example interface 200I or the example interface 200J.

[0071] In some embodiments, the second interface may further include object category identifiers corresponding to at least one group of objects each matching at least one object matching the media content item. For example, if the media content item includes a first content segment matching a first object and a second content segment matching a second object, the first object matches a first group of objects, and the second object matches a second group of objects (the first group of objects and the second group of objects are respectively a group of objects searched based on search terms corresponding to the first object and the second object), then the second interface may include an object category identifier corresponding to the first group of objects and an object category identifier corresponding to the second group of objects.

[0072] Continuing to refer to Figure 2C and Figure 2J, if the media content item shown in the example interface 200C matches the object "casual shirt", the object "casual trousers", and the object "casual shoes", the terminal device 110 can determine a group of objects that each matches these three objects, and determine the object category identifiers corresponding to the three groups of objects corresponding to the three objects. For example, the object "casual shirt" matches a group of corresponding object category identifiers of "shirt", the object "casual trousers" matches a group of corresponding object category identifiers of "trousers", and the object "casual shoes" matches a group of corresponding object category identifiers of "casual shoes". The example interface 200J may include an area 234, and the terminal device 110 may present the object category identifiers "shirt", "trousers", and "casual shoes" in area 234.

[0073] In summary, according to various embodiments of the present disclosure, when a media content item includes content that matches an object, an interactive interface element can be presented in the presentation interface of the media content item, and the interactive interface element indicates object information of the object that matches the content in the media content item. The user can obtain search results that match the object in the interactive interface element by triggering the interactive interface element, and the search results at least include the object that matches the content in the media content item. As a result, there is no need for the content publisher to set the media content items and objects by themselves, and there is no need for the user to search by themselves. The search results can be provided to the user through simple interaction, which can improve the efficiency of the user in obtaining information.

[0074] Figure 3 A flow chart of a method 300 for interface interaction according to some embodiments of the present disclosure is shown. The method 300 may be implemented at the terminal device 110 .

[0075] In box 310, in response to the media content item including content matching the first object, the terminal device 110 presents an interactive interface element in a first interface for presenting the media content item, wherein the interactive interface element indicates first object information of the first object.

[0076] In box 320, the terminal device 110 switches from the first interface to the second interface in response to triggering the interactive interface element, wherein a first group of objects matching the first object is presented on the second interface.

[0077] In some embodiments, presenting an interactive interface element in a first interface includes: presenting the interactive interface element in a first state during a first time period or in response to a trigger to collapse the interactive interface element, wherein in the first state the interactive interface element indicates first object information; and presenting the interactive interface element in a second state during a second time period, wherein in the second state the interactive interface element indicates the first object information and additional object information, and the second time period is after the first time period.

[0078] In some embodiments, a first object matches a first content segment of a media content item, and method 300 further includes: in response to a second content segment after the first content segment in the media content item being presented, and the second content segment matching a second object, updating an interactive interface element to indicate second object information of the second object; and in response to a trigger of the interactive interface element, switching from a first interface to a second interface, wherein a second set of objects matching the second object is presented in the second interface.

[0079] In some embodiments, the second interface presents an object category identifier corresponding to a first set of objects and an object category identifier corresponding to a second set of objects.

[0080] In some embodiments, the multiple objects include a first object, and the first object is presented at a specified position in the second interface, and / or wherein the multiple objects include a first object, and indication information corresponding to the first object is presented in the second interface to indicate the association between the first object and the media content item.

[0081] In some embodiments, the first object information at least includes a search term corresponding to the first object, and the first set of objects matching the first object in the second interface is obtained by searching based on the search term, and wherein the second interface further presents a search box, and the search box includes the search term corresponding to the first object.

[0082] In some embodiments, the second interface further presents a first image segment in an image matching the first object in the media content item, and the first set of objects matching the first object in the second interface is obtained by searching based on the first image segment.

[0083] In some embodiments, the second interface further presents a second image segment in an image matching the first object, and method 300 further includes: in response to detecting a trigger of the second image segment, presenting a third set of objects obtained by searching based on the second image segment in the second interface.

[0084] In some embodiments, the search term is determined as follows: determining a set of target objects associated with the media content item based on a content identifier of the media content item, the set of target objects at least including the first object; and determining the search term corresponding to the first object based on description information of the set of target objects.

[0085] In some embodiments, the search term is determined as follows: extracting a first image from content in the media content item that matches the first object; determining a set of target objects matching the first object from a set of candidate objects based on the matching degree between the first image and candidate images respectively corresponding to the set of candidate objects; and determining the search term corresponding to the first object based on description information of the set of target objects.

[0086] In some embodiments, method 300 further includes: in response to detecting a trigger for interface rollback in the second interface, switching back from the second interface to the first interface.

[0087] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above methods or processes. Figure 5 An exemplary structural block diagram of an apparatus 400 for interface interaction according to some embodiments of the present disclosure is shown. The apparatus 400 may be implemented as or included in a terminal device 110. Each module / component in the apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0088] As Figure 4 shown, the apparatus 400 includes an element presentation module 410 configured to present an interactive interface element in a first interface for presenting a media content item in response to the media content item including content matching a first object, where the interactive interface element indicates first object information of the first object. The apparatus 400 further includes an interface switching module 420 configured to switch from the first interface to a second interface in response to a trigger on the interactive interface element, where a first set of objects matching the first object is presented in the second interface.

[0089] In some embodiments, the element presentation module 410 is further configured to: present the interactive interface element in a first state within a first period or in response to a trigger for collapsing the interactive interface element, where in the first state the interactive interface element indicates the first object information; and present the interactive interface element in a second state in a second period, where in the second state the interactive interface element indicates the first object information and additional object information, and the second period is after the first period.

[0090] In some embodiments, the first object matches a first content segment of the media content item, where the apparatus 400 further includes: an element update module configured to update the interactive interface element to indicate second object information of a second object in response to a second content segment after the first content segment in the media content item being presented and the second content segment matching a second object; and a second interface switching module configured to switch from the first interface to a second interface in response to a trigger on the interactive interface element, where a second set of objects matching the second object is presented in the second interface.

[0091] In some embodiments, the second interface presents an object category identifier corresponding to the first set of objects and an object category identifier corresponding to the second set of objects.

[0092] In some embodiments, the multiple objects include a first object, and the first object is presented at a specified position in the second interface, and / or the multiple objects include a first object, and indication information corresponding to the first object is presented in the second interface to indicate the association between the first object and the media content item.

[0093] In some embodiments, the first object information at least includes a search term corresponding to the first object, and the first set of objects matching the first object in the second interface is obtained by searching based on the search term, and the second interface further presents a search box, and the search box includes the search term corresponding to the first object.

[0094] In some embodiments, the second interface further presents a first image segment in the image matching the first object in the media content item, and the first set of objects matching the first object in the second interface is obtained by searching based on the first image segment.

[0095] In some embodiments, the second interface further presents a second image segment in the image matching the first object, and the apparatus 400 further includes: an object presentation module configured to, in response to detecting a trigger on the second image segment, present a third set of objects obtained by searching based on the second image segment in the second interface.

[0096] In some embodiments, the search term is determined as follows: determining a set of target objects associated with the media content item based on the content identifier of the media content item, the set of target objects at least including the first object; and determining the search term corresponding to the first object based on the description information of the set of target objects.

[0097] In some embodiments, the search term is determined as follows: extracting a first image from the content of the media content item matching the first object; determining a set of target objects matching the first object from a set of candidate objects based on the matching degree between the first image and the candidate images respectively corresponding to the set of candidate objects; and determining the search term corresponding to the first object based on the description information of the set of target objects.

[0098] In some embodiments, the apparatus 400 further includes: a fallback module configured to, in response to detecting a trigger for interface fallback in the second interface, switch back from the second interface to the first interface.

[0099] The modules included in apparatus 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to the machine-executable instructions, some or all of the modules in apparatus 400 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0100] It should be understood that one or more steps in the above methods can be performed by a suitable electronic device or combination of electronic devices. Such an electronic device or combination of electronic devices can include, for example, Figure 1 the terminal device 110 in

[0101] Figure 5 A block diagram of an electronic device 500 in which one or more embodiments of the present disclosure can be implemented is shown. It should be understood that Figure 5 the electronic device 500 shown is merely exemplary and should not constitute any limitation on the functions and scope of the embodiments described herein. Figure 5 The electronic device 500 shown can be used to implement Figure 1 the terminal device 110 of Figure 4 the apparatus 400 of

[0102] As Figure 5 shown, the electronic device 500 is in the form of a general-purpose electronic device. The components of the electronic device 500 can include, but are not limited to, one or more processing units or processors 510, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processor 510 can be an actual or virtual processor and is capable of performing various processes according to programs stored in the memory 520. In a multi-processor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing ability of the electronic device 500.

[0103] An electronic device 500 generally includes multiple computer storage media. Such media can be any accessible media to which the electronic device 500 can gain access, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 520 can be volatile memory (such as registers, caches, random access memory (RAM)), non-volatile memory (such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, magnetic disks, or any other media that can be capable of storing information and / or data and can be accessed within the electronic device 500.

[0104] The electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in Figure 5 it, a disk drive for reading from or writing to a removable, non-volatile magnetic disk (such as a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk can be provided. In these cases, each drive can be connected to a bus (not shown) by one or more data media interfaces. The memory 520 can include a computer program product 525 having one or more program modules that are configured to perform the various methods or actions of the various embodiments of the present disclosure.

[0105] The communication unit 540 enables communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 500 can be implemented by a single computing cluster or multiple computer machines that are capable of communicating through a communication connection. Thus, the electronic device 500 can operate in a networked environment using a logical connection with one or more other servers, network personal computers (PCs), or another network node.

[0106] The input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. The output device 560 can be one or more output devices, such as a display, speaker, printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown) as needed through the communication unit 540, such as storage devices, display devices, etc., communicate with one or more devices that enable a user to interact with the electronic device 500, or communicate with any device that enables the electronic device 500 to communicate with one or more other electronic devices (such as a network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0107] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, and the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, the computer program product being tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, and the computer-executable instructions being executed by a processor to implement the method described above.

[0108] Aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and the combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0109] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, when executed by the processor of the computer or other programmable data processing apparatus, create a means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, which instructions cause a computer, a programmable data processing apparatus, and / or other devices to operate in a particular manner, so that the computer-readable medium storing the instructions includes a manufacture, which includes instructions for implementing various aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0110] The computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device, such that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0111] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various implementations of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two consecutive blocks may in fact be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

[0112] The implementations of the present disclosure have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The choice of terms used herein is intended to best explain the principles of the implementations, the practical application, or the improvement of the technology in the market, or to enable other ordinary skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: In response to the media content item including content matching a first object, presenting an interactive interface element in a first interface for presenting the media content item, wherein the interactive interface element indicates first object information of the first object; And In response to a trigger of the interactive interface element, switching from the first interface to a second interface, wherein a first set of objects matching the first object is presented in the second interface.

2. The method according to claim 1, wherein presenting the interactive interface element in the first interface includes: Presenting the interactive interface element in a first state within a first period or in response to a trigger to collapse the interactive interface element, wherein in the first state the interactive interface element indicates first object information; And Presenting the interactive interface element in a second state in a second period, wherein in the second state the interactive interface element indicates the first object information and additional object information, and the second period is after the first period.

3. The method according to claim 1, wherein the first object matches a first content segment of the media content item, and the method further includes: In response to a second content segment after the first content segment in the media content item being presented and the second content segment matching a second object, updating the interactive interface element to indicate second object information of the second object; And In response to a trigger of the interactive interface element, switching from the first interface to the second interface, wherein a second set of objects matching the second object is presented in the second interface.

4. The method according to claim 3, wherein the second interface presents an object category identifier corresponding to the first set of objects and an object category identifier corresponding to the second set of objects.

5. The method according to claim 1, wherein the multiple objects include the first object, and the first object is presented at a specified position in the second interface, and / or Wherein the multiple objects include the first object, and indication information corresponding to the first object is presented in the second interface to indicate the association between the first object and the media content item.

6. The method according to claim 1, wherein the first object information at least includes a search term corresponding to the first object, and the first set of objects matching the first object in the second interface is obtained by searching based on the search term, and Wherein the second interface further presents a search box, and the search box includes the search term corresponding to the first object.

7. The method according to claim 1, wherein the second interface further presents a first image segment in an image matching the first object in the media content item, and the first set of objects matching the first object in the second interface is obtained by searching based on the first image segment.

8. The method according to claim 7, wherein the second interface further presents a second image segment in the image that matches the first object, and the method further comprises: In response to detecting a trigger on the second image segment, presenting a third set of objects searched based on the second image segment in the second interface.

9. The method according to claim 6, wherein the search term is determined based on: Determining a set of target objects associated with the media content item based on the content identifier of the media content item, the set of target objects at least including the first object; and Determining the search term corresponding to the first object based on the description information of the set of target objects.

10. The method according to claim 6, wherein the search term is determined based on: Extracting a first image from the content of the media content item that matches the first object; Determining a set of target objects that match the first object from the set of candidate objects based on the degree of match between the first image and the candidate images respectively corresponding to the set of candidate objects; and Determining the search term corresponding to the first object based on the description information of the set of target objects.

11. The method according to claim 1, further comprising: In response to detecting a trigger for interface backtracking in the second interface, switching back from the second interface to the first interface.

12. An apparatus for interface interaction, comprising: An element presentation module, configured to present an interactive interface element in a first interface for presenting the media content item in response to the media content item including content that matches a first object, wherein the interactive interface element indicates first object information of the first object; And An interface switching module, configured to switch from the first interface to a second interface in response to a trigger on the interactive interface element, wherein a first set of objects that match the first object are presented in the second interface.

13. An electronic device, comprising: At least one processor; And At least one memory, the at least one memory being coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions when executed by the at least one processor cause the electronic device to execute the method according to any one of claims 1 to 11.

14. A computer-readable storage medium, having stored thereon computer-executable instructions, the computer-executable instructions being executable by a processor to implement the method according to any one of claims 1 to 11.

15. A computer program product, comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 11.

Images