Method, apparatus, device, storage medium and program product for searching

Abstract

According to embodiments of the present disclosure, methods, apparatuses, devices, storage media, and program products for searching are provided. The method includes: presenting a media content at a first interface; and in response to a trigger on the media content, presenting a first panel at the first interface, the first panel including: at least one interactive control, each interactive control configured to trigger a respective interactive operation on the media content, and a plurality of search items matching at least one object identified from the media content.

Description

Technical Field

[0001] The exemplary embodiments disclosed herein generally relate to the field of computers, and particularly to methods, apparatus, electronic devices, computer-readable storage media, and computer program products for searching. Background Technology

[0002] With the rapid development of the internet, more and more applications are designed to provide users with various services. For example, applications can provide search services. Applications can provide users with interfaces for presenting media content, which can include any appropriate type of content such as images, text, video, and audio. If the content of the media is associated with an object, it is hoped that it can improve the efficiency of users in obtaining other information that matches that object. Summary of the Invention

[0003] In a first aspect of this disclosure, a method for searching is provided. The method includes: presenting media content on a first interface; and, in response to a triggering of the media content, presenting a first panel on the first interface, the first panel including: at least one interactive control, each interactive control configured to trigger a corresponding interactive operation on the media content, and a plurality of search terms matching at least one object identified from the media content.

[0004] In a second aspect of this disclosure, an apparatus for searching is provided. The apparatus includes: a media content presentation module configured to present media content on a first interface; and a panel presentation module configured to present a first panel on the first interface in response to a triggering of the media content. The first panel includes: at least one interactive control, each interactive control configured to trigger a corresponding interactive operation on the media content, and a plurality of search terms matching at least one object identified from the media content.

[0005] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the electronic device to perform the method of the first aspect.

[0006] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that, when executed by a processor, implement the method of the first aspect.

[0007] In a fifth aspect of this disclosure, a computer program product is provided. The computer program product includes computer-executable instructions, wherein when executed by a processor, the computer-executable instructions implement the method according to a first aspect of this disclosure.

[0008] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0009] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0010] Figure 1 A schematic diagram of an example environment in which embodiments of the present disclosure can be implemented is shown;

[0011] Figures 2A to 2I Example interfaces for searching according to some embodiments of this disclosure are shown;

[0012] Figure 3 A flowchart of a method for searching according to some embodiments of the present disclosure is shown;

[0013] Figure 4 An exemplary structural block diagram of a search apparatus according to some embodiments of the present disclosure is shown; and

[0014] Figure 5 A block diagram of an electronic device in which one or more embodiments of the present disclosure may be implemented is shown. Detailed Implementation

[0015] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0016] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0017] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0018] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0019] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and user authorization should be obtained.

[0020] For example, in response to receiving a user's active request, a prompt message is sent to the user to clearly inform the user that the requested operation will require the acquisition and use of the user's personal information, thereby enabling the user to choose whether to provide personal information to the software or hardware such as electronic devices, applications, servers or storage media that perform the operation of the technical solution disclosed herein, based on the prompt message.

[0021] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0022] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0023] In this disclosure, "trigger" refers to one or more interactive actions performed by a user on a terminal device. Furthermore, these interactive actions may be triggered within the same user interface / pop-up window or within different user interfaces / pop-up windows. This disclosure is not limited in this respect.

[0024] In this disclosure, "object" can refer to any physical or virtual object, including but not limited to physical or virtual goods, media works, etc.

[0025] As briefly mentioned earlier, applications can provide users with an interface for presenting media content, which can include any appropriate type of content such as images, text, video, and audio. Media content can also include any appropriate type of content. The content of media can be associated with objects. For example, media content can include displays of goods such as clothing and accessories. Traditionally, if a user wants to search for objects within media content, they can try searching for the names of objects appearing in the media content using a text search in the search box, or performing an image search using screenshots, to find related content. This method requires multiple interactions from the user, which can affect the efficiency of the search.

[0026] In view of this, this disclosure proposes an improved scheme for searching. According to an embodiment of this disclosure, media content is presented on a first interface. In response to a triggering of the media content, a first panel is presented on the first interface. The first panel includes at least one interactive control and a plurality of search items matching at least one object identified from the media content, wherein each interactive control is configured to trigger a corresponding interactive operation on the media content.

[0027] In this way, when media content is triggered, in addition to providing interactive controls, multiple search terms matching the objects in the media content will be displayed in the panel. Users can easily and quickly obtain various search results corresponding to the objects in the media content by simply triggering the displayed panel, without the need for users to perform complex interactions themselves, which can improve the efficiency of users obtaining information.

[0028] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In this example environment 100, an instance of application 120 is installed on terminal device 110. User 140 can interact with application 120 via an attachment device of terminal device 110. Similarly, user 140 can interact with application 120 via terminal device 110 and / or attachment device of terminal device 110.

[0029] In some embodiments, application 120 can be any suitable application that can provide services associated with media content to user 140. Media content can also be referred to as media content item, media content, content item, etc. Services associated with media content can include browsing, commenting, forwarding, creating (e.g., shooting and / or editing), publishing, etc. Media content can include one or more types of content, such as video, images, GIFs, image sets, graphic works, audio, text, etc.

[0030] exist Figure 1In environment 100, if application 120 is active, terminal device 110 can display the interface 150 of application 120. Interface 150 may include various interfaces that application 120 can provide, such as content presentation interface, search interface, query interface, search result presentation interface, etc.

[0031] In some embodiments, terminal device 110 communicates with server 130 to provide services to application 120. Terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0032] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in cloud environments, etc.

[0033] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0034] The following description continues with reference to the accompanying drawings, illustrating some exemplary embodiments of this disclosure. The search method described herein can be implemented on terminal device 110. It should be noted that the operations performed by terminal device 110 may specifically be performed by a relevant application (e.g., application 120) installed on terminal device 110. Some operations described with reference to terminal device 110 may require the assistance of server 130 to complete.

[0035] It should be understood that the interface shown in the accompanying drawings is merely an example, and various interface designs are possible in practice. The various graphic elements in the interface can have different arrangements and different visual representations, one or more elements can be omitted or replaced, and one or more other elements may also be present. The embodiments of this disclosure are not limited in this respect.

[0036] Figures 2A to 2I Example interfaces 200A to 200I for searching according to some embodiments of the present disclosure are shown. The interfaces shown in example interfaces 200A to 200I can be presented on terminal device 110. For ease of discussion, reference will be made to... Figure 1 The example interfaces 200A to 200I are described using environment 100. Terminal device 110 can be used for interaction by receiving operations from associated users (e.g., user 140) to present corresponding interaction results.

[0037] In environment 100, terminal device 110 presents an interface 150 of application 120. Interface 150 may be, for example, a content presentation interface of application 120 (which may also be referred to as a first interface, presentation interface, etc.), and terminal device 110 may present media content in the content presentation interface. Media content may include at least visual content, such as images, videos, and graphic works. In some embodiments, the content presentation interface may be an interface used to display or push media content and other relevant information to a user. A set of media content presented in the content presentation interface may include various types of media content. The media content items to be presented in a specific content presentation interface can be determined according to application design needs. The specific media content to be displayed and its number will vary in different scenarios.

[0038] In some embodiments, the content presentation interface may include the homepage of application 120, or a recommended homepage among a set of homepage interfaces of application 120. The recommended data displayed to the user on the recommended homepage is sometimes referred to as a recommended information stream. In some embodiments, the content presentation interface may also include a specific content presentation interface of application 120, which may be used to present media content items published by a specific user. That is, the media content items presented by terminal device 110 in the first interface may be media content items in the information stream or recommended stream of application 120, or media content items published by a specific user.

[0039] Terminal device 110 can display a first panel on a first interface in response to a trigger on media content. For example, terminal device 110 can determine that a trigger on media content has been received in response to receiving a long-press operation, selection operation, etc. In embodiments of this disclosure, if a user trigger is detected during the presentation of media content (e.g., during video playback), it may mean that the user expects to perform some interaction with the media content. Therefore, the displayed first panel includes at least one interactive control. The interactive control is configured to trigger a corresponding interactive operation on the media content. At least one interactive control may include any appropriate control such as a favorite control, download control, share control, add to view list control, etc.

[0040] On the other hand, in addition to interacting with the media content itself, users may also expect to view more information about a certain object appearing in the media content when the media content is triggered. Therefore, in embodiments of this disclosure, the first panel presented also includes multiple search terms that match at least one object identified from the media content. These search terms may include media content (e.g., videos, images, graphic works, etc.) containing the same or similar objects, or non-media content such as product items containing the same or similar objects. For example, if at least one object includes object A, the search terms may be media content containing objects similar to object A, or products similar to object A. The terminal device 110 may present multiple search terms in the first panel in any suitable form. As an example only, the terminal device 110 may present multiple search term cards in the first panel, each search term card representing one search term.

[0041] In some embodiments, for each object identified from media content, terminal device 110 can determine the object's attribute information. The attribute information can indicate the object's category, which may include products, encyclopedic entities, media content, etc. Terminal device 110 can then determine the type of search terms matching the object based on the object's attribute information. The search term type may include product type, encyclopedic type, media work type (or further subdivided into video work type or text / image work type, etc.), etc. For example, if the attribute information of an object indicates that its category is product, the type of search terms matching that object can be determined to be product type, and multiple search terms matching the object under that product type can be obtained and presented accordingly, such as multiple product cards. If the attribute information of an object indicates that its category is encyclopedia, the type of search terms matching that object can be determined to be encyclopedic type, and multiple encyclopedia entries can be obtained and presented accordingly. And so on. Of course, if an object can match multiple search term types, then multiple types of search terms can also be presented. These search terms can be presented in a mixed manner, or they can be divided by category tags, allowing users to select what to present as needed.

[0042] As an example, see reference Figure 2A and Figure 2B Terminal device 110 can display a first interface as shown in example interface 200A, which displays media content. Terminal device 110 can also display example interface 200B in response to receiving a trigger on the media content in example interface 200A. Example interface 200B includes a first panel 210. The first panel 210 may include at least one interactive control and multiple search terms matching at least one object identified from the media content.

[0043] In some embodiments, the terminal device 110 may also sort multiple search terms based on their similarity to objects in the media content, and present the multiple search terms in a first panel based on this sorting result. For example, search terms with higher similarity are presented earlier. In this case, the terminal device 110 may present a label 215 at the first search term among the multiple search terms (i.e., the search term with the highest similarity), and the label 215 may indicate that the first search term has the highest similarity to objects in the media content.

[0044] In some embodiments, the first panel 210 may include an area 212, which includes at least a portion of at least one interactive control (e.g., controls other than the share control), such as the favorites control, the don't-interest control, the download control, the add-to-list control, the add-to-tag control, etc., as shown in the figure. In some embodiments, since the size of the first interface is limited, if the number of interactive controls to be presented in area 212 (e.g., it can be referred to as the first group of interactive controls) is large, the terminal device 110 may only present some of the interactive controls in area 212. In this case, the terminal device 110 may, for example, present other interactive controls in response to receiving a swipe operation on area 212.

[0045] In some embodiments, the first panel 210 includes at least a sharing control 213. (Combined with...) Figure 2C Terminal device 110 can respond to a trigger on sharing control 213 received in example interface 200B by presenting sharing panel 220, which may also be referred to as a second panel. Sharing panel 220 includes at least one sharing target associated with media content.

[0046] At least one sharing target may include at least one user associated with user 140 within application 120. The at least one user associated with user 140 may include any suitable user such as user 140's friends, users previously followed by user 140, or users previously interacted with by user 140 (e.g., if user 140 has a previous conversation with user A, then user A is a user previously interacted with by user 140). At least one sharing target may also include a third-party platform / application. The third-party platform / application may, for example, include a platform / application currently installed on terminal device 110. (See reference...) Figure 2C The sharing panel 220 may include, for example, area 222, which may display at least one third-party platform / application.

[0047] In some embodiments, the sharing panel 220 may further include a search box 221. In response to receiving user input via the search box 221, the terminal device 110 may search for a matching sharing target from at least one sharing target from which the user 140 can share media content. This can help improve the efficiency of finding sharing targets.

[0048] refer to Figure 2B and Figure 2D In some embodiments, terminal device 110 may also present a cancellation control 214 associated with the sharing control 213. Terminal device 110 may cancel the presentation of the sharing control in the first panel 210 in response to receiving a trigger on the cancellation control 214. For example, terminal device 110 may present example interface 200D in response to receiving a trigger on the cancellation control 214 in example interface 200B, where the first panel 210 does not include the sharing control 213.

[0049] In some embodiments, the multiple search terms presented in the first panel are associated with segments of media content that are triggered. For example, the terminal device 110 may present the first panel in response to detecting a trigger action on a first portion of the media content (e.g., a long press or selection action on a first portion of the media content). At this time, multiple search terms matching a first object identified from the first portion are presented in the first panel. (See reference...) Figure 2A and Figure 2B In example interface 200A, the media content includes a man wearing a shirt, trousers, and casual shoes. If terminal device 110 receives a trigger on the media content at the shirt portion, it can determine that the trigger applies to that portion, and then present example interface 200B, displaying multiple search terms in the first panel that match the shirt identified from that portion.

[0050] In some embodiments, if the media content also includes text, the terminal device 110 may, in response to receiving a trigger on the text portion, determine the portion that matches the text portion from the visual data of the media content, and identify that portion as the part to which the trigger applies. For example, if the media content includes an image and descriptive text for that image, the image including a man wearing a shirt, and the descriptive text including at least the text "shirt," the terminal device 110 may, in response to receiving a trigger on the text "shirt," determine the portion that matches the text (i.e., the portion of the image where the shirt is located) from the visual data of the media content, and identify that portion as the part targeted by the user-initiated trigger.

[0051] In some embodiments, if no object is identified from the first portion, the terminal device 110 may also present multiple search terms matching at least one second object in the first panel, wherein the at least one second object is identified from a portion other than the first portion of the media content. For example, continue to refer to Figure 2A and Figure 2B If the trigger applies to the portion of the sample interface 200A where the shirt is located, and the terminal device 110 fails to successfully recognize the shirt, the terminal device 110 can present multiple search items in the first panel 210 that match objects recognized in other portions of the media content (e.g., objects matching trousers recognized from the portion where the trousers are located). It should be noted that these other portions can be other parts of the images or video frames presented on the first interface when the media content is triggered, or other images included in the media content, or other video frames in the video.

[0052] In some embodiments, if multiple search terms in the first panel match an object in the media content, the terminal device 110 may also, in response to determining that multiple search terms in the media content match at least one object other than the original object, present object identification marks in the first interface, each associated with one of these objects. The object identification marks can be any suitable symbol, such as a circle or a dot. Each object identification mark indicates that the object has corresponding search results, allowing the user to decide whether to view further information as needed. For example, if the media content includes a man wearing a shirt and trousers, and multiple search terms in the first panel match a shirt, the terminal device 110 may, in response to determining that multiple search terms match trousers (which are not presented in the first panel), present object identification marks associated with trousers in the media content of the first interface. Thus, presenting object identification marks informs the user that the object corresponding to the object identification mark also has multiple search terms.

[0053] In some embodiments, the first panel is overlaid on a first area of ​​the first interface, and the terminal device 110 may also display at least a portion of the media content in a second area of ​​the first interface. To facilitate user understanding of which part of the media content the objects corresponding to the multiple search terms in the first panel are located in, the terminal device 110 may, for example, control the display of at least the corresponding portion of the media content in the second area of ​​the first interface while displaying the first panel. It is understood that the terminal device 110 can move the position of the media content so that the portions corresponding to the multiple search terms in the first panel (i.e., the portions where the objects matched by the multiple search terms are located) are displayed in the second area. For example, if a triggering action on the media content applies to portion A of the media content, and the terminal device 110 can identify an object from portion A, the terminal device 110 may overlay the first panel on the first area of ​​the first interface and display the multiple search terms corresponding to that object in the first panel. Accordingly, the terminal device 110 may also move the media content so that at least part of portion A is displayed in the second area.

[0054] In some embodiments, the terminal device 110 may also overlay a selection box onto the portion of the media content corresponding to multiple search items in the first panel to indicate the selection status of that portion, that is, to indicate that the search item currently presented in the first panel matches the object in that portion. The terminal device 110 may also receive adjustment operations on the selection box. Adjustment operations may include direct movement operations, zooming operations, zooming operations, etc., of the selection box.

[0055] In some embodiments, the terminal device 110 may also determine, in response to receiving a trigger on a portion different from the portion corresponding to the plurality of search items in the first panel, that a movement operation has been received to move the selection box from the portion corresponding to the plurality of search items in the first panel to the other portion. It is understood that the portion covered by the zoomed-in / zoomed-out selection box is different from the portion covered by the previously unadjusted selection box.

[0056] Terminal device 110, for example, may, in response to a selection box being moved to the second part of the media content, replace the currently presented multiple search terms in the first panel with multiple search terms that match the objects identified from the second part. (See reference) Figure 2D The media content can be a man wearing a shirt and trousers. In example interface 200D, selection box 201 is overlaid on the portion of the media content where the shirt is located, and multiple search terms presented in the first panel 210 match the object (i.e., the shirt) identified from the portion where the shirt is located. Terminal device 110 can respond to selection box 201 being adjusted to the portion of the media content where the trousers are located, and present... Figure 2EExample interface 200E. In example interface 200E, selection box 201 is overlaid on the part where the pants are located, and multiple search items presented in the first panel 210 are matched with objects (i.e., pants) identified from the part where the pants are located.

[0057] In some embodiments, the terminal device 110 may also expand the first panel to present multiple search items in response to a predetermined operation on the first panel. It is understood that the number of search items presented in the expanded first panel exceeds the number of search items presented in the unexpanded first panel. The expanded first panel includes at least one portion of the media content when the media content is triggered, wherein each portion includes at least one object, and multiple search items matching the at least one object included in the currently selected portion. The terminal device 110 may maintain the presentation of at least one interactive control in the expanded first panel, or may cancel the presentation of at least one interactive control in the expanded first panel.

[0058] Pre-defined operations on the first panel may include an extension instruction for the first panel. For example, terminal device 110 may determine that it has received an extension instruction for the first panel in response to receiving an up-pull operation, a double-click operation, a triggering of an extension control in the first panel, etc. As an example, see [reference needed]. Figure 2D and Figure 2F The first panel 210 of the example interface 200D includes an extension control 211. The terminal device 110 can, in response to receiving a trigger operation on the extension control 211 (e.g., a click, a swipe up, etc.), determine that an extension instruction has been received for the first panel 210, and thus extend the presentation size of the first panel in the first interface. The terminal device 110 can present the example interface 200F. The example interface 200F includes at least one portion (e.g., portion 232, portion 233, portion 234) of the media content when the media content is triggered, wherein each portion includes at least one object.

[0059] The first panel 210 of the example interface 200F may include multiple search terms that match at least one object included in the currently selected portion, which by default may be the portion indicated by the selection box 201 in the example interface 200D. The terminal device 110 may, for example, highlight the currently selected portion. The terminal device 110 may, for example, respond to receiving a selection of another portion in the example interface 200F that is different from the currently selected portion, switch the multiple search terms presented in the first panel 210 so that the first panel 210 presents multiple search terms corresponding to the other selected portion.

[0060] The first panel 210 in the example interface 200F may also include at least one category label, with different category labels corresponding to different search terms. For example, at least one category label may include the label "by similarity" and the label "product" as shown in the figure. In some embodiments, the terminal device 110 may, in response to the label "by similarity" being currently selected, sort multiple search terms according to the similarity between multiple search terms and objects in the media content, and present multiple search terms based on the sorting results. In some embodiments, the label "by similarity" may be selected by default. In some embodiments, the terminal device 110 may, in response to the label "product" being currently selected, present products associated with objects in the media content in the first panel 210. Of course, it is understood that in addition to these two types of labels, search results may also be categorized according to other classification criteria and granularities, and the corresponding category labels may be presented in the first panel so that users can view them according to their needs.

[0061] In some embodiments, the first panel may further include a search and view control. In this case, a pre-defined operation on the first panel may include triggering the search and view control in the first panel. For example, see [reference needed]. Figure 2G and Figure 2F The first panel 210 of the example interface 200G includes a search and view control 216. The search and view control 216 indicates a search for matching objects of media content. The terminal device 110 can, in response to receiving a trigger operation on the search and view control 216, determine that an expansion instruction for the first panel 210 has been received, and thus expand the first panel to provide more search results. The terminal device 110 can present the example interface 200F, in which the expanded first panel is displayed.

[0062] In some embodiments, where the first panel includes a search and view control, the terminal device 110 can expand the first panel in response to receiving an expansion instruction. The expanded first panel includes at least one interactive control, a search and view control, and multiple search items. In this case, the multiple search items presented in the expanded first panel correspond to the same objects or portions as the multiple search items presented in the unexpanded first panel. As an example, refer to... Figure 2G and Figure 2H Terminal device 110 can respond to receiving an up-swipe operation on the extended control 211, determine that it has received an extension instruction for the first panel 210, and then extend the first panel as shown in the example interface 200H.

[0063] In some embodiments, after the first panel is expanded, the terminal device 110 may also shrink the first panel in response to receiving a shrink instruction for the first panel. For example, the terminal device 110 may determine that it has received a shrink instruction for the first panel in response to receiving a swipe-down operation on the first panel, a swipe-down operation on the expansion control of the first panel, etc. (See reference...) Figure 2F , Figure 2G , Figure 2H and Figure 2I Terminal device 110 can switch back to displaying example interface 200I in response to a zoom-out instruction on the first panel 210 in example interface 200F. Terminal device 110 can switch back to displaying example interface 200G in response to a zoom-out instruction on the first panel 210 in example interface 200H.

[0064] In some embodiments, if the media content includes video, the terminal device 110 can pause or resume playback of the video when presenting the first panel. That is, the terminal device 110 can pause or resume video playback in response to the presentation of the first panel. If video playback is paused, the terminal device 110 can resume playback on the first interface in response to the cancellation of the first panel's presentation. For example, if the terminal device 110 receives a trigger on the video and presents the first panel at the 10th second of the video, the terminal device 110 can resume video playback on the first interface in response to the cancellation of the first panel's presentation (i.e., continue playing the video from the 10th second). If video playback is resumed, the terminal device 110 can continue playing the video on the first interface according to the video's playback progress in response to the cancellation of the first panel's presentation. For example, if at the 10th second of the video, the terminal device 110 receives a trigger on the video and presents the first panel, and the first panel is presented for 10 seconds (during which the video continues to play), then the terminal device 110 can respond to the cancellation of the first panel presentation and continue playing the video on the first interface according to the video playback progress (e.g., continue playing the video from the 20th second).

[0065] In some embodiments, the terminal device 110 may also switch from the first interface to a presentation interface (e.g., a second interface) corresponding to the search item in response to a triggering of a search item among a plurality of search items in the first panel. This presentation interface displays details of the triggered search item. For example, if the triggered search item is media content, the terminal device 110 may switch to a presentation interface displaying that media content. If the triggered search item is a product, the terminal device 110 may switch to a presentation interface displaying that product; such a presentation interface may also be referred to as a product details interface.

[0066] In summary, according to the various embodiments of this disclosure, when media content is triggered, in addition to providing interactive controls, multiple search terms matching the objects in the media content are also provided in the displayed panel. Users can easily and quickly obtain various search results corresponding to the objects in the media content by simply triggering the displayed panel, without requiring users to perform complex interactions themselves, which can improve the efficiency of users obtaining information.

[0067] Figure 3 A flowchart of a method 300 for searching according to some embodiments of the present disclosure is shown. Method 300 may be implemented at terminal device 110.

[0068] In frame 310, terminal device 110 presents media content on the first interface.

[0069] In box 320, terminal device 110, in response to a triggering of media content, presents a first panel on a first interface. The first panel includes: at least one interactive control, each interactive control being configured to trigger a corresponding interactive operation on the media content, and a plurality of search items matching at least one object identified from the media content.

[0070] In some embodiments, presenting the first panel includes: in response to triggering a first portion of media content, presenting a plurality of search terms in the first panel that match a first object identified from the first portion.

[0071] In some embodiments, presenting the first panel further includes: in response to an object not being identified from the first portion, presenting a plurality of search terms in the first panel that match at least one second object, wherein the at least one second object is identified from a portion other than the first portion of the media content.

[0072] In some embodiments, method 300 further includes: overlaying a selection box in a first portion of the media content to indicate a selected state of the first portion; and in response to the selection box being moved to a second portion of the media content, replacing a plurality of search terms matching a first object in a first panel with a plurality of search terms matching a third object identified from the second portion.

[0073] In some embodiments, method 300 further includes: expanding the first panel to present a plurality of search terms in response to a predetermined operation on the first panel, wherein the expanded first panel includes at least: at least one portion of the media content when the media content is triggered, each portion including at least one object, and a plurality of search terms matching the at least one object included in the currently selected portion.

[0074] In some embodiments, at least one interactive control is de-presented in the expanded first panel.

[0075] In some embodiments, a predetermined operation on the first panel includes: an extension instruction for the first panel, or triggering a search and view control in the first panel.

[0076] In some embodiments, the first panel is overlaid on a first area of ​​the first interface, and method 300 further includes: presenting at least a portion of the media content in a second area of ​​the first interface.

[0077] In some embodiments, method 300 further includes: in response to a fourth object of at least one object appearing in a third portion of the media content, controlling at least a third portion of the media content to be presented in a second area of ​​the first interface while presenting the first panel.

[0078] In some embodiments, the media content includes video, and method 300 further includes: pausing video playback in response to the presentation of the first panel; and resuming video playback on the first interface in response to the cancellation of the presentation of the first panel.

[0079] In some embodiments, the media content includes video, and method 300 further includes: maintaining video playback in response to the presentation of the first panel; and continuing video playback on the first interface according to the video playback progress in response to the cancellation of the presentation of the first panel.

[0080] In some embodiments, at least one interactive control includes a sharing control, and method 300 further includes: in response to a triggering of the sharing control, presenting a second panel, the second panel including at least one sharing target associated with media content.

[0081] In some embodiments, the plurality of search terms in the first panel are matched with a first object in the media content, and the method 300 further includes: in response to determining that the plurality of search terms match at least one fifth object in the media content, presenting object identification marks in the first interface respectively associated with at least one fifth object, the object identification marks indicating that at least one fifth object has a corresponding search result.

[0082] In some embodiments, method 300 further includes: in response to triggering a first search item among a plurality of search items, switching from a first interface to a second interface corresponding to the first search item, wherein the second interface presents detailed information of the first search item.

[0083] In some embodiments, multiple search terms matching each object are determined based on: determining the object's attribute information; determining the type of search terms matching the object based on the object's attribute information; and obtaining multiple search terms matching the object under the determined type.

[0084] Embodiments of this disclosure also provide corresponding apparatus for implementing the above methods or processes. Figure 4 An exemplary structural block diagram of a search apparatus 400 according to some embodiments of the present disclosure is shown. Apparatus 400 may be implemented as or included in terminal device 110. Various modules / components in apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0085] like Figure 4 As shown, device 400 includes a media content presentation module 410 configured to present media content on a first interface. Device 400 also includes a panel presentation module 420 configured to present a first panel on the first interface in response to a triggering of the media content. The first panel includes: at least one interactive control, each interactive control configured to trigger a corresponding interactive operation on the media content, and a plurality of search items matching at least one object identified from the media content.

[0086] In some embodiments, the panel presentation module 420 is further configured to: in response to triggering a first portion of the media content, present a plurality of search terms in a first panel that match a first object identified from the first portion.

[0087] In some embodiments, the panel presentation module 420 is further configured to: in response to an object not identified from the first portion, present a plurality of search terms in the first panel that match at least one second object, wherein the at least one second object is identified from a portion other than the first portion of the media content.

[0088] In some embodiments, the apparatus 400 further includes: a selection box presentation module configured to overlay a selection box on a first portion of the media content to indicate a selected state of the first portion; and a search term replacement module configured to replace a plurality of search terms matching a first object with a plurality of search terms matching a third object identified from the second portion in a first panel in response to the selection box being moved to a second portion of the media content.

[0089] In some embodiments, the device 400 further includes: a panel expansion module configured to expand the first panel to present a plurality of search terms in response to a predetermined operation on the first panel, and wherein the expanded first panel includes at least: at least one portion of the media content when the media content is triggered, each portion including at least one object, and a plurality of search terms matching the at least one object included in the currently selected portion.

[0090] In some embodiments, at least one interactive control is de-presented in the expanded first panel.

[0091] In some embodiments, a predetermined operation on the first panel includes: an extension instruction for the first panel, or triggering a search and view control in the first panel.

[0092] In some embodiments, the first panel is overlaid on a first area of ​​the first interface, and the device 400 further includes a content presentation module configured to present at least a portion of the media content in a second area of ​​the first interface.

[0093] In some embodiments, the apparatus 400 further includes a partial presentation module configured to, in response to a fourth object of at least one object appearing in a third portion of the media content, control the presentation of at least a third portion of the media content within a second area of ​​the first interface while presenting the first panel.

[0094] In some embodiments, the media content includes video, and the device 400 further includes: a playback pause module configured to pause video playback in response to the presentation of the first panel; and a playback resume module configured to resume video playback on the first interface in response to the cancellation of the presentation of the first panel.

[0095] In some embodiments, the media content includes video, and the device 400 further includes: a playback hold module configured to hold the playback of the video in response to the presentation of the first panel; and a continue playback module configured to continue playing the video on the first interface according to the video playback progress in response to the cancellation of the presentation of the first panel.

[0096] In some embodiments, at least one interactive control includes a sharing control, and the apparatus 400 further includes a sharing panel presentation module configured to present a second panel in response to a triggering of the sharing control, the second panel including at least one sharing target associated with media content.

[0097] In some embodiments, the plurality of search terms in the first panel are matched with a first object in the media content. The apparatus 400 further includes a flag presentation module configured to, in response to determining that the plurality of search terms match at least one fifth object in the media content, present object identification flags in the first interface respectively associated with at least one fifth object, the object identification flags indicating that at least one fifth object has a corresponding search result.

[0098] In some embodiments, the device 400 further includes an interface switching module configured to switch from a first interface to a second interface corresponding to the first search item in response to a triggering of a first search item among a plurality of search items, wherein the second interface presents detailed information of the first search item.

[0099] In some embodiments, multiple search terms matching each object are determined based on: determining the object's attribute information; determining the type of search terms matching the object based on the object's attribute information; and obtaining multiple search terms matching the object under the determined type.

[0100] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more modules may be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the modules in device 400 may be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that may be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-chips (SoCs), complex programmable logic devices (CPLDs), and so on.

[0101] It should be understood that one or more steps in the above methods can be performed by suitable electronic devices or combinations of electronic devices. Such electronic devices or combinations of electronic devices may include, for example, […]. Figure 1 Terminal device 110 in the middle.

[0102] Figure 5 A block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 5 The electronic device 500 shown can be used to achieve Figure 1 Terminal equipment 110 or Figure 4 Device 400.

[0103] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0104] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0105] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of this disclosure.

[0106] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0107] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0108] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0109] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0110] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0111] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0112] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some, as newer, implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0113] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for searching, comprising: The media content is displayed on the first screen. as well as In response to the triggering of the media content, a first panel is displayed on the first interface, the first panel including: At least one interactive control, each interactive control being configured to trigger a corresponding interactive operation on the media content, and Multiple search terms that match at least one object identified from the media content.

2. The method of claim 1, wherein presenting the first panel comprises: In response to the trigger acting on a first portion of the media content, a plurality of search terms matching a first object identified from the first portion are presented in the first panel.

3. The method of claim 2, wherein presenting the first panel further comprises: In response to the absence of an object from the first portion, a plurality of search terms matching at least one second object are presented in the first panel, wherein the at least one second object is identified from a portion of the media content other than the first portion.

4. The method according to claim 2, further comprising: A selection box is overlaid on the first part of the media content to indicate the selection status of the first part; as well as In response to the selection box being adjusted to the second part of the media content, multiple search terms matching the first object are replaced in the first panel with multiple search terms matching the third object identified from the second part.

5. The method according to claim 1, further comprising: In response to a predetermined operation on the first panel, the first panel is expanded to present the plurality of search items, and wherein the expanded first panel includes at least: When the media content is triggered, at least one portion of the media content, each portion including at least one object, and Multiple search terms that match at least one object included in the currently selected portion.

6. The method of claim 5, wherein at least one interactive control is de-presented in the expanded first panel.

7. The method of claim 5, wherein the predetermined operation on the first panel includes: Extended indication of the first panel, or Triggering the search and view controls in the first panel.

8. The method of claim 1, wherein the first panel is overlaid on a first area of ​​the first interface, the method further comprising: At least a portion of the media content is presented in a second area of ​​the first interface.

9. The method according to claim 8, further comprising: In response to the appearance of a fourth object in the third part of the media content, while presenting the first panel, control is made to present at least the third part of the media content in the second area of ​​the first interface.

10. The method of claim 1, wherein the media content includes video, and the method further includes: In response to the display of the first panel, the playback of the video is paused; as well as In response to the cancellation of the first panel, the playback of the video is resumed on the first interface.

11. The method of claim 1, wherein the media content includes video, and the method further includes: In response to the presentation of the first panel, the video continues to play; as well as In response to the cancellation of the first panel, the video continues to play on the first interface according to the video playback progress.

12. The method of claim 1, wherein the at least one interactive control includes a sharing control, and the method further includes: In response to a triggering of the sharing control, a second panel is displayed, the second panel including at least one sharing target associated with the media content.

13. The method of claim 1, wherein the plurality of search items in the first panel are matched with a first object in the media content, the method further comprising: In response to determining that at least one fifth object in the media content matches multiple search terms, an object identification flag is presented in the first interface in association with each of the at least one fifth object, the object identification flag indicating that the at least one fifth object has a corresponding search result.

14. The method according to claim 1, further comprising: In response to the triggering of the first search item among the plurality of search items, the interface switches from the first interface to the second interface corresponding to the first search item, and the second interface displays the details of the first search item.

15. The method of claim 1, wherein the plurality of search terms matching each object are determined based on the following: Determine the attribute information of the object; Based on the attribute information of the object, determine the type of search item that matches the object; and Based on the determined type, obtain multiple search terms under the type that match the object.

16. A search apparatus, comprising: The media content presentation module is configured to present media content on the first screen; as well as A panel presentation module is configured to present a first panel on the first interface in response to a triggering of the media content. The first panel includes: at least one interactive control, each interactive control being configured to trigger a corresponding interactive operation on the media content, and a plurality of search terms matching at least one object identified from the media content.

17. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 15 when executed by the at least one processor.

18. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 15.

19. A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 15.

Images