Object presentation method and device, equipment and storage medium
By presenting interactive interface elements in the interface of media content and presenting matching objects in the second interface based on user interaction, the problem of difficulty for users to obtain object search results in a timely manner after screenshots is solved, and the user's search experience is improved.
Patent Information
- Application Number
- CN202510240108.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-28
- Publication Date
- 2025-05-30
AI Technical Summary
When a user performs screenshot operations on media content, it is difficult for the prior art to effectively present the search portal, resulting in the user that may ignore the portal, thus failing to obtain the desired object search results in a timely manner.
By presenting the first interactive interface element in the first interface of the media content, at least the intercepted image is presented; if the intercepted image includes a target object, a second interactive interface element indicating the target object is presented in association with the first interactive interface element; at least a portion of the objects in a group of objects matching the target object is presented in the second interface based on a trigger associated with the second interactive interface element.
Provide users with more prominent interactive interface elements for indicating objects, improving the convenience of users triggering object searches when needed, especially in terms of object search results corresponding to objects in the screenshot image, improving the user's search experience.
Smart Images

Figure CN120066664A_ABST
Abstract
Description
Technical Field
[0001] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to methods, apparatuses, devices, and computer-readable storage media for object rendering. Background Art
[0002] With the rapid development of the Internet, more and more applications are designed to provide various services to users. For example, an application can provide a search service to a user. The application can obtain a search request from the user (e.g., the user clicks an entry for searching) and provide search results corresponding to the search request. Therefore, it is necessary to continuously explore the accuracy of search results to improve the user experience. Summary of the Invention
[0003] In a first aspect of the present disclosure, there is provided a method for object rendering, including: in response to an operation for intercepting an image for media content, presenting a first interactive interface element in a first interface corresponding to the media content, the first interactive interface element presenting at least the intercepted image; in response to the intercepted image including a target object, presenting a second interactive interface element indicating the target object in association with the first interactive interface element; and based on a trigger associated with the second interactive interface element, presenting at least some of a set of objects matching the target object in a second interface.
[0004] In a second aspect of the present disclosure, there is provided an apparatus for object rendering, including: a first interactive interface element presenting module configured to, in response to an operation for intercepting an image for media content, present a first interactive interface element in a first interface corresponding to the media content, the first interactive interface element presenting at least the intercepted image; a second interactive interface element presenting module configured to, in response to the intercepted image including a target object, present a second interactive interface element indicating the target object in association with the first interactive interface element; and an object presenting module configured to, based on a trigger associated with the second interactive interface element, present at least some of a set of objects matching the target object in a second interface.
[0005] In a third aspect of the present disclosure, there is provided an electronic device. The device includes at least one processor; and at least one memory, the at least one memory being coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to execute the method of the first aspect.
[0006] In a fourth aspect of the present disclosure, there is provided a computer-readable storage medium. Computer-executable instructions are stored on the computer-readable storage medium, and the computer-executable instructions can be executed by a processor to implement the method of the first aspect.
[0007] According to a fifth aspect of the present disclosure, there is provided a computer program product including computer-executable instructions, wherein when the computer-executable instructions are executed by a processor, the method of the first aspect is implemented.
[0008] It should be understood that the content described in this content part is not intended to define the key features or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] In combination with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent. In the drawings, the same or similar reference numerals represent the same or similar elements, where:
[0010] Figure 1 A schematic diagram showing an example environment in which the embodiments of the present disclosure can be implemented;
[0011] Figures 2A to 2E A schematic diagram showing an example interface for object presentation according to some embodiments of the present disclosure;
[0012] Figure 3 A flowchart showing a process for object presentation according to some embodiments of the present disclosure;
[0013] Figure 4 A block diagram showing an apparatus for object presentation according to some embodiments of the present disclosure; and
[0014] Figure 5 A block diagram showing a device capable of implementing one or more embodiments of the present disclosure. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0015] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.
[0016] In the description of the embodiments of the present disclosure, the term "including" and its like terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". There may also be other explicit and implicit definitions hereinafter.
[0017] In this document, unless otherwise specified, performing a step "in response to A" does not mean that the step is executed immediately after "A", but may include one or more intermediate steps.
[0018] It should be understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of the corresponding laws, regulations and related provisions.
[0019] It should be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained through appropriate means in accordance with relevant laws and regulations.
[0020] For example, when a user's active request is received, a prompt message is sent to the user to clearly prompt the user that the operation requested by the user will require the acquisition and use of the user's personal information, so that the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, an application program, a server, or a storage medium that performs the operations of the technical solution of the present disclosure according to the prompt message.
[0021] As an optional but non-limiting implementation manner, the manner of sending a prompt message to the user in response to receiving the user's active request may be, for example, in the form of a pop-up window, and the prompt message may be presented in text in the pop-up window. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0022] It should be understood that the above process of notifying and obtaining the user's authorization is only illustrative and does not limit the implementation manner of the present disclosure. Other manners that meet the relevant laws and regulations can also be applied to the implementation manner of the present disclosure.
[0023] As briefly mentioned above, the application can provide a search service to the user. Conventionally, for media content (such as videos), if the user captures an image, a search entry can be presented briefly (for example, within 5 seconds) to allow the user to search for the objects appearing in the image. However, in this case, since the search entry can be presented briefly, the user is likely to overlook the search entry and thus cannot obtain the desired object search results in time.
[0024] In view of this, the present disclosure proposes an improved solution for object presentation. According to the solution of an embodiment of the present disclosure, if an operation for intercepting an image for media content is received, a first interactive interface element is presented in a first interface corresponding to the media content, and the first interactive interface element presents at least the intercepted image. Correspondingly, if the intercepted image includes a target object, a second interactive interface element indicating the target object is presented in association with the first interactive interface element. Based on a trigger associated with the second interactive interface element, at least some objects in a group of objects matching the target object are presented in a second interface.
[0025] In this way, when an operation for intercepting an image of media content is received, object recognition can be performed on the intercepted image, and an interactive interface element corresponding to the recognized object can be provided. This can provide a more prominent interactive interface element for the user to indicate the object, so that the user can conveniently trigger an object search when needed, especially for the object search results corresponding to the object in the screenshot image. Further, the user can view other relevant objects matching the object recognized from the image via the interactive interface element, thereby enhancing the user's search experience.
[0026] In the present disclosure, "trigger" refers to one or more interactive operations of the user on the terminal device. Further, these interactive operations can be triggered within the same user interface / popup window or within different user interfaces / popup windows. The present disclosure is not limited in this regard.
[0027] In the present disclosure, "object" refers to any entity or virtual object, including but not limited to, physical or virtual goods, media works, and the like.
[0028] The exemplary embodiments of the present disclosure will be described below with reference to the accompanying drawings.
[0029] Example environment
[0030] Figure 1 A schematic diagram of an exemplary environment 100 in which embodiments of the present disclosure can be implemented is shown. In this exemplary environment 100, an instance of an application 120 is installed in a terminal device 130. The user 132 can interact with the application 120 via an attached device of the terminal device 130. Similarly, the user 132 can interact with the application 120 via an attached device of the terminal device 130.
[0031] In some embodiments, the application 120 may be any suitable application that can provide a search service for the user 132. As an example, the application 120 may be a search or query type of application. As another example, the application 120 may be an instant messaging (IM) application. It should be understood that the above are only examples of the application 120 and are not intended to be any limitation. The application 120 may be any suitable type of application that provides a search service. In Figure 1 the environment 100, if the application 120 is active, the terminal device 130 may present the interface 150 of the application 120. The interface 150 may include various types of pages that the application 120 can provide, such as a search page, a query page, a search result presentation page, and so on.
[0032] In some embodiments, the terminal device 130 communicates with the server 110 to implement the supply of the service of the application 120. The terminal device 130 may be any type of mobile terminal, fixed terminal, or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / video camera, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 130 is also capable of supporting any type of interface for the user (such as a "wearable" circuit, etc.). The server 110 may be various types of computing systems / servers capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in a cloud environment, and so on.
[0033] It should be understood that the structures and functions of the various elements in the environment 100 are described only for exemplary purposes and do not imply any limitation on the scope of the present disclosure.
[0034] Various example implementations of the present disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the pages shown in the drawings are merely examples, and various page designs may actually exist. Each graphical element in the page may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also exist. Embodiments of the present disclosure are not limited in this regard. In addition, in the following, example embodiments will be mainly described with respect to the terminal device 130. It should be understood that the actions described with respect to the terminal device 130 may be performed by the application 120 on the terminal device 130, or may be performed by the application 120 in cooperation with its server (e.g., the server 110). In some embodiments, in a scenario where the terminal device 130 cooperates with its server (e.g., the server), the terminal device 130 may request the server to provide an object to be presented, and receive the determined object from the server for presentation in the target page.
[0035] Figures 2A to 2E Schematic diagrams of example interfaces 200A to 200E for object presentation according to some embodiments of the present disclosure are shown.
[0036] In some embodiments, the terminal device 130 may present media content in a first interface or play the media content in the interface. In some embodiments, the media content may be video, a collection of dynamically played images, a dynamic image, etc., which can be played content. The media content may be provided in any suitable application or platform of the terminal device 130. In embodiments of the present disclosure, during the presentation or playing of the media content, if the terminal device 130 receives an operation for intercepting an image of the media content, a first interactive interface element is presented in the first interface.
[0037] As Figure 2AIn the example interface 200A shown, the terminal device 130 can present media content (e.g., video) on the first interface, and if an operation indicating image capture (also referred to as a screenshot operation) is received for the media content, an interactive interface element 210 can be presented in the first interface (e.g., the example interface 200A). In some embodiments, the terminal device 130 can present the interactive interface element 210 at a first position in the first interface, also referred to as a screenshot component. For example, for media content, if the terminal device 130 receives an operation of capturing an image (e.g., taking a screenshot), the interactive interface element 210 can be presented at any position in the interface 200A. In some embodiments, the interactive interface element 210 can present the captured image 211, sharing controls 213 for sharing the image 211, and so on. In some embodiments, the interactive interface element 210 can also present an entry control 212 configured to perform object recognition on the image 211 to detect whether there is an object in the image 211. In some embodiments, the captured image 211 can be the image included in the corresponding video frame when the current video is screenshot, or the image corresponding to when a set of dynamically played images is screenshot.
[0038] In some embodiments, the interactive interface element 210 can be presented in the first interface, and at this time, the media content presented in the first interface can be in a playing state. It can be understood that for the currently presented media content, the user 132 can perform an operation of capturing an image. At this time, the terminal device 130 can present the interactive interface element 210 in the second interface (such as the example interface 200A). In some examples, during the process of the terminal device 130 presenting the interactive interface element 210 in the first interface, the media content included in the first interface can be in a playing state.
[0039] In an embodiment of the present disclosure, if the terminal device 130 determines that the captured image includes a target object, a second interactive interface element indicating the target object is presented in association with the first interactive interface. As Figures 2A to 2B shown in the example interfaces 200A to 200B, if the terminal device 130 determines that the captured image 211 includes a target object 215, an interactive interface element 221 for indicating the target object can be presented in association with the interactive interface element 210. How to present the second interactive interface element 221 will be described in detail below with reference to the accompanying drawings.
[0040] In some embodiments, if the terminal device 130 determines multiple target objects from the captured image, it may also provide interactive interface elements indicating the multiple objects. The user 132 may click on the interactive interface elements to view a set of objects respectively associated with each object. It should be understood that the terminal device 130 may determine multiple target objects from the captured image. In such a case, the terminal device 130 may provide interactive interface elements for indicating the multiple target objects. The user 132 may click on these interactive interface elements to view a set of objects respectively associated with each object. For ease of understanding, the present disclosure will mainly focus on determining target objects from the captured image, but this is merely exemplary and the present disclosure does not limit this.
[0041] For ease of understanding below, first reference will be made to the appended Figure 2A to describe how to determine if the captured image includes a target object. In some embodiments, after receiving the operation of the user 132 to capture an image, the terminal device 130 may obtain the captured image. The terminal device 130 may perform intent understanding on the image using a model to determine if the image includes a target object. Referring to Figure 2A , if the terminal device 130 determines that the captured image 211 includes a target object 215 with strong e-commerce intent, it may call the model to obtain a set of objects associated with the target object 215.
[0042] In some embodiments, if the terminal device 130 determines that the type of the target object belongs to a queryable object type, it may present a second interactive interface element indicating the target object in association with the first interactive interface element. In some examples, if the terminal device 130 determines that the captured image includes an object with strong e-commerce intent, it may determine the object as a target object. For example, the terminal device 130 may determine whether the content included in the image belongs to an object in an e-commerce store. That is, after obtaining the captured image 211, the terminal device 130 may determine whether the image 211 includes an object that already exists in the e-commerce store.
[0043] In some embodiments, if the terminal device 130 determines that the media content is associated with the access entry of the target object, it may present a second interactive interface element indicating the target object in relation to the first interactive interface element. In some embodiments, if the terminal device 130 determines that the media content belongs to a video for recommending object A (e.g., a video associated with an online product), it may present a second interactive interface element indicating object A in relation to the first interactive interface element. In some examples, the media content for recommending an object (e.g., a product) may indicate a link associated with the product. For example, the media content has a Product Identification Code (PID). The Product Identification Code (PID) indicates the code used to uniquely identify the product promoted in the advertisement. Through the PID, advertisers, advertising platforms, and relevant parties can accurately locate and manage the advertisement placement of specific products. For example, in e-commerce advertisements, each product has a unique PID. When a user clicks on the advertisement to enter the product details page, the system can accurately display the corresponding product information and related content according to the PID. This helps improve the accuracy and effectiveness of advertisement placement, facilitates users to quickly find the products they are interested in, and also enables advertisers and platforms to statistically analyze the advertisement data of products, such as the click-through rate and conversion rate of products with different PIDs.
[0044] In some embodiments, the terminal device 130 may determine whether to present a second interactive interface element indicating the target object in relation to the first interactive interface element based on the degree of association between the target object and the user. It can be understood that the terminal device 130 may determine whether the object included in the captured image is the object that the user 132 wishes to query according to the historical behavior of the user 132. Further, if the terminal device 130 determines that the object included in the captured image is the object that the user 132 wishes to query, it may present a second interactive interface element indicating the target object in relation to the first interactive interface element.
[0045] For example, if the user 132 has previously purchased an object associated with the object included in the image 211 in an e-commerce store, that object may be used as the target object. Another example is that if the user 132 searches for and collects some objects associated with the object included in the image 211, that object may be used as the target object. Additionally, if the user 132 has added some objects associated with the object included in the image 211 to the shopping cart, that object may be used as the target object.
[0046] Furthermore, if the terminal device 130 determines that the image 211 includes the target object 215, it may present an interactive interface element 221 indicating the target object 215 in association with the interactive interface element 210. The following continues to refer to Figures 2A to 2BDescribe in detail if an interactive interface element 221 indicating the target object 215 is presented.
[0047] In some embodiments, if the terminal device 130 determines that the image 211 includes the target object 215, it may present the interactive interface element 221 associated with the interactive interface element 210 within a predetermined time period (e.g., 0.6 seconds - 1.1 seconds or any other appropriate time length). It can be understood that after receiving the operation of the user 132 to capture the image, the terminal device 130 may present the interactive interface element 221 within the component where the interactive interface element 210 is presented within a predetermined time period. That is, the component for presenting the interactive interface element 210 slides down a predetermined number of pixels (e.g., 54px or other specified pixel values) for presenting the interactive interface element 221. Refer to Figure 2B , the interactive interface element 221 may be presented in the lower area of the entry control 212 and the upper area of the sharing control 213. However, this is only exemplary, and the present disclosure does not limit this.
[0048] In some embodiments, a thumbnail of the target object is presented in the second interactive interface element. As Figure 2B shown in the example interface 200B, a thumbnail 223 of the target object 215 is presented in the interactive interface element 221. The thumbnail here may be generated based on the image captured from the media content, or may be a pre-configured thumbnail for the same type of object. In some embodiments, in addition to presenting the thumbnail, the object recognition result may also be indicated in any other appropriate way, such as the identifier of the object, such as the object name, type, etc. The recognition result of the object (thumbnail, name, etc.) may be configured as an interactive entry control for the user to trigger the presentation of more objects.
[0049] In some embodiments, object information associated with the target object is presented in the second interactive interface element. As Figure 2B shown in the example interface 200B, object information 224 associated with the target object 215 is presented in the interactive interface element 221. In some embodiments, the object information 224 may include the number information and description information of a group of objects that match the target object 215, the object name, etc. In some embodiments, the object information 224 may also include only the description information. How to present the object information 224 will be described in detail below with reference to Figure 2B Describe in detail how to present the object information 224.
[0050] In some embodiments, if the terminal device 130 determines that the number of objects matching the target object is less than the first predetermined number, it presents the description information. If the terminal device 130 determines that the number of objects matching the target object 215 is less than the first predetermined number (e.g., 20 or any other appropriate number), it may present only the description information 226 "Same-model objects".
[0051] In some embodiments, if the terminal device 130 determines that the number of objects matching the target object is greater than the first predetermined number and less than the second predetermined number, it may present the description information and the first number information. In some embodiments, the first predetermined number is less than the second predetermined number. If the terminal device 130 determines that the number of objects matching the target object 215 is greater than the first predetermined number (e.g., 20 or any other appropriate number) and less than the second predetermined number (e.g., 99 or any other appropriate number), it may present the description information 226 and the number information 225, such as "20+ Same-model objects". In this case, the number information 225 included in the object information 224 may be integer information, such as rounding up or rounding down. However, this is only exemplary, and the present disclosure does not limit this.
[0052] In some embodiments, if the terminal device 130 determines that the number of objects matching the target object is greater than the second predetermined number, it may present the description information and the second number information. In some embodiments, the second predetermined number is less than the third predetermined number. If the terminal device 130 determines that the number of objects matching the target object 215 is greater than the second predetermined number (e.g., 99), it may present the description information 226 and the number information 225, such as "99+ Same-model objects".
[0053] In some embodiments, the second interactive interface element may further include the associated price information of a group of objects matching the target object. The interactive interface element 221 may include the associated price information 227 of a group of objects matching the target object 215. In some embodiments, the terminal device 130 may call a model to determine one or more objects with lower prices from a group of objects matching a group of objects, and then present the price information of these objects in the interactive interface element 221.
[0054] The above describes that the terminal device 130 presents the first interactive interface element and the second interactive interface element at the first position in the first interface. The following will continue to refer to Figures 2B to 2D the description that after a period of time, the terminal device 130 may present a third interactive interface element at the second position in the first interface.
[0055] In some embodiments, the terminal device 130 may cancel presenting the first interactive interface element and the second interactive interface element within a first time period. Correspondingly, the terminal device 130 may present a third interactive interface element indicating the target object at a second position on the first interface. As Figures 2B to 2D shown in the example interfaces 200B to 200D, the terminal device 130 may cancel presenting the interactive interface element 210 and the interactive interface element 221 within a first time period (e.g., 5 seconds - 5.2 seconds or any other appropriate time length). It can be understood that after receiving an operation for intercepting an image for the media content and presenting the interactive interface element 210 and the interactive interface element 221 at a first position on the first interface for a predetermined time period (e.g., 5s), the components for presenting the interactive interface element 210 and the interactive interface element 221 gradually shrink and move down and disappear. As Figures 2C to 2D shown in the example interfaces 200C to 200D, the terminal device 130 gradually cancels presenting the interactive interface element 210 and the interactive interface element 221 in the area 230 and presents the interactive interface element 231 on the first interface (e.g., the example interface 200D).
[0056] In some embodiments, the first interactive interface element and the second interactive interface element presented in association are cancelled according to a first predetermined rule. In some embodiments, the first predetermined rule indicates the manner in which the visual attributes of the first interactive interface element and the second interactive interface element change. In some examples, the first predetermined rule may indicate that the respective corresponding attribute values of the first interactive interface element and the second interactive interface element gradually decrease. For example, the terminal device 130 may shrink the components for presenting the interactive interface element 210 and the interactive interface element 221 to a predetermined ratio (e.g., 60%). Correspondingly, the terminal device 130 may gradually reduce the transparency of the components for presenting the interactive interface element 210 and the interactive interface element 221 to zero. However, this is merely exemplary, and the present disclosure does not limit this.
[0057] Subsequently, within a second predetermined time period, the terminal device 130 may present a third interactive interface element at a second position on the first interface according to a second predetermined rule. In some embodiments, the second predetermined rule indicates the manner in which the visual attributes of the third interactive interface element change. In some examples, the second predetermined rule indicates that the corresponding attribute value of the third interactive interface element gradually increases. It can be understood that the terminal device 130 gradually presents the interactive interface element 231 within the second predetermined time period (e.g., 5.2s - 5.4s). For example, the terminal device 130 may enlarge the components for presenting the interactive interface element 210 and the interactive interface element 221 from a first ratio (e.g., 60% or any other appropriate ratio) to a second ratio (e.g., 100% or any other appropriate ratio). Correspondingly, the terminal device 130 may gradually increase the transparency of the components for presenting the interactive interface element 210 and the interactive interface element 221 to 100%. However, this is merely exemplary, and the present disclosure is not limited thereto.
[0058] In some embodiments, the third interactive interface element may include a thumbnail of the target object. As Figure 2C shown in the example interface 200C, the interactive interface element 231 may include a thumbnail 223 of the target object 215. Correspondingly, the third interactive interface element may include object information associated with the target object. As Figure 2C shown in the example interface 200C, the interactive interface element 231 may include object information 224 associated with the target object 215. The object information 224 may include the number information and description information of a group of objects that match the target object 215. In some embodiments, the object information 224 may also include only the description information. How the interactive interface element 231 presents the object information 224 may refer to the manner in which the interactive interface element 221 presents the object information 224 in the foregoing, and the present disclosure will not elaborate herein.
[0059] After the terminal device 130 identifies a group of objects that match the target object, it may present a second interface including the group of objects that match the target object. The following will continue to refer to Figures 2A to 2E to describe how the terminal device 130 presents the second interface.
[0060] In the embodiments of the present disclosure, when the terminal device 130 is triggered according to the second interactive interface element associated therewith, it presents at least some of the group of objects that match the target object in the second interface. In some embodiments, if the terminal device 130 receives a selection of the second interactive interface element, it may present at least some of the group of objects that match the target object in the second interface. As Figure 2B and Figure 2EAs shown in the example interfaces 200B and 200E, if the terminal device 130 receives a selection of the interactive interface element 221 by the user 132, it can present at least some of the objects in a set of objects that match the target object in the interface 250.
[0061] In some embodiments, if the terminal device 130 receives a selection of a third interactive interface element, it can present at least some of the objects in a set of objects that match the target object in a second interface. For example, Figure 2C and Figure 2E As shown in the example interfaces 200C and 200E, if the terminal device 130 detects a selection of the interactive interface element 231 by the user 132, it can present at least some of the objects in a set of objects that match the target object in the interface 250.
[0062] Additionally, referring to Figure 2A and Figure 2E As shown in the example interfaces 200A and 200E, if the terminal device 130 detects a trigger of the entry control 212 in the interactive interface element 210, it can also present at least some of the objects in a set of objects that match the target object in the interface 250. In the case where the terminal device 130 does not detect the target object from the image 211, if a trigger of the entry control 212 is detected, the content associated with the image 211 can be presented in the interface 250.
[0063] In some embodiments, the objects that match the target object can be retrieved from a candidate object database through a search algorithm. For example, in a scenario where it is determined that the image 211 intercepted by the user 132 includes an object A (e.g., a handbag), if the terminal device 130 receives a selection of any one of the interactive interface element 221 indicating object A, the interactive interface element 231, or the entry control 212, it can present different styles of bags in a second interface (such as the example interface 250). For example, objects 251, 252, 253, 254, etc. that are associated with object A can be presented in the second interface (such as the example interface 250).
[0064] In some embodiments, if the terminal device 130 determines that the intercepted image includes a target object, it may perform a search task based on the target object (e.g., the name of the target object, the image corresponding to the target object), and then determine a set of objects that match the target object. In some examples, if the terminal device 130 receives a selection of the interactive interface elements 221 and 231 corresponding to object A (e.g., a package), it may perform a search task based on the name of object A or the image corresponding to object A. Further, the terminal device 130 may present different styles of packages that match object A in the second interface (such as the example interface 250). For example, by detecting that the user 132 clicks any one of the interactive interface elements 221 or 231 corresponding to object A, different styles of packages can be viewed.
[0065] In some embodiments, at least a part of the second interface is presented in association with at least a part of the first interface. In some embodiments, the terminal device 130 may present at least a part of the second interface (such as the example interface 250) in association with the first interface in a 7 - split - screen style. In some embodiments, the terminal device 130 may present the presentation interface 250 (such as the example interface 200E) associated with the intercepted image in a 7 - split - screen style. In some embodiments, if the terminal device 130 receives a trigger associated with the second interface, it may present the second interface in a predetermined ratio. If the terminal device 130 receives a swiping - up operation on the interface 250 in the interface 200E, it may present the interface 250 full - screen in the interface. The terminal device 130 may present all objects associated with object A in the interface 250.
[0066] In some embodiments, the first interactive interface element, the second interactive interface element, and the third interactive interface element may all be presented in the first interface (e.g., the example interfaces 200A, 200B, 200C, and 200D). In these scenarios, the media content included in the first interface may be in a playing state. It can be understood that when the terminal device 130 receives an operation from the user 132 for intercepting an image and presents the first interactive interface element, the second interactive interface element, or the third interactive interface element in the first interface, the media content in the first interface may be in a playing state.
[0067] In some embodiments, if the terminal device 130 receives a selection of the second interactive interface element, it may present a return control in association with the second interface. In some examples, if the terminal device 130 receives a selection of either the second interactive interface element or the third interactive interface element, it may present a return control associated with the second interface. As Figure 2B / 2C and Figure 2E In the example interfaces 200B / 200C and 200E shown, if the terminal device 130 receives a selection of any interactive interface element among the interactive interface elements 221 or 231, it may present a return control 255 associated with a second interface (e.g., interface 250).
[0068] Furthermore, if the terminal device 130 receives a trigger of the return control, it may cancel the presentation of the second interface and may present a complete portion of the first interface, which includes a third interactive interface element. As Figure 2E and Figure 2D In the example interfaces 200E and 200D shown, if the terminal device 130 receives a trigger of the return control 255, it may cancel the presentation of interface 250 and present interface 200D, which includes the interactive interface element 231. It can be understood that in the case where the user 132 enters the second interface (e.g., interface 250) from any of the interactive interface elements 221 or 221. If the terminal device 130 detects that the user 132 clicks the return control 255, it may present the first interface (e.g., the example interface 200D) including the interactive interface element 231.
[0069] Additionally, in the case where the user 132 enters the second interface (e.g., interface 250) from the interactive interface element 210 and the terminal device 130 determines that there is a target object 215 in the image 211. If the terminal device 130 detects that the user 132 clicks the return control 255, it may present the first interface (e.g., the example interface 200D) including the interactive interface element 231. In the case where the user 132 enters the second interface (e.g., interface 250) from the interactive interface element 210 and the terminal device 130 determines that there is no target object 215 in the image 211. If the terminal device 130 detects that the user 132 clicks the return control 255, it may present the first interface (e.g., the interface where media content is presented).
[0070] In this way, upon receiving an operation for intercepting an image of media content, object recognition may be performed on the intercepted image, and an interactive interface element corresponding to the recognized object may be provided. This can provide a more prominent interactive interface element for the user to indicate the object, thereby improving the conversion rate of data. Further, the user may view other related objects matching the object recognized from the image via the interactive interface element, thereby enhancing the user experience.
[0071] Example process
[0072] Figure 3FIG. 300 is a flowchart of a process for object presentation according to some embodiments of the present disclosure. The process 300 may be implemented at the terminal device 130. The following will refer to Figure 1 describe the process 300.
[0073] At block 310, in response to an operation for intercepting an image for media content, the terminal device 130 presents a first interactive interface element in a first interface corresponding to the media content, and the first interactive interface element presents at least the intercepted image.
[0074] At block 320, in response to the intercepted image including a target object, the terminal device 130 presents a second interactive interface element indicating the target object in association with the first interactive interface element.
[0075] At block 330, the terminal device 130 presents at least some objects in a set of objects matching the target object in a second interface based on a trigger associated with the second interactive interface element.
[0076] In some embodiments, presenting at least some objects in a set of objects matching the target object in a second interface includes: presenting at least some objects in a set of objects matching the target object in the second interface in response to a selection of the second interactive interface element.
[0077] In some embodiments, the first interactive interface element and the second interactive interface element are presented at a first position of the first interface, and presenting at least some objects in a set of objects matching the target object in the second interface includes: canceling the presentation of the first interactive interface element and the second interactive interface element within a first time period, and presenting a third interactive interface element indicating the target object at a second position of the first interface; and presenting at least some objects in a set of objects matching the target object in the second interface in response to a selection of the third interactive interface element.
[0078] In some embodiments, the first interactive interface element and the second interactive interface element presented in association are canceled according to a first predetermined rule, and the first predetermined rule indicates a manner of changing the visual attributes of the first interactive interface element and the second interactive interface element.
[0079] In some embodiments, presenting the third interactive interface element indicating the target object includes: presenting the third interactive interface element according to a second predetermined rule, and the second predetermined rule indicates a manner of changing the visual attributes of the third interactive interface element.
[0080] In some embodiments, at least one of the following is presented in the second interactive interface element or the third interactive element: a thumbnail of the target object, or object information associated with the target object.
[0081] In some embodiments, the object information presented in the second interactive interface element or the third interactive interface element includes: in response to the number of objects matching the target object being less than a first predetermined number, the object information includes descriptive information; in response to the number of objects matching the target object being greater than the first predetermined number and less than a second predetermined number, the object information includes descriptive information and first number information, where the first predetermined number is less than the second predetermined number; or in response to the number of objects matching the target object being greater than the second predetermined number, the object information includes descriptive information and second number information.
[0082] In some embodiments, at least a part of the second interface is presented in association with at least a part of the first interface, and the media content presented in the first interface is in a playing state.
[0083] In some embodiments, process 300 further includes: in response to the selection of the second interactive interface element, presenting a return control in association with the second interface; and in response to the triggering of the return control, canceling the presentation of the second interface and presenting the entire part of the first interface, where the first interface includes a third interactive interface element.
[0084] In some embodiments, presenting a second interactive interface element indicating a target object in association with a first interactive interface element includes determining, based on at least one of the following, to present a second interactive interface element indicating a target object in association with the first interactive interface element: the type of the target object belongs to a queryable object type, the media content is associated with an access entry of the target object, or the degree of association between the target object and the user.
[0085] Example apparatus and equipment
[0086] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above methods or processes.
[0087] Figure 4 FIG. shows a schematic structural block diagram of an apparatus 400 for object presentation according to certain embodiments of the present disclosure. The apparatus 400 can be implemented as or included in a terminal device 130. Each module / component in the apparatus 400 can be implemented by hardware, software, firmware, or any combination thereof.
[0088] As Figure 4As shown, the device 400 includes a first interactive interface element presenting module 410, configured to present a first interactive interface element in a first interface corresponding to media content in response to an operation for capturing an image of the media content, where the first interactive interface element presents at least the captured image. The device 400 further includes a second interactive interface element presenting module 420, configured to present a second interactive interface element indicating the target object in association with the first interactive interface element in response to the captured image including the target object. The device 400 further includes an object presenting module 430, configured to present at least some objects in a set of objects matching the target object in a second interface based on a trigger associated with the second interactive interface element.
[0089] In some embodiments, the object presenting module 430 is further configured to present at least some objects in a set of objects matching the target object in a second interface in response to a selection of the second interactive interface element.
[0090] In some embodiments, the first interactive interface element and the second interactive interface element are presented at a first position in the first interface, and the object presenting module 430 is further configured to cancel presenting the first interactive interface element and the second interactive interface element within a first time period and present a third interactive interface element indicating the target object at a second position in the first interface; and present at least some objects in a set of objects matching the target object in a second interface in response to a selection of the third interactive interface element.
[0091] In some embodiments, the presented first interactive interface element and the second interactive interface element associated therewith are cancelled according to a first predetermined rule, where the first predetermined rule indicates a manner of change of visual attributes of the first interactive interface element and the second interactive interface element.
[0092] In some embodiments, the device 400 further includes a third interactive interface element presenting module configured to present a third interactive interface element according to a second predetermined rule, where the second predetermined rule indicates a manner of change of visual attributes of the third interactive interface element.
[0093] In some embodiments, at least one of the following is presented in the second interactive interface element or the third interactive element: a thumbnail of the target object, or object information associated with the target object.
[0094] In some embodiments, the object information presented in the second interactive interface element or the third interactive interface element includes: in response to the number of objects matching the target object being less than a first predetermined number, the object information includes descriptive information; in response to the number of objects matching the target object being greater than the first predetermined number and less than a second predetermined number, the object information includes descriptive information and first number information, where the first predetermined number is less than the second predetermined number; or in response to the number of objects matching the target object being greater than the second predetermined number, the object information includes descriptive information and second number information.
[0095] In some embodiments, at least a portion of the second interface is presented in association with at least a portion of the first interface, and the media content presented in the first interface is in a playing state.
[0096] In some embodiments, the apparatus 400 further includes an interface presentation module configured to present a return control in association with the second interface in response to a selection of the second interactive interface element; and cancel the presentation of the second interface and present a complete portion of the first interface in response to a trigger of the return control, where the first interface includes a third interactive interface element.
[0097] In some embodiments, the second interactive interface element presentation module 420 is further configured to determine, based on at least one of the following, to present a second interactive interface element indicating a target object in association with the first interactive interface element: the type of the target object belongs to a queryable object type, the media content is associated with an access entry of the target object, or the degree of association between the target object and the user.
[0098] The units and / or modules included in the apparatus 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to the machine-executable instructions, some or all of the units and / or modules in the apparatus 400 can be at least partially implemented by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0099] It should be understood that one or more steps in the above methods can be performed by a suitable electronic device or a combination of electronic devices. Such an electronic device or a combination of electronic devices can include, for example Figure 1 the terminal device 130 in
[0100] Figure 5FIG. 500 is a block diagram of an electronic device in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 5 the illustrated electronic device 500 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Figure 5 The illustrated electronic device 500 may be used to implement Figure 1 the terminal device 130.
[0101] As Figure 5 shown, the electronic device 500 is in the form of a general-purpose electronic device. The components of the electronic device 500 may include, but are not limited to, one or more processors 510 or processing units, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processor 5105 may be an actual or virtual processor and is capable of performing various processes according to the programs stored in the memory 520. In a multi-processor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing ability of the electronic device 500.
[0102] The electronic device 500 generally includes multiple computer storage media. Such media may be any available media accessible to the electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 520 may be a volatile memory (such as registers, caches, random access memory (RAM)), a non-volatile memory (such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 may be a removable or non-removable medium and may include machine-readable media, such as a flash drive, a magnetic disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 500.
[0103] The electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in Figure 5 FIG., a disk drive for reading from or writing to a removable, non-volatile magnetic disk (such as a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 520 may include a computer program product 525 having one or more program modules that are configured to perform various methods or actions of the various embodiments of the present disclosure.
[0104] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 500 can be implemented with a single computing cluster or multiple computer machines that are capable of communicating via a communication link. Thus, the electronic device 500 can operate in a networked environment using a logical connection to one or more other servers, network personal computers (PCs), or another network node.
[0105] The input device 550 can be one or more input devices such as a mouse, keyboard, trackball, etc. The output device 560 can be one or more output devices such as a display, speaker, printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown) as needed via the communication unit 540, the external devices such as a storage device, a display device, etc., communicate with one or more devices that enable a user to interact with the electronic device 500, or communicate with any device that enables the electronic device 500 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).
[0106] According to an exemplary implementation of the present disclosure, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, there is also provided a computer program product, the computer program product being tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, and the computer-executable instructions being executed by a processor to implement the method described above.
[0107] Aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and the combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.
[0108] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that the instructions, when executed by the processor of the computer or other programmable data processing apparatus, create a means for implementing the functions / acts specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, a programmable data processing apparatus, and / or other devices to operate in a particular manner, such that the computer-readable medium storing the instructions comprises a manufacture including instructions for implementing various aspects of the functions / acts specified in one or more blocks of the flowchart and / or block diagram.
[0109] Computer-readable program instructions may be loaded onto a computer, other programmable data processing apparatus, or other devices, causing a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other devices to generate a computer-implemented process, such that the instructions executed on the computer, other programmable data processing apparatus, or other devices implement the functions / actions specified in one or more boxes of the flowchart and / or block diagram.
[0110] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various implementations of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a segment of a program, or a part of an instruction, and the module, segment of a program, or part of an instruction contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the boxes may occur in a different order than noted in the figures. For example, two consecutive boxes may in fact be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functionality involved. It should also be noted that each box of the block diagrams and / or flowcharts, and combinations of boxes in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system for performing the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.
[0111] The various implementations of the present disclosure have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art in the field without departing from the scope and spirit of the described implementations. The choice of terms used herein is intended to best explain the principles of the implementations, the practical application, or the improvement of the technology in the market, or to enable other ordinary skilled artisans in the field to understand the various implementations disclosed herein.
Claims
1. A method for object presentation, comprising: In response to an operation for capturing an image of the media content, presenting a first interactive interface element in a first interface corresponding to the media content, wherein the first interactive interface element at least presents the captured image; In response to the captured image including a target object, presenting a second interactable interface element indicating the target object in association with the first interactable interface element; as well as Based on a trigger associated with the second interactive interface element, at least some of the objects in a group of objects matching the target object are presented in the second interface.
2. The method according to claim 1, wherein presenting at least part of a group of objects matching the target object in the second interface comprises: In response to selection of the second interactive interface element, at least some of the objects in a group of objects matching the target object are presented in the second interface.
3. The method according to claim 1, wherein the first interactive interface element and the second interactive interface element are presented at a first position of the first interface, and presenting at least part of a group of objects matching the target object in the second interface comprises: canceling the presentation of the first interactive interface element and the second interactive interface element within a first time period, and presenting a third interactive interface element indicating the target object at a second position of the first interface; as well as In response to selection of the third interactive interface element, at least some of the objects in a group of objects matching the target object are presented in the second interface.
4. A method according to claim 3, wherein the first interactive interface element and the second interactive interface element that are presented in association are unpresented according to a first predetermined rule, and the first predetermined rule indicates how the visual properties of the first interactive interface element and the second interactive interface element are changed.
5. The method according to claim 3, wherein presenting a third interactive interface element indicating the target object comprises: The third interactive interface element is presented according to a second predetermined rule, wherein the second predetermined rule indicates a manner in which a visual attribute of the third interactive interface element is changed.
6. The method according to claim 1 or 3, wherein at least one of the following items is presented in the second interactive interface element or the third interactive element: a thumbnail of the target object, or The object information associated with the target object.
7. The method according to claim 6, wherein the object information presented in the second interactive interface element or the third interactive interface element comprises: In response to the number of objects matching the target object being less than a first predetermined number, the object information includes the description information; In response to the number of objects matching the target object being greater than the first predetermined number and less than a second predetermined number, the object information includes the description information and first number information, and the first predetermined number is less than the second predetermined number; or In response to the number of objects matching the target object being greater than the second predetermined number, the object information includes the description information and second number information. 8 . The method according to claim 1 , wherein at least a portion of the second interface is presented in association with at least a portion of the first interface, and the media content presented in the first interface is in a playing state.
9. The method according to claim 3, further comprising: In response to selection of the second interactive interface element, presenting a return control in association with the second interface; as well as In response to triggering the return control, the second interface is canceled and a complete portion of the first interface is presented, wherein the first interface includes the third interactive interface element.
10. The method of claim 1, wherein presenting a second interactive interface element indicating the target object in association with the first interactive interface element comprises: Based on at least one of the following determinations, presenting a second interactive interface element indicating the target object in association with the first interactive interface element: The type of the target object belongs to the queryable object type, The media content is associated with the access entry of the target object, or The degree of association between the target object and the user.
11. An apparatus for object presentation, comprising: A first interactive interface element presentation module is configured to present a first interactive interface element in a first interface corresponding to the media content in response to an operation for capturing an image of the media content, wherein the first interactive interface element at least presents the captured image; A second interactive interface element presentation module, configured to present a second interactive interface element indicating the target object in association with the first interactive interface element in response to the captured image including the target object; as well as An object presentation module is configured to present at least some of the objects in a group of objects matching the target object in the second interface based on a trigger associated with the second interactive interface element.
12. An electronic device comprising: at least one processor; as well as At least one memory, the at least one memory is coupled to the at least one processor and stores instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 10 when executed by the at least one processor.
13. A computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions can be executed by a processor to implement the method according to any one of claims 1 to 10.
14. A computer program product comprising computer executable instructions, wherein the computer executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 10.
Citation Information
Cited By
Object presentation method and apparatus, device, and storage medium
WO2026179273A1