Object presentation method and apparatus, device, and storage medium

Abstract

According to embodiments of the present invention, provided are an object presentation method and apparatus, a device, and a storage medium. The object presentation method comprises: in response to an operation for capturing an image from media content, presenting a first interactive interface element in a first interface corresponding to the media content, the first interactive interface element at least presenting the captured image; in response to the captured image comprising a target object, presenting, in association with the first interactive interface element, a second interactive interface element indicating the target object; and on the basis of a trigger associated with the second interactive interface element, presenting, in a second interface, at least some objects in a group of objects matching the target object.

Description

Methods, apparatus, devices, and storage media for object rendering

[0001] This application claims priority to Chinese Patent Application No. 202510240108.6, filed on February 28, 2025, entitled "Method, Apparatus, Device and Storage Medium for Object Presentation", the entire contents of which are incorporated herein by reference. Technical Field

[0002] The exemplary embodiments disclosed herein relate generally to the field of computers, and more particularly to methods, apparatuses, devices, and computer-readable storage media for object rendering. Background Technology

[0003] With the rapid development of the internet, more and more applications are designed to provide users with various services. For example, applications can provide search services. Applications can obtain search requests from users (e.g., when a user clicks on a search entry point) and provide search results corresponding to that request. Therefore, it is necessary to continuously explore the accuracy of search results to improve the user experience. Summary of the Invention

[0004] In a first aspect of this disclosure, a method for object rendering is provided, comprising: in response to an operation for capturing an image of media content, presenting a first interactive interface element in a first interface corresponding to the media content, the first interactive interface element at least presenting the captured image; in response to the captured image including a target object, presenting a second interactive interface element indicating the target object in association with the first interactive interface element; and based on a trigger associated with the second interactive interface element, presenting at least a portion of a set of objects matching the target object in a second interface.

[0005] In a second aspect of this disclosure, an apparatus for object rendering is provided, comprising: a first interactive interface element rendering module configured to render a first interactive interface element in a first interface corresponding to the media content in response to an operation for capturing an image for media content, the first interactive interface element at least rendering the captured image; a second interactive interface element rendering module configured to render a second interactive interface element indicating the target object in association with the first interactive interface element in response to the captured image including a target object; and an object rendering module configured to render at least a portion of a set of objects matching the target object in a second interface based on a trigger associated with the second interactive interface element.

[0006] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0008] According to a fifth aspect of this disclosure, a computer program product is provided, including computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method of the first aspect.

[0009] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0011] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] Figures 2A to 2E illustrate schematic diagrams of example interfaces for object rendering according to some embodiments of the present disclosure;

[0013] Figure 3 shows a flowchart of a process for object rendering according to some embodiments of the present disclosure;

[0014] Figure 4 shows a block diagram of an apparatus for object rendering according to some embodiments of the present disclosure; and

[0015] Figure 5 shows a block diagram of an apparatus capable of implementing one or more embodiments of the present disclosure. Detailed Implementation

[0016] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0017] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0018] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0019] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0020] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and user authorization should be obtained.

[0021] For example, in response to receiving a user's active request, a prompt message is sent to the user to clearly inform the user that the requested operation will require the acquisition and use of the user's personal information, thereby enabling the user to choose whether to provide personal information to the software or hardware such as electronic devices, applications, servers or storage media that perform the operation of the technical solution disclosed herein, based on the prompt message.

[0022] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0023] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0024] As briefly mentioned earlier, applications can provide search services to users. Typically, for media content (e.g., video), if a user captures an image, a search entry can be briefly displayed (e.g., within 5 seconds), allowing the user to search for objects appearing in the image. However, in this case, the search entry is presented only briefly, and users may easily overlook it, thus failing to obtain the desired search results in a timely manner.

[0025] In view of this, this disclosure proposes an improved scheme for object presentation. According to an embodiment of this disclosure, if an operation to capture an image for media content is received, a first interactive interface element is presented in a first interface corresponding to the media content. The first interactive interface element at least presents the captured image. Accordingly, if the captured image includes a target object, a second interactive interface element indicating the target object is presented in association with the first interactive interface element. Based on a trigger associated with the second interactive interface element, at least a portion of a set of objects matching the target object is presented in the second interface.

[0026] In this way, upon receiving a cropped image of media content, object recognition can be performed on the cropped image, and interactive interface elements corresponding to the recognized objects can be provided. This provides users with more prominent interactive interface elements to indicate objects, allowing them to easily trigger object searches when needed, especially for objects corresponding to those in the cropped image. Furthermore, users can view other related objects that match the objects recognized from the image through these interactive interface elements, thereby enhancing the user's search experience.

[0027] In this disclosure, "trigger" refers to one or more interactive actions performed by a user on a terminal device. Furthermore, these interactive actions may be triggered within the same user interface / pop-up window or within different user interfaces / pop-up windows. This disclosure is not limited in this respect.

[0028] In this disclosure, “object” refers to any physical or virtual object, including but not limited to physical or virtual goods, media works, etc.

[0029] Example embodiments of this disclosure are described below with reference to the accompanying drawings.

[0030] Example Environment

[0031] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In this example environment 100, an instance of application 120 is installed on terminal device 130. User 132 can interact with application 120 via an attachment to terminal device 130. Similarly, user 132 can interact with application 120 via an attachment to terminal device 130.

[0032] In some embodiments, application 120 can be any suitable application that can provide search services to user 132. As an example, application 120 can be a search-type or query-type application. As another example, application 120 can be an instant messaging (IM) application. It should be understood that the above are merely examples of application 120 and are not intended to be limiting; application 120 can be any suitable type of application that provides search services. In environment 100 of Figure 1, if application 120 is active, terminal device 130 can present the interface 150 of application 120. Interface 150 can include various types of pages that application 120 can provide, such as search pages, query pages, search result display pages, etc.

[0033] In some embodiments, terminal device 130 communicates with server 110 to provide services to application 120. Terminal device 130 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 130 can also support any type of user-facing interface (such as "wearable" circuitry). Server 110 can be various types of computing systems / servers capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, etc.

[0034] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0035] Various exemplary implementations of this disclosure will now be described in detail with reference to the accompanying drawings. It should be understood that the pages shown in the drawings are merely examples, and various page designs are possible in practice. The various graphic elements on the page may have different arrangements and different visual representations, one or more elements may be omitted or replaced, and one or more other elements may also be present. The embodiments of this disclosure are not limited in this respect. Furthermore, in the following description, exemplary embodiments will be primarily referred to with respect to terminal device 130. It should be understood that the actions described with respect to terminal device 130 may be performed by application 120 on terminal device 130, or may be performed by application 120 in collaboration with its server (e.g., server 110). In some embodiments, in a scenario where the actions are performed by terminal device 130 in collaboration with its server (e.g., server), terminal device 130 may request the server to provide an object to be presented, and receive the determined object from the server for presentation on the target page.

[0036] Figures 2A to 2E illustrate schematic diagrams of example interfaces 200A to 200E for object rendering according to some embodiments of the present disclosure.

[0037] In some embodiments, the terminal device 130 may present media content on a first interface or play media content on that interface. In some embodiments, the media content may be playable content such as video, a dynamically played collection of images, or animated images. The media content may be provided in any suitable application or platform of the terminal device 130. In embodiments of this disclosure, if the terminal device 130 receives an operation for capturing an image of the media content during the presentation or playback of the media content, it will present a first interactive interface element on the first interface.

[0038] As shown in the example interface 200A of Figure 2A, the terminal device 130 can present media content (e.g., video) on a first interface, and if it receives an operation instructing the capture of an image (also called a screenshot operation) for the media content, it can present an interactive interface element 210 on the first interface (e.g., example interface 200A). In some embodiments, the terminal device 130 can present the interactive interface element 210 at a first position on the first interface, also called a screenshot component. For example, if the terminal device 130 receives an operation to capture an image (e.g., a screenshot) for the media content, it can present the interactive interface element 210 at any position in interface 200A. In some embodiments, the interactive interface element 210 can present the captured image 211, a sharing control 213 for sharing the image 211, etc. In some embodiments, the interactive interface element 210 can also present an entry control 212 configured to perform object recognition on the image 211 to detect whether an object exists in the image 211. In some embodiments, the captured image 211 may be an image included in the corresponding video frame when the current video is captured, or an image corresponding to the dynamically played image set when it is captured.

[0039] In some embodiments, the interactive interface element 210 can be presented in a first interface, where the media content presented in the first interface can be in a playback state. Understandably, the user 132 can perform an image capture operation on the currently presented media content. At this time, the terminal device 130 can present the interactive interface element 210 in a second interface (such as example interface 200A). In some examples, while the terminal device 130 is presenting the interactive interface element 210 in the first interface, the media content included in the first interface can be in a playback state.

[0040] In embodiments of this disclosure, if terminal device 130 determines that the captured image includes a target object, it presents a second interactive interface element associated with the first interactive interface that indicates the target object. As shown in example interfaces 200A to 200B of FIG. 2A to 2B, if terminal device 130 determines that the captured image 211 includes a target object 215, it can present an interactive interface element 221 associated with interactive interface element 210 that indicates the target object. The presentation of the second interactive interface element 221 will be described in detail below with reference to the accompanying drawings.

[0041] In some embodiments, if the terminal device 130 determines multiple target objects from a captured image, it may also provide interactive interface elements indicating the multiple objects. The user 132 can click on these interactive interface elements to view a set of objects associated with each object. It should be understood that the terminal device 130 can determine multiple target objects from a captured image. In this case, the terminal device 130 can provide interactive interface elements to indicate the multiple target objects. The user 132 can click on these interactive interface elements to view a set of objects associated with each object. For ease of understanding, this disclosure will primarily focus on determining target objects from a captured image, but this is merely exemplary and not intended to limit the scope of the disclosure.

[0042] For ease of understanding, the following description, referring to Figure 2A, will first describe how it is determined that the captured image includes a target object. In some embodiments, after receiving an operation from user 132 to capture an image, terminal device 130 can acquire the captured image. Terminal device 130 can utilize a model to perform intent understanding on the image to determine whether the image includes a target object. Referring to Figure 2A, if terminal device 130 determines that the captured image 211 includes a target object 215 with a strong e-commerce intent, it can invoke a model to retrieve a set of objects associated with the target object 215.

[0043] In some embodiments, if the terminal device 130 determines that the type of the target object belongs to a queryable object type, it can present a second interactive interface element indicating the target object in relation to the first interactive interface element. In some examples, if the terminal device 130 determines that the captured image includes an object with strong e-commerce intent, it can identify that object as the target object. For example, the terminal device 130 can determine whether the content included in the image belongs to an object in an e-commerce store. That is, after acquiring the captured image 211, the terminal device 130 can determine whether the image 211 includes an object that already exists in an e-commerce store.

[0044] In some embodiments, if the terminal device 130 determines that the media content is associated with an access point to a target object, it can present a second interactive interface element indicating the target object in relation to the first interactive interface element. In some embodiments, if the terminal device 130 determines that the media content belongs to a video used to recommend object A (e.g., a video associated with an online product), it can present a second interactive interface element indicating object A in relation to the first interactive interface element. In some examples, the media content used to recommend an object (e.g., a product) can indicate a link associated with that product, for example, the media content has a Product Identification Code (PID). A Product Identification Code (PID) indicates a code used to uniquely identify the product promoted in an advertisement. Through the PID, advertisers, advertising platforms, and relevant parties can accurately target and manage the advertising of specific products. For example, in e-commerce advertising, each product has a unique PID. When a user clicks on an advertisement and enters the product details page, the system can accurately display the corresponding product information and related content based on the PID. This helps improve the accuracy and effectiveness of advertising, making it easier for users to quickly find products they are interested in, and also facilitating advertisers and platforms to statistically analyze product advertising data, such as click-through rates and conversion rates for products with different PIDs.

[0045] In some embodiments, the terminal device 130 can determine whether to present a second interactive interface element indicating the target object in relation to the first interactive interface element based on the correlation between the target object and the user. It is understood that the terminal device 130 can determine whether the object included in the captured image is the object that the user 132 intends to query based on the user 132's historical behavior. Furthermore, if the terminal device 130 determines that the object included in the captured image is the object that the user 132 intends to query, it can present the second interactive interface element indicating the target object in relation to the first interactive interface element.

[0046] For example, if user 132 has previously purchased an object associated with the object included in image 211 from an e-commerce store, that object can be used as the target object. Similarly, if user 132 searches for or saves some objects associated with the object included in image 211, that object can be used as the target object. Additionally, if user 132 has added some objects associated with the object included in image 211 to their shopping cart, that object can be used as the target object.

[0047] Furthermore, if the terminal device 130 determines that the image 211 includes the target object 215, it can present an interactive interface element 221 indicating the target object 215, which is associated with the interactive interface element 210. The following describes in detail, with reference to Figures 2A and 2B, if the interactive interface element 221 indicating the target object 215 is presented.

[0048] In some embodiments, if the terminal device 130 determines that the image 211 includes the target object 215, it can present the interactive interface element 221 associated with the interactive interface element 210 for a predetermined time period (e.g., 0.6 seconds to 1.1 seconds or any other suitable time length). It is understood that after receiving the image capture operation from the user 132, the terminal device 130 can present the interactive interface element 221 in the component where the interactive interface element 210 is presented for the predetermined time period. That is, the component used to present the interactive interface element 210 slides down a predetermined number of pixels (e.g., 54px or other specified pixel value) to present the interactive interface element 221. Referring to FIG2B, the interactive interface element 221 can be presented in the area below the entry control 212 and the area above the share control 213. However, this is merely exemplary and is not intended to limit the scope of this disclosure.

[0049] In some embodiments, a thumbnail of the target object is presented in the second interactive interface element. As shown in example interface 200B of FIG2B, a thumbnail 223 of the target object 215 is presented in interactive interface element 221. This thumbnail may be generated based on an image captured from media content, or it may be a pre-configured thumbnail for objects of the same type. In some embodiments, in addition to presenting a thumbnail, the object identification result may be indicated in any other suitable manner, such as the object's identifier, such as the object name, type, etc. The object identification result (thumbnail, name, etc.) may be configured as an interactive entry control to be triggered by the user to present more objects.

[0050] In some embodiments, the second interactive interface element presents object information associated with the target object. As shown in the example interface 200B of FIG2B, the interactive interface element 221 presents object information 224 associated with the target object 215. In some embodiments, the object information 224 may include information on the number and description of a group of objects matching the target object 215, object names, etc. In some embodiments, the object information 224 may also include only description information. The following will describe in detail how the object information 224 is presented with reference to FIG2B.

[0051] In some embodiments, if the terminal device 130 determines that the number of objects matching the target object is less than a first predetermined number, it presents description information. If the terminal device 130 determines that the number of objects matching the target object 215 is less than the first predetermined number (e.g., 20 or any other suitable number), it may only present description information 226 "same type of object".

[0052] In some embodiments, if the terminal device 130 determines that the number of objects matching the target object is greater than a first predetermined number and less than a second predetermined number, it may present description information and first number information. In some embodiments, the first predetermined number is less than the second predetermined number. If the terminal device 130 determines that the number of objects matching the target object 215 is greater than the first predetermined number (e.g., 20 or any other suitable number) and less than the second predetermined number (e.g., 99 or any other suitable number), it may present description information 226 and number information 225, such as "20+ similar objects". In this case, the number information 225 included in the object information 224 may be integer information, such as rounded up or rounded down. However, this is merely exemplary and is not limited thereto.

[0053] In some embodiments, if the terminal device 130 determines that the number of objects matching the target object is greater than a second predetermined number, it may present description information and second number information. In some embodiments, the second predetermined number is less than a third predetermined number. If the terminal device 130 determines that the number of objects matching the target object 215 is greater than the second predetermined number (e.g., 99), it may present description information 226 and number information 225, such as "99 + similar objects".

[0054] In some embodiments, the second interactive interface element may further include associated price information of a set of objects matching the target object. Interactive interface element 221 may include associated price information 227 of a set of objects matching the target object 215. In some embodiments, the terminal device 130 may invoke a model to determine one or more objects with lower prices from the set of objects matching the target object, and then present the price information of these objects in the interactive interface element 221.

[0055] The preceding text describes how the terminal device 130 presents a first interactive interface element and a second interactive interface element at a first position in the first interface. The following text will continue to describe with reference to Figures 2B to 2D. After a period of time, the terminal device 130 can present a third interactive interface element at a second position in the first interface.

[0056] In some embodiments, the terminal device 130 may cancel the presentation of the first and second interactive interface elements within a first time period. Correspondingly, the terminal device 130 may present a third interactive interface element indicating a target object at a second position on the first interface. As shown in the example interfaces 200B to 200D of Figures 2B to 2D, the terminal device 130 may cancel the presentation of interactive interface elements 210 and 221 within a first time period (e.g., 5 seconds to 5.2 seconds or any other suitable time length). It is understood that after receiving an operation to capture an image for media content, and after presenting interactive interface elements 210 and 221 at a first position on the first interface for a predetermined time period (e.g., 5 seconds), the components used to present interactive interface elements 210 and 221 gradually shrink and disappear downwards. As shown in the example interfaces 200C to 200D in Figures 2C to 2D, the terminal device 130 gradually cancels the presentation of interactive interface elements 210 and 221 in region 230, and presents interactive interface element 231 in the first interface (e.g., example interface 200D).

[0057] In some embodiments, the first and second interactive interface elements that are associatedly presented are de-presented according to a first predetermined rule. In some embodiments, the first predetermined rule indicates how the visual attributes of the first and second interactive interface elements are changed. In some examples, the first predetermined rule may indicate that the respective attribute values ​​of the first and second interactive interface elements gradually decrease. For example, the terminal device 130 may shrink the components used to present interactive interface elements 210 and 221 to a predetermined ratio (e.g., 60%). Accordingly, the terminal device 130 may gradually reduce the transparency of the components used to present interactive interface elements 210 and 221 to zero. However, this is merely exemplary and is not intended to limit the scope of this disclosure.

[0058] Subsequently, within a second predetermined time period, terminal device 130 may present a third interactive interface element at a second position on the first interface according to a second predetermined rule. In some embodiments, the second predetermined rule indicates how the visual attributes of the third interactive interface element change. In some examples, the second predetermined rule indicates that the corresponding attribute value of the third interactive interface element gradually increases. It is understood that terminal device 130 gradually presents interactive interface element 231 within the second predetermined time period (e.g., 5.2s-5.4s). For example, terminal device 130 may enlarge the components used to present interactive interface elements 210 and 221 from a first scale (e.g., 60% or any other suitable scale) to a second scale (e.g., 100% or any other suitable scale). Accordingly, terminal device 130 may gradually increase the transparency of the components used to present interactive interface elements 210 and 221 to 100%. However, this is merely exemplary and is not intended to limit the scope of this disclosure.

[0059] In some embodiments, the third interactive interface element may include a thumbnail of the target object. As shown in the example interface 200C in FIG2C, the interactive interface element 231 may include a thumbnail 223 of the target object 215. Correspondingly, the third interactive interface element may include object information associated with the target object. As shown in the example interface 200C in FIG2C, the interactive interface element 231 may include object information 224 associated with the target object 215. The object information 224 may include the number of objects matching the target object 215 and descriptive information. In some embodiments, the object information 224 may also include only descriptive information. How the interactive interface element 231 presents the object information 224 can be referred to the above description of how the interactive interface element 221 presents the object information 224, and will not be repeated here.

[0060] After identifying a set of objects that match the target object, terminal device 130 can present a second interface that includes the set of objects that match the target object. The following description, referring to Figures 2A to 2E, will continue to illustrate how terminal device 130 presents the second interface.

[0061] In embodiments of this disclosure, terminal device 130 presents at least a portion of a set of objects matching a target object in a second interface based on a trigger associated with a second interactive interface element. In some embodiments, if terminal device 130 receives a selection of a second interactive interface element, it can present at least a portion of a set of objects matching a target object in the second interface. As shown in example interfaces 200B and 200E of Figures 2B and 2E, if terminal device 130 receives a selection of interactive interface element 221 by user 132, it can present at least a portion of a set of objects matching a target object in interface 250.

[0062] In some embodiments, if terminal device 130 receives a selection of a third interactive interface element, it can present at least a portion of a set of objects matching the target object in a second interface. As shown in example interfaces 200C and 200E of Figures 2C and 2E, if terminal device 130 detects that user 132 has selected interactive interface element 231, it can present at least a portion of a set of objects matching the target object in interface 250.

[0063] Additionally, referring to the example interfaces 200A and 200E shown in Figures 2A and 2E, if the terminal device 130 detects a trigger on the entry control 212 in the interactive interface element 210, it can also present at least a portion of a set of objects matching the target object in the interface 250. If the terminal device 130 does not detect the target object from the image 211, but detects a trigger on the entry control 212, it can present content associated with the image 211 in the interface 250.

[0064] In some embodiments, objects matching the target object can be retrieved from a candidate object database using a search algorithm. For example, if it is determined that the image 211 captured by user 132 includes object A (e.g., a handbag), and terminal device 130 receives a selection of any one of the interactive interface elements 221, 231, or entry control 212 indicating object A, it can present different styles of bags on a second interface (such as example interface 250). For example, objects 251, 252, 253, 254, etc., associated with object A can be presented on the second interface (such as example interface 250).

[0065] In some embodiments, if the terminal device 130 determines that the captured image includes a target object, it can perform a search task based on the target object (e.g., the name of the target object, or the image corresponding to the target object) to determine a set of objects matching the target object. In some examples, if the terminal device 130 receives a selection of interactive interface element 221 or interactive interface element 231 corresponding to object A (e.g., a bag), it can perform a search task based on the name of object A or the image corresponding to object A. Furthermore, the terminal device 130 can present different styles of bags matching object A in a second interface (such as example interface 250). For example, by detecting that the user 132 clicks on any one of the interactive interface elements 221 or 231 corresponding to object A, different styles of bags can be viewed.

[0066] In some embodiments, at least a portion of the second interface is presented in association with at least a portion of the first interface. In some embodiments, the terminal device 130 may present at least a portion of the second interface (e.g., example interface 250) in a 7-screen split format in association with the first interface. In some embodiments, the terminal device 130 may present interface 250 (e.g., example interface 200E) in a 7-screen split format associated with a captured image. In some embodiments, the terminal device 130 may present the second interface in a predetermined ratio if it receives a trigger associated with the second interface. If the terminal device 130 receives an up swipe operation on interface 250 in interface 200E, it may present interface 250 in full screen. The terminal device 130 may present all objects associated with object A in interface 250.

[0067] In some embodiments, the first interactive interface element, the second interactive interface element, and the third interactive interface element can all be presented in the first interface (e.g., example interfaces 200A, 200B, 200C, and 200D). In these scenarios, the media content included in the first interface can be in a playback state. It is understood that after receiving the operation from user 132 to capture an image, the media content in the first interface can be in a playback state while the terminal device 130 is presenting the first interactive interface element, the second interactive interface element, or the third interactive interface element in the first interface.

[0068] In some embodiments, if the terminal device 130 receives a selection of a second interactive interface element, it can present a return control associated with the second interface. In some examples, if the terminal device 130 receives a selection of either the second or any third interactive interface element, it can present a return control associated with the second interface. As shown in the example interfaces 200B / 200C and 200E of Figures 2B / 2C and 2E, if the terminal device 130 receives a selection of either interactive interface element 221 or interactive interface element 231, it can present a return control 255 associated with the second interface (e.g., interface 250).

[0069] Furthermore, if terminal device 130 receives a trigger on the return control, it can cancel the presentation of the second interface and present a complete portion of the first interface, which includes a third interactive interface element. As shown in the example interfaces 200E and 200D of Figures 2E and 2D, if terminal device 130 receives a trigger on the return control 255, it can cancel the presentation of interface 250 and present interface 200D, which includes interactive interface element 231. It is understood that when user 132 enters the second interface (e.g., interface 250) from interactive interface element 221 or any interactive interface element 221, if terminal device 130 detects that user 132 clicks the return control 255, it can present the first interface including interactive interface element 231 (e.g., example interface 200D).

[0070] Additionally, if user 132 enters a second interface (e.g., interface 250) from interactive interface element 210 and terminal device 130 determines that target object 215 exists in image 211, terminal device 130 may present a first interface (e.g., example interface 200D) including interactive interface element 231 if it detects that user 132 clicks the return control 255. If user 132 enters a second interface (e.g., interface 250) from interactive interface element 210 and terminal device 130 determines that target object 215 does not exist in image 211, terminal device 130 may present a first interface (e.g., an interface where media content is presented) if it detects that user 132 clicks the return control 255.

[0071] In this way, upon receiving an image capture of media content, object recognition can be performed on the captured image, and interactive interface elements corresponding to the recognized objects can be provided. This provides users with more prominent interactive interface elements to indicate objects, thereby improving data conversion rates. Furthermore, users can view other related objects that match the objects identified from the image through these interactive interface elements, thus enhancing the user experience.

[0072] Example process

[0073] Figure 3 shows a flowchart of a process 300 for object presentation according to some embodiments of the present disclosure. Process 300 can be implemented at a terminal device 130. Process 300 is described below with reference to Figure 1.

[0074] In box 310, in response to an operation for capturing an image of media content, terminal device 130 presents a first interactive interface element in a first interface corresponding to the media content, the first interactive interface element at least presenting the captured image.

[0075] In box 320, in response to the captured image including a target object, terminal device 130 presents a second interactive interface element that indicates the target object in association with the first interactive interface element.

[0076] In box 330, terminal device 130 presents at least a portion of a set of objects that match the target object in the second interface based on a trigger associated with a second interactive interface element.

[0077] In some embodiments, presenting at least a portion of a set of objects matching the target object in the second interface includes: in response to selection of a second interactive interface element, presenting at least a portion of a set of objects matching the target object in the second interface.

[0078] In some embodiments, presenting a first interactive interface element and a second interactive interface element at a first position on a first interface, and presenting at least a portion of a set of objects matching a target object on a second interface includes: de-presenting the first interactive interface element and the second interactive interface element during a first time period, and presenting a third interactive interface element indicating the target object at a second position on the first interface; and, in response to the selection of the third interactive interface element, presenting at least a portion of a set of objects matching the target object on the second interface.

[0079] In some embodiments, the first and second interactive interface elements that are presented together are de-presented according to a first predetermined rule, which indicates how the visual attributes of the first and second interactive interface elements are changed.

[0080] In some embodiments, presenting a third interactive interface element that indicates a target object includes: presenting the third interactive interface element according to a second predetermined rule, wherein the second predetermined rule indicates how the visual attributes of the third interactive interface element are changed.

[0081] In some embodiments, at least one of the following is presented in the second or third interactive interface element: a thumbnail of the target object, or object information associated with the target object.

[0082] In some embodiments, the object information presented in the second or third interactive interface element includes: in response to the number of objects matching the target object being less than a first predetermined number, the object information includes description information; in response to the number of objects matching the target object being greater than the first predetermined number and less than a second predetermined number, the object information includes description information and a first number information, wherein the first predetermined number is less than the second predetermined number; or in response to the number of objects matching the target object being greater than the second predetermined number, the object information includes description information and a second number information.

[0083] In some embodiments, at least a portion of the second interface is presented in association with at least a portion of the first interface, and the media content presented in the first interface is in a playback state.

[0084] In some embodiments, process 300 further includes: in response to selection of a second interactive interface element, presenting a return control associated with the second interface; and in response to triggering of the return control, canceling the presentation of the second interface and presenting a complete portion of the first interface, wherein the first interface includes a third interactive interface element.

[0085] In some embodiments, presenting a second interactive interface element indicating a target object in association with a first interactive interface element includes determining, based on at least one of the following: the type of the target object is a queryable object type, media content is associated with an access point of the target object, or the degree of association between the target object and the user.

[0086] Example devices and equipment

[0087] Embodiments of this disclosure also provide corresponding apparatus for implementing the above methods or processes.

[0088] Figure 4 shows a schematic structural block diagram of an object presentation apparatus 400 according to certain embodiments of the present disclosure. The apparatus 400 may be implemented as or included in the terminal device 130. The various modules / components in the apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0089] As shown in Figure 4, the device 400 includes a first interactive interface element presentation module 410, configured to present a first interactive interface element in a first interface corresponding to the media content in response to an operation for capturing an image of the media content. The first interactive interface element at least presents the captured image. The device 400 also includes a second interactive interface element presentation module 420, configured to present a second interactive interface element indicating the target object in association with the first interactive interface element in response to the captured image including a target object. The device 400 also includes an object presentation module 430, configured to present at least a portion of a set of objects matching the target object in a second interface based on a trigger associated with the second interactive interface element.

[0090] In some embodiments, the object rendering module 430 is further configured to, in response to the selection of a second interactive interface element, render at least a portion of a set of objects that match the target object in the second interface.

[0091] In some embodiments, a first interactive interface element and a second interactive interface element are presented at a first position on a first interface, and the object presentation module 430 is further configured to cancel the presentation of the first interactive interface element and the second interactive interface element during a first time period, and present a third interactive interface element indicating a target object at a second position on the first interface; and in response to the selection of the third interactive interface element, present at least a portion of a set of objects matching the target object in a second interface.

[0092] In some embodiments, the first and second interactive interface elements that are presented together are de-presented according to a first predetermined rule, which indicates how the visual attributes of the first and second interactive interface elements are changed.

[0093] In some embodiments, the device 400 further includes a third interactive interface element presentation module configured to present a third interactive interface element according to a second predetermined rule, the second predetermined rule indicating how the visual attributes of the third interactive interface element are changed.

[0094] In some embodiments, at least one of the following is presented in the second or third interactive interface element: a thumbnail of the target object, or object information associated with the target object.

[0095] In some embodiments, the object information presented in the second or third interactive interface element includes: in response to the number of objects matching the target object being less than a first predetermined number, the object information includes description information; in response to the number of objects matching the target object being greater than the first predetermined number and less than a second predetermined number, the object information includes description information and a first number information, wherein the first predetermined number is less than the second predetermined number; or in response to the number of objects matching the target object being greater than the second predetermined number, the object information includes description information and a second number information.

[0096] In some embodiments, at least a portion of the second interface is presented in association with at least a portion of the first interface, and the media content presented in the first interface is in a playback state.

[0097] In some embodiments, the device 400 further includes an interface presentation module configured to, in response to the selection of a second interactive interface element, present a return control associated with the second interface; and, in response to the triggering of the return control, cancel the presentation of the second interface and present a complete portion of the first interface, wherein the first interface includes a third interactive interface element.

[0098] In some embodiments, the second interactive interface element presentation module 420 is further configured to determine, based on at least one of the following, to present a second interactive interface element indicating a target object in association with the first interactive interface element: the type of the target object belongs to a queryable object type, the media content is associated with the access point of the target object, or the degree of association between the target object and the user.

[0099] The units and / or modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units and / or modules in device 400 can be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-chips (SoCs), complex programmable logic devices (CPLDs), and so on.

[0100] It should be understood that one or more steps in the above methods can be performed by suitable electronic devices or combinations of electronic devices. Such electronic devices or combinations of electronic devices may, for example, include the terminal device 130 in FIG1.

[0101] Figure 5 shows a block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 500 shown in Figure 5 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device 500 shown in Figure 5 can be used to implement the terminal device 130 of Figure 1.

[0102] As shown in Figure 5, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processors 510 or processing units, memory 520, storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0103] Electronic device 500 typically includes multiple computer storage media. Such media can be any available media accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data and accessible within electronic device 500.

[0104] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0105] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0106] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0107] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0108] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0109] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0110] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0111] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0112] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for object rendering, comprising: In response to an operation for capturing an image of media content, a first interactive interface element is presented in a first interface corresponding to the media content, wherein the first interactive interface element at least presents the captured image. In response to the captured image including a target object, a second interactive interface element indicating the target object is presented in association with the first interactive interface element; as well as Based on a trigger associated with the second interactive interface element, at least a portion of a set of objects matching the target object are presented in the second interface.

2. The method of claim 1, wherein presenting at least a portion of a set of objects matching the target object in the second interface comprises: In response to the selection of the second interactive interface element, at least a portion of a set of objects that match the target object are presented in the second interface.

3. The method according to any one of claims 1 to 2, wherein the first interactive interface element and the second interactive interface element are presented at a first position on the first interface, and at least a portion of a set of objects matching the target object are presented on the second interface, comprising: During the first time period, the first interactive interface element and the second interactive interface element are canceled from being displayed, and a third interactive interface element indicating the target object is displayed at a second position on the first interface. as well as In response to the selection of the third interactive interface element, at least a portion of a set of objects matching the target object are presented in the second interface.

4. The method of claim 3, wherein the first interactive interface element and the second interactive interface element that are associated with each other are de-presented according to a first predetermined rule, the first predetermined rule indicating how the visual attributes of the first interactive interface element and the second interactive interface element are changed.

5. The method of claim 3, wherein presenting a third interactive interface element indicating the target object comprises: The third interactive interface element is presented in accordance with a second predetermined rule, wherein the second predetermined rule indicates how the visual attributes of the third interactive interface element are changed.

6. The method according to claim 1 or 3, wherein at least one of the following is presented in the second interactive interface element or the third interactive element: The thumbnail of the target object, or The object information associated with the target object.

7. The method according to claim 6, wherein the object information presented in the second interactive interface element or the third interactive interface element includes: In response to the fact that the number of objects matching the target object is less than a first predetermined number, the object information includes the description information; In response to a situation where the number of objects matching the target object is greater than a first predetermined number and less than a second predetermined number, the object information includes the description information and a first number information, wherein the first predetermined number is less than the second predetermined number; or In response to the number of objects matching the target object being greater than the second predetermined number, the object information includes the description information and the second number information.

8. The method according to any one of claims 1 to 7, wherein at least a portion of the second interface is presented in association with at least a portion of the first interface, and the media content presented in the first interface is in a playback state.

9. The method according to claim 3, further comprising: In response to the selection of the second interactive interface element, a return control associated with the second interface is presented; as well as In response to the triggering of the return control, the presentation of the second interface is canceled and a complete portion of the first interface is presented, wherein the first interface includes the third interactive interface element.

10. The method according to any one of claims 1 to 9, wherein presenting a second interactive interface element indicating the target object in association with the first interactive interface element comprises: A second interactive interface element indicating the target object is presented in association with the first interactive interface element based on at least one of the following: The target object is of the type of a queryable object. The media content is associated with the access point of the target object, or The degree of association between the target object and the user.

11. An apparatus for object rendering, comprising: A first interactive interface element presentation module is configured to present a first interactive interface element in a first interface corresponding to the media content in response to an operation for capturing an image of media content. The first interactive interface element at least presents the captured image. The second interactive interface element presentation module is configured to, in response to the captured image including a target object, present a second interactive interface element that indicates the target object in association with the first interactive interface element. as well as An object rendering module is configured to render at least a portion of a set of objects that match the target object in a second interface based on a trigger associated with the second interactive interface element.

12. An electronic device, comprising: At least one processor; as well as At least one memory, coupled to the at least one processor and storing instructions for execution by the at least one processor, which, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1 to 10.

13. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 10.

14. A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 10.

Images