Method and apparatus for object presentation, and device and storage medium

Abstract

A method and apparatus for object presentation, and a device and a storage medium. The method comprises: in response to pausing media content that is in a playing state, presenting at least a first interactive interface element; in response to the triggering of the first interactive interface element, presenting a first interface, wherein the first interface comprises an image corresponding to the media content when the media content is paused; and in response to having received by means of the first interface the selection of at least part of an image region of the image, presenting a set of objects that matches a target object in the at least part of the image region.

Description

Methods, apparatus, devices, and storage media for object rendering

[0001] This application claims priority to Chinese Patent Application No. 202510238217.4, filed on February 28, 2025, entitled "Method, Apparatus, Device and Storage Medium for Object Presentation", the entire contents of which are incorporated herein by reference. Technical Field

[0002] The exemplary embodiments disclosed herein relate generally to the field of computers, and more particularly to methods, apparatuses, devices, and computer-readable storage media for object rendering. Background Technology

[0003] With the rapid development of the internet, more and more applications are designed to provide users with various services. For example, applications can provide search services. Applications can obtain search requests from users (e.g., when a user clicks on a search entry point) and provide search results corresponding to that request. Therefore, continuous exploration of the accuracy of search results is necessary to improve the user experience. Summary of the Invention

[0004] In a first aspect of this disclosure, a method for object rendering is provided, comprising: rendering at least a first interactive interface element in response to a pause trigger of media content in a playback state; rendering a first interface in response to the trigger of the first interactive interface element, the first interface including an image corresponding to the paused state in the media content; and rendering a set of objects matching a target object in the at least partial image region in response to receiving a selection of at least a partial image region of the image via the first interface.

[0005] In a second aspect of this disclosure, an apparatus for object rendering is provided, comprising: an interactive interface element rendering module configured to render at least a first interactive interface element in response to a pause trigger of media content in a playback state; an interface rendering module configured to render a first interface in response to the trigger of the first interactive interface element, the first interface including an image corresponding to the pause in the media content; and an object rendering module configured to render a set of objects matching a target object in at least a portion of the image region in response to receiving a selection of at least a portion of the image region via the first interface.

[0006] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0008] According to a fifth aspect of this disclosure, a computer program product is provided, including computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method of the first aspect.

[0009] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0011] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] Figures 2A to 2G illustrate schematic diagrams of example interfaces for object rendering according to some embodiments of the present disclosure;

[0013] Figure 3 shows a flowchart of a process for object rendering according to some embodiments of the present disclosure;

[0014] Figure 4 shows a block diagram of an apparatus for object rendering according to some embodiments of the present disclosure; and

[0015] Figure 5 shows a block diagram of an apparatus capable of implementing one or more embodiments of the present disclosure. Detailed Implementation

[0016] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0017] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0018] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0019] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0020] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and user authorization should be obtained.

[0021] For example, in response to receiving a user's active request, a prompt message is sent to the user to clearly inform the user that the requested operation will require the acquisition and use of the user's personal information, thereby enabling the user to choose whether to provide personal information to the software or hardware such as electronic devices, applications, servers or storage media that perform the operation of the technical solution disclosed herein, based on the prompt message.

[0022] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0023] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0024] As briefly mentioned earlier, applications can provide users with search services. Typically, for media content that is playing (e.g., video), if the user pauses the video, a search entry can be presented, allowing the user to search for objects appearing in the media content. However, in this case, because object recognition is automatically performed based on the current content, the identified subjects may be inaccurate, making it difficult for users to search for objects they are truly interested in.

[0025] In view of this, this disclosure proposes an improved scheme for object presentation. According to an embodiment of this disclosure, if a pause trigger is received for media content in a playback state, at least a first interactive interface element is presented. Further, if a trigger is received for the first interactive interface element, a first interface is presented, the first interface including the image corresponding to the paused state in the media content. Accordingly, if a selection of at least a portion of the image region is received via the first interface, a set of objects matching a target object within the at least portion of the image region is presented.

[0026] This method allows users to select any area of ​​interest from the paused interface to perform object recognition, and then determine the objects included in that area for object searching. The found matching objects are then presented. This enables users to accurately locate objects of interest for searching, improving the user experience.

[0027] In this disclosure, "trigger" refers to one or more interactive actions performed by a user on a terminal device. Furthermore, these interactive actions may be triggered within the same user interface / pop-up window or within different user interfaces / pop-up windows. This disclosure is not limited in this respect.

[0028] In this disclosure, "object" can refer to any physical or virtual object, including but not limited to physical or virtual goods, media works, etc.

[0029] Example embodiments of this disclosure are described below with reference to the accompanying drawings.

[0030] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In this example environment 100, an instance of application 120 is installed on terminal device 130. User 132 can interact with application 120 via an attachment device of terminal device 130. Similarly, user 132 can interact with application 120 via an attachment device of terminal device 130.

[0031] In some embodiments, application 120 can be any suitable application that can provide search services to user 132. As an example, application 120 can be a search-type or query-type application. As another example, application 120 can be an instant messaging (IM) application. It should be understood that the above are merely examples of application 120 and are not intended to be limiting; application 120 can be any suitable type of application that provides search services. In environment 100 of Figure 1, if application 120 is active, terminal device 130 can present the interface 150 of application 120. Interface 150 can include various types of pages that application 120 can provide, such as search pages, query pages, search result display pages, etc.

[0032] In some embodiments, terminal device 130 communicates with server 110 to provide services to application 120. Terminal device 130 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 130 can also support any type of user-facing interface (such as "wearable" circuitry). Server 110 can be various types of computing systems / servers capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, etc.

[0033] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0034] Various exemplary implementations of this disclosure will now be described in detail with reference to the accompanying drawings. It should be understood that the pages shown in the drawings are merely examples, and various page designs are possible in practice. The various graphic elements on the page may have different arrangements and different visual representations, one or more elements may be omitted or replaced, and one or more other elements may also be present. The embodiments of this disclosure are not limited in this respect. Furthermore, in the following description, exemplary embodiments will be primarily referred to with respect to terminal device 130. It should be understood that the actions described with respect to terminal device 130 may be performed by application 120 on terminal device 130, or may be performed by application 120 in collaboration with its server (e.g., server 110). In some embodiments, in a scenario where the actions are performed by terminal device 130 in collaboration with its server (e.g., server), terminal device 130 may request the server to provide an object to be presented, and receive the determined object from the server for presentation on the target page.

[0035] Figures 2A to 2G illustrate schematic diagrams of example interfaces 200A to 200G for object rendering according to some embodiments of the present disclosure.

[0036] In embodiments of this disclosure, terminal device 130 can play media content. In some embodiments, the media content can be playable content such as video, a dynamically played collection of images, animated images, etc. The media content can be provided in any suitable application or platform of terminal device 130. During the playback of media content, if a pause trigger is received for the media content that is in playback state, at least a first interactive interface element is presented.

[0037] As shown in the example interface 200A of Figure 2A, the terminal device 130 presents media content (e.g., video) and, upon receiving a pause trigger for the playing media content, presents an interactive interface element 211. In some embodiments, the interactive interface element 211 can be configured to perform object recognition on a selected image region using a first object recognition mode. This first object recognition mode is configured to perform object recognition on the selected image region. That is, if the terminal device 130 receives a selection of a portion of the image region from the user 132, it can perform object recognition on the selected image region to detect whether an object exists in that image region.

[0038] In some embodiments, if the terminal device 130 receives a pause trigger for media content that is currently playing, it can present multiple interactive interface elements, each of which is configured to trigger a corresponding object recognition mode. As shown in FIG2A, if a pause trigger is received for media content that is currently playing, in addition to interactive interface element 211, the terminal device 130 can also present interactive interface elements 213, 212, and 214. In some examples, interactive interface elements 211, 212, 213, and 214 can be presented in a list format in interface 200A. The following will describe in detail, with reference to the accompanying drawings, how the terminal device 130 presents objects based on different interactive interface elements.

[0039] In embodiments of this disclosure, if the terminal device 130 receives a trigger on a first interactive interface element, it presents a first interface, which includes the image corresponding to when the media content is paused. As shown in example interfaces 200A to 200B of Figures 2A and 2B, when the media content is paused, if the terminal device 130 receives a trigger on interactive interface element 211, it can present interface 200B. In some embodiments, other interface elements appearing during media content playback can be de-presented, and only the image included in the page corresponding to when the current media content is paused is presented in interface 200B. For example, interface 200B may include the image included in the corresponding video frame when the video is paused, or the image corresponding to when a dynamically playing image set is paused.

[0040] Referring to Figures 2A and 2B, if the terminal device 130 receives a trigger on the interactive interface element 211, it can present a prompt message 221 in the interface 200B. The prompt message 221 can be configured to prompt the user 132 to select at least a portion of the image area. It is understood that the prompt message 221 is used to prompt the user 132 to select a portion of the image area. In some examples, the user 132 can select a portion of the image area by circling, for example, by selecting the area 223 that meets their needs in the interface 200B. In some examples, the user 132 can select a portion of the image area using gestures, a mouse, a stylus, etc. This is merely exemplary, and this disclosure does not limit it.

[0041] In embodiments of this disclosure, if terminal device 130 receives a selection of at least a portion of an image region via a first interface, it presents a set of objects matching a target object within that portion of the image region. For example, if terminal device 130 receives a trigger on interactive interface element 211, it can receive a selection of a portion of the image region 223 via interface 200B in a first object recognition mode. It is understood that if terminal device 130 receives a selection of a portion of the image region 223, it can perform object recognition on that portion of the region 223, thereby presenting a set of objects matching the recognized target object. The objects matching the target object can be retrieved from a candidate object database using a search algorithm.

[0042] For example, if terminal device 130 receives a request from user 132 to select object A (e.g., a shirt), it can directly present different types of shirts on the second interface (e.g., example interface 250). As another example, if terminal device 130 receives a request from user 132 to select object A and object B (e.g., a bow tie), it can directly present different types of shirts and different types of bow ties on the second interface (e.g., example interface 250). This allows users to conveniently and quickly retrieve more other objects that match the objects (e.g., products) in the media content they are viewing. The following will describe in detail how a set of objects matching a target object is presented with reference to Figures 2E to 2G.

[0043] In some embodiments, if the terminal device 130 receives a selection of at least a portion of an image region via a first interface, it performs object recognition on at least the selected portion of the image region and presents at least one first object identified from the image region. In some examples, if the terminal device 130 receives a selection of a portion of an image region 223, it can perform object recognition on the portion of the image region 223, thereby identifying at least one first object from the portion of the image region 223. For example, if the terminal device 130 receives a selection from user 132 that includes object A (e.g., a shirt) and object B (e.g., a bow tie), it can present object A and object B. In some embodiments, as shown in example interface 200C or example interface 200D of FIG. 2C or FIG. 2D, the terminal device 130 can present a thumbnail 231 of the identified object A and a thumbnail of object B in the interface (such as example interface 200C / 200D). The thumbnails here can be generated based on images captured from media content, or they can be thumbnails pre-configured for the same type of object. In some embodiments, in addition to presenting thumbnails, object identification results can be indicated in any other appropriate manner, such as object identifiers, object names, types, etc. The object identification results (thumbnails, names, etc.) can be configured as interactive entry controls to be triggered by the user to present more objects.

[0044] Furthermore, if the terminal device 130 receives a trigger for a target object among at least one first object, it can present a set of objects matching the target object in a second interface. In some embodiments, if the terminal device 130 receives a selection of a target object from the user 132, it can perform a search task based on the target object (e.g., the name of the target object, the image corresponding to the target object) to determine a set of objects matching the target object. In some examples, if the terminal device 130 detects a selection of object A (e.g., a shirt) by the user 132, it can perform a search task based on the name of object A or the image corresponding to object A. Furthermore, the terminal device 130 can present different types of shirts matching object A in a second interface (such as example interface 250). For example, by detecting that the user clicks on the thumbnail 231 corresponding to object A, different types of shirts can be viewed.

[0045] In some embodiments, terminal device 130 may also present at least one second object. That is, terminal device 130 may present at least one second object identified by it from a region in the image other than the selected at least part of the image region. As shown in Figures 2B and 2D, terminal device 130 may determine object C (e.g., shoes) and object D (e.g., pants) from a region in the image other than the selected at least part of the image region 223, and then present thumbnails 241 corresponding to object C and 242 corresponding to object D in interface 200D.

[0046] In some embodiments, terminal device 130 may also display at least one second object identified from the media content. For example, terminal device 130 may identify other objects from the media content and display thumbnails 242 corresponding to the other objects in interface 200D.

[0047] Furthermore, if the terminal device 130 receives a trigger for another target object among at least one second object, it presents a set of objects that match the other target object. Referring to FIG2D, if the terminal device 130 receives a trigger for object A among objects A, C, and D, it can present a set of objects that match object A. For example, user 132 can click on the thumbnail 231 corresponding to object A (e.g., a shirt) to view similar objects of object A.

[0048] In some embodiments, the terminal device 130 may present at least one second object after at least one first object identified in at least a portion of the image area has been presented. In some examples, the terminal device 130 may present at least one object according to a predetermined rule (e.g., priority). The priority of at least one first object is higher than the priority of at least one second object.

[0049] In some embodiments, the terminal device 130 may prioritize identifying and presenting at least one object included in an image region selected by the user, and then continue to perform object recognition in other regions of the image, presenting one or more objects identified from those other regions. Furthermore, it may also continue to perform object recognition on content in the media content before or after the current pause position, presenting objects identified at that position. That is, the priority of object recognition and presentation in other regions of the paused image is greater than the priority of object recognition and presentation in other parts of the media content.

[0050] The following description continues with reference to Figures 2B to 2D, illustrating the animation of the terminal device 130 in the process of determining a set of objects that match the target object. It should be understood that the animations described in this disclosure are merely exemplary and are not intended to be limiting. For example, any other suitable visual guidance may be used to inform the user which region of objects is currently being identified.

[0051] In some embodiments, after receiving a selection of at least a portion of image region 223 on a first interface (such as example interface 200B), terminal device 130 may present a first animation associated with at least one object in the image on the first interface (such as example interface 200C). As shown in example interface 200C in FIG2C, during the process of identifying object A, terminal device 130 may present a stroke animation 233 on interface 200C to indicate to user 132 that they are currently in the process of identifying object A. In some examples, the stroke animation indicates that during the process of identifying an object, a contour is dynamically drawn along the edge lines of the object on the interface, for example, by presenting dynamic lighting effects at the edge of the object. Of course, this is just an example, and any other animation effects can be configured according to the specific application to make it easier for the user to notice the currently identified object.

[0052] In some embodiments, after presenting at least one first object, the terminal device 130 may present a first animation for at least one second object in a first interface (such as example interface 200D) during the process of identifying at least one second object. For example, after the terminal device 130 identifies object A, during the process of identifying object C, a stroke animation 245 may be presented in interface 200D to indicate to the user 132 that they are currently in the process of identifying object C. In some examples, the terminal device 130 may present the stroke animation according to predetermined rules (e.g., a rule of "rotating counterclockwise from the upper left and scrolling cyclically"). Of course, this is just an example, and any other animation effects can be configured according to the specific application.

[0053] Terminal device 130 can present a second animation associated with the first interface (such as example interface 200C). For example, during the process of identifying object A, terminal device 130 can present an overall screen lighting effect 232 on interface 200C to indicate to user 132 that they are currently in the process of identifying object A. Understandably, if terminal device 130 receives a selection of at least a portion of the image area 223, it can diffuse the lighting effect from the center of interface 200C, amplify the effect, and then disappear; this process repeats cyclically. Of course, this is just an example; any other animation effects can be configured according to the specific application.

[0054] Terminal device 130 can also present prompts indicating the object recognition status on a first interface (such as example interface 200C). For example, during the process of recognizing object A, terminal device 130 can present prompt 234 on interface 200C to inform user 132 that they are currently in the process of identifying object A.

[0055] The following description, referring to Figures 2E to 2G, describes how terminal device 130 presents at least a portion of the objects from at least one set of objects that match the target object.

[0056] In some embodiments, if the terminal device 130 receives a selection of an indicated partial image region via a first interface, it may at least partially present a second interface after a first time period. Accordingly, the terminal device 130 may present at least a portion of a set of objects matching the target object in the second interface. In some embodiments, after receiving a selection of at least a partial image region, the terminal device 130 identifies a set of objects matching the object corresponding to that at least partial image region. It is understood that the terminal device 130 may present the second interface at different proportions (such as example interface 250) after a period of time (e.g., N seconds) to present a portion of the set of objects matching the target object in the second interface.

[0057] In some embodiments, terminal device 130 may present at least a portion of the second interface that matches the first interface. At this time, the media content presented in the first interface is playable, meaning that while presenting the matching object, the user can also decide whether to continue playing the media content as needed. As shown in example interface 200E of FIG2E, after receiving a selection of at least a portion of the image area, and after a period of time (e.g., after a group of objects matching object A has been identified), terminal device 130 may present interface 250 according to a first ratio. That is, the first interface (e.g., interface 253) shrinks and moves upwards, presenting interface 250 in the lower area of ​​interface 200E. Terminal device 130 may present objects 251, 252, etc., that match object A in interface 250. In this scenario, if terminal device 130 detects that user 132 swipes down or drags interface 250, it may present the first interface.

[0058] In some embodiments, as shown in the example interface 200F of FIG2F, after receiving a selection of at least a portion of an image region, and after a period of time (e.g., after a set of objects matching at least one first object and at least one second object have been identified respectively), the terminal device 130 can present the interface 250 at a second ratio. That is, the first interface shrinks and moves upward, presenting more of the interface 250 in the lower area of ​​the interface 200F. The second ratio can be greater than the first ratio. For example, after a period of time, the interface 250 can be automatically presented in a 7-screen split style so that the user can see more matching objects from the interface 250. At this time, the terminal device 130 can present objects 251, 252, 261, 262, etc., that match object A in the interface 250. In this scenario, if the terminal device 130 detects that the user 132 swipes down or drags the interface 250, it can present the first interface.

[0059] In some embodiments, terminal device 130 may present object information associated with each of at least one second object. Correspondingly, terminal device 130 may also present object information associated with each of at least one first object. It is understood that, for a set of objects that terminal device 130 has determined to match each of these objects, terminal device 130 may present object information for any object in the interface. Object information may include a thumbnail of the object, an identifier (name, type, etc.), and / or the time the object appears in the media content.

[0060] As shown in the example interface 200F of Figure 2F, assuming the terminal device 130 has identified a set of objects that match objects A, C, D, etc., the terminal device 130 can display object information 263 for object A, object information 264 for object C, and all controls 265 on the interface. Object information 263 includes a thumbnail 231 of object A, the time object A appears in the media content 266, and text information 268. Object information 264 includes a thumbnail 241 of object C, the time object C appears in the media content 267, and text information 269.

[0061] User 132 can click on all controls 265 to view a set of objects that the terminal device 130 has identified as matching any given object. In some examples, the terminal device 130 may present the object information for each object in a list format. Accordingly, user 132 can also swipe the list in a predetermined manner (e.g., left-right, up-down, etc.) to view a set of objects that match any given object. In some embodiments, the terminal device 130 may display a progress bar 266 associated with the interface 250 to indicate that at least one object has been identified. In some examples, user 132 can drag or click on the progress bar 266 to view the object information for each object.

[0062] In some embodiments, terminal device 130 may also display navigation labels corresponding to at least one object category from a set of objects in area 254 included in interface 250. In some examples, if terminal device 130 determines a set of objects that match object A, it may display navigation labels corresponding to object A in area 254, such as a "Similar Products" navigation label. In other examples, if terminal device 130 determines a set of objects that match at least one object, it may display navigation labels corresponding to at least one object category in area 254. For example, "All" navigation label, "Object A" navigation label, "Object B" navigation label, "Comprehensive" navigation label, etc. In some examples, terminal device 130 may default to displaying a set of objects matching at least one object under the "All" navigation label.

[0063] In some embodiments, if the terminal device 130 receives a trigger associated with the second interface, it can present the second interface at a third ratio, where the third ratio is greater than the second ratio. As shown in the example interfaces 200F to 200G of Figures 2F to 2G, if the terminal device 130 receives an up-swipe operation on interface 250 in interface 200F, it can present interface 250 in full-screen mode in interface 200G. The terminal device 130 can present objects 251, 252, 261, 262, 271, 272, etc., associated with objects such as object A, object C, etc., in interface 250.

[0064] In some examples, terminal device 130 may present object information of at least one object in region 273. In some embodiments, if terminal device 130 detects a user 132 swiping down the full screen, it may present interface 250 in a 7-screen split style (such as example interface 200F).

[0065] The following description, with reference to the accompanying drawings, continues to describe how the terminal device 130 presents objects based on different entry controls.

[0066] In some embodiments, if terminal device 130 receives a trigger on a second interactive interface element for indicating a third object identified from an image, it can present a set of objects matching the third object. As shown in example interface 200A of FIG2A, when the media content is paused, terminal device 130 can present an interactive interface element 212 for indicating a C object (e.g., shoes) identified from an image. If terminal device 130 receives a trigger on interactive interface element 212, it can present a set of objects matching the C object in interface 250. Correspondingly, when the media content is paused, terminal device 130 can also present an interactive interface element 213 for indicating an A object (e.g., a shirt) identified from an image. If terminal device 130 receives a trigger on interactive interface element 213, it can present a set of objects matching the A object in interface 250. In some embodiments, if terminal device 130 receives a trigger on a second interactive interface element for indicating a third object identified from an image, it can present a set of objects matching the third object in a second object recognition mode. The second object recognition mode is configured to perform object recognition on a specific object in an image. For example, in the example of Figure 2A, if the terminal device 130 receives a click from the user 132 on the interactive interface element 212, it can search for a set of objects that match object C and present them to the user.

[0067] In some embodiments, if the terminal device 130 receives a trigger on a third interactive interface element used to indicate all objects identified from the media content, it can present a set of objects matching all the objects in a third object recognition mode. The third object recognition mode is configured to perform object recognition on all objects identified in the media content. As shown in FIG2A, when the media content is paused, the terminal device 130 can also present an interactive interface element 214 used to indicate all objects identified from the media content. If a trigger is received on the interactive interface element 214, the terminal device 130 can present a set of objects in interface 250 that each matches all the objects.

[0068] In this way, users can freely select a region that meets their needs on the first interface. The terminal device can then determine the objects included in that region based on the user's selection, thereby improving the accuracy of object recognition. Furthermore, this disclosure can identify other objects that match the selected object and also supports users in quickly previewing / switching multiple objects that match other objects included in the media content, thus enhancing the user experience.

[0069] Figure 3 shows a flowchart of a process 300 for object presentation according to some embodiments of the present disclosure. Process 300 can be implemented at a terminal device 130. Process 300 is described below with reference to Figure 1.

[0070] In frame 310, terminal device 130, in response to a pause trigger on media content that is in playback, presents at least a first interactive interface element.

[0071] In frame 320, terminal device 130 responds to a triggering of a first interactive interface element by presenting a first interface, which includes an image corresponding to when the media content is paused.

[0072] In box 330, in response to receiving a selection of at least a portion of an image region via a first interface, terminal device 130 presents a set of objects that match a target object in at least a portion of the image region.

[0073] In some embodiments, presenting a set of objects that match a target object in at least a portion of an image region includes: in response to receiving a selection of at least a portion of an image region via a first interface, presenting at least one first object identified from at least a portion of the image region; and in response to triggering a target object among at least one first object, presenting a set of objects that match the target object in a second interface.

[0074] In some embodiments, process 300 further includes: presenting at least one second object, wherein at least one second image is identified from a region of an image other than a selected at least portion of the image region or from another image in the media content; and in response to a triggering of another target object among the at least one second object, presenting a set of objects that match the other target object.

[0075] In some embodiments, after at least one first object identified in at least a portion of the image area is presented, at least one second object is presented.

[0076] In some embodiments, presenting at least one second object includes: presenting object information associated with each of the at least one second object, the object information including at least one of the following: a thumbnail of the second object, an identifier of the second object, or the time when the second object appears in the media content.

[0077] In some embodiments, process 300 further includes: in response to receiving a selection of at least a portion of an image region in the image via a first interface, presenting at least one of the following in the first interface: a first animation associated with at least one object in the image, a second animation associated with the first interface, or a first prompt indicating an object recognition status.

[0078] In some embodiments, presenting a set of objects that match a target object in at least a portion of an image region includes: in response to receiving a selection of at least a portion of an image region via a first interface, presenting at least a portion of a second interface after a first time period; and presenting at least a portion of the set of objects that match the target object in the second interface.

[0079] In some embodiments, at least a portion of the second interface is presented in association with the first interface, and the media content presented in the first interface is playable.

[0080] In some embodiments, process 300 further includes: in response to triggering a first interactive interface element, presenting a second prompt message on the first interface, the second prompt message being configured to prompt a selection method for at least a portion of an image region in the image.

[0081] In some embodiments, process 300 further includes: in response to a pause trigger on media content in playback, presenting a first interactive interface element and a second interactive interface element, the second interactive interface element being matched with a third object identified from an image; and in response to a trigger on the second interactive interface element, presenting a set of objects that match the third object.

[0082] Embodiments of this disclosure also provide corresponding apparatus for implementing the above methods or processes.

[0083] Figure 4 shows a schematic structural block diagram of an object presentation apparatus 400 according to certain embodiments of the present disclosure. The apparatus 400 may be implemented as or included in the terminal device 130. The various modules / components in the apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0084] As shown in Figure 4, the device 400 includes an interface element presentation module 410, configured to present at least a first interactive interface element in response to a pause trigger on media content in playback. The device 400 also includes an interface presentation module 420, configured to present a first interface in response to the trigger of the first interactive interface element, the first interface including an image corresponding to the paused state in the media content. The device 400 further includes an object presentation module 430, configured to present a set of objects matching a target object in at least a portion of the image area in response to receiving a selection of at least a portion of the image area via the first interface.

[0085] In some embodiments, the object rendering module 430 is further configured to, in response to receiving a selection of at least a portion of an image region of an image via a first interface, render at least one first object identified from at least a portion of the image region; and in response to triggering a target object among the at least one first object, render a set of objects matching the target object in a second interface.

[0086] In some embodiments, the object rendering module 430 is further configured to render at least one second object, wherein at least one second image is identified from a region of an image other than a selected at least part of the image region or from another image in the media content; and in response to a triggering of another target object in at least one second object, to render a set of objects that match the other target object.

[0087] In some embodiments, after at least one first object identified in at least a portion of the image area is presented, at least one second object is presented.

[0088] In some embodiments, the object rendering module 430 is further configured to render object information associated with each of the at least one second object, the object information including at least one of the following: a thumbnail of the second object, an identifier of the second object, or the time when the second object appears in the media content.

[0089] In some embodiments, the apparatus 400 further includes a presentation module configured to, in response to receiving a selection of at least a portion of an image region in an image via a first interface, present at least one of the following in the first interface: a first animation associated with at least one object in the image, a second animation associated with the first interface, or a first prompt indicating an object recognition status.

[0090] In some embodiments, the object rendering module 430 is further configured to, in response to receiving a selection of at least a portion of an image region of an image via a first interface, at least partially render a second interface after a first time period; and render at least a portion of a set of objects that match the target object in the second interface.

[0091] In some embodiments, at least a portion of the second interface is presented in association with the first interface, and the media content presented in the first interface is in a playable state.

[0092] In some embodiments, the device 400 further includes a prompting information presentation module configured to present a second prompting information on the first interface in response to a triggering of a first interactive interface element, the second prompting information being configured to prompt a selection method for at least a portion of an image region in the image.

[0093] In some embodiments, the device 400 further includes a presentation module configured to present a first interactive interface element and a second interactive interface element in response to a pause trigger of media content in playback, the second interactive interface element being matched with a third object identified from an image, wherein the object presentation module 430 is further configured to present a set of objects matching the third object in response to a trigger of the second interactive interface element.

[0094] The units and / or modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units and / or modules in device 400 can be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-chips (SoCs), complex programmable logic devices (CPLDs), and so on.

[0095] It should be understood that one or more steps in the above methods can be performed by suitable electronic devices or combinations of electronic devices. Such electronic devices or combinations of electronic devices may, for example, include the terminal device 130 in FIG1.

[0096] Figure 5 shows a block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 500 shown in Figure 5 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device 500 shown in Figure 5 can be used to implement the terminal device 130 of Figure 1.

[0097] As shown in Figure 5, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processors 510 or processing units, memory 520, storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0098] Electronic device 500 typically includes multiple computer storage media. Such media can be any available media accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data and accessible within electronic device 500.

[0099] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0100] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0101] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0102] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0103] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0104] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0105] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0106] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0107] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for object rendering, comprising: In response to a pause trigger on media content that is playing, present at least the first interactive UI element; In response to the triggering of the first interactive interface element, a first interface is presented, the first interface including the image corresponding to the media content being paused; as well as In response to receiving a selection of at least a portion of the image region of the image via the first interface, a set of objects matching the target object in the at least a portion of the image region is presented.

2. The method of claim 1, wherein presenting a set of objects that match the target object in the at least partial image region comprises: In response to receiving a selection of at least a portion of the image region of the image via the first interface, at least one first object identified from the at least a portion of the image region is presented; as well as In response to a triggering of the target object in the at least one first object, a set of objects matching the target object is presented in the second interface.

3. The method according to claim 1 or 2, further comprising: Presenting at least one second object, wherein the at least one second image is identified from a region of the image other than the selected at least partial image region or from another image in the media content; as well as In response to a triggering of another target object in the at least one second object, a set of objects matching the other target object is presented.

4. The method of claim 3, wherein the at least one first object identified in the at least partial image region is presented, and then the at least one second object is presented.

5. The method of claim 3, wherein presenting at least one second object comprises: Present object information associated with each of the at least one second object, the object information including at least one of the following: a thumbnail of the second object, an identifier of the second object, or the time when the second object appears in the media content.

6. The method according to any one of claims 1 to 5, further comprising: In response to receiving a selection of at least a portion of the image region in the image via the first interface, at least one of the following is presented in the first interface: A first animation associated with at least one object in the image, The second animation associated with the first interface, or The first prompt message indicating the object's identification status.

7. The method according to any one of claims 1 to 6, wherein presenting a set of objects matching the target object in the at least partial image region comprises: In response to receiving a selection of at least a portion of the image region of the image via the first interface, a second interface is presented at least partially after a first time period; as well as The second interface presents at least a portion of a set of objects that match the target object.

8. The method of claim 2 or 7, wherein at least a portion of the second interface is presented in association with the first interface, and wherein the media content presented in the first interface is playable.

9. The method according to any one of claims 1 to 8, further comprising: In response to the triggering of the first interactive interface element, a second prompt message is presented on the first interface, the second prompt message being configured to prompt the selection method for at least a portion of the image region in the image.

10. The method according to any one of claims 1 to 9, further comprising: In response to a pause trigger on media content that is in playback, the first interactive interface element and the second interactive interface element are presented, the second interactive interface element being linked to a third object identified from the image; as well as In response to a triggering of the second interactive interface element, a set of objects matching the third object is presented.

11. An apparatus for object rendering, comprising: The interface element presentation module is configured to present at least one interactive interface element in response to a pause trigger on media content that is in playback. The interface presentation module is configured to present a first interface in response to the triggering of the first interactive interface element, the first interface including an image corresponding to when the media content is paused; as well as An object rendering module is configured to, in response to receiving a selection of at least a portion of an image region of the image via the first interface, render a set of objects that match a target object in the at least a portion of the image region.

12. An electronic device, comprising: At least one processor; as well as At least one memory, coupled to the at least one processor and storing instructions for execution by the at least one processor, which, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1 to 10.

13. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 10.

14. A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 10.

Images