Object presentation method and device, equipment and storage medium
By identifying and presenting objects that match objects in the media content when media content is paused, the problem of not being able to effectively identify and display related objects in the prior art is solved, and user experience and interaction convenience are improved.
Patent Information
- Application Number
- CN202510237955.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-28
- Publication Date
- 2025-05-30
AI Technical Summary
The prior art cannot effectively identify and present objects that match other objects in the media content when media content is suspended, limiting the user's experience of quickly searching and viewing related objects in the media content.
By presenting the first interactive interface element when the media content is paused, the objects in the media content and their matching objects are identified and presented in response to user triggers, a first interface is formed to display the combination of matching objects.
It realizes the identification and display of objects after media content is suspended, improves the user's experience of quickly searching and viewing related objects in media content, and enhances the convenience of user interaction and the accuracy of search.
Smart Images

Figure CN120066660A_ABST
Abstract
Description
Technical Field
[0001] Example embodiments of the present disclosure generally relate to the field of computers, and particularly to methods, apparatuses, devices, and computer-readable storage media for object presentation. Background Art
[0002] With the rapid development of the Internet, more and more applications are designed to provide various services to users. For example, an application can provide a search service to a user. The application can obtain a search request from the user (e.g., the user clicks an entry for searching), and provide search results corresponding to the search request. Therefore, it is necessary to continuously explore the accuracy of search results to improve the user experience. Summary of the Invention
[0003] In a first aspect of the present disclosure, there is provided a method for object presentation, including: in response to a pause trigger of media content in a playing state, presenting a first interactive interface element; in response to a trigger of the first interactive interface element, presenting second interactive interface elements respectively corresponding to at least one object, where the at least one object is recognized from the media content; and presenting a first interface, where the first interface includes a set of objects matching one or more of the at least one object.
[0004] In a second aspect of the present disclosure, there is provided an apparatus for object presentation, including: a first interactive interface element presentation module configured to present a first interactive interface element in response to a pause trigger of media content in a playing state; a second interactive interface element presentation module configured to present second interactive interface elements respectively corresponding to at least one object in response to a trigger of the first interactive interface element, where the at least one object is recognized from the media content; and an interface presentation module configured to present a first interface, where the first interface includes a set of objects matching one or more of the at least one object.
[0005] In a third aspect of the present disclosure, there is provided an electronic device. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to execute the method of the first aspect.
[0006] In a fourth aspect of the present disclosure, there is provided a computer-readable storage medium. A computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.
[0007] According to a fifth aspect of the present disclosure, there is provided a computer program product including computer-executable instructions, where the computer-executable instructions, when executed by a processor, implement the method of the first aspect.
[0008] It should be understood that the content described in this content part is not intended to define the key features or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] In conjunction with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent. In the drawings, the same or similar reference numerals denote the same or similar elements, where:
[0010] Figure 1 FIG. [X] shows a schematic diagram of an exemplary environment in which embodiments of the present disclosure can be implemented;
[0011] Figures 2A to 2F FIG. [X] shows a schematic diagram of an exemplary interface for object rendering according to some embodiments of the present disclosure;
[0012] Figure 3 FIG. [X] shows a flowchart of a process for object rendering according to some embodiments of the present disclosure;
[0013] Figure 4 FIG. [X] shows a block diagram of a device for object rendering according to some embodiments of the present disclosure; and
[0014] Figure 5 FIG. [X] shows a block diagram of a device capable of implementing one or more embodiments of the present disclosure. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0015] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the scope of protection of the present disclosure.
[0016] In the description of the embodiments of the present disclosure, the term "including" and its like should be understood as an open inclusion, that is, "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". There may also be other explicit and implicit definitions hereinafter.
[0017] In this document, unless otherwise specified, performing a step "in response to A" does not mean that the step is executed immediately after "A", but may include one or more intermediate steps.
[0018] It can be understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of the corresponding laws, regulations and related provisions.
[0019] It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, usage scopes, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner according to the relevant laws and regulations.
[0020] For example, when responding to receiving an active request from the user, a prompt message is sent to the user to clearly prompt the user that the operation requested by the user will require obtaining and using the user's personal information, so that the user can autonomously choose whether to provide personal information to the software or hardware such as an electronic device, an application program, a server or a storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.
[0021] As an optional but non-limiting implementation manner, the manner of sending a prompt message to the user in response to receiving an active request from the user may be, for example, in the form of a pop-up window, and the prompt message may be presented in text in the pop-up window. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0022] It can be understood that the above process of notifying and obtaining the user's authorization is only illustrative and does not limit the implementation manner of the present disclosure. Other manners that meet the relevant laws and regulations can also be applied to the implementation manner of the present disclosure.
[0023] As briefly mentioned above, the application can provide a search service to the user. Conventionally, for media content (such as video) in the playing state, if the user clicks pause, a search entry can be presented to allow the user to search for objects that appear in the media content. However, in this case, since object recognition is automatically performed based on the current content, objects that match other objects in the media content cannot be recognized.
[0024] In view of this, the present disclosure proposes an improved solution for object presentation. According to the solution of an embodiment of the present disclosure, if a pause trigger for media content in a playing state is received, a first interactive interface element is presented. If a trigger for the first interactive interface element is received, second interactive interface elements corresponding to at least one object identified from the media content are presented. Further, a first interface is presented, and the first interface includes a set of objects that match one or more of the at least one object.
[0025] In this way, object recognition can be performed on the entire media content after the media content is paused, and interactive interface elements corresponding to the respective objects obtained can be provided. Through these interactive interface elements, other related objects that match the objects identified from the media content can be viewed. In this way, users can view and search for objects that appear anywhere in the media content through a more convenient and simple interaction process, improving the user experience.
[0026] In the present disclosure, "trigger" refers to one or more interactive operations of a user on a terminal device. Further, these interactive operations can be triggered within the same user interface / popup window or within different user interfaces / popup windows. The present disclosure is not limited in this regard.
[0027] In the present disclosure, "object" refers to any entity or virtual object, including but not limited to, physical or virtual goods, media works, and the like.
[0028] The exemplary embodiments of the present disclosure will be described below with reference to the accompanying drawings.
[0029] Example environment
[0030] Figure 1 A schematic diagram of an exemplary environment 100 in which embodiments of the present disclosure can be implemented is shown. In this exemplary environment 100, an instance of an application 120 is installed in a terminal device 130. A user 132 can interact with the application 120 via an attached device of the terminal device 130. Similarly, the user 132 can interact with the application 120 via an attached device of the terminal device 130.
[0031] In some embodiments, the application 120 can be any suitable application that can provide a search service for the user 132. As an example, the application 120 can be a search or query application. As another example, the application 120 can be an instant messaging (IM) application. It should be understood that the above are only examples of the application 120 and are not intended to be any limitation. The application 120 can be any suitable type of application that provides a search service. Figure 1In an environment 100, if an application 120 is active, a terminal device 130 can present an interface 150 of the application 120. The interface 150 can include various types of pages that the application 120 can provide, such as a search page, a query page, a search result presentation page, and so on.
[0032] In some embodiments, the terminal device 130 communicates with a server 110 to implement the supply of services for the application 120. The terminal device 130 can be any type of mobile terminal, fixed terminal, or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / video camera, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 130 is also capable of supporting any type of interface for users (such as a "wearable" circuit, etc.). The server 110 can be various types of computing systems / servers capable of providing computing capabilities, including but not limited to mainframes, edge computing nodes, computing devices in a cloud environment, and so on.
[0033] It should be understood that the structures and functions of the various elements in the environment 100 are described only for exemplary purposes, without implying any limitation on the scope of the present disclosure.
[0034] Various example implementations of the present disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the pages shown in the drawings are only examples, and various page designs can actually exist. The various graphical elements in the pages can have different arrangements and different visual representations, one or more of which can be omitted or replaced, and there can also be one or more other elements. The embodiments of the present disclosure are not limited in this regard. In addition, in the following, example embodiments will be mainly described with respect to the terminal device 130. It should be understood that the actions described with respect to the terminal device 130 can be performed by the application 120 on the terminal device 130, or can be performed by the application 120 in cooperation with its server (for example, the server 110). In some embodiments, in a scenario where the terminal device 130 cooperates with its server (for example, the server) to perform, the terminal device 130 can request the server to provide an object to be presented, and receive the determined object from the server for presentation in the target page.
[0035] Figures 2A to 2F Schematic diagrams of example interfaces 200A to 200F for object presentation according to some embodiments of the present disclosure are shown.
[0036] In an embodiment of the present disclosure, the terminal device 130 may play media content. In some embodiments, the media content may be video, a collection of dynamically played images, a dynamic image, or other playable content. The media content may be provided in any suitable application or platform of the terminal device 130. During the playback of the media content, if a pause trigger for the media content in the playing state is received, a first interactive interface element is presented. As Figure 2A shown in the example interface 200A, when the terminal device 130 presents media content (e.g., video) and receives a pause trigger for the media content in the playing state, the interactive interface element 210 may be presented. For example, when the terminal device 130 receives a pause trigger for the media content in the playing state, the interactive interface element 210 may be presented below the title 217. In some embodiments, the interactive interface element 210 may be configured to perform object recognition on the media content to detect whether there are objects in the media content.
[0037] In some embodiments, the first interactive interface element may be presented in a second interface, and the second interface indicates that the media content is in a paused state. In some embodiments, the second interface includes an image corresponding to when the media content is paused and interface elements associated with the media content. Understandably, for the media content currently in the playing state, the user 132 may click to pause. At this time, the terminal device 130 may present the interactive interface element 210 in the second interface (such as the example interface 200A).
[0038] In some embodiments, the first interactive interface element includes thumbnails of one or more objects recognized from the media content. In some embodiments, the interactive interface element 210 may include thumbnails of objects such as the XX object in the media content, the XXX object thumbnail, etc. In some embodiments, the terminal device 130 may preferentially present thumbnails of at least one first object in the corresponding image when the current media content is paused in the interactive interface element 210. As Figure 2A shown, the interactive interface element 210 may include a thumbnail 212 of the A object (e.g., shirt) recognized from the current image, a thumbnail 214 of the B object (e.g., shoes), and thumbnails of at least one second object recognized from other images in the media content other than the current image. The thumbnails here may be generated based on images intercepted from the media content, or may be pre-configured thumbnails for the same type of object.
[0039] In some embodiments, each thumbnail of at least one object included in the interactive interface element 210 may be configured to trigger a corresponding object recognition mode. Below, how the terminal device 130 presents an object matching at least one object based on each thumbnail of at least one object will be described in detail with reference to the accompanying drawings. Referring to Figure 2A , in some embodiments, the first interactive interface element includes a prompt message 216 for the first interactive interface element. In some examples, the prompt message 216 is used to prompt the user 132 to click on the interactive interface element 210 to view the same object as the object in the media content.
[0040] In an embodiment of the present disclosure, if the terminal device 130 detects a trigger on the first interactive interface element, it presents a second interactive interface element corresponding to each of at least one object. The terminal device 130 may determine at least one object from the media content. In some embodiments, if the terminal device 130 receives a trigger on the first interactive interface element, it may determine at least one object from the media content in a first object recognition mode. Further, the terminal device 130 presents a second interactive interface element corresponding to each of at least one object, so as to present a set of objects matching at least one object in the first interface. In some examples, the first object recognition mode is configured to perform object recognition on all objects in the media content.
[0041] In some embodiments, if the terminal device 130 receives a trigger on the first interactive interface element, it may maintain the image corresponding to when the media content is paused and cancel the presentation of the interface elements associated with the media content. As Figures 2A to 2B shown in the example interfaces 200A to 200B, when the media content is in a paused state, if the terminal device 130 receives a trigger on the interactive interface element 210, it may present a second interface (such as the example interface 200B). At this time, other information in the interface 200B is cancelled from being presented, and only the image included in the page corresponding to when the current media content is paused is presented. For example, the interface 200B may include the image included in the video frame corresponding to when the video is paused, or the image corresponding to when a set of dynamically played images is paused.
[0042] After the terminal device 130 receives a trigger on the interactive interface element 210, while cancelling the presentation of other information in the second interface (such as the example interface 200B, the example interface 200C), it enters the process of recognizing an object matching at least one object in the media content. In some embodiments, the terminal device 130 may determine at least one object in the media content in the following manner.
[0043] In some embodiments, if the terminal device 130 receives a trigger for the interactive interface element 210, it may determine at least one first object from the content portion corresponding to when the media content was paused. As Figures 2B to 2C shown in the example interfaces 200B to 200C, the terminal device 130 first determines object A and object B from the image corresponding to when the media content is currently paused, and presents the interactive interface element 221 of the currently recognized object A and the interactive interface element 231 of object B in the interface. In some embodiments, the terminal device 130 may present the interactive interface element 221 of object A and the interactive interface element 231 of object B in the order of recognizing object A and object B. In some examples, the interactive interface element 221 of object A and the interactive interface element 231 of object B may respectively indicate the thumbnail of object A and the thumbnail of object B.
[0044] In some embodiments, the terminal device 130 may determine at least one second object from other images in the media content besides the image. It can be understood that the terminal device 130 may first recognize the objects in the image corresponding to when the media content is currently paused, and then successively recognize other objects in the subsequent images. As Figure 2C shown in the example interface 200C, the terminal device 130 first determines object A and object B from the image corresponding to when the media content is currently paused, and successively determines object C (e.g., a bag), object D (e.g., a mobile phone), etc. from other parts of the media content.
[0045] Correspondingly, the terminal device 130 presents the interactive interface element 221 of the currently recognized object A, the interactive interface element 231 of object B, and the interactive interface element 232 of object C in the interface 200C. In some embodiments, the terminal device 130 may present the interactive interface element 221 of object A, the interactive interface element 231 of object B, and the interactive interface element 232 of object C in the order of recognizing object A, object B, and object C. In some examples, the interactive interface element 221 of object A, the interactive interface element 231 of object B, and the interactive interface element 232 of object C may respectively indicate the thumbnail of object A, the thumbnail of object B, and the thumbnail of object C.
[0046] After the terminal device 130 receives a trigger for the interactive interface element 210, while recognizing a group of objects that match at least one object, it may present some animations in the second interface (such as the example interface 200B and the example interface 200C). The following will refer to Figures 2B to 2CDescribe presenting some animations in a second interface (such as example interface 200B, example interface 200C). It should be understood that the animations described in this disclosure are merely exemplary and are not limited thereto. For example, any other appropriate visual guidance can also be used to let the user know which part of the area the object being recognized currently is.
[0047] In some embodiments, if the terminal device 130 receives a trigger for the interactive interface element 210, it can present a first animation associated with at least one object in the image in a second interface (such as example interface 200B). For example, during the process of the terminal device 130 recognizing object A, it can present a stroke animation 223 in interface 200B to prompt the user 132 that it is currently in the process of searching for other objects matching object A. In some examples, the stroke animation indicates that during the process of recognizing a certain object, the edge lines of the object are presented in the interface, such as presenting a dynamic light effect at the edge of the object.
[0048] In some embodiments, after the terminal device 130 recognizes at least one first object and during the process of recognizing at least one second object, it can present a first animation for at least one second object in a second interface (such as example interface 200C). For example, after the terminal device 130 recognizes object A and during the process of recognizing object B, it can present a stroke animation 234 in interface 200C to prompt the user 132 that it is currently in the process of determining the same model as object C. In some examples, the terminal device 130 can present the dynamic light effect of the stroke according to a predetermined rule (for example, the rule of "rotating counterclockwise from the upper left corner and scrolling in a loop"). Of course, this is only an example here, and actually any other animation effects can be configured according to specific applications to enable the user to more easily notice the currently recognized object.
[0049] The terminal device 130 can present a second animation associated with the second interface in the second interface (such as example interface 200B). For example, during the process of the terminal device 130 recognizing object A, it can present an overall screen light effect 224 in interface 200B to prompt the user 132 that it is currently in the process of determining the same model as object A. It can be understood that the overall light effect 224 indicates that if the terminal device 130 receives a trigger for the interactive interface element 210, the light effect can start to spread from the center of interface 200B, the light effect is enlarged and then disappears, and this process appears in a loop. Of course, this is only an example here, and actually any other animation effects can be configured according to specific applications to enable the user to more easily notice the currently recognized object.
[0050] The terminal device 130 may also present a prompt message for indicating the object recognition status in the second interface (such as the example interface 200B). For example, during the process of recognizing object A, the terminal device 130 may present a prompt message 225 in the interface 200B to prompt the user 132 that the current process is to determine the same model of object A.
[0051] After the terminal device 130 recognizes a set of objects that match at least one object, it may present a first interface including the set of objects that match at least one object. The following will continue to refer to Figures 2D to 2F to describe how the terminal device 130 presents the first interface.
[0052] For ease of understanding, the second interactive interface elements will be described first. During the process of the terminal device 130 recognizing a set of objects that match each object in at least one object, the second interactive interface elements corresponding to each object (such as the interactive interface elements 221, 231, 232 in the example interfaces 200B and 200C) may indicate the thumbnail of each object. In some embodiments, in addition to presenting the thumbnail, any other appropriate way may be used to indicate the object recognition result, such as the identifier of the object, such as the object name, type, and so on. The object recognition result (thumbnail, name, etc.) may be configured as an interactive entry control for the user to trigger the presentation of more objects.
[0053] Correspondingly, while the terminal device 130 presents the first interface (such as the example interface 240), the second interactive interface elements corresponding to each object may include the thumbnail of each object, the identifier of each object (name, type, etc.), and / or the time when each object appears in the media content. For example, the interactive interface element 254 corresponding to object A may include the thumbnail 212 of object A and the time 257 when object A appears in the media content. The interactive interface element 255 corresponding to object B may include the thumbnail 214 of object B and the time 258 when object B appears in the media content.
[0054] The following will continue to refer to Figures 2D to 2FDescribe how the terminal device 130 presents the first interface. In an embodiment of the present disclosure, the terminal device 130 presents a first interface including a set of objects that match one or more of at least one object. In some embodiments, if the terminal device 130 detects a trigger of a second interactive interface element corresponding to a target object in at least one object, it may present a first interface including a set of objects that match the target object. In some examples, if the terminal device 130 receives a click of the second interactive interface element corresponding to the target object by the user 132, it may present a set of objects that match the target object in the first interface. The objects that match the target object may be objects retrieved from the candidate object database through a search algorithm and that match the target object. For example, if the terminal device 130 receives a selection of the interactive interface element corresponding to object A (e.g., shirt) by the user 132, it may present different types of shirts in the first interface (such as the example interface 240).
[0055] In some embodiments, if the terminal device 130 receives a selection of a target object by the user 132, it may perform a search task based on the target object (e.g., the name of the target object, the image corresponding to the target object), and then determine a set of objects that match the target object. In some examples, if the terminal device 130 detects a selection of the interactive interface element 254 corresponding to object A (e.g., shirt) by the user 132, it may perform a search task based on the name of object A or the image corresponding to object A. Further, the terminal device 130 may present different types of shirts that match object A in the first interface (such as the example interface 240). For example, by detecting that the user 132 clicks the interactive interface element 254 corresponding to object A, different types of shirts can be viewed.
[0056] In some embodiments, within a predetermined time period after the second interactive interface element is presented, the first interface is at least partially presented. Accordingly, the terminal device 130 may present at least some of the set of objects that match one or more of at least one object in the first interface. In some embodiments, after receiving a trigger of the interactive interface element 210, the terminal device 130 searches for a set of objects that match at least one object in the media content. During this process, after a period of time (e.g., N seconds), the terminal device 130 may present the first interface (such as the example interface 240) in different proportions, so as to present at least some of the set of objects that match one or more of at least one object it has searched for in the first interface.
[0057] In some embodiments, the terminal device 130 may present at least a portion of the first interface in association with the second interface. At this time, the media content presented in the second interface is in a playable state, that is, while presenting the matching object, the user is also allowed to decide whether to continue restarting the playback of the media content as needed. In some examples, such as Figure 2D the illustrated example interface 200D, after the terminal device 130 receives a trigger for the interactive interface element 210 and after a period of time (for example, a set of objects matching the A object and the B object have been searched out), the interface 240 may be presented in accordance with a first ratio. That is, the second interface (such as interface 243) shrinks and moves upward, and the interface 240 is presented in the lower area of the interface 200D. At this time, the terminal device 130 may present objects 241, 242, and so on that respectively match the A object and the B object in the interface 240. In such a scenario, if the terminal device 130 detects that the user 132 slides or drags the interface 250, the second interface may be presented.
[0058] In some embodiments, such as Figure 2E the illustrated example interface 200E, after the terminal device 130 receives a trigger for the interactive interface element 210 and after a period of time (for example, a set of objects matching at least one first object and at least one second object have been searched out respectively), the interface 240 may be presented in accordance with a second ratio. That is, the second interface shrinks and moves upward, and the interface 240 is presented in the lower area of the interface 200E. The second ratio is greater than the first ratio. For example, the interface 240 is presented in a 7 - split screen style. At this time, the terminal device 130 may present objects 241, 242, 251, 252, and so on that respectively match the A object, the B object, and the C object in the interface 240.
[0059] In some embodiments, if the terminal device 130 receives a trigger for a second interactive interface element corresponding to a target object among at least one object, an image of the target object included in the media content may be presented in the second interface. Such as Figure 2E the illustrated example interface 200E, in the scenario where the interactive interface element 254 corresponding to the current A object is selected, a set of objects matching the A object are presented in the first interface (such as the example interface 240), and an image corresponding to the A object in the media content is presented in the second interface.
[0060] In such a scenario, if the terminal device 130 receives a click on the interactive interface element 255 corresponding to the B object by the user 132, a set of objects matching the B object are presented in the first interface (such as the example interface 240), and an image corresponding to the B object in the media content is presented in the second interface.
[0061] In some embodiments, if the terminal device 130 receives a trigger for the interactive interface element 210, it may present a second interactive interface element associated with the second interactive interface element. As Figure 2E shown, the terminal device 130 may present the interactive interface element 256 associated with a second interactive interface element (e.g., the interactive interface element 254 or the interactive interface element 255).
[0062] In some embodiments, if the terminal device 130 receives a trigger for a third interactive interface element, it may present a first interface. The first interface includes a set of objects that globally match at least one object identified from the media content. As Figure 2E shown, the user 132 may click on the interactive interface element 256 to view a set of objects respectively associated with all the objects included in the media content that the terminal device 130 has determined. In some examples, the terminal device 130 may present the interactive interface elements corresponding to each object in a list style. Correspondingly, the user 132 may also slide the list in a predetermined manner (e.g., left - right, up - down, etc.) to view a set of objects respectively associated with any object.
[0063] In some embodiments, the terminal device 130 may present a fourth interactive interface element indicating the progress bar of the media content associated with the second interactive interface element. In some embodiments, the terminal device 130 may present the interactive interface element 255 for indicating the progress bar of the media content associated with a second interactive interface element (e.g., the interactive interface element 254 or the interactive interface element 255).
[0064] In some embodiments, if the terminal device 130 receives a positioning indication for the progress bar, it will present the second interactive interface element associated with the position corresponding to the positioning indication as being in a selected state. Correspondingly, the terminal device 130 may present a set of objects that match the object corresponding to the second interactive interface element in the selected state in the first interface. In some examples, the user 132 may drag or click on the interactive interface element 255 to view the objects that match any object.
[0065] As Figure 2E shown, in the scenario where the interactive interface element 254 corresponding to the current object A is in a selected state. If the terminal device 130 receives the user 132 dragging / clicking the interactive interface element (also referred to as the "progress bar") 255 to the interactive interface element 255 corresponding to object B, then the interactive interface element 255 corresponding to object B is in a selected state. At this time, a set of objects that match object B are presented in the first interface (such as the example interface 240).
[0066] In some embodiments, the terminal device 130 may also present navigation labels corresponding to at least one object category in a group of objects in the area 253 included in the interface 240. In some examples, if the terminal device 130 determines a group of objects associated with object A, it may present a navigation label corresponding to object A in the area 254. For example, a "Same Model Products" navigation label. In other examples, if the terminal device 130 determines a group of objects associated with at least one object, it may present navigation labels corresponding to at least one object category in the area 253. For example, navigation labels such as an "All" navigation label, an "Object A" navigation label, an "Object B" navigation label, a "Comprehensive" navigation label, and so on. In some examples, the terminal device 130 may default to presenting a group of objects associated with the "All" navigation label that are associated with at least one object.
[0067] In some embodiments, if the terminal device 130 receives a trigger associated with the first interface, it may present the first interface at a third ratio, where the third ratio is greater than the second ratio. As Figures 2E to 2F shown in the example interfaces 200E to 200F, if the terminal device 130 receives a swiping-up operation on the interface 240 in the interface 200E, it may present the interface 240 full-screen in the interface 200F. The terminal device 130 may present objects 241, 242, 251, 252, 261, 262, etc. in the interface 240 that are associated with objects such as object A, object B, object C, and so on.
[0068] In some examples, the terminal device 130 may present an interactive interface element for each of at least one object in the area 263. In some embodiments, if the terminal device 130 detects an operation where the user 132 swipes down the full screen, it may present the interface 240 in a 7-split screen style (such as the example interface 200E).
[0069] The following will continue to describe how the terminal device 130 presents objects based on different entry controls with reference to the accompanying drawings.
[0070] In some embodiments, if the terminal device 130 receives a trigger on a thumbnail indicating a certain object identified from media content, it may present a group of objects that match the object in a second object recognition mode. The second object recognition mode is configured to perform object recognition on a certain object in media content.
[0071] Refer to Figure 2A, in some embodiments, when the media content is in a paused state, the interactive interface element 210 presented by the terminal device 130 may include a thumbnail 212 for indicating an A object identified from the media content. If the terminal device 130 receives a trigger for the thumbnail 214, it may present a set of objects matching the A object in a first interface (such as the example interface 240). Correspondingly, when the media content is in a paused state, the interactive interface element 210 presented by the terminal device 130 may further include a thumbnail 214 for indicating a B object identified from the image. If the terminal device 130 receives a trigger for the thumbnail 214, it may present a set of objects matching the B object in the interface 240.
[0072] When the media content is in a paused state, the terminal device 130 may further present an interaction entry 215 for indicating an interaction operation (such as selecting a partial image area) in a second interface. If the terminal device 130 receives a trigger for the interaction entry 215, it may present an interface including an image. Further, the terminal device 130 may perform an object recognition task on the partial image area based on the user's selection of the partial image area received via this interface, and then present a set of objects matching the target object.
[0073] In this way, after the media content is paused, a first interactive interface element may be presented, and at the same time, thumbnails of one or more objects in the media content are presented. Further, when the user clicks on the first interactive interface element or the thumbnails of one or more objects, they can view the objects matching at least one object in the media content or a set of objects matching one or more objects. The present disclosure can also support the user to quickly preview / switch multiple objects matching other objects included in the media content, thereby improving the user experience.
[0074] Example process
[0075] Figure 3 The flowchart of a process 300 for object presentation according to some embodiments of the present disclosure is shown. The process 300 may be implemented at the terminal device 130. The following refers to Figure 1 Describe the process 300.
[0076] In block 310, the terminal device 130 presents a first interactive interface element in response to a pause trigger for media content in a playing state.
[0077] In block 320, the terminal device 130 presents a second interactive interface element corresponding to each of at least one object in response to a trigger for the first interactive interface element, where the at least one object is identified from the media content.
[0078] At block 330, the terminal device 130 presents a first interface that includes a set of objects that match one or more of the at least one object.
[0079] In some embodiments, for each object of the at least one object, the second interactive interface element includes at least one of the following: a thumbnail of the object, an identifier of the object, or an appearance time of the object in the media content.
[0080] In some embodiments, presenting the first interface includes: in response to triggering of a second interactive interface element corresponding to a target object of the at least one object, presenting the first interface that includes a set of objects that match the target object.
[0081] In some embodiments, presenting the first interface includes: within a predetermined time period after the second interactive interface element is presented, at least partially presenting the first interface that includes at least some of the set of objects that match one or more of the at least one object.
[0082] In some embodiments, the first interactive interface element includes at least one of the following: a thumbnail of one or more objects identified from the media content, or a hint message for the first interactive interface element.
[0083] In some embodiments, presenting the first interactive interface element includes: presenting the first interactive interface element in a second interface that includes an image corresponding to when the media content is paused and interface elements associated with the media content, and process 300 further includes: in response to triggering of the first interactive interface element, maintaining the image corresponding to when the media content is paused and canceling the presentation of the interface elements associated with the media content.
[0084] In some embodiments, process 300 further includes: in response to triggering of the first interactive interface element, presenting at least one of the following in the second interface: a first animation associated with at least one object in the image, a second animation associated with the second interface, or a hint message indicating an object recognition status.
[0085] In some embodiments, the at least one object is determined by: in response to triggering of the first interactive interface element, determining at least one first object from a content portion corresponding to when the media content is paused; and determining at least one second object from other images in the media content other than the image.
[0086] In some embodiments, at least a portion of the first interface is presented in association with at least a portion of the second interface, and the media content presented in the second interface is in a playable state.
[0087] In some embodiments, process 300 further includes: in response to a trigger of a second interactive interface element corresponding to a target object among at least one object, presenting an image of the target object included in the media content in a second interface.
[0088] In some embodiments, process 300 further includes: in response to a trigger of a first interactive interface element, presenting a third interactive interface element associated with the second interactive interface element; and in response to a trigger of the third interactive interface element, presenting a first interface, the first interface including a set of objects that match the whole of at least one object identified from the media content.
[0089] In some embodiments, process 300 further includes: presenting a fourth interactive interface element associated with the second interactive interface element, the fourth interactive interface element indicating a progress bar of the media content; in response to a positioning indication of the fourth interactive interface element, presenting the second interactive interface element associated with the position corresponding to the positioning indication as being in a selected state; and in the first interface, presenting a set of objects that match the object corresponding to the second interactive interface element in the selected state.
[0090] Example apparatus and equipment
[0091] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above methods or processes.
[0092] Figure 4 A schematic structural block diagram of an apparatus 400 for object presentation according to certain embodiments of the present disclosure is shown. Apparatus 400 may be implemented as or included in a terminal device 130. Each module / component in apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.
[0093] As Figure 4 shown, apparatus 400 includes a first interactive interface element presentation module 410 configured to present a first interactive interface element in response to a pause trigger of media content in a playing state. Apparatus 400 further includes a second interactive interface element presentation module 420 configured to present a second interactive interface element corresponding to each of at least one object in response to a trigger of the first interactive interface element, the at least one object being identified from the media content. Apparatus 400 further includes an interface presentation module 430 configured to present a first interface, the first interface including a set of objects that match one or more of the at least one object.
[0094] In some embodiments, for each object among the at least one object, the second interactive interface element includes at least one of the following: a thumbnail of the object, an identifier of the object, or an appearance time of the object in the media content.
[0095] In some embodiments, the interface presentation module 430 is further configured to present a first interface in response to a trigger of a second interactive interface element corresponding to a target object among at least one object, where the first interface includes a set of objects matching the target object.
[0096] In some embodiments, the interface presentation module 430 is further configured to at least partially present a first interface within a predetermined time period after the second interactive interface element is presented, where the first interface includes at least some objects among a set of objects matching one or more objects among at least one object.
[0097] In some embodiments, the first interactive interface element includes at least one of the following: a thumbnail of one or more objects recognized from media content, or a prompt message for the first interactive interface element.
[0098] In some embodiments, the first interactive interface element presentation module 410 is further configured to present a first interactive interface element in a second interface, where the second interface includes an image corresponding to when the media content is paused and interface elements associated with the media content. The apparatus 400 further includes an interface element cancellation presentation module configured to, in response to a trigger of the first interactive interface element, maintain the image corresponding to when the media content is paused and cancel the presentation of the interface elements associated with the media content.
[0099] In some embodiments, the apparatus 400 further includes an animation presentation module configured to, in response to a trigger of the first interactive interface element, present at least one of the following in the second interface: a first animation associated with at least one object in the image, a second animation associated with the second interface, or a prompt message indicating an object recognition state.
[0100] In some embodiments, at least one object is determined by: in response to a trigger of the first interactive interface element, determining at least one first object from a content portion corresponding to when the media content is paused; and determining at least one second object from other images in the media content other than the image.
[0101] In some embodiments, at least part of the first interface is presented in association with at least part of the second interface, and the media content presented in the second interface is in a playable state.
[0102] In some embodiments, the apparatus 400 further includes an image presentation module configured to, in response to a trigger of a second interactive interface element corresponding to a target object among at least one object, present an image including the target object in the media content in the second interface.
[0103] In some embodiments, the interface presentation module 430 is further configured to, in response to a trigger of a first interactive interface element, present a third interactive interface element in association with a second interactive interface element; and in response to a trigger of the third interactive interface element, present a first interface that includes a set of objects that globally match at least one object identified from media content.
[0104] In some embodiments, the apparatus 400 further includes an object presentation module configured to present a fourth interactive interface element in association with the second interactive interface element, the fourth interactive interface element indicating a progress bar of media content; in response to a positioning indication of the fourth interactive interface element, present the second interactive interface element associated with the position corresponding to the positioning indication as being in a selected state; and in the first interface, present a set of objects that match the object corresponding to the second interactive interface element in the selected state.
[0105] The units and / or modules included in the apparatus 400 may be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules may be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to the machine-executable instructions, some or all of the units and / or modules in the apparatus 400 may be at least partially implemented by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that may be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0106] It should be understood that one or more steps in the above methods may be performed by a suitable electronic device or a combination of electronic devices. Such an electronic device or combination of electronic devices may include, for example, Figure 1 the terminal device 130 in
[0107] Figure 5 A block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that Figure 5 the electronic device 500 shown is merely exemplary and should not constitute any limitation to the functions and scopes of the embodiments described herein. Figure 5 The electronic device 500 shown may be used to implement Figure 1 the terminal device 130.
[0108] As Figure 5As shown, the electronic device 500 is in the form of a general-purpose electronic device. The components of the electronic device 500 may include, but are not limited to, one or more processors 510 or processing units, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processor 510 can be an actual or virtual processor and is capable of performing various processes according to the programs stored in the memory 520. In a multi-processor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing ability of the electronic device 500.
[0109] The electronic device 500 generally includes multiple computer storage media. Such media can be any available media accessible to the electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 520 can be a volatile memory (such as registers, caches, random access memory (RAM)), a non-volatile memory (such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 can be a removable or non-removable medium and can include machine-readable media, such as flash drives, magnetic disks, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 500.
[0110] The electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in Figure 5 a disk drive for reading from or writing to a removable, non-volatile magnetic disk (such as a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 520 may include a computer program product 525 having one or more program modules configured to perform the various methods or actions of the various embodiments of the present disclosure.
[0111] The communication unit 540 enables communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 500 can be implemented in a single computing cluster or multiple computer machines that are capable of communicating through a communication connection. Thus, the electronic device 500 can operate in a networked environment using a logical connection with one or more other servers, network personal computers (PCs), or another network node.
[0112] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown) as needed through the communication unit 540. The external devices such as a storage device, a display device, etc., communicate with one or more devices that enable a user to interact with the electronic device 500, or communicate with any device that enables the electronic device 500 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).
[0113] According to an exemplary implementation of the present disclosure, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, there is also provided a computer program product, the computer program product being tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, and the computer-executable instructions being executed by a processor to implement the method described above.
[0114] Aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.
[0115] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine, such that when the instructions are executed by the processor of the computer or other programmable data processing apparatus, a device is produced that implements the functions / acts specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, which instructions cause a computer, a programmable data processing apparatus, and / or other devices to operate in a particular manner, so that the computer-readable medium storing the instructions includes a manufacture, which includes instructions for implementing various aspects of the functions / acts specified in one or more blocks of the flowchart and / or block diagram.
[0116] The computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device, such that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in one or more blocks of the flowchart and / or block diagram.
[0117] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various implementations of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions noted in the blocks may occur in a different order than noted in the accompanying drawings. For example, two consecutive blocks may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.
[0118] The various implementations of the present disclosure have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The choice of terms used herein is intended to best explain the principles of the implementations, the practical application, or the improvement of technologies in the market, or to enable other ordinary skill in the art to understand the various implementations disclosed herein.
Claims
1. A method for object presentation, comprising: In response to a pause trigger of the media content in a playing state, presenting a first interactive interface element; In response to triggering the first interactive interface element, presenting a second interactive interface element corresponding to at least one object, wherein the at least one object is identified from the media content; as well as A first interface is presented, the first interface including a group of objects matching one or more objects of the at least one object.
2. The method according to claim 1, wherein for each of the at least one object, the second interactive interface element includes at least one of the following: a thumbnail of the object, an identifier of the object, or an appearance time of the object in the media content.
3. The method according to claim 1, wherein presenting the first interface comprises: In response to triggering a second interactive interface element corresponding to a target object among the at least one object, presenting the first interface, wherein the first interface includes a group of objects matching the target object.
4. The method according to claim 1, wherein presenting the first interface comprises: Within a predetermined time period after the second interactive interface element is presented, the first interface is at least partially presented, wherein the first interface includes at least some objects in a group of objects that match one or more objects in the at least one object.
5. The method according to claim 1, wherein the first interactive interface element comprises at least one of the following: thumbnails of one or more objects identified from the media content, or prompt information for the first interactive interface element.
6. The method of claim 1, wherein presenting the first interactive interface element comprises: The first interactive interface element is presented in a second interface, wherein the second interface includes an image corresponding to when the media content is paused and an interface element associated with the media content, and The method further comprises: In response to triggering of the first interactive interface element, the image corresponding to when the media content is paused is maintained and the interface element associated with the media content is canceled.
7. The method according to claim 6, further comprising: In response to triggering the first interactive interface element, at least one of the following is presented in the second interface: a first animation associated with at least one object in the image, a second animation associated with the second interface, or Hint indicating the object recognition status.
8. The method of claim 1, wherein the at least one object is determined by: In response to triggering the first interactive interface element, determining at least one first object from a content portion corresponding to when the media content is paused; and At least one second object is determined from other images in the media content except the image. 9 . The method according to claim 1 , wherein at least a portion of the first interface is presented in association with at least a portion of a second interface, and the media content presented in the second interface is in a playable state.
10. The method according to claim 9, further comprising: In response to triggering a second interactive interface element corresponding to a target object among the at least one object, an image of the media content including the target object is presented in the second interface.
11. The method according to claim 1, further comprising: In response to triggering the first interactive interface element, presenting a third interactive interface element in association with the second interactive interface element; as well as In response to triggering the third interactive interface element, the first interface is presented, wherein the first interface includes a group of objects that match the at least one object identified from the media content as a whole.
12. The method according to claim 1, further comprising: presenting a fourth interactive interface element in association with the second interactive interface element, the fourth interactive interface element indicating a progress bar of the media content; In response to the positioning indication of the fourth interactive interface element, presenting the second interactive interface element associated with the position corresponding to the positioning indication as being in a selected state; as well as In the first interface, a group of objects matching the object corresponding to the second interactive interface element in the selected state is presented.
13. An apparatus for object presentation, comprising: A first interactive interface element presentation module, configured to present a first interactive interface element in response to a pause trigger of the media content in a playing state; A second interactive interface element presentation module, configured to present, in response to triggering of the first interactive interface element, a second interactive interface element corresponding to at least one object, wherein the at least one object is identified from the media content; as well as The interface presenting module is configured to present a first interface, wherein the first interface includes a group of objects matching one or more objects of the at least one object.
14. An electronic device, comprising: at least one processor; as well as At least one memory, the at least one memory is coupled to the at least one processor and stores instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 12 when executed by the at least one processor.
15. A computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions can be executed by a processor to implement the method according to any one of claims 1 to 12.
16. A computer program product, comprising a computer program, wherein the computer program, when executed by a processor, implements the method according to any one of claims 1 to 12.
Citation Information
Cited By
Method and apparatus for object presentation, and device and storage medium
WO2026179286A1