Interface interaction method and apparatus, device, and storage medium

Abstract

Embodiments of the present disclosure provide an interface interaction method and apparatus, a device, and a storage medium. The interface interaction method comprises: displaying a playback interface of video content; in response to a first operation associated with the playback interface being received, displaying a first image, associated with the first operation, of the video content while continuing playing back the video content; and displaying a set of content items associated with a set of objects in the first image, the set of content items being determined on the basis of the identification for the set of objects. In this way, the embodiments of the present disclosure can improve the efficiency of users in acquiring information.

Description

Method, device, equipment and storage medium for interface interaction

[0001] This application claims priority to the Chinese invention patent application entitled “Methods, devices, equipment and storage media for interface interaction” filed on March 20, 2024, with application number: 202410324536.2. The entire contents of this application are incorporated by reference into this application. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for interface interaction. Background Art

[0003] With the development of computer technology, various multimedia contents have become one of the main ways for people to obtain content. Multimedia content can include, for example, pictures, videos, text, audio, etc. In some cases, users may want to know information about specific objects in multimedia content (e.g., video content). However, this usually requires users to perform relatively complex information search operations. Summary of the Invention

[0004] In a first aspect of the present disclosure, a method for interface interaction is provided. The method includes: displaying a playback interface for video content; in response to receiving a first operation associated with the playback interface, displaying a first image associated with the first operation in the video content while continuing to play the video content; and displaying a group of content items associated with a group of objects in the first image, the group of content items being determined based on recognition of the group of objects.

[0005] In a second aspect of the present disclosure, a device for interface interaction is provided. The device includes: an interface presentation module configured to display a playback interface of video content; a first display module configured to, in response to receiving a first operation associated with the playback interface, display a first image associated with the first operation in the video content while continuing to play the video content; and a second display module configured to display a group of content items associated with a group of objects in the first image, where the group of content items is determined based on recognition of the group of objects.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the electronic device to perform the method of the first aspect.

[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein computer-executable instructions are stored on the medium, and when the computer-executable instructions are executed by a processor, the method of the first aspect is implemented.

[0008] In a fifth aspect of the present disclosure, there is provided a computer program product tangibly stored in a computer storage medium and comprising computer executable instructions which, when executed by a device, cause the device to perform the method of the first aspect.

[0009] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0011] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] 2A to 2H are schematic diagrams illustrating examples of interface interactions according to some embodiments of the present disclosure;

[0013] FIG3 shows a flowchart of a process for interface interaction according to some embodiments of the present disclosure;

[0014] FIG4 shows a schematic structural block diagram of an apparatus for interface interaction according to certain embodiments of the present disclosure; and

[0015] FIG5 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0016] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0017] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment may be included under any section / subsection. Furthermore, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or in different sections / subsections.

[0018] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0019] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects shall comply with the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms them. Accordingly, when implementing the various embodiments of the present disclosure, the types, scope of use, and usage scenarios of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method may vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0020] Where this specification and the embodiments involve the processing of personal information, such processing will be conducted with a legitimate basis (e.g., with the consent of the subject of personal information or as necessary for the performance of a contract) and only within the prescribed or agreed scope. A user's refusal to process personal information other than that required for basic functions will not affect the user's use of these functions.

[0021] As briefly mentioned above, with the development of computer technology, various multimedia content has become one of the main ways people access content. Multimedia content can include, for example, images, videos, text, audio, and so on. In some cases, users may desire to obtain information about specific objects within multimedia content (e.g., video content). However, this often requires users to perform complex information search operations, which seriously affects the efficiency of users in obtaining information.

[0022] To this end, embodiments of the present disclosure provide a solution for interface interaction. According to this solution, a playback interface for video content can be displayed; in response to receiving a first operation associated with the playback interface, a first image associated with the first operation in the video content can be displayed while the video content continues to play; and a group of content items associated with a group of objects in the first image can be displayed, where the group of content items is determined based on the recognition of the group of objects.

[0023] In this way, the embodiments of the present disclosure can provide users with information about related objects in the picture through object recognition without affecting the user's acquisition of video content, thereby improving the efficiency of the user's acquisition of information.

[0024] Various example implementations of this solution are described in detail below in conjunction with the accompanying drawings.

[0025] Sample Environment

[0026] FIG1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG1 , the example environment 100 may include an electronic device 110 .

[0027] In the example environment 100, an application 120 is installed in an electronic device 110. A user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices. The application 120 can be a video playback application, or any other suitable application.

[0028] In the environment 100 of FIG. 1 , if the application 120 is active, the application 120 may provide a presentation interface 150 to the user 140 .

[0029] In some embodiments, the electronic device 110 communicates with the server 130 to provide services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as "wearable" circuitry, etc.).

[0030] The server 130 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. The server 130 may include, for example, a computing system / server such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. The server 130 may provide background services for the application 120 that supports content presentation in the electronic device 110.

[0031] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established via a wired or wireless method. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus connection, a Wi-Fi connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction via the communication connection between them.

[0032] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0033] Example Interaction

[0034] According to an embodiment of the present disclosure, objects in video content can be identified and content items associated with these objects can be provided. In some embodiments, such objects can include appropriate types such as commodity objects, user objects, etc.

[0035] The following will first describe an example interaction process for identifying a commodity object with reference to FIG. 2A to FIG. 2D .

[0036] Figure 2A shows a schematic diagram of an example of an interactive interface 200A according to some embodiments of the present disclosure. As shown in Figure 2A, when the application 120 is in the running state, the electronic device 110 can present the playback interface 200A corresponding to the video content 210. In some embodiments, in response to the application 120 being in the running state, the electronic device 110 can present the playback interface 200A of the video content 210 by default.

[0037] In some embodiments, when the application 120 is in operation, the electronic device 110 may also provide a playback interface 200A as shown in FIG2A upon receiving an access request for the video content 210. In some embodiments, the video content may include, for example, a published video work.

[0038] In some embodiments, the playback interface of the video content can be a live interface, and the video content 210 can include a live video stream. It should be understood that the video content 210 and the playback interface 200A can be of any appropriate style, and the present disclosure is not intended to limit the specific style of the video content and the playback interface.

[0039] In some embodiments, upon receiving a screen clearing request from a user, the electronic device 110 may present a playback interface 200B corresponding to the video content 210. As shown in FIG2B , in the interface 200B, the electronic device 110 may provide an entry 220 for identifying a commodity object in the video content.

[0040] In some embodiments, the electronic device 110 may also exit the clear screen mode and switch to the interface 200A based on triggering the control 222 in the interface 200B.

[0041] 2A and 2C , electronic device 110 may trigger the display of panel 230 as shown in FIG2C based on a preset operation of the user in interface 200A. In some embodiments, the triggering operation includes, but is not limited to, a click operation (e.g., clicking a preset control), a long press operation, a double-click operation, a slide operation, and the like.

[0042] As shown in FIG. 2C , the electronic device 110 may provide an entry 232 in the panel 230 for identifying a merchandise object in the video content.

[0043] In some embodiments, upon receiving a selection of the entry 220 shown in FIG2B or the entry 232 shown in FIG2C , the electronic device 110 may present an interface 200D as shown in FIG2D . In some embodiments, the interface 200D may also be triggered based on other appropriate preset operations.

[0044] 2D , the electronic device 110 may display an image 240 in the video content 210 while continuing to play the video content 210. In some embodiments, the image 240 may be determined based on a received trigger operation (eg, selection of the portal 220 or the portal 232).

[0045] In some embodiments, image 240 may include at least a portion of a video frame of video content 210 at a target time. Such a target time may be determined based on the time at which the triggering operation is received. For example, electronic device 110 may determine as image 240 a video frame of video content 210 played at the time (or near the time) when selection of entry 220 or entry 232 is received.

[0046] 2D , the electronic device 110 may present a set of content items associated with a set of objects in the image 240. Such a set of objects may include one or more objects of a specified type identified from the image 240, such as merchandise objects.

[0047] 2D as an example, the group of objects may include a product object 241 and a product object 245. Accordingly, the electronic device 110 may display a content item 246 associated with the product object 241 in the panel 243.

[0048] In some embodiments, such content item 246 may include description information of at least one product that matches product object 241. As an example, such description information may include the name, price, image, etc. of the product.

[0049] In some embodiments, such content item 246 may also include an entry for viewing a viewing page of the corresponding product. For example, a user may access the details page of the product by clicking on content item 246.

[0050] Alternatively or additionally, such content item 246 may also include an entry for purchasing or adding a corresponding commodity. For example, a user may add the commodity to a shopping cart or directly purchase the commodity by clicking a corresponding control.

[0051] In some embodiments, the product associated with content item 246 may be determined based on a match with the screen content of product object 241. For example, server 130 may search a product library for one or more products that match the screen content of product object 241 in image 240 based on the screen content of product object 241 in image 240.

[0052] In some embodiments, the electronic device 110 may provide a plurality of selection controls 244 corresponding to the product object 241 and the product object 245. As shown in FIG2D, such selection controls 244 may display a portion of the image 240 corresponding to the product object 241 or the product object 245.

[0053] In some embodiments, the selection control 244-1 corresponding to the product object 241 may be in a selected state by default. In this case, the electronic device 110 may mark the product object 241 in the image 240 using a corresponding interface element, for example, to highlight the area corresponding to the product object 241.

[0054] Furthermore, after receiving the selection of the selection control 244 - 2 , the electronic device 110 may, for example, mark the product object 245 in the image 240 using a corresponding interface element, so as to highlight the corresponding area of ​​the product object 245 .

[0055] Additionally, the electronic device 110 may also switch the panel 243 to provide content items of one or more commodities matching the commodity object 245 .

[0056] In some embodiments, the electronic device 110 may further provide an identification portal 242 in association with the image 240. After receiving a trigger operation for the identification portal 242, the electronic device 110 may replace the image 240 with another image in the video content 210. The other image may, for example, correspond to a video frame played by the video content 210 at the time (or additional time) when the trigger operation is received.

[0057] In some embodiments, the electronic device 110 may also trigger recognition of another image in the video content 210 based on other appropriate operations. For example, the electronic device 110 may provide a corresponding recognition entry at another location, or may trigger recognition of another image in the video content 210 based on a preset operation of the user in the interface.

[0058] Furthermore, the electronic device 110 may also update the content in the panel 243 to display content items associated with one or more objects in the determined other image. In this way, the embodiments of the present disclosure can avoid the problem of difficulty in accurately identifying objects due to poor image quality when the user triggers the operation.

[0059] 2D , the electronic device 110 may also provide a set of recommendation items 247. Such a set of recommendation items 247 may be determined based on the provided content items 246.

[0060] Taking a product object as an example, the electronic device 110 may provide, as a recommendation item 247 , description information of one or more additional products that are similar to or associated with the product corresponding to the content item 246 .

[0061] The following will first describe an example interaction process for identifying a user object with reference to FIG. 2E to FIG. 2G .

[0062] First, referring to Figures 2E and 2F, electronic device 110 can, for example, use interfaces 200E and 200F to play video content 250. In some embodiments, video content 250 can include, for example, a published video work. In some embodiments, the playback interface of video content 250 can be a live broadcast interface, and video content 250 can include a live video stream. As an example, interface 200F can correspond to the clear screen mode of interface 200E.

[0063] Additionally, as shown in FIG. 2G , the electronic device 110 may further support a user-activated panel 252 to initiate a request to identify a user object in the video content 250 .

[0064] As an example, the electronic device 110 may receive a user selection of the entry 251 shown in FIG. 2F or the entry 253 shown in FIG. 2G , thereby receiving a request to identify a user object in the video content 250 .

[0065] Accordingly, the electronic device 110 may present an interface 200H as shown in FIG2H . In the interface 200H, the electronic device 110 may display an image 280 while continuing to play the video content 250 .

[0066] In some embodiments, the image 280 may be determined based on a received trigger operation (e.g., a selection of entry 251 or entry 253). In some embodiments, the image 280 may include at least a portion of a video frame of the video content 250 at a target time. Such a target time may be determined based on the time at which the trigger operation is received. For example, the electronic device 110 may determine the video frame of the video content 250 played at the time (or near the time) when the selection of entry 251 or entry 253 is received as the image 280.

[0067] 2H , electronic device 110 may present a set of content items associated with a set of objects in image 280. Such a set of objects may include one or more objects of a specified type identified from image 280, such as user objects.

[0068] 2H as an example, the group of objects may include a user object 281. Accordingly, the electronic device 110 may display a content item 284 associated with the user object 281 in a panel 283.

[0069] In some embodiments, such content item 284 may include description information of at least one user that matches the user object 281. As an example, such description information may include the user's name, avatar, introduction, etc.

[0070] In some embodiments, such content item 284 may also include an entry for viewing a corresponding user's viewing page. For example, a user may access the user's personal page by clicking on content item 284.

[0071] Alternatively or additionally, such content item 284 may also include an entry for following a corresponding user. For example, a user may follow a corresponding user, such as a host, by clicking a corresponding control.

[0072] In some embodiments, the user associated with the content item 284 may be determined based on a match with the screen content of the user object 281. For example, the server 130 may search the user library for one or more users that match the screen content based on the screen content of the user object 281 in the image 280.

[0073] In some embodiments, the electronic device 110 may provide a plurality of selection controls 244 corresponding to the user object 281 and other user objects in the image 280. As shown in FIG2H, such selection controls 244 may display a portion of the image 280 corresponding to the user object 281.

[0074] In some embodiments, the selection control 244 corresponding to the user object 281 may be in a selected state by default. In this case, the electronic device 110 may mark the user object 281 with a corresponding interface element in the image 280, for example, to highlight the area corresponding to the user object 281.

[0075] Furthermore, after receiving a selection of the selection control 244 - 2 corresponding to the other user object, the electronic device 110 may, for example, mark the other user object using a corresponding interface element in the image 280 to, for example, highlight the area corresponding to the other user object.

[0076] Additionally, the electronic device 110 may also switch the panel 283 to provide content items of one or more users that match the selected other user object.

[0077] In some embodiments, the electronic device 110 may further provide an identification portal in association with the image 280. After receiving a trigger operation for the identification portal, the electronic device 110 may replace the image 280 with another image in the video content 250. The other image may, for example, correspond to a video frame of the video content 250 played at the time (or additional time) when the trigger operation is received.

[0078] Furthermore, the electronic device 110 may also update the content in the panel 283 to display content items associated with one or more objects in the determined other image. In this way, the embodiments of the present disclosure can avoid the problem of difficulty in accurately identifying objects due to poor image quality when the user triggers the operation.

[0079] 2H , the electronic device 110 may also provide a set of recommendation items 285. Such a set of recommendation items 285 may be determined based on the provided content item 284.

[0080] Taking the user object as an example, the electronic device 110 may provide descriptive information of one or more additional users who are similar to or associated with the user corresponding to the content item 284 as the recommendation item 285 .

[0081] In summary, the embodiments of the present disclosure can provide various types of information determined by identifying objects within video frames during video playback. Furthermore, while this information is being displayed, the user can continue to watch the video content. This improves the viewer's viewing and interactive experience.

[0082] Although the interaction process of the embodiments of the present disclosure is described above using commodity objects and user objects as examples, it should be understood that the above object recognition and information provision process is also applicable to any other appropriate types of objects, such as animals, buildings, food, etc.

[0083] Example Process

[0084] FIG3 shows a flow chart of a process 300 for interface interaction according to some embodiments of the present disclosure. The process 300 may be implemented at the electronic device 110. The process 300 is described below with reference to FIG1.

[0085] In block 310 , the electronic device 110 displays a playback interface of the video content.

[0086] In block 320 , in response to receiving the first operation associated with the play interface, the electronic device 110 displays a first image associated with the first operation in the video content while continuing to play the video content.

[0087] At block 330 , the electronic device 110 displays a set of content items associated with the set of objects in the first image, the set of content items being determined based on the recognition of the set of objects.

[0088] In some embodiments, the first image includes at least a portion of a video frame of the video content at a target time, the target time being determined based on a time at which the first operation is received.

[0089] In some embodiments, process 300 further includes labeling a group of objects in the first image using the first element.

[0090] In some embodiments, a group of objects includes multiple objects, and process 300 also includes: displaying multiple selection controls corresponding to the multiple objects; and based on triggering a first selection control among the multiple selection controls, displaying at least one content item associated with the first object, the first object corresponding to the first selection control.

[0091] In some embodiments, process 300 further includes: displaying portions of the first image corresponding to the plurality of objects using a plurality of selection controls; and / or marking the selected first object in the first image using a second element.

[0092] In some embodiments, a group of objects is a first group of objects, and a group of content items is a first group of content items, and process 300 also includes: in response to receiving a second operation, while keeping playing the video content, replacing the first image with a second image in the video content determined based on the second operation; and displaying a second group of content items associated with the second group of objects in the second image.

[0093] In some embodiments, the set of objects includes a product object, and the set of content items includes descriptive information of at least one product that matches the product object.

[0094] In some embodiments, a set of content items further includes: a first entry for viewing a viewing page of at least one product; and / or a second entry for purchasing or adding to a purchase at least one product.

[0095] In some embodiments, the set of objects includes a user object, and the set of content items includes descriptive information of at least one user that matches the user object.

[0096] In some embodiments, the set of content items further includes: a third entry for viewing a personal page of at least one user; and / or a fourth entry for following at least one user.

[0097] In some embodiments, process 300 further includes displaying a set of recommendation items, the set of recommendation items being determined based on the set of content items.

[0098] In some embodiments, a set of content items is associated with a target product or a target user, and a set of recommendation items includes descriptive information about a set of additional products or a set of additional users, where the set of additional products or the set of additional users are determined based on the target product or the target user.

[0099] Example devices and equipment

[0100] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above-described methods or processes. FIG4 shows a schematic structural block diagram of an apparatus 400 for interface interaction according to certain embodiments of the present disclosure. Apparatus 400 may be implemented as or included in electronic device 110. Each module / component in apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0101] As shown in the figure, the device 400 includes an interface presentation module 410, which is configured to display a playback interface of the video content; a first display module 420, which is configured to display a first image associated with the first operation in the video content while keeping playing the video content in response to receiving a first operation associated with the playback interface; and a second display module 430, which is configured to display a group of content items associated with a group of objects in the first image, where the group of content items is determined based on the recognition of a group of objects.

[0102] In some embodiments, the first image includes at least a portion of a video frame of the video content at a target time, the target time being determined based on a time at which the first operation is received.

[0103] In some embodiments, the apparatus 400 further includes a marking module configured to mark a group of objects in the first image using the first element.

[0104] In some embodiments, a group of objects includes multiple objects, and the device 400 also includes a third display module, which is configured to display multiple selection controls corresponding to the multiple objects; and based on triggering the first selection control among the multiple selection controls, display at least one content item associated with the first object, and the first object corresponds to the first selection control.

[0105] In some embodiments, the apparatus 400 further includes a second marking module configured to display portions of the first image corresponding to the plurality of objects using a plurality of selection controls; and / or mark the selected first object in the first image using a second element.

[0106] In some embodiments, a group of objects is a first group of objects, a group of content items is a first group of content items, and the device 400 also includes a processing module, which is configured to, in response to receiving a second operation, replace the first image with a second image determined in the video content based on the second operation while keeping playing the video content; and display a second group of content items associated with the second group of objects in the second image.

[0107] In some embodiments, the set of objects includes a product object, and the set of content items includes descriptive information of at least one product that matches the product object.

[0108] In some embodiments, a set of content items further includes: a first entry for viewing a viewing page of at least one product; and / or a second entry for purchasing or adding to a purchase at least one product.

[0109] In some embodiments, the set of objects includes a user object, and the set of content items includes descriptive information of at least one user that matches the user object.

[0110] In some embodiments, the set of content items further includes: a third entry for viewing a personal page of at least one user; and / or a fourth entry for following at least one user.

[0111] In some embodiments, the apparatus 400 further includes a fourth display module configured to display a set of recommendation items, where the set of recommendation items is determined based on a set of content items.

[0112] In some embodiments, a set of content items is associated with a target product or a target user, and a set of recommendation items includes descriptive information about a set of additional products or a set of additional users, where the set of additional products or the set of additional users are determined based on the target product or the target user.

[0113] The modules and / or units included in the device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more modules and / or units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the modules and / or units in the device 400 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0114] FIG5 shows a block diagram of an electronic device 500 that can implement one or more embodiments of the present disclosure. It should be understood that the electronic device 500 shown in FIG5 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 500 shown in FIG5 can be used to implement the electronic device 110 and / or the server 130 of FIG1 .

[0115] As shown in FIG5 , electronic device 500 is in the form of a general-purpose computing device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of electronic device 500.

[0116] The electronic device 500 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 520 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data (e.g., training data for training) and can be accessed within the electronic device 500.

[0117] The electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 520 may include a computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0118] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 500 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 500 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0119] Input device 550 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 560 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device 500 may also communicate with one or more external devices (not shown) via communication unit 540 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with electronic device 500, or with any device that allows electronic device 500 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0120] According to an exemplary embodiment of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary embodiment of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0121] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0122] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0123] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0124] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0125] While various implementations of the present disclosure have been described above, the above descriptions are exemplary, non-exhaustive, and not intended to be limiting of the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various embodiments disclosed herein.

Claims

1. A method for interface interaction, comprising: Display the playback interface of the video content; In response to receiving a first operation associated with the playback interface, displaying a first image associated with the first operation in the video content while continuing to play the video content; as well as A set of content items associated with a set of objects in the first image is displayed, the set of content items determined based on the identification of the set of objects. 2 . The method of claim 1 , wherein the first image comprises at least a portion of a video frame of the video content at a target time, the target time being determined based on a time at which the first operation is received.

3. The method according to claim 1, further comprising: The group of objects is labeled in the first image with a first element.

4. The method of claim 1 , wherein the set of objects comprises a plurality of objects, the method further comprising: displaying a plurality of selection controls corresponding to the plurality of objects; as well as Based on triggering of a first selection control among the plurality of selection controls, at least one content item associated with a first object is displayed, the first object corresponding to the first selection control.

5. The method according to claim 4, further comprising: displaying portions of the first image corresponding to the plurality of objects using the plurality of selection controls; and / or The selected first object is marked in the first image with a second element.

6. The method of claim 1 , wherein the group of objects is a first group of objects, the group of content items is a first group of content items, the method further comprising: In response to receiving a second operation, while continuing to play the video content, replacing the first image with a second image in the video content determined based on the second operation; as well as A second set of content items associated with the second set of objects in the second image is displayed. 7 . The method according to claim 1 , wherein the group of objects includes a product object, and the group of content items includes description information of at least one product matching the product object.

8. The method of claim 7, wherein the set of content items further comprises: A first entry, for viewing a viewing page of the at least one product; and / or The second entrance is used to purchase or add the at least one commodity. 9 . The method according to claim 1 , wherein the set of objects includes a user object, and the set of content items includes description information of at least one user matching the user object.

10. The method of claim 7, wherein the set of content items further comprises: A third entry, for viewing the personal page of the at least one user; and / or The fourth entry is used to follow the at least one user.

11. The method according to claim 1 , further comprising: A set of recommendation items is displayed, the set of recommendation items being determined based on the set of content items.

12. The method of claim 11, wherein the set of content items is associated with a target product or a target user, and the set of recommended items includes descriptive information about a set of additional products or a set of additional users, wherein the set of additional products or the set of additional users are determined based on the target product or the target user.

13. A device for interface interaction, comprising: An interface presentation module, configured to display a playback interface of the video content; a first display module configured to, in response to receiving a first operation associated with the playback interface, display a first image associated with the first operation in the video content while continuing to play the video content; as well as The second display module is configured to display a set of content items associated with a set of objects in the first image, wherein the set of content items is determined based on the recognition of the set of objects.

14. An electronic device comprising: at least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 12 when executed by the at least one processor. 15 . A computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions are capable of implementing the method according to claim 1 when executed by a processor.

16. A computer program product tangibly stored in a computer storage medium and comprising computer executable instructions which, when executed by a device, cause the device to perform the method according to any one of claims 1 to 12.

Images