Multimedia resource marking method, multimedia resource playing method, multimedia resource marking device, multimedia resource playing device, multimedia resource equipment and medium

Abstract

The invention provides a multimedia resource marking method and device, a multimedia resource playing method and device, equipment and a medium, and belongs to the technical field of multimedia. According to the method, a user is supported to mark the multimedia element, and interaction with the multimedia element is carried out based on the interaction control of the marked multimedia element. According to the mode, the user can mark the video frame or the video clip in the multimedia resource according to the viewpoint and the interest of the user in the process of watching the multimedia resource, so that the interaction form between the user and the multimedia resource is enriched, the watching and interaction experience of the user is improved, and the playing rate of the multimedia resource is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of multimedia technology, and in particular to a marking method, a playing method, a device, a equipment and a medium for multimedia resources. Background Art

[0002] With the development of Internet technology and the application of multimedia technology, multimedia resources have become an important carrier of information dissemination. Users can watch multimedia resources and perform various interactive operations such as adjusting the viewing progress, liking and posting comments during the viewing process. However, the above interactive forms are still relatively simple. Summary of the invention

[0003] The present disclosure provides a multimedia resource marking method, a playback method, a device, a equipment and a medium, which enriches the interaction between users and multimedia resources, improves the viewing and interactive experience of users, and is conducive to improving the playback rate of multimedia resources. The technical solution of the present disclosure is as follows.

[0004] According to one aspect of an embodiment of the present disclosure, a method for marking multimedia resources is provided, the method comprising:

[0005] Display the playback interface of multimedia resources;

[0006] In response to a marking operation on a multimedia element in the playback interface, an information input component of the multimedia element is displayed, where the multimedia element is any video frame or any video clip of the multimedia resource;

[0007] Acquire the mark information input in the information input component, wherein the mark information is used to represent the viewpoint of the terminal login object;

[0008] An interactive control associated with the mark information is displayed in the playback interface, and interaction is performed based on the interactive control.

[0009] According to another aspect of an embodiment of the present disclosure, a method for playing multimedia resources is provided, the method comprising:

[0010] Display a playback interface, where the playback interface is used to play multimedia resources;

[0011] Displaying tag information of a multimedia element in the playback interface, the tag information is used to indicate the view of the audience of the multimedia resource on the multimedia element, the multimedia element being a video frame or a video clip in the multimedia resource;

[0012] An interactive control associated with the mark information is displayed in the playback interface, and interaction is performed based on the interactive control.

[0013] According to another aspect of an embodiment of the present disclosure, a multimedia resource marking device is provided, the device comprising:

[0014] An interface display unit, configured to display a playback interface of multimedia resources;

[0015] a component display unit, configured to display an information input component of a multimedia element in response to a marking operation on a multimedia element in the playback interface, wherein the multimedia element is any video frame or any video clip of the multimedia resource;

[0016] an acquisition unit, configured to acquire the mark information input in the information input component, wherein the mark information is used to represent the viewpoint of the terminal login object;

[0017] The interaction unit is configured to display the interaction control associated with the mark information in the playback interface and perform interaction based on the interaction control.

[0018] In some embodiments, the interaction unit is configured to send the multimedia element and the tag information to the target object in response to a trigger operation on a sharing control associated with the tag information; or, in response to a trigger operation on a comment control associated with the tag information, display comment information in a comment display area of ​​the multimedia resource, the comment information including the multimedia element and the tag information; or, in response to a trigger operation on a collection control associated with the tag information, add the multimedia element and the tag information to a favorites; or, in response to a trigger operation on a storage control associated with the tag information, store a target image, the target image being generated based on the multimedia element and the tag information; or, in response to a trigger operation on a barrage publishing control associated with the tag information, publish barrage information in the playback interface, the barrage information including the tag information.

[0019] In some embodiments, the interface display unit is further configured to display bullet screen information in the playback interface in response to playing the multimedia element, and the bullet screen information includes the tag information.

[0020] In some embodiments, the component display unit is configured to display the information input component of the multimedia element in response to a marking operation on the multimedia element in the playback interface when the multimedia resource is a multimedia resource sent by an associated object of the terminal login object.

[0021] In some embodiments, the component display unit is further configured to send a mark sharing message to the associated object, the mark sharing message including the multimedia element and the marking information, and the mark sharing message is used to indicate that the terminal login object has marked the multimedia element.

[0022] In some embodiments, the component display unit is configured to display a preview area in the playback interface in response to a marking operation on the first video frame in the playback interface, wherein the preview area includes the first video frame and displays the information input component associated with the first video frame.

[0023] In some embodiments, a video frame adjacent to the first video frame is also displayed in the preview area; the component display unit is also configured to display the information input component associated with the second video frame in response to a selection operation on the second video frame in the preview area.

[0024] In some embodiments, the component display unit is configured to display a playback progress bar of the multimedia resource in the playback interface, and in response to a sliding operation in a target direction after the playback progress bar is pressed for a preset time, display an information input component of the video frame corresponding to the pressed position; or, when the multimedia resource is played to any video frame, in response to a preset gesture operation in the playback interface, display the information input component of the video frame in the playback interface.

[0025] In some embodiments, the playback interface displays a playback progress bar of the multimedia resource, and the component display unit is configured to display an information input component of the video segment determined by the first position and the second position in response to sequential triggering operations on the first position and the second position on the playback progress bar; or, in response to sliding from the third position to the fourth position on the playback progress bar, display the information input component of the video segment determined by the third position and the fourth position; or, in response to dragging the start mark and the end mark on the playback progress bar, display the information input component of the video segment determined by the start mark and the end mark.

[0026] In some embodiments, the component display unit is further configured to display candidate input information based on the multimedia element, wherein the candidate input information is used to describe the multimedia element; and in response to a triggering operation on the candidate input information, display the candidate input information in the information input component.

[0027] In some embodiments, the component display unit is further configured to display expression resources associated with the keywords in the tag information; in response to a triggering operation on the expression resources, display the keywords in the tag information replaced with the expression resources.

[0028] In some embodiments, the apparatus further comprises:

[0029] The first information display unit is configured to display the summary marking information of the multimedia element at a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, where the summary marking information is generated based on the marking information of the multimedia element by at least one object.

[0030] In some embodiments, the first information display unit is further configured to display summary marking information of the multimedia element at a position corresponding to any multimedia element on the playback progress bar in response to the multimedia element satisfying a preset condition; wherein the preset condition includes at least one of the following: the number of objects marking the multimedia element is greater than a preset threshold; the ranking corresponding to the number of objects marking the multimedia element is within a preset ranking.

[0031] In some embodiments, the aggregated tagging information includes at least one of a tagging keyword of the multimedia element and the number of accounts that tagged the multimedia element, and the tagging keyword is generated from at least one piece of tagging information for the multimedia element.

[0032] In some embodiments, the apparatus further comprises:

[0033] The second information display unit is configured to display the marking detail information of any multimedia element in response to a marking viewing operation on the multimedia element, wherein the marking detail information includes at least one of the number of objects marking the multimedia element, at least one piece of marking information for the multimedia element, the number of times the multimedia element is marked, and the ranking of the number of times the multimedia element is marked.

[0034] In some embodiments, the opinion is a first type or a second type of opinion, the first type is used to indicate that the terminal login object is supportive of the multimedia element, and the second type is used to indicate that the terminal login object is opposed to the multimedia element.

[0035] According to another aspect of an embodiment of the present disclosure, a device for playing multimedia resources is provided, the device comprising:

[0036] An interface display unit, configured to display a playback interface, wherein the playback interface is used to play multimedia resources;

[0037] an information display unit, configured to display tag information of a multimedia element in the playback interface, wherein the tag information is used to indicate the viewpoint of the audience of the multimedia resource on the multimedia element, and the multimedia element is a video frame or a video clip in the multimedia resource;

[0038] A control display unit is configured to display the interactive control associated with the mark information in the playback interface and to interact based on the interactive control.

[0039] In some embodiments, the control display unit is configured to display the interactive controls associated with the tag information in the playback interface in response to the playback time of the multimedia resource reaching a preset time, and interact based on the interactive controls; or, in response to interactive operations with the multimedia resource, display the interactive controls associated with the tag information in the playback interface, and interact based on the interactive controls.

[0040] In some embodiments, the control display unit is configured to do at least one of the following: in response to a trigger operation on a sharing control associated with the tag information, send the multimedia element and the tag information to a target object; or, in response to a trigger operation on a comment control associated with the tag information, display comment information in a comment display area of ​​the multimedia resource, the comment information including the multimedia element and the tag information; or, in response to a trigger operation on a collection control associated with the tag information, add the multimedia element and the tag information to a favorites; or, in response to a trigger operation on a storage control associated with the tag information, store a target image, the target image being generated based on the multimedia element and the tag information; or, in response to a trigger operation on a barrage publishing control associated with the tag information, publish barrage information in the playback interface, the barrage information including the tag information.

[0041] In some embodiments, the information display unit is further configured to display bullet screen information in the playback interface in response to playing the multimedia element, and the bullet screen information includes the tag information.

[0042] In some embodiments, the opinion is a first type or a second type of opinion, the first type is used to indicate that the terminal login object is supportive of the multimedia element, and the second type is used to indicate that the terminal login object is opposed to the multimedia element.

[0043] In some embodiments, the information display unit is further configured to display a first identifier on the playback progress bar of the multimedia resource when the terminal login object has marked the multimedia elements in the multimedia resource; and to display a second identifier on the playback progress bar of the multimedia resource when the terminal login object has not marked the multimedia elements in the multimedia resource.

[0044] In some embodiments, the information display unit is further configured to display summary marking information of the multimedia element at a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, wherein the summary marking information is generated based on marking information of the multimedia element by at least one object.

[0045] In some embodiments, the information display unit is further configured to display summary tag information of the multimedia element in the playback interface in response to playing the multimedia element, wherein the summary tag information is generated based on tag information of the multimedia element by at least one object; or, in response to the playback progress bar of the multimedia resource being dragged to a position corresponding to the multimedia element or the position corresponding to the multimedia element in the playback progress bar being clicked, display the summary tag information in the playback interface.

[0046] In some embodiments, the information display unit is further configured to display a tag list of the multimedia element in the playback interface, the tag list including tag information corresponding to multiple opinion types and the number of tags corresponding to the multiple opinion types, the number of tags referring to the number of viewers who added tag information of the opinion type to the multimedia element.

[0047] In some embodiments, the marking information is used to represent the views of the associated object of the terminal login object on the multimedia element, and the information display unit is also configured to display prompt information in the playback interface, and the prompt information is used to prompt that the associated object has marked the multimedia element; in response to a triggering operation on the prompt information, the multimedia resource is played starting from the multimedia element.

[0048] According to another aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0049] one or more processors;

[0050] A memory for storing program codes executable by the processor;

[0051] The processor is configured to execute the program code to implement the above-mentioned multimedia resource marking method or multimedia resource playing method.

[0052] According to another aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can execute the above-mentioned multimedia resource marking method or multimedia resource playing method.

[0053] According to another aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program, which implements the above-mentioned multimedia resource marking method or multimedia resource playback method when executed by a processor.

[0054] The disclosed embodiment provides a multimedia resource marking method, which supports users to mark multimedia elements and interact with multimedia elements based on the interactive controls of the marked multimedia elements. The above method enables users to mark video frames or video clips in multimedia resources according to their own views and interests during the process of watching multimedia resources, which enriches the interaction between users and multimedia resources, improves the viewing and interactive experience of users, and is conducive to improving the playback rate of multimedia resources.

[0055] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0057] Figure 1 is a schematic diagram of an implementation environment according to an exemplary embodiment;

[0058] Figure 2 is a flow chart of a multimedia resource marking method according to an exemplary embodiment;

[0059] Figure 3 is a flow chart of another multimedia resource marking method according to an exemplary embodiment;

[0060] Figure 4 is a schematic diagram of a multimedia resource playback interface according to an exemplary embodiment;

[0061] Figure 5 is a schematic diagram of another multimedia resource playback interface according to an exemplary embodiment;

[0062] Figure 6 is a flow chart of another multimedia resource marking method according to an exemplary embodiment;

[0063] Figure 7 is a flow chart of another multimedia resource marking method according to an exemplary embodiment;

[0064] Figure 8 is a schematic diagram of another multimedia resource playback interface according to an exemplary embodiment;

[0065] Fig. 9 is a flowchart of a method for playing multimedia resources according to an exemplary embodiment;

[0066] Fig.10 is a flow chart of another method for playing multimedia resources according to an exemplary embodiment;

[0067] Fig.11 is a schematic diagram showing a play page with interactive controls displayed according to an exemplary embodiment;

[0068] Fig.12 is a schematic diagram showing a play page displaying a mark list according to an exemplary embodiment;

[0069] Fig.13 is a block diagram of a multimedia resource marking device according to an exemplary embodiment;

[0070] Fig.14 is a block diagram of another multimedia resource marking device according to an exemplary embodiment;

[0071] Fig.15 is a block diagram of a multimedia resource playback device according to an exemplary embodiment;

[0072] Fig.16 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0073] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0074] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0075] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions. For example, the multimedia resources, tag information, summary tag information and tag detail information involved in this disclosure are all obtained with full authorization.

[0076] Figure 1 FIG. 1 is a schematic diagram of an implementation environment according to an exemplary embodiment. Figure 1 The implementation environment specifically includes: a terminal 101 and a server 102. The terminal 101 can be connected to the server 102 via a wireless network or a wired network.

[0077] The terminal 101 can be at least one of a smart phone, a smart watch, a desktop computer, a laptop, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), and a laptop computer. A target application can be installed and run on the terminal 101. The target application is used to play multimedia resources, and during the playback of multimedia resources, the logged-in object (viewer) of the terminal 101 can mark any video frame or any video clip in the multimedia resources. The target application is associated with the server 102, and the server 102 provides background services to the terminal 101.

[0078] The terminal 101 may generally refer to one of a plurality of terminals. This embodiment is described by taking the terminal 101 as an example. Those skilled in the art may know that the number of the above terminals may be more or less. For example, the above terminals may be several, or the above terminals may be dozens or hundreds, or a greater number. The embodiment of the present disclosure does not limit the number and device type of the terminals.

[0079] The server 102 is at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. Optionally, the number of the above servers may be more or less, which is not limited in the embodiments of the present disclosure. Of course, the server 102 may also include other functional servers to provide more comprehensive and diversified services. In some embodiments, the server 102 undertakes the main computing work, and the terminal 101 undertakes the secondary computing work; or, the server 102 undertakes the secondary computing work, and the terminal 101 undertakes the main computing work; or, the server 102 and the terminal 101 use a distributed computing architecture for collaborative computing. The server 102 can be connected to the terminal 101 and other terminals via a wireless network or a wired network. Optionally, the number of the above servers may be more or less, which is not limited in the embodiments of the present disclosure.

[0080] Figure 2 is a flowchart of a multimedia resource marking method according to an exemplary embodiment. Figure 2 As shown, the method is executed by the terminal and includes the following steps.

[0081] In step S201, the terminal displays a playback interface of a multimedia resource.

[0082] In the embodiments of the present disclosure, the multimedia resource may be a video, an image set, etc., which is not limited in the embodiments of the present disclosure. In addition to displaying the multimedia resource, the multimedia resource playback interface may also display description information of the multimedia resource, such as the title and introduction of the multimedia resource, or controls of the multimedia resource, such as a like control, a favorite control, and a share control.

[0083] It should be noted that the embodiments of the present disclosure do not limit the application in which the playback interface of the multimedia resource is located. For example, the playback interface of the multimedia resource can be a page in a variety of applications such as a video playback application, an e-shopping application, a social media application, and an online music application. The embodiments of the present disclosure do not limit the terminal that displays the playback interface of the multimedia resource. Accordingly, the terminal can be a terminal used by the publisher of the multimedia resource, and the terminal can also be a terminal used by the viewer of the multimedia resource.

[0084] In step S202, the terminal displays an information input component of the multimedia element in response to a marking operation on the multimedia element in the play interface, where the multimedia element is any video frame or any video clip of the multimedia resource.

[0085] In the embodiment of the present disclosure, the multimedia element may be in the form of an image or a video. The marking operation is used to mark the multimedia element in the playback interface. The embodiment of the present disclosure does not limit the marking operation. For example, the marking operation may be an interactive operation with a specific component in the playback interface, or may be a specific gesture operation in the playback interface.

[0086] The information input component of the multimedia element is used to input information for the multimedia element. The information input component of the multimedia element can be displayed in any area of ​​the playback interface. In order to establish a visual connection between the information input component of the multimedia element and the multimedia element, the information input component of the multimedia element is displayed in a display area associated with the multimedia element, such as a display area associated with the corresponding position of the multimedia element in the playback progress bar, or a display area associated with the thumbnail of the multimedia element.

[0087] In step S203, the terminal obtains the tag information input in the information input component, where the tag information is used to represent the viewpoint of the terminal login object.

[0088] In the disclosed embodiment, the terminal login object is the account logged in by the terminal. To prompt the user to input the marking information in the information input component, the information input component may display a prompt message. For example, the prompt message is "Enter the information and mark it, and tell me the reason for your marking".

[0089] The disclosed embodiments do not limit the form of the marking information. For example, the marking information may be text or an image. The disclosed embodiments do not limit the content of the marking information. Accordingly, the marking information indicates whether the user likes the multimedia element, the marking information indicates the reason why the user recommends or does not recommend the multimedia element, the marking information indicates the content that the user thinks the multimedia element can be improved, etc. For example, the marking information is "This frame is so beautiful", or "This plot is super exciting", or "This segment is very scary, it is recommended to skip", etc.

[0090] In step S204, the terminal displays the interactive controls associated with the mark information in the play interface, and performs interaction based on the interactive controls.

[0091] In the embodiment of the present disclosure, the number of interactive controls associated with the tag information may be one or at least two. The interactive controls associated with the tag information may be used to perform at least one of a plurality of interactive behaviors such as sharing, liking, collecting, saving, and sending comments, which are not limited here.

[0092] The original controls displayed in the playback interface are directly associated with multimedia resources for users to interact with multimedia resources. Different from this, the interactive controls associated with tag information are associated with tag information for users to interact with the tag information. For example, the original sharing controls in the playback interface are used to share multimedia resources with other objects related to the terminal login object. The sharing controls associated with the tag information displayed in the playback interface are used to share the tag information, or the tag information and the corresponding multimedia elements, etc. with other objects related to the terminal login object.

[0093] The disclosed embodiment provides a multimedia resource marking method, which supports users to mark multimedia elements and interact with multimedia elements based on the interactive controls of the marked multimedia elements. The above method enables users to mark video frames or video clips in multimedia resources according to their own views and interests during the process of watching multimedia resources, which enriches the interaction between users and multimedia resources, improves the viewing and interactive experience of users, and is conducive to improving the playback rate of multimedia resources.

[0094] In some embodiments, the interaction based on the interactive control includes at least one of the following:

[0095] In response to a triggering operation on a sharing control associated with the tag information, sending the multimedia element and the tag information to the target object; or,

[0096] In response to a triggering operation on a comment control associated with the tag information, displaying the comment information in a comment display area of ​​the multimedia resource, the comment information including the multimedia element and the tag information; or,

[0097] In response to a triggering operation on a favorites control associated with the tag information, adding the multimedia element and the tag information to a favorites folder; or,

[0098] In response to a triggering operation on a storage control associated with the tag information, a target image is stored, where the target image is generated based on the multimedia element and the tag information; or,

[0099] In response to a triggering operation on a bullet-screen publishing control associated with the mark information, the bullet-screen information is published in the playback interface, and the bullet-screen information includes the mark information.

[0100] In the disclosed embodiments, the user is supported to interact with the multimedia elements through sharing controls, comment controls, favorite controls, storage controls, and bullet screen publishing controls. Among them, the sharing controls, comment controls, and bullet screen publishing controls associated with the tag information promote the dissemination of information and are conducive to improving the playback rate of multimedia resources; the favorite controls and storage controls associated with the tag information meet the user's information management needs. The above-mentioned interactive controls and interactive behaviors not only enrich the interactive methods of multimedia resources, but also enhance the user's experience and participation in watching multimedia resources.

[0101] In some embodiments, the method further comprises:

[0102] In response to playing to the multimedia element, barrage information is displayed in the playback interface, and the barrage information includes marking information.

[0103] In the disclosed embodiment, the above method can display the bullet screen information containing the tag information without the user having to re-enter the tag information and confirm the release through the conventional bullet screen release function. Therefore, the above method reduces the operation steps and improves the efficiency of human-computer interaction. At the same time, since part of the bullet screen information displayed when playing multimedia resources contains the tag information and can reflect the user's point of view, the above method increases the richness of the bullet screen information.

[0104] In some embodiments, in response to a marking operation on a multimedia element in a playback interface, displaying an information input component of the multimedia element includes:

[0105] In the case where the multimedia resource is a multimedia resource sent by an associated object of the terminal login object, in response to a marking operation on the multimedia element in the play interface, an information input component of the multimedia element is displayed.

[0106] In the disclosed embodiment, the above method improves the interactive experience between the terminal login object and the associated object, and is also conducive to improving the playback rate of multimedia resources.

[0107] In some embodiments, the method further comprises:

[0108] A tag sharing message is sent to the associated object, the tag sharing message includes the multimedia element and tag information, and the tag sharing message is used to indicate that the terminal login object has marked the multimedia element.

[0109] In the disclosed embodiment, the above method provides an interactive function between the associated object and the terminal login object based on the marking of multimedia resources, enriches the interaction form, improves the interactive experience between the terminal login object and the associated object, and is also conducive to improving the playback rate of multimedia resources.

[0110] In some embodiments, in response to a marking operation on a multimedia element in a playback interface, displaying an information input component of the multimedia element includes:

[0111] In response to a marking operation on the first video frame in the playback interface, a preview area is displayed in the playback interface, the preview area includes the first video frame, and an information input component associated with the first video frame is displayed.

[0112] In the embodiment of the present disclosure, by displaying the first video frame in the preview area of ​​the playback interface and displaying the information input component associated with the first video frame at the same time, it is convenient for the user to clearly preview the video frame being marked, so as to more accurately input the marking information related to the video frame. The above method provides a way for the user to mark and express opinions on specific video frames in multimedia resources, enriches the interaction between the user and the multimedia resources, and enhances the interactivity between the user and the playback interface.

[0113] In some embodiments, a video frame adjacent to the first video frame is also displayed in the preview area; and the method further includes:

[0114] In response to a selection operation on the second video frame in the preview area, an information input component associated with the second video frame is displayed.

[0115] In the disclosed embodiment, by displaying video frames adjacent to the first video frame, the orderliness of information display is improved, and it is convenient for users to compare adjacent and similar video frames, which is helpful to help users accurately determine the video frames they want to mark and enter the corresponding marking information. At the same time, by allowing users to directly select other video frames in the preview area for marking, it is convenient to switch between different video frames, which improves the convenience of operation.

[0116] In some embodiments, in response to a marking operation on a multimedia element in a playback interface, displaying an information input component of the multimedia element includes:

[0117] A playback progress bar of a multimedia resource is displayed in the playback interface, and in response to a sliding operation in a target direction after the playback progress bar is pressed for a preset time, an information input component of a video frame corresponding to the pressed position is displayed; or,

[0118] When the multimedia resource is played to any video frame, in response to a preset gesture operation in the play interface, an information input component of the video frame is displayed in the play interface.

[0119] In the disclosed embodiment, by allowing the user to intuitively select the video frame position to be marked by pressing the playback progress bar and then sliding, the convenience of user operation is improved. By allowing the user to mark the currently played video frame through preset gesture operations and call up the information input component of the currently played video frame without jumping to other interfaces or performing other complex operations, the operation process is further simplified and convenient.

[0120] In some embodiments, the playback interface displays a playback progress bar of the multimedia resource, and in response to a marking operation on the multimedia element in the playback interface, an information input component of the multimedia element is displayed, including:

[0121] In response to the sequential triggering operation of the first position and the second position on the play progress bar, an information input component of the video segment determined by the first position and the second position is displayed; or,

[0122] In response to sliding from the third position to the fourth position on the play progress bar, displaying an information input component of the video segment determined by the third position and the fourth position; or,

[0123] In response to a dragging operation of a start mark and an end mark on the play progress bar, an information input component of a video segment determined by the start mark and the end mark is displayed.

[0124] In the disclosed embodiment, by supporting users to select the video clips they want to mark through a variety of interactive methods, the operating habits and needs of different users are met. At the same time, by precisely controlling the position on the playback progress bar, the user can accurately select a specific clip in the video for marking. This intuitive operating interface and concise operating steps improve the marking efficiency.

[0125] In some embodiments, after displaying the information input component of the multimedia element, the method further includes:

[0126] Based on the multimedia element, display candidate input information, where the candidate input information is used to describe the multimedia element;

[0127] In response to a triggering operation on the candidate input information, the candidate input information is displayed in the information input component.

[0128] In the disclosed embodiment, since the candidate input information is content related to the multimedia element, by providing the candidate input information, the user can select the candidate input information or modify it based on the candidate input information, which improves the efficiency of information input and is more convenient and quick.

[0129] In some embodiments, after acquiring the mark information input in the information input component, the method further includes:

[0130] Based on the keywords in the tag information, display the expression resources associated with the keywords;

[0131] In response to the triggering operation on the expression resource, it is displayed that the keywords in the markup information are replaced with the expression resource.

[0132] In the disclosed embodiment, by providing associated expression resources for users to choose from, the steps of searching and inserting expression resources for users are simplified, so that users can directly determine the corresponding expression resources without leaving the information input component, thereby improving the efficiency and convenience of information editing. At the same time, by allowing users to replace keywords in the marked information with corresponding expression resources, the interactivity between users and the information input component is increased, and the interaction mode is enriched.

[0133] In some embodiments, the method further comprises:

[0134] At a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, summary marking information of the multimedia element is displayed, where the summary marking information is generated based on marking information of the multimedia element by at least one object.

[0135] In the disclosed embodiment, the above method can prompt the user to pay attention to and watch a specific video frame or video clip in the multimedia resource. At the same time, by displaying the summary tag information, the user can intuitively display the overview of the relevant tag information of the multimedia element. This allows the user to obtain user feedback by summarizing the tag information without having to view each tag information of other users separately, enriching the display content of the multimedia resource and improving the efficiency of information transmission.

[0136] In some embodiments, at a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, the summary mark information of the multimedia element is displayed, including:

[0137] In response to the multimedia element satisfying a preset condition, displaying summary mark information of the multimedia element at a position corresponding to any multimedia element on the play progress bar;

[0138] The preconditions include at least one of the following:

[0139] The number of objects marking multimedia elements is greater than a preset threshold;

[0140] The ranking corresponding to the number of objects marking multimedia elements is within the preset ranking.

[0141] In the disclosed embodiment, by using preset conditions such as the number of marked objects being greater than a preset threshold or the ranking being within a preset ranking, multimedia elements that have received more attention or higher evaluation can be screened out and the corresponding summary mark information can be displayed. This not only avoids excessive information display at the playback progress bar, prevents users from being disturbed by irrelevant or redundant information, but also improves the pertinence and quality of information display.

[0142] In some embodiments, the aggregated tag information includes at least one of a tag keyword of the multimedia element and the number of accounts that tagged the multimedia element, and the tag keyword is generated from at least one piece of tag information for the multimedia element.

[0143] In the disclosed embodiment, since the tagged keyword is a brief description of the content of the multimedia element, it is helpful for users to quickly understand the theme of the multimedia element or the evaluation it has received. At the same time, by displaying the number of accounts that tagged the multimedia element, the degree of attention the multimedia element has received can be intuitively reflected. By displaying the tagged keywords and the number of tagged accounts, not only the readability and intuitiveness of the information are enhanced, but also multi-dimensional information about the multimedia elements is provided, reflecting the content of the key elements or the user's consensus on the content, enriching the displayed content and the user's viewing experience.

[0144] In some embodiments, the method further comprises:

[0145] In response to a mark viewing operation on any multimedia element, mark detail information of the multimedia element is displayed, and the mark detail information includes at least one of the number of objects marking the multimedia element, at least one piece of marking information for the multimedia element, the number of times the multimedia element is marked, and the ranking of the number of times the multimedia element is marked.

[0146] In the disclosed embodiment, by displaying marking detail information such as the number of marks, multiple marking information, the number of times marked and the ranking of the number of times marked, the user can have a more comprehensive understanding of the marking status of the multimedia elements. This not only helps the user to more accurately determine the popularity and views of the multimedia elements, but also improves the richness and comprehensiveness of the information display.

[0147] In some embodiments, the viewpoint is a first type or a second type of viewpoint, the first type is used to indicate that the terminal login object is supportive of the multimedia element, and the second type is used to indicate that the terminal login object is opposed to the multimedia element.

[0148] In the embodiment of the present disclosure, through the above-mentioned method, the terminal supports marking various types of viewpoints on multimedia elements to express one's support or opposition attitude, which is conducive to promoting interaction.

[0149] Above Figure 2The flowchart of a multimedia resource marking method of the present disclosure is only the basic process of the present disclosure. A specific implementation method is proposed on this basis. By introducing various marking operations on video frames and video clips, and the corresponding content displayed by the terminal, the solution provided by the present disclosure is further explained. Figure 3 , Figure 3 The flowchart of another multimedia resource marking method according to an exemplary embodiment is shown. The method is executed by a terminal and includes the following steps.

[0150] In step S301, the terminal displays a playback interface of a multimedia resource.

[0151] In the embodiment of the present disclosure, step S301 is similar to step S201 and will not be described in detail here.

[0152] It should be noted that when the multimedia element is a video frame, the marking operations supported by the terminal and the corresponding responses refer to step S302; when the multimedia element is a video clip, the marking operations supported by the terminal and the corresponding responses refer to step S303.

[0153] In step S302, in response to a marking operation on any video frame in the playback interface, the terminal displays an information input component associated with the video frame.

[0154] In the embodiment of the present disclosure, the information input component associated with the video frame is used to input the tag information of the video frame. The information input component associated with the video frame can be displayed in any area of ​​the playback interface. The information input component can be displayed in the display area associated with the corresponding position of the video frame in the playback progress bar, and can also be displayed in the display area associated with the thumbnail of the video frame, which is not limited by the embodiment of the present disclosure.

[0155] It should be noted that the above step S302 includes at least one of the following methods A and B. A playback progress bar of the multimedia resource is displayed in the playback interface.

[0156] Mode A: In response to the sliding operation in the target direction after the duration of pressing the playback progress bar reaches a preset duration, the terminal displays the information input component of the video frame corresponding to the pressed position. For example, the preset duration can be set to 2 seconds or 3 seconds, and the target direction can be set to upward or downward.

[0157] Among them, the pressing operation and the sliding operation can be called a marking operation based on the playback progress bar. At this time, after performing the marking operation, the terminal confirms the video frame corresponding to the pressing position as the video frame that the user wants to mark by default, and displays the information input component of the video frame. Optionally, after performing the marking operation, the terminal can also confirm the preset video frame or the current video frame as the video frame that the user wants to mark by default, and display the information input component of the video frame. Among them, the preset video frame can be the first video frame of the multimedia resource, and the current video frame can be the video frame played by the multimedia resource when the pressing starts.

[0158] Mode B: When the multimedia resource is played to any video frame, the terminal responds to a preset gesture operation in the playback interface and displays the information input component of the video frame in the playback interface. The preset gesture operation may be a long press operation, a double-click operation, a trigger operation of a mark control in the playback interface, etc. The mark control is used to mark the video frame currently displayed in the playback interface.

[0159] It should be noted that the terminal supports selecting the video frame position to be marked by pressing the playback progress bar and sliding, which improves the convenience of user operation. The terminal supports users to call up the information input component of the currently played video frame through preset gesture operations, without jumping to other interfaces or performing complex operations of selecting video frames again, further simplifying the operation process and making it convenient and quick.

[0160] In some embodiments, the terminal displays prompt information in response to an interactive operation on the playback progress bar. The prompt information is used to prompt a marking operation based on the playback progress bar to achieve marking of multimedia elements. Among them, the interactive operation on the playback progress bar may be dragging the playback progress bar, clicking the playback progress bar, double-clicking the playback progress bar, and long pressing the playback progress bar, etc., which is not limited in the embodiments of the present disclosure. When the user interacts with the playback progress bar, the terminal displays the prompt information to indicate to the user the marking function that can be achieved through the playback progress bar, which is conducive to promoting further interaction between the user and the playback progress bar.

[0161] In some embodiments, in response to the interactive operation on the play progress bar, the terminal may also display at least one of the following information: the play time corresponding to the currently played video frame, the duration of the multimedia resource, the play time corresponding to the interactive operation position, the thumbnail of the video frame corresponding to the interactive operation position, the thumbnail of the video frame played when the interactive operation starts, etc. The disclosed embodiment does not limit this. By displaying one or more of the above information, more abundant and comprehensive information related to the current interactive operation and the play progress bar is provided, so that the user can perform subsequent operations conveniently.

[0162] It should be noted that, during the interaction with the playback progress bar, the multimedia resources in the playback interface may stop playing or continue playing, and the embodiments of the present disclosure do not limit this.

[0163] To facilitate the description of the playback interface of multimedia resources, see Figure 4 As shown, Figure 4 401 is a play progress bar. 402 is a prompt message, which is displayed as "Press and hold for 2 seconds to mark the highlights". 403 is used to indicate the play time corresponding to the currently played video frame and the total duration of the multimedia resource.

[0164] In some embodiments, the terminal supports marking multimedia resources sent by associated objects. Accordingly, when the multimedia resources are multimedia resources sent by associated objects of the terminal login object, the terminal displays the information input component of the multimedia element in response to the marking operation on the multimedia element in the playback interface. The associated object refers to an object that has an associated relationship with the terminal login object, such as a friend object of the terminal login object.

[0165] It should be noted that the above method improves the interactive experience between the terminal login object and the associated object, and is also conducive to improving the playback rate of multimedia resources.

[0166] In some embodiments, the terminal supports sending relevant information to the associated object after marking the multimedia resource. Accordingly, the terminal sends a marking sharing message to the associated object, and the marking sharing message includes the multimedia element and the marking information. The marking sharing message is used to indicate that the terminal login object has marked the multimedia element. Among them, the terminal can automatically send the marking sharing information to the associated object after the terminal login object completes the marking; the terminal can also send the marking sharing information to the associated object when the terminal login object completes the marking and confirms the sharing. The embodiments of the present disclosure are not limited to this.

[0167] It should be noted that the above method provides an interactive function between the associated object and the terminal login object based on the marking of multimedia resources, enriches the interaction form, improves the interactive experience between the terminal login object and the associated object, and is also conducive to improving the playback rate of multimedia resources.

[0168] In some embodiments, the terminal displays a preview area in response to a marking operation. Accordingly, in response to a marking operation on the first video frame in the playback interface, the terminal displays a preview area in the playback interface, the preview area includes the first video frame, and displays an information input component associated with the first video frame.

[0169] The preview area is used to display the video frame. It should be noted that in addition to displaying the first video frame, the preview area may also display other video frames. For example, the preview area also displays multiple video frames adjacent to the first video frame. In order to establish a visual connection between the first video frame and the information input component associated with the first video frame, the information input component may be displayed above the preview area and relative to the location of the first video frame.

[0170] In some embodiments, the preview area is located above the position of the play progress bar. Accordingly, in response to the marking operation based on the play progress bar, the terminal cancels the display of the play progress bar and displays the preview area above the display position of the play progress bar. In this way, the terminal displays the effect that the preview area pops up from the play progress bar.

[0171] For the purpose of describing the preview area displayed in the playback interface, see Figure 5 As shown, Figure 5 is a schematic diagram of another multimedia resource playback interface according to an exemplary embodiment. Figure 5 As shown in the middle (a), 501 is a preview area, 502 is a first video frame, and 503 is an information input component associated with the first video frame. 503 is displayed above 502.

[0172] It should be noted that by displaying the first video frame in the preview area of ​​the playback interface and displaying the information input component associated with the first video frame at the same time, it is convenient for the user to clearly preview the video frame being marked, so as to more accurately input the marking information related to the video frame. The above method provides a way for users to mark and express their opinions on specific video frames in multimedia resources, enriches the interaction between users and multimedia resources, and enhances the interactivity between users and the playback interface.

[0173] In some embodiments, the terminal supports selecting other video frames in the preview area. Accordingly, in response to the selection operation of the second video frame in the preview area, the terminal displays the information input component associated with the second video frame. The video frame displayed in the preview area supports sliding and selection. In order to establish a visual connection between the second video frame and the information input component associated with the second video frame, the information input component can be displayed above the preview area and relative to the location of the second video frame.

[0174] The multiple video frames displayed in the preview area support sliding switching. Accordingly, in response to the user's sliding operation in the preview area to the left, the terminal displays the video frame after the current multiple video frames at the corresponding moment; in response to the user's sliding operation in the preview area to the right, the terminal displays the video frame before the current multiple video frames at the corresponding moment.

[0175] The video frames displayed in the preview area support trigger selection. Accordingly, in response to a trigger operation on any video frame in the preview area, the terminal displays the information input component of the video frame and cancels the display of the information input component of the video frame before the trigger operation is performed.

[0176] In some embodiments, the terminal highlights the currently selected video frame to be marked in the preview area. For example, the currently selected video frame is highlighted, a border is added to the currently selected video frame, the currently selected video frame is moved up for display, the currently selected video frame is enlarged for display, etc. Alternatively, the terminal stops playing the multimedia resource and adjusts the multimedia resource in the playback interface to the currently selected video frame for display. In the above manner, the user can be prompted concisely and intuitively about the currently selected video frame to be marked, so that the user can switch the video frame he wants to mark.

[0177] For ease of description, see Figure 5 As shown in FIG. (b), 504 is the second video frame, and 505 is the information input component associated with the second video frame. 505 is displayed above 504. It should be noted that Figure 5 In the figure (a), the multiple video frames displayed in the preview area of ​​the playback interface are video frames A to G. The terminal responds to the user's left sliding operation in the preview area, see Figure 5 As shown in Figure (b), the multiple video frames displayed in the preview area of ​​the playback interface are video frames C to video frames I.

[0178] It should be noted that by displaying video frames adjacent to the first video frame, the orderliness of information display is improved, and it is convenient for users to compare adjacent and similar video frames, which is conducive to helping users accurately determine the video frames they want to mark and enter corresponding marking information. At the same time, the terminal allows users to directly select other video frames in the preview area for marking, which improves the convenience of user operation.

[0179] In step S303, in response to a marking operation on any video segment in the playback interface, the terminal displays an information input component associated with the video segment.

[0180] In the embodiment of the present disclosure, the information input component associated with the video clip is used to input the tag information of the video clip. The information input component associated with the video clip can be displayed in any area of ​​the playback interface. The information input component can be displayed in the display area associated with the corresponding position of the video clip in the playback progress bar, and can also be displayed in the display area associated with the thumbnail mark of the video clip, which is not limited in the embodiment of the present disclosure.

[0181] In some embodiments, the above step S303 includes at least one of the following methods (1), (2) and (3). A playback progress bar of the multimedia resource is displayed in the playback interface. Different positions on the playback progress bar correspond to different video frames in the multimedia resource.

[0182] Mode (1): In response to the sequential triggering operation of the first position and the second position on the play progress bar, the terminal displays the information input component of the video segment determined by the first position and the second position. The video segment is the video segment between the video frame corresponding to the first position and the video frame corresponding to the second position.

[0183] Optionally, in response to the user's triggering operation on the first position on the play progress bar, the terminal displays prompt information to prompt the user to select another position to determine the video segment to be marked. In this way, the user is prompted to perform further operations.

[0184] Mode (2): In response to sliding the playback progress bar from the third position to the fourth position, the terminal displays an information input component of a video segment determined by the third position and the fourth position. The video segment is a video segment between a video frame corresponding to the third position and a video frame corresponding to the fourth position.

[0185] It should be noted that the video frame corresponding to the third position may be earlier than the video frame corresponding to the second position, and the video frame corresponding to the third position may also be later than the video frame corresponding to the second position, and the embodiment of the present disclosure does not limit this. That is, the terminal does not limit the sliding direction in the play progress bar.

[0186] Mode (3): In response to the dragging operation of the start mark and the end mark on the play progress bar, the terminal displays the information input component of the video segment determined by the start mark and the end mark. The video segment is the video segment between the video frame corresponding to the start mark and the video frame corresponding to the end position.

[0187] It should be noted that the terminal supports users to select the video clips they want to mark by triggering the first position and the second position, sliding operations, dragging the start and end marks, and other interactive methods, which meets the operating habits and needs of different users. At the same time, by accurately controlling the position on the playback progress bar, users can accurately select specific video clips in the video for marking. This intuitive operation interface and concise operation steps improve the marking efficiency.

[0188] In step S304, the terminal obtains the tag information input in the information input component, where the tag information is used to represent the viewpoint of the terminal login object.

[0189] In the embodiment of the present disclosure, step S304 is similar to step S203 and will not be described in detail here.

[0190] In some embodiments, the viewpoint is a first type or a second type of viewpoint, the first type is used to indicate that the terminal login object is supportive of the multimedia element, and the second type is used to indicate that the terminal login object is opposed to the multimedia element.

[0191] It should be noted that, since the opinions are divided into the first type and the second type, the marking information can also be divided into marking information corresponding to the first type and marking information corresponding to the second type. Optionally, after the terminal obtains the marking information input in the information input component, it automatically identifies the type corresponding to the opinion expressed by it, and adds a type label corresponding to the type to the marking information. The type label may not be displayed in the playback interface, but is only used as a data association label for the marking information to facilitate subsequent classification and classification display of the marking information; the type label may also be displayed together with the marking information in the playback interface to intuitively indicate the type of opinion expressed by the marking information, which is convenient for users to view.

[0192] It should be noted that, through the above method, the terminal supports marking various types of viewpoints on multimedia elements to express one's support or opposition, which is conducive to promoting interaction.

[0193] In step S305, the terminal displays the interactive controls associated with the mark information in the play interface, and performs interaction based on the interactive controls.

[0194] In the embodiment of the present disclosure, step S305 is similar to step S204 and will not be described in detail here.

[0195] The disclosed embodiment provides a method for marking multimedia resources, which realizes marking of video frames or video segments by displaying corresponding information input components in response to marking operations on video frames or video segments. The above method enables users to mark video frames or video segments according to their own views and interests during the process of watching multimedia resources, which enriches the forms of interaction between users and multimedia resources and is conducive to improving the playback rate of multimedia resources. At the same time, since the terminal supports multiple marking operations, it is easy to meet the needs of different users and improve the viewing and interactive experience of users.

[0196] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, and will not be described in detail here.

[0197] Above Figure 2 and Figure 3 The flowchart of the multimedia resource marking method of the present disclosure is shown. On this basis, a specific implementation method is proposed, and the scheme provided by the present disclosure is further explained by introducing the interactive operations that can be performed after the marking is completed and the corresponding content displayed by the terminal. Figure 6 is a flowchart of another multimedia resource marking method according to an exemplary embodiment. Figure 6 The method is executed by the terminal and includes the following steps.

[0198] In step S601, the terminal displays a playback interface of a multimedia resource.

[0199] In the embodiment of the present disclosure, step S601 is similar to step S201 and will not be described in detail here.

[0200] In step S602, the terminal displays an information input component of the multimedia element in response to a marking operation on the multimedia element in the play interface, where the multimedia element is any video frame or any video clip of the multimedia resource.

[0201] In the embodiment of the present disclosure, step S602 is similar to step S202, step S302 and step S303, and will not be described in detail here.

[0202] In some embodiments, the terminal displays candidate input information related to the multimedia element. Accordingly, the terminal displays the candidate input information based on the multimedia element, and the candidate input information is used to describe the multimedia element; the terminal displays the candidate input information in the information input component in response to a triggering operation on the candidate input information.

[0203] The candidate input information may be a summary text of the multimedia element, such as a description text summarizing the plot of the video clip; the candidate input information may also be a keyword describing the multimedia element, such as the protagonist's first meeting, sweetness, horror, and other keywords; the candidate input information may also be a keyword expressing an opinion, such as recommended, not recommended, recommended to skip, repeated viewing, and other keywords. It should be noted that the candidate input information may be displayed in any area of ​​the playback interface, and the embodiments of the present disclosure are not limited to this. For example, the candidate input information is displayed above the input box.

[0204] It should be noted that since the candidate input information is content related to the multimedia element, the terminal provides the candidate input information so that the user can select the candidate input information or modify it based on the candidate input information, which improves the efficiency of information input and is more convenient and quick.

[0205] In step S603, the terminal obtains the tag information input in the information input component, where the tag information is used to represent the viewpoint of the terminal login object.

[0206] In the embodiment of the present disclosure, step S603 is similar to step S203 and will not be described in detail here.

[0207] In some embodiments, the terminal displays candidate input information related to the tag information. Accordingly, based on the keywords in the tag information, the terminal displays the expression resources associated with the keywords; in response to the triggering operation on the expression resources, the terminal displays the keywords in the tag information replaced with the expression resources.

[0208] The expression resource may be an expression picture or an expression gif. For example, if the keyword included in the tag information is "like", an expression resource in the form of a heart may be displayed, and if the keyword included in the tag information is "recommend", an expression resource in the form of a thumbs-up may be displayed. It should be noted that the expression resource may be displayed in any area of ​​the playback interface, and the embodiments of the present disclosure do not limit this. For example, the expression resource is displayed above the input box.

[0209] It should be noted that the terminal simplifies the steps of searching and inserting expression resources by providing related expression resources for users to choose, so that users can directly determine the corresponding expression resources without leaving the information input component, thereby improving the efficiency and convenience of information editing. At the same time, the terminal increases the interactivity between the user and the information input component and enriches the interaction mode by allowing the user to replace the keywords in the marked information with the corresponding expression resources.

[0210] In step S604, the terminal displays at least one of a sharing control, a comment control, a favorite control, a storage control, and a bullet screen publishing control associated with the mark information in the playback interface, and interacts based on the above-mentioned interactive controls.

[0211] In an embodiment of the present disclosure, an implementation method of interaction based on an interactive control includes at least one of the following.

[0212] In some embodiments, the terminal sends the multimedia element and the tag information to the target object in response to the triggering operation of the sharing control associated with the tag information. The target object is an object associated with the terminal login object, such as an account associated with the account logged in by the terminal, other applications different from the applications running on the terminal, etc. The multimedia element and tag information sent by the terminal to the target object may be in the form of directly sending the multimedia element and the tag information; it may also be in the form of sending the target image obtained by the multimedia element and the tag information; it may also be in the form of simultaneously sending the multimedia resource to which the multimedia element belongs, as well as the play time and tag information of the multimedia element.

[0213] In some embodiments, the terminal displays the comment information in the comment display area of ​​the multimedia resource in response to the triggering operation of the comment control associated with the tag information. The comment information includes multimedia elements and tag information. The comment information may include tag information in text form and multimedia elements in image form or animated form; it may also be a target image synthesized by the multimedia element and the tag information; it may also be text information synthesized by the playback time of the multimedia element and the tag information.

[0214] Optionally, the terminal displays the multimedia element in the playback interface in response to the triggering operation of the comment information. Accordingly, in the case where the multimedia element is a video frame, the terminal displays the video frame in the playback interface in response to the triggering operation of the comment information, or starts playing the video from the video frame. In the case where the multimedia element is a video clip, the terminal jumps to the beginning of the video clip in the playback interface in response to the triggering operation of the comment information and starts playing.

[0215] In some embodiments, the terminal adds the multimedia element and the tag information to the favorites in response to a triggering operation on a collection control associated with the tag information. The embodiments of the present disclosure do not further limit the display form of the multimedia elements and the tag information in the favorites. For example, the favorites include a target image composed of tag information and a video frame. Or, the favorites include a video clip whose cover image contains tag information. Or, the favorites include a title composed of the playback time of the multimedia element and the tag information, as well as multimedia resources.

[0216] In some embodiments, the terminal stores a target image in response to a trigger operation on a storage control associated with the tag information, and the target image is generated based on the multimedia element and the tag information. It should be noted that the target image can be stored in a local storage space or a storage server, and there is no limitation on this.

[0217] In some embodiments, the terminal releases the barrage information in the playback interface in response to a triggering operation on a barrage release control associated with the tag information, and the barrage information includes the tag information.

[0218] It should be noted that in the above method, the terminal supports users to interact with multimedia elements through interactive operations with sharing controls, comment controls, collection controls, storage controls, and bullet screen publishing controls. Among them, sharing controls, comment controls, and bullet screen publishing controls associated with tag information promote the dissemination of information and are conducive to improving the playback rate of multimedia resources; collection controls and storage controls associated with tag information meet users' information management needs. The above interactive controls and interactive behaviors not only enrich the interactive methods of multimedia resources, but also enhance the experience and participation of watching multimedia resources.

[0219] In some embodiments, in response to playing to a multimedia element, the terminal displays bullet screen information in the play interface, and the bullet screen information includes tag information. At this time, the terminal automatically sends the bullet screen information. It should be noted that the bullet screen information is information that the user has authorized.

[0220] It should be noted that, through the above method, the terminal can display the bullet screen information containing the tag information without the user having to re-enter the tag information and confirm the release through the conventional bullet screen release function. Therefore, the above method reduces the operation steps and improves the efficiency of human-computer interaction. At the same time, since part of the bullet screen information displayed when playing multimedia resources contains the tag information and can reflect the user's point of view, the above method increases the richness of the content and enhances the viewing experience.

[0221] The disclosed embodiment provides a method for marking multimedia resources, by supporting users to interact with multimedia elements based on interactive controls of marked multimedia elements. The above method enables users to mark segments or moments in multimedia resources according to their own views and interests during viewing of multimedia resources, and then realize multiple functions such as sharing, commenting, collecting, storing, and publishing bullet comments through interactive controls. This provides an interactive form between users and marked information, enhances the interactivity between users and multimedia resources, improves users' viewing and interactive experience, and is conducive to improving the playback rate of multimedia resources.

[0222] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, and will not be described in detail here.

[0223] Above Figure 2 , Figure 3 , Figure 6 The flowchart of the multimedia resource marking method disclosed in the present invention is shown. A specific implementation method is proposed on this basis. The solution provided by the present invention is further explained by introducing the display of summary marking information and marking detail information in the playback interface. Figure 7 is a flowchart of another multimedia resource marking method according to an exemplary embodiment. Figure 7 The method is executed by the terminal and includes the following steps.

[0224] In step S701, the terminal displays a playback interface of a multimedia resource.

[0225] In the embodiment of the present disclosure, step S701 is similar to step S201 and will not be described in detail here.

[0226] It should be noted that, in the case where a multimedia resource is marked, the summary marking information and the marking detail information are displayed in the multimedia resource playback interface, as shown in the following steps S702 and S703, respectively. The multimedia resource being marked means that the multimedia resource is marked by any terminal login object. For any terminal login object, even if the terminal login object does not mark the multimedia resource, the summary marking information and the marking detail information can be displayed in the multimedia resource playback interface.

[0227] In step S702, the terminal displays the summary marking information of the multimedia elements at a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, where the summary marking information is generated based on the marking information of the multimedia elements by at least one object.

[0228] In the disclosed embodiment, the display position of each marked multimedia element corresponds to the multimedia element. Different multimedia elements have different corresponding positions in the playback progress bar, and the display position of the summary marking information is also different. For example, in the playback interface of the same multimedia resource, the display positions of the summary marking information of the multimedia element with a playback time of 9 seconds and the summary marking information of the multimedia element with a playback time of 12 seconds are different. Through the above method, the correlation between the summary marking information and the multimedia elements is improved, which is convenient for users to distinguish the summary marking information corresponding to different multimedia elements and quickly locate different multimedia elements.

[0229] The summary mark information can be displayed in the playback progress bar or in the area near the playback progress bar, and there is no restriction on this. Figure 8 As shown, Figure 8 is a schematic diagram of another multimedia resource playback interface according to an exemplary embodiment. Figure 8 In the middle (a) figure, 801 and 802 are two pieces of summary mark information displayed in the play progress bar. Since the two pieces correspond to different multimedia resources, the two pieces are displayed at different positions in the play progress bar. Figure 8 In the middle (b) figure, 803 and 804 are two pieces of summary mark information displayed in the area above the play progress bar. Since the two pieces correspond to different multimedia resources, the two pieces are displayed at different positions in the play progress bar.

[0230] It should be noted that, through the above method, the terminal prompts the user to pay attention to and watch a specific video frame or video clip in the multimedia resource. At the same time, by displaying the summary tag information, the terminal can intuitively show the user an overview of the relevant tag information of the multimedia element. This allows the user to obtain user feedback by summarizing the tag information without having to view each tag information of other users separately, enriching the page display content and improving the efficiency of information transmission.

[0231] In some embodiments, the aggregated tag information includes at least one of a tag keyword of a multimedia element and the number of accounts that tagged the multimedia element, and the tag keyword is generated by at least one tag information for the multimedia element. The keyword can be a general description of the content of the multimedia element based on the tag information, or a general statement label of the multimedia element based on the tag information. For example, the aggregated tag information is "×× people think the picture is beautiful", "high music", "highly recommended", "×× people do not recommend", "×× people like it", "repeatedly watched", etc.

[0232] It should be noted that since the tagged keyword is a brief description of the content of the multimedia element, it is helpful for users to quickly understand the theme of the multimedia element or the evaluation it has received. At the same time, by displaying the number of accounts that have tagged the multimedia element, the degree of attention the multimedia element has received can be intuitively reflected. By displaying the tagged keywords and the number of tagged accounts, the terminal not only enhances the readability and intuitiveness of the information, but also provides multi-dimensional information about the multimedia elements, reflecting the content of the key elements or the user's consensus on the content, enriching the displayed content and the user's viewing experience.

[0233] In some embodiments, the terminal will display the summary marking information of the multimedia element according to the above steps only when the multimedia element meets the preset conditions. The preset conditions include at least one of the following: the number of objects marking multimedia elements is greater than a preset threshold; the ranking corresponding to the number of objects marking multimedia elements is within the preset ranking; or, the number of objects marking multimedia elements is greater than the preset threshold and the corresponding ranking is within the preset ranking. The ranking is obtained by sorting the number of objects marking each multimedia element in the same multimedia resource from high to low. Optionally, all marked multimedia elements in the multimedia resource participate in the sorting, or multimedia resources in the multimedia resource that have been marked more than a threshold number of times participate in the sorting.

[0234] It should be noted that, through the above preset conditions, multimedia elements that have received more attention or high evaluation can be screened out, and the corresponding summary mark information can be displayed. This not only avoids excessive information display at the playback progress bar, avoids users being disturbed by irrelevant or redundant information, but also improves the pertinence and quality of information display.

[0235] In step S703, the terminal displays the mark detail information of any multimedia element in response to the mark viewing operation on any multimedia element.

[0236] In the disclosed embodiment, the marking detail information includes at least one of the number of objects marking multimedia elements, at least one piece of marking information for the multimedia element, the number of times the multimedia element is marked, and the ranking of the number of times the multimedia element is marked. The marking viewing operation may be a triggering operation of a marking viewing control in the playback interface, or may refer to an interactive operation on the summary marking information in the playback interface, or may refer to an interactive operation on the summary marking information at a corresponding position in the playback progress bar in the playback interface, and there is no limitation on this. It should be noted that the marking detail information may be displayed in a pop-up window, in a half-screen page, or directly in the playback interface, and there is no limitation on this. Optionally, at least one piece of marking information in the marking detail information supports operations such as likes, copies, favorites, and forwarding, and no further description is given on this.

[0237] It should be noted that the terminal displays marking details such as the number of marks, multiple marking information, the number of times marked and the ranking of the number of times marked, so that users can have a more comprehensive understanding of the marking of multimedia elements. This not only helps users to more accurately determine the popularity and views of multimedia elements, but also improves the richness and comprehensiveness of information display.

[0238] The disclosed embodiment provides a multimedia resource tagging method, in which the user can quickly browse other users' opinions on multimedia elements while viewing multimedia resources by displaying summary tagging information and tagging details information, so as to focus on the corresponding multimedia elements. This enriches the interaction between the user and the multimedia resources, improves the user's viewing and interactive experience, and is conducive to increasing the playback rate of multimedia resources.

[0239] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, and will not be described in detail here.

[0240] Above Figures 2 to 8 The multimedia elements in the marked multimedia resources are described. The display of the marking information and the associated interactive controls in the playback interface during the multimedia resource playback by the terminal or other terminals is described below. Fig. 9 is a flowchart of a method for playing multimedia resources according to an exemplary embodiment. Fig. 9 As shown, the method is executed by the terminal and includes the following steps.

[0241] In step S901, the terminal displays a play interface, where the play interface is used to play multimedia resources.

[0242] In the disclosed embodiment, the terminal is a playback terminal of the multimedia resource, which is the same as or different from the terminal in the multimedia resource marking method. That is, the terminal can be not only a terminal for displaying marking information, but also a terminal for marking multimedia resources. The terminal can be not only a terminal used by the audience of the multimedia resource, but also a terminal used by the author of the multimedia resource.

[0243] In step S902, the terminal displays the marking information of the multimedia element in the playback interface, where the marking information is used to indicate the viewpoint of the audience of the multimedia resource on the multimedia element, where the multimedia element is a video frame or a video clip in the multimedia resource.

[0244] In the embodiment of the present disclosure, the marking information can be displayed in any area on the play interface. At least one piece of marking information can be displayed on the play interface.

[0245] Among them, the marking information can be displayed at the position corresponding to the multimedia element on the playback progress bar. Since different multimedia elements have different corresponding positions in the playback progress bar, the display position of the marking information is also different. For example, in the playback interface of the same multimedia resource, the marking information of the multimedia element with a playback time of 9 seconds and the marking information of the multimedia element with a playback time of 12 seconds have different display positions. The marking information can also be displayed in an area outside the playback progress bar on the playback interface. The marking information can include playback time information, or can be displayed in association with the playback time information to facilitate the distinction of the marking information of different multimedia elements. In the above manner, the correlation between the marking information and the multimedia elements is improved, and different multimedia elements are quickly located.

[0246] In step S903, the terminal displays the interactive controls associated with the mark information in the play interface, and performs interaction based on the interactive controls.

[0247] In the embodiments of the present disclosure, the tag information is associated with one or more interactive controls. Different interactive controls correspond to different interactive functions, including but not limited to sharing, liking, copying, collecting, sending to comments, and forwarding, etc., which are not limited by the embodiments of the present disclosure. In some embodiments, the interactive controls associated with the tag information are displayed in the control display area associated with the tag information.

[0248] The disclosed embodiment provides a method for playing multimedia resources. During the playing process of multimedia resources, the method displays the marking information corresponding to the marked multimedia elements on the playing interface. Since the marking information indicates the user's view on the multimedia element, it can more accurately reflect the user's preferences. Therefore, the marking information is displayed in the multimedia resources, which can realize the prominent display of the multimedia elements in the multimedia resources, thereby improving the user's viewing experience and facilitating the increase of the playing rate of the multimedia resources. At the same time, by providing interactive controls, the interactive forms between users and multimedia resources are enriched, and the experience and participation of watching multimedia resources are improved.

[0249] In some embodiments, displaying an interactive control associated with the mark information in the playback interface, and performing interaction based on the interactive control, includes:

[0250] In response to the playback time of the multimedia resource reaching a preset time, displaying an interactive control associated with the mark information in the playback interface, and performing interaction based on the interactive control; or,

[0251] In response to the interactive operation with the multimedia resource, the interactive control associated with the marking information is displayed in the play interface, and the interaction is performed based on the interactive control.

[0252] In an embodiment of the present disclosure, by displaying interactive controls associated with tag information in the playback page when the playback time of a multimedia resource reaches a preset time or an interactive operation is performed with the multimedia resource, it is convenient to increase the user's participation in the process of watching the multimedia resource and enrich the interaction methods with the multimedia resource.

[0253] In some embodiments, the interaction based on the interactive control includes at least one of the following:

[0254] In response to a triggering operation on a sharing control associated with the tag information, sending the multimedia element and the tag information to the target object; or,

[0255] In response to a triggering operation on a comment control associated with the tag information, displaying the comment information in a comment display area of ​​the multimedia resource, the comment information including the multimedia element and the tag information; or,

[0256] In response to a triggering operation on a favorites control associated with the tag information, adding the multimedia element and the tag information to a favorites folder; or,

[0257] In response to a triggering operation on a storage control associated with the tag information, a target image is stored, where the target image is generated based on the multimedia element and the tag information; or,

[0258] In response to a triggering operation on a bullet-screen publishing control associated with the mark information, the bullet-screen information is published in the playback interface, and the bullet-screen information includes the mark information.

[0259] In the disclosed embodiment, users are supported to interact with the tagged information through interactive operations with sharing controls, comment controls, favorite controls, storage controls, and bullet screen publishing controls. Among them, the sharing controls, comment controls, and bullet screen publishing controls associated with the tagged information promote the dissemination of information and are conducive to improving the playback rate of multimedia resources; the favorite controls and storage controls associated with the tagged information meet the user's information management needs. The above-mentioned interactive controls and interactive behaviors not only enrich the interactive methods of multimedia resources, but also improve the experience and participation of watching multimedia resources.

[0260] In some embodiments, the method further comprises:

[0261] In response to playing to the multimedia element, barrage information is displayed in the playback interface, and the barrage information includes marking information.

[0262] In the embodiments of the present disclosure, it supports displaying barrage information containing tag information. Since the barrage information contains tag information and can reflect user opinions, the above method increases the content richness in the process of playing multimedia resources, enhances the viewing experience, and facilitates users to quickly and intuitively obtain the opinions of other users, thereby improving the efficiency of information transmission.

[0263] In some embodiments, the viewpoint is a first type or a second type of viewpoint, the first type is used to indicate that the terminal login object is supportive of the multimedia element, and the second type is used to indicate that the terminal login object is opposed to the multimedia element.

[0264] In the embodiments of the present disclosure, by supporting tag information corresponding to multiple types of viewpoints, it is convenient for users to obtain more comprehensive and rich viewpoints, thereby improving the comprehensiveness of information acquisition.

[0265] In some embodiments, displaying the tag information of the multimedia element in the playback interface includes:

[0266] In the case where the terminal login object has marked a multimedia element in the multimedia resource, displaying a first mark on a playback progress bar of the multimedia resource;

[0267] In the case that the terminal login object does not mark the multimedia element in the multimedia resource, a second mark is displayed on the play progress bar of the multimedia resource.

[0268] In the disclosed embodiment, different marks are displayed on the playback progress bar of the multimedia resource based on whether the terminal login object has marked the multimedia element in the multimedia resource, so that the user can intuitively confirm whether he has marked the multimedia element in the multimedia resource. This information display method is more intuitive and clear, and improves the efficiency of information transmission.

[0269] In some embodiments, the method further comprises:

[0270] At a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, summary marking information of the multimedia element is displayed, where the summary marking information is generated based on marking information of the multimedia element by at least one object.

[0271] In the embodiments of the present disclosure, by displaying the aggregated tag information, an overview of the related tag information of the multimedia elements can be intuitively displayed to the user. This allows the user to obtain user feedback by aggregating the tag information without having to view each tag information of other users separately, enriching the page display content and improving the efficiency of information transmission.

[0272] In some embodiments, the method further comprises:

[0273] In response to playing a multimedia element, displaying summary tag information of the multimedia element in a playback interface, where the summary tag information is generated based on tag information of the multimedia element by at least one object; or,

[0274] In response to the playback progress bar of the multimedia resource being dragged to a position corresponding to the multimedia element or the position corresponding to the multimedia element in the playback progress bar being clicked, the summary mark information is displayed in the playback interface.

[0275] In the embodiment of the present disclosure, by displaying the summary marking information in the playback interface when playing to the marked multimedia element or the interactive operation with the content related to the multimedia element, the efficiency of information transmission is improved, the user's viewing method of the summary marking information is enriched, and the user experience is improved.

[0276] In some embodiments, displaying the tag information of the multimedia element in the playback interface includes:

[0277] A tag list of multimedia elements is displayed in the playback interface. The tag list includes tag information corresponding to multiple viewpoint types and tag quantities corresponding to multiple viewpoint types. The tag quantity refers to the number of viewers who have added tag information of viewpoint types to the multimedia elements.

[0278] In the embodiment of the present disclosure, the information displayed in the playback interface is further enriched through the tag list, which helps users to have a more comprehensive understanding of the tag information related to the multimedia elements, thereby improving the efficiency of information transmission and the comprehensiveness of information display.

[0279] In some embodiments, the tag information is used to indicate the viewpoint of the associated object of the terminal login object on the multimedia element, and the method further includes:

[0280] Displaying a prompt message in the playback interface, the prompt message is used to prompt the associated object that the multimedia element has been marked;

[0281] In response to the triggering operation of the prompt information, the multimedia resource is played starting from the multimedia element.

[0282] In the disclosed embodiment, by directly displaying the multimedia elements marked by the associated object, the efficiency of information transmission is improved, and at the same time, based on the prompt information, the terminal login object is encouraged to view the multimedia elements marked by the associated object, thereby promoting interaction. Moreover, triggering the prompt information can reach the multimedia elements marked by the associated object with one click, shortening the interaction path and improving the efficiency of human-computer interaction.

[0283] Above Fig. 9 The flowchart of a multimedia resource playback method disclosed in the present invention is only a basic flow, and a specific implementation method is proposed on this basis. Fig.10 , Fig.10 The flowchart of another multimedia resource playing method according to an exemplary embodiment is shown. The method is executed by a terminal and includes the following steps.

[0284] In step S1001, the terminal displays a play interface, where the play interface is used to play multimedia resources.

[0285] In the embodiment of the present disclosure, step S1001 is similar to step S901 and will not be described in detail here.

[0286] In step S1002, the terminal displays the marking information of the multimedia element in the playback interface, where the marking information is used to indicate the viewpoint of the audience of the multimedia resource on the multimedia element, where the multimedia element is a video frame or a video clip in the multimedia resource.

[0287] In the embodiment of the present disclosure, step S1002 is similar to step S902 and will not be described in detail here. The following is a supplementary description of the content displayed in the playback interface.

[0288] In some embodiments, in response to playing to a multimedia element, barrage information is displayed in the playback interface, and the barrage information includes tag information.

[0289] In the embodiments of the present disclosure, it supports displaying barrage information containing tag information. Since the barrage information contains tag information and can reflect user opinions, the above method increases the content richness in the process of playing multimedia resources, enhances the viewing experience, and facilitates users to quickly and intuitively obtain the opinions of other users, thereby improving the efficiency of information transmission.

[0290] In some embodiments, the viewpoint is a first type or a second type of viewpoint, the first type is used to indicate that the terminal login object supports the multimedia element, and the second type is used to indicate that the terminal login object opposes the multimedia element. It should be noted that the first type and the second type are only exemplary descriptions, and other types of viewpoints are also supported. For example, the third type is used to indicate that the terminal login object is questioning the multimedia element, and the fourth type is used to indicate that the terminal login object is mocking the multimedia element.

[0291] In the embodiments of the present disclosure, by supporting tag information corresponding to multiple types of viewpoints, it is convenient for users to obtain more comprehensive and richer views of other users, thereby improving the comprehensiveness of information acquisition.

[0292] In some embodiments, a corresponding identifier is displayed in the playback interface. Accordingly, when the terminal login object has marked a multimedia element in the multimedia resource, a first identifier is displayed on the playback progress bar of the multimedia resource; when the terminal login object has not marked a multimedia element in the multimedia resource, a second identifier is displayed on the playback progress bar of the multimedia resource. The first identifier and the second identifier can be distinguished by color, shape, size, associated text, etc.

[0293] In the disclosed embodiment, by displaying a corresponding mark on the playback progress bar of the multimedia resource based on whether the terminal login object has marked the multimedia element, the user can intuitively confirm whether he has marked the multimedia element in the multimedia resource and distinguish it. This information display method is more intuitive and clear, and improves the efficiency of information transmission.

[0294] In some embodiments, the playback interface displays summary mark information. Accordingly, the summary mark information of the multimedia element is displayed at a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, and the summary mark information is generated based on the mark information of the multimedia element by at least one object.

[0295] In the embodiments of the present disclosure, by displaying the aggregated tag information, an overview of the related tag information of the multimedia elements can be intuitively displayed to the user. This allows the user to obtain user feedback by aggregating the tag information without having to view each tag information of other users separately, enriching the page display content and improving the efficiency of information transmission.

[0296] In some embodiments, the summary tag information includes at least one of a tag keyword of the multimedia element and the number of accounts that tagged the multimedia element, and the tag keyword is generated from at least one tag information for the multimedia element. The keyword can be a summary description of the content of the multimedia element based on the tag information, or a summary statement label of the multimedia element based on the tag information.

[0297] In the disclosed embodiment, since the tagged keyword is a brief description of the content of the multimedia element, this helps the user quickly understand the theme of the multimedia element or the evaluation it has received. At the same time, by displaying the number of accounts that have tagged the multimedia element, the degree of attention the multimedia element has received can be intuitively reflected. By displaying the tagged keywords and the number of tagged accounts, the terminal not only enhances the readability and intuitiveness of the information, but also provides multi-dimensional information about the multimedia elements, reflecting the content of the key elements or the user's consensus on the content, enriching the displayed content and the user's viewing experience.

[0298] In some embodiments, the terminal will display the summary marking information of the multimedia element according to the above steps only when the multimedia element meets the preset conditions. The preset conditions include at least one of the following: the number of objects marking multimedia elements is greater than a preset threshold; the ranking corresponding to the number of objects marking multimedia elements is within the preset ranking; or, the number of objects marking multimedia elements is greater than the preset threshold and the corresponding ranking is within the preset ranking. The ranking is obtained by sorting the number of objects marking each multimedia element in the same multimedia resource from high to low. Optionally, all marked multimedia elements in the multimedia resource participate in the sorting, or multimedia resources in the multimedia resource that have been marked more than a threshold number of times participate in the sorting.

[0299] In the disclosed embodiment, the above preset conditions can be used to screen out multimedia elements that have received more attention or high evaluation, and display corresponding summary mark information. This not only avoids excessive information display at the playback progress bar, avoids users being disturbed by irrelevant or redundant information, but also improves the pertinence and quality of information display.

[0300] In some embodiments, the summary mark information of the multimedia element is displayed in accordance with the above steps only when the playback process or interactive operation in the playback interface meets the preset conditions. Accordingly, in response to playing the multimedia element, the summary mark information of the multimedia element is displayed in the playback interface, and the summary mark information is generated based on the mark information of the multimedia element by at least one object; or, in response to the playback progress bar of the multimedia resource being dragged to the position corresponding to the multimedia element or the position corresponding to the multimedia element in the playback progress bar being clicked, the summary mark information is displayed in the playback interface.

[0301] In the embodiment of the present disclosure, by displaying the summary marking information in the playback interface when playing to the marked multimedia element or the interactive operation with the content related to the multimedia element, the efficiency of information transmission is improved, the user's viewing method of the summary marking information is enriched, and the user experience is improved.

[0302] It should be noted that the following steps S1003 and S1004 are two ways for the terminal to display the interactive controls associated with the tag information in the playback interface in response to the corresponding conditions being met. When any of the conditions is met, the interactive controls can be displayed in the playback interface.

[0303] In step S1003, in response to the playback duration of the multimedia resource reaching a preset duration, the terminal displays an interactive control associated with the tag information in the playback interface, and performs interaction based on the interactive control.

[0304] In the embodiment of the present disclosure, the preset duration can be set to a fixed duration, such as 5 seconds or 10 seconds; it can also be set to a duration confirmed based on the total duration of the multimedia resource, such as 1 / 2 of the total duration of the multimedia resource.

[0305] In step S1004, the terminal displays the interactive controls associated with the mark information in the play interface in response to the interactive operation with the multimedia resource, and performs interaction based on the interactive controls.

[0306] In the embodiments of the present disclosure, interactive operations include but are not limited to likes, comments, forwarding, favorites, and other operations.

[0307] The interactive controls associated with the tag information are displayed in the control display area associated with the tag information. For ease of description, see Fig.11 As shown, Fig.11 1101 is a schematic diagram of a play page displaying interactive controls according to an exemplary embodiment. 1101 is a control display area. The control display area displays multiple interactive controls associated with tag information.

[0308] It should be noted that by displaying interactive controls associated with tag information in the playback page when the playback time of the multimedia resource reaches a preset time or an interactive operation is performed with the multimedia resource, it is convenient to increase the user's participation in the process of watching the multimedia resource and enrich the way of interaction with the multimedia resource.

[0309] Among them, interaction based on interactive controls includes at least one of the following.

[0310] In some embodiments, the terminal sends the multimedia element and the tag information to the target object in response to the triggering operation of the sharing control associated with the tag information. The target object is an object associated with the terminal login object, such as an account associated with the account logged in by the terminal, other applications different from the applications running on the terminal, etc. The multimedia element and tag information sent by the terminal to the target object may be in the form of directly sending the multimedia element and the tag information; it may also be in the form of sending the target image obtained by the multimedia element and the tag information; it may also be in the form of simultaneously sending the multimedia resource to which the multimedia element belongs, as well as the play time and tag information of the multimedia element.

[0311] In some embodiments, the terminal displays the comment information in the comment display area of ​​the multimedia resource in response to the triggering operation of the comment control associated with the tag information. The comment information includes multimedia elements and tag information. The comment information may include tag information in text form and multimedia elements in image form or animated form; it may also be a target image synthesized by the multimedia element and the tag information; it may also be text information synthesized by the playback time of the multimedia element and the tag information.

[0312] Optionally, the terminal displays the multimedia element in the playback interface in response to the triggering operation of the comment information. Accordingly, in the case where the multimedia element is a video frame, the terminal displays the video frame in the playback interface in response to the triggering operation of the comment information, or starts playing the video from the video frame. In the case where the multimedia element is a video clip, the terminal jumps to the beginning of the video clip in the playback interface in response to the triggering operation of the comment information and starts playing.

[0313] In some embodiments, the terminal adds the multimedia element and the tag information to the favorites in response to a triggering operation on a collection control associated with the tag information. The embodiments of the present disclosure do not further limit the display form of the multimedia elements and the tag information in the favorites. For example, the favorites include a target image composed of tag information and a video frame. Or, the favorites include a video clip whose cover image contains tag information. Or, the favorites include a title composed of the playback time of the multimedia element and the tag information, as well as multimedia resources.

[0314] In some embodiments, the terminal stores a target image in response to a trigger operation on a storage control associated with the tag information, and the target image is generated based on the multimedia element and the tag information. It should be noted that the target image can be stored in a local storage space or a storage server, and there is no limitation on this.

[0315] In some embodiments, the terminal releases the barrage information in the playback interface in response to a triggering operation on a barrage release control associated with the tag information, and the barrage information includes the tag information.

[0316] It should be noted that users are supported to interact with the tagged information through interactive operations with sharing controls, comment controls, favorite controls, storage controls, and bullet screen publishing controls. Among them, sharing controls, comment controls, and bullet screen publishing controls associated with tagged information promote the dissemination of information and are conducive to improving the playback rate of multimedia resources; favorite controls and storage controls associated with tagged information meet users' information management needs. The above-mentioned interactive controls and interactive behaviors not only enrich the interactive methods of multimedia resources, but also improve the experience and participation of watching multimedia resources.

[0317] In some embodiments, a tag list is displayed in the playback interface. Accordingly, a tag list of multimedia elements is displayed in the playback interface, and the tag list includes tag information corresponding to multiple viewpoint types and tag numbers corresponding to the multiple viewpoint types, and the tag number refers to the number of viewers who added tag information of the viewpoint type to the multimedia element. The multiple viewpoint types include at least one of the first type and the second type.

[0318] For ease of description, see Fig.12 As shown, Fig.12 1 is a schematic diagram of a play page showing a mark list according to an exemplary embodiment. The play interface shows a mark list, and the mark list shows mark information and a mark quantity 1201 corresponding to a first type and mark information and a mark quantity 1202 corresponding to a second type.

[0319] In the embodiment of the present disclosure, the information displayed in the playback interface is further enriched through the tag list, which helps users to have a more comprehensive understanding of the tag information related to the multimedia elements, thereby improving the efficiency of information transmission and the comprehensiveness of information display.

[0320] In some embodiments, the marking information is used to indicate the viewpoint of the associated object of the terminal login object on the multimedia element. The terminal displays prompt information in the playback interface, and the prompt information is used to prompt the associated object that the multimedia element has been marked; in response to the triggering operation of the prompt information, the multimedia resource is played starting from the multimedia element. For example, the prompt information is the words "your friend marked ××, go and have a look".

[0321] In the disclosed embodiment, by directly displaying the multimedia elements marked by the associated object, the efficiency of information transmission is improved, and at the same time, based on the prompt information, the terminal login object is encouraged to view the multimedia elements marked by the associated object, thereby promoting interaction. Moreover, triggering the prompt information can reach the playback node marked by the associated object with one click, shortening the interaction path and improving the efficiency of human-computer interaction.

[0322] The disclosed embodiment provides a method for playing multimedia resources. During the playing process of multimedia resources, the method displays the marking information corresponding to the marked multimedia elements on the playing interface. Since the marking information indicates the user's view on the multimedia element, it can more accurately reflect the user's preferences. Therefore, the marking information is displayed in the multimedia resources, which can realize the prominent display of the multimedia elements in the multimedia resources, thereby improving the user's viewing experience and facilitating the increase of the playing rate of the multimedia resources. At the same time, by providing interactive controls, the interactive forms between users and multimedia resources are enriched, and the experience and participation of watching multimedia resources are improved.

[0323] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, and will not be described in detail here.

[0324] Fig.13 FIG. 1 is a block diagram of a multimedia resource marking device according to an exemplary embodiment. Fig.13 As shown, the device includes: an interface display unit 1301, a component display unit 1302, an acquisition unit 1303 and an interaction unit 1304.

[0325] The interface display unit 1301 is configured to display the playback interface of the multimedia resource;

[0326] The component display unit 1302 is configured to display the information input component of the multimedia element in response to the marking operation on the multimedia element in the playback interface, where the multimedia element is any video frame or any video segment of the multimedia resource;

[0327] The acquisition unit 1303 is configured to acquire the mark information input in the information input component, where the mark information is used to represent the viewpoint of the terminal login object;

[0328] The interaction unit 1304 is configured to display the interaction controls associated with the mark information in the playback interface, and perform interaction based on the interaction controls.

[0329] In some embodiments, the interaction unit 1303 is configured to send multimedia elements and tag information to a target object in response to a trigger operation on a sharing control associated with the tag information; or, in response to a trigger operation on a comment control associated with the tag information, display comment information in a comment display area of ​​a multimedia resource, the comment information including multimedia elements and tag information; or, in response to a trigger operation on a collection control associated with the tag information, add the multimedia elements and tag information to a favorites; or, in response to a trigger operation on a storage control associated with the tag information, store a target image, the target image being generated based on the multimedia elements and tag information; or, in response to a trigger operation on a barrage publishing control associated with the tag information, publish barrage information in a playback interface, the barrage information including tag information.

[0330] In some embodiments, the interface display unit 1301 is further configured to display bullet screen information in the playback interface in response to playing to a multimedia element, and the bullet screen information includes tag information.

[0331] In some embodiments, the component display unit 1302 is configured to display an information input component of a multimedia element in response to a marking operation on the multimedia element in the playback interface when the multimedia resource is a multimedia resource sent by an associated object of a terminal login object.

[0332] In some embodiments, the component display unit 1302 is further configured to send a mark sharing message to the associated object, the mark sharing message includes the multimedia element and marking information, and the mark sharing message is used to indicate that the terminal login object has marked the multimedia element.

[0333] In some embodiments, the component display unit 1302 is configured to display a preview area in the playback interface in response to a marking operation on the first video frame in the playback interface, the preview area including the first video frame, and displaying an information input component associated with the first video frame.

[0334] In some embodiments, a video frame adjacent to the first video frame is also displayed in the preview area; the component display unit 1302 is further configured to display an information input component associated with the second video frame in response to a selection operation on the second video frame in the preview area.

[0335] In some embodiments, the component display unit 1302 is configured to display a playback progress bar of the multimedia resource in the playback interface, and in response to a sliding operation in the target direction after the playback progress bar is pressed for a preset time, display an information input component of the video frame corresponding to the pressed position; or, when the multimedia resource is played to any video frame, in response to a preset gesture operation in the playback interface, display an information input component of the video frame in the playback interface.

[0336] In some embodiments, the playback interface displays a playback progress bar of a multimedia resource, and the component display unit 1302 is configured to display an information input component of a video segment determined by the first position and the second position in response to sequential triggering operations on a first position and a second position on the playback progress bar; or, in response to sliding from a third position to a fourth position on the playback progress bar, display an information input component of a video segment determined by the third position and the fourth position; or, in response to dragging a start mark and an end mark on the playback progress bar, display an information input component of a video segment determined by the start mark and the end mark.

[0337] In some embodiments, the component display unit 1302 is further configured to display candidate input information based on the multimedia element, where the candidate input information is used to describe the multimedia element; and in response to a triggering operation on the candidate input information, the candidate input information is displayed in the information input component.

[0338] In some embodiments, the component display unit 1302 is further configured to display the expression resources associated with the keywords based on the keywords in the tag information; and in response to a triggering operation on the expression resources, display the keywords in the tag information replaced with the expression resources.

[0339] In some embodiments, Fig.14 is a block diagram of another multimedia resource marking device according to an exemplary embodiment, the device further comprising:

[0340] The first information display unit 1305 is configured to display the summary marking information of the multimedia element at a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, where the summary marking information is generated based on the marking information of the multimedia element by at least one object.

[0341] In some embodiments, the first information display unit 1305 is also configured to display summary marking information of the multimedia element at a position corresponding to any multimedia element on the playback progress bar in response to the multimedia element satisfying a preset condition; wherein the preset condition includes at least one of the following: the number of objects marking the multimedia element is greater than a preset threshold; the ranking corresponding to the number of objects marking the multimedia element is within the preset ranking.

[0342] In some embodiments, the aggregated tag information includes at least one of a tag keyword of the multimedia element and the number of accounts that tagged the multimedia element, and the tag keyword is generated from at least one piece of tag information for the multimedia element.

[0343] In some embodiments, the apparatus further comprises:

[0344] The second information display unit 1306 is configured to display the marking detail information of the multimedia element in response to a marking viewing operation on any multimedia element, the marking detail information including at least one item of the number of objects marking the multimedia element, at least one piece of marking information for the multimedia element, the number of times the multimedia element is marked, and the ranking of the number of times the multimedia element is marked.

[0345] In some embodiments, the viewpoint is a first type or a second type of viewpoint, the first type is used to indicate that the terminal login object is supportive of the multimedia element, and the second type is used to indicate that the terminal login object is opposed to the multimedia element.

[0346] The disclosed embodiment provides a multimedia resource marking device, wherein the terminal supports users to mark multimedia elements by marking multimedia elements and inputting marking information in the information input component, and supports users to interact with multimedia elements based on interactive controls of the marked multimedia elements. This enables users to mark segments or moments in multimedia resources according to their own views and interests while watching multimedia resources, and recommend or share them through interactive controls. This enriches the forms of interaction between users and multimedia resources, improves users' viewing and interactive experience, and is conducive to increasing the playback rate of multimedia resources.

[0347] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

[0348] It should be noted that the multimedia resource marking device provided in the above embodiment is only illustrated by the division of the above functional units. In actual applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the electronic device is divided into different functional units to complete all or part of the functions described above. In addition, the multimedia resource marking device provided in the above embodiment and the multimedia resource marking method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0349] Regarding the multimedia resource marking device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0350] Fig.15 FIG. 1 is a block diagram of a multimedia resource playback device according to an exemplary embodiment. Fig.15 As shown, the device includes: an interface display unit 1501, an information display unit 1502 and a control display unit 1503.

[0351] The interface display unit 1501 is configured to display a play interface, where the play interface is used to play multimedia resources;

[0352] The information display unit 1502 is configured to display the marking information of the multimedia element in the playback interface, where the marking information is used to indicate the viewpoint of the audience of the multimedia resource on the multimedia element, where the multimedia element is a video frame or a video segment in the multimedia resource;

[0353] The control display unit 1503 is configured to display the interactive controls associated with the mark information in the playback interface, and to perform interaction based on the interactive controls.

[0354] In some embodiments, the control display unit 1503 is configured to display interactive controls associated with the tag information in the playback interface in response to the playback time of the multimedia resource reaching a preset time, and interact based on the interactive controls; or, in response to interactive operations with the multimedia resource, display interactive controls associated with the tag information in the playback interface, and interact based on the interactive controls.

[0355] In some embodiments, the control display unit 1503 is configured to do at least one of the following: in response to a trigger operation on a sharing control associated with the tag information, send the multimedia element and tag information to the target object; or, in response to a trigger operation on a comment control associated with the tag information, display comment information in the comment display area of ​​the multimedia resource, the comment information including the multimedia element and tag information; or, in response to a trigger operation on a collection control associated with the tag information, add the multimedia element and tag information to the favorites; or, in response to a trigger operation on a storage control associated with the tag information, store the target image, the target image is generated based on the multimedia element and the tag information; or, in response to a trigger operation on a barrage publishing control associated with the tag information, publish the barrage information in the playback interface, the barrage information including the tag information.

[0356] In some embodiments, the information display unit 1502 is further configured to display barrage information in the playback interface in response to playing to the multimedia element, and the barrage information includes tag information.

[0357] In some embodiments, the viewpoint is a first type or a second type of viewpoint, the first type is used to indicate that the terminal login object is supportive of the multimedia element, and the second type is used to indicate that the terminal login object is opposed to the multimedia element.

[0358] In some embodiments, the information display unit 1502 is also configured to display a first identifier on the playback progress bar of the multimedia resource when the terminal login object has marked the multimedia elements in the multimedia resource; and to display a second identifier on the playback progress bar of the multimedia resource when the terminal login object has not marked the multimedia elements in the multimedia resource.

[0359] In some embodiments, the information display unit 1502 is further configured to display the summary marking information of the multimedia element at a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, where the summary marking information is generated based on the marking information of the multimedia element by at least one object.

[0360] In some embodiments, the information display unit 1502 is also configured to display summary tag information of the multimedia element in the playback interface in response to playing the multimedia element, where the summary tag information is generated based on the tag information of the multimedia element by at least one object; or, in response to the playback progress bar of the multimedia resource being dragged to the position corresponding to the multimedia element or the position corresponding to the multimedia element in the playback progress bar being clicked, display the summary tag information in the playback interface.

[0361] In some embodiments, the information display unit 1502 is further configured to display a tag list of multimedia elements in the playback interface, the tag list including tag information corresponding to multiple opinion types and the number of tags corresponding to the multiple opinion types, the number of tags referring to the number of viewers who added tag information of opinion types to the multimedia elements.

[0362] In some embodiments, the marking information is used to indicate the views of the associated objects of the terminal login object on the multimedia elements. The information display unit 1502 is also configured to display prompt information in the playback interface, and the prompt information is used to prompt that the associated objects have marked the multimedia elements; in response to the triggering operation of the prompt information, the multimedia resources are played starting from the multimedia elements.

[0363] The disclosed embodiment provides a multimedia resource playback device. During the playback of multimedia resources, the marking information corresponding to the marked multimedia elements is displayed on the playback interface. Since the marking information indicates the user's view on the multimedia element, it can more accurately reflect the user's preferences. Therefore, the marking information is displayed in the multimedia resource, which can realize the prominent display of the multimedia elements in the multimedia resource, thereby improving the user's viewing experience and facilitating the increase of the playback rate of the multimedia resource. At the same time, by providing interactive controls, the interactive forms between users and multimedia resources are enriched, and the experience and participation of viewing multimedia resources are improved.

[0364] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

[0365] It should be noted that the multimedia resource playback device provided in the above embodiment is only illustrated by the division of the above functional units. In actual applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the electronic device is divided into different functional units to complete all or part of the functions described above. In addition, the multimedia resource playback device provided in the above embodiment and the multimedia resource playback method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0366] Regarding the multimedia resource playback device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0367] Fig.16 1 is a block diagram of an electronic device according to an exemplary embodiment. Generally, the electronic device 1600 includes: a processor 1601 and a memory 1602 .

[0368] The processor 1601 may include one or more processing cores, such as a 4-core processor, a 16-core processor, etc. The processor 1601 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1601 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1601 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1601 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0369] The memory 1602 may include one or more computer-readable storage media, which may be non-transitory. The memory 1602 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1602 is used to store at least one program code, which is used to be executed by the processor 1601 to implement the multimedia resource marking method or multimedia resource playback method provided in the method embodiment of the present disclosure.

[0370] In some embodiments, the electronic device 1600 may further optionally include: a peripheral device interface 1603 and at least one peripheral device. The processor 1601, the memory 1602 and the peripheral device interface 1603 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 1603 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1604, a display screen 1605, a camera assembly 1606, an audio circuit 1607 and a power supply 1608.

[0371] The peripheral device interface 1603 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1601 and the memory 1602. In some embodiments, the processor 1601, the memory 1602, and the peripheral device interface 1603 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1601, the memory 1602, and the peripheral device interface 1603 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0372] The radio frequency circuit 1604 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1604 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1604 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1604 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 1604 can communicate with other electronic devices through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1604 may also include circuits related to NFC (Near Field Communication), which is not limited in the present disclosure.

[0373] The display screen 1605 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1605 is a touch display screen, the display screen 1605 also has the ability to collect touch signals on the surface or above the surface of the display screen 1605. The touch signal can be input to the processor 1601 as a control signal for processing. At this time, the display screen 1605 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 1605 can be one, and the front panel of the electronic device 1600 is set; in other embodiments, the display screen 1605 can be at least two, which are respectively set on different surfaces of the electronic device 1600 or are folded; in some other embodiments, the display screen 1605 can be a flexible display screen, which is set on the curved surface or folded surface of the electronic device 1600. Even, the display screen 1605 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1605 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0374] The camera assembly 1606 is used to capture images or videos. Optionally, the camera assembly 1606 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the electronic device, and the rear camera is arranged on the back of the electronic device. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1606 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0375] The audio circuit 1607 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1601 for processing, or input them into the radio frequency circuit 1604 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the electronic device 1600. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1601 or the radio frequency circuit 1604 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1607 may also include a headphone jack.

[0376] The power supply 1608 is used to power various components in the electronic device 1600. The power supply 1608 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1608 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0377] Those skilled in the art will understand that Fig.16 The structure shown in the figure does not constitute a limitation on the electronic device 1600, and may include more or less components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0378] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 1602 including instructions, and the instructions can be executed by a processor 1601 of a terminal 1600 to complete the above-mentioned multimedia resource marking method or multimedia resource playing method. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0379] A computer program product includes a computer program, which implements the above-mentioned multimedia resource marking method or multimedia resource playing method when executed by a processor.

[0380] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0381] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for marking multimedia resources, characterized in that: The method comprises: Display the playback interface of multimedia resources; In response to a marking operation on a multimedia element in the playback interface, an information input component of the multimedia element is displayed, where the multimedia element is any video frame or any video clip of the multimedia resource; Acquire the mark information input in the information input component, wherein the mark information is used to represent the viewpoint of the terminal login object; An interactive control associated with the tag information is displayed in the playback interface, and interaction is performed based on the interactive control.

2. The multimedia resource marking method according to claim 1, characterized in that: The interacting based on the interactive control includes at least one of the following: In response to a triggering operation on a sharing control associated with the tag information, sending the multimedia element and the tag information to a target object; or, In response to a triggering operation on a comment control associated with the tag information, displaying comment information in a comment display area of ​​the multimedia resource, the comment information including the multimedia element and the tag information; or, In response to a triggering operation on a collection control associated with the mark information, adding the multimedia element and the mark information to a favorites folder; or, In response to a triggering operation on a storage control associated with the tag information, storing a target image, wherein the target image is generated based on the multimedia element and the tag information; or, In response to a triggering operation on a bullet screen publishing control associated with the tag information, the bullet screen information is published in the playback interface, and the bullet screen information includes the tag information.

3. The multimedia resource marking method according to claim 1, characterized in that: The method further comprises: In response to playing the multimedia element, barrage information is displayed in the playback interface, and the barrage information includes the tag information.

4. The multimedia resource marking method according to claim 1, characterized in that: The information input component for displaying the multimedia element in response to a marking operation on the multimedia element in the playback interface includes: In the case where the multimedia resource is a multimedia resource sent by an associated object of the terminal login object, in response to a marking operation on the multimedia element in the play interface, an information input component of the multimedia element is displayed.

5. The multimedia resource marking method according to claim 4, characterized in that: The method further comprises: A mark sharing message is sent to the associated object, wherein the mark sharing message includes the multimedia element and the marking information, and the mark sharing message is used to indicate that the terminal login object has marked the multimedia element.

6. The multimedia resource marking method according to claim 1, characterized in that: The information input component for displaying the multimedia element in response to a marking operation on the multimedia element in the playback interface includes: In response to a marking operation on the first video frame in the playback interface, a preview area is displayed in the playback interface, the preview area includes the first video frame, and the information input component associated with the first video frame is displayed.

7. The multimedia resource marking method according to claim 6, characterized in that: The preview area also displays a video frame adjacent to the first video frame; the method further includes: In response to a selection operation on a second video frame in the preview area, the information input component associated with the second video frame is displayed.

8. The multimedia resource marking method according to claim 1, characterized in that: The information input component for displaying the multimedia element in response to a marking operation on the multimedia element in the playback interface includes: The playback interface displays a playback progress bar of the multimedia resource, and in response to a sliding operation in a target direction after the playback progress bar is pressed for a preset time, an information input component of a video frame corresponding to the pressed position is displayed; or When the multimedia resource is played to any video frame, in response to a preset gesture operation in the playback interface, an information input component of the video frame is displayed in the playback interface.

9. The multimedia resource marking method according to claim 1, characterized in that: The playback interface displays a playback progress bar of the multimedia resource, and the information input component for displaying the multimedia element in response to a marking operation on the multimedia element in the playback interface includes: In response to the sequential triggering operation of the first position and the second position on the play progress bar, an information input component of the video segment determined by the first position and the second position is displayed; or, In response to sliding from the third position to the fourth position on the play progress bar, displaying an information input component of the video segment determined by the third position and the fourth position; or, In response to the dragging operation of the start mark and the end mark on the play progress bar, an information input component of the video segment determined by the start mark and the end mark is displayed.

10. The multimedia resource marking method according to claim 1, characterized in that: After displaying the information input component of the multimedia element, the method further includes: Based on the multimedia element, display candidate input information, where the candidate input information is used to describe the multimedia element; In response to a triggering operation on the candidate input information, the candidate input information is displayed in the information input component.

11. The multimedia resource marking method according to claim 1, characterized in that: After acquiring the mark information input in the information input component, the method further includes: Based on the keywords in the tag information, display the expression resources associated with the keywords; In response to a triggering operation on the expression resource, it is displayed that the keywords in the tag information are replaced with the expression resource.

12. The multimedia resource marking method according to claim 1, characterized in that: The method further comprises: At a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, summary marking information of the multimedia element is displayed, where the summary marking information is generated based on marking information of the multimedia element by at least one object.

13. The multimedia resource marking method according to claim 12, characterized in that: The displaying of summary mark information of the multimedia element at a position corresponding to any multimedia element on the playback progress bar of the multimedia resource includes: In response to the multimedia element satisfying a preset condition, displaying summary mark information of the multimedia element at a position corresponding to any multimedia element on the playback progress bar; The preset condition includes at least one of the following: The number of objects marking the multimedia element is greater than a preset threshold; The ranking corresponding to the number of objects marking the multimedia elements is within the preset ranking.

14. The multimedia resource marking method according to claim 12, characterized in that: The aggregated tagging information includes at least one of a tagging keyword of the multimedia element and the number of accounts that tag the multimedia element, and the tagging keyword is generated from at least one piece of tagging information for the multimedia element.

15. The multimedia resource marking method according to claim 1, characterized in that: The method further comprises: In response to a mark viewing operation on any multimedia element, mark detail information of the multimedia element is displayed, wherein the mark detail information includes at least one of the number of objects marking the multimedia element, at least one piece of mark information for the multimedia element, the number of times the multimedia element has been marked, and the ranking of the number of times the multimedia element has been marked.

16. The multimedia resource marking method according to claim 1, characterized in that: The viewpoint is a first type or a second type of viewpoint, the first type is used to indicate that the terminal login object supports the multimedia element, and the second type is used to indicate that the terminal login object opposes the multimedia element.

17. A method for playing multimedia resources, characterized in that: The method comprises: Display a playback interface, where the playback interface is used to play multimedia resources; Displaying tag information of a multimedia element in the playback interface, the tag information is used to indicate the viewpoint of the audience of the multimedia resource on the multimedia element, the multimedia element being a video frame or a video clip in the multimedia resource; An interactive control associated with the tag information is displayed in the playback interface, and interaction is performed based on the interactive control.

18. The method for playing multimedia resources according to claim 17, characterized in that: The step of displaying the interactive control associated with the mark information in the playback interface and performing interaction based on the interactive control includes: In response to the playback time of the multimedia resource reaching a preset time, displaying an interactive control associated with the tag information in the playback interface, and performing interaction based on the interactive control; or, In response to an interactive operation with the multimedia resource, an interactive control associated with the tag information is displayed in the playback interface, and interaction is performed based on the interactive control.

19. The method for playing multimedia resources according to claim 17, characterized in that: The interacting based on the interactive control includes at least one of the following: In response to a triggering operation on a sharing control associated with the tag information, sending the multimedia element and the tag information to a target object; or, In response to a triggering operation on a comment control associated with the tag information, displaying comment information in a comment display area of ​​the multimedia resource, the comment information including the multimedia element and the tag information; or, In response to a triggering operation on a collection control associated with the mark information, adding the multimedia element and the mark information to a favorites folder; or, In response to a triggering operation on a storage control associated with the tag information, storing a target image, wherein the target image is generated based on the multimedia element and the tag information; or, In response to a triggering operation on a bullet screen publishing control associated with the tag information, the bullet screen information is published in the playback interface, and the bullet screen information includes the tag information.

20. The method for playing multimedia resources according to claim 17, characterized in that: The method further comprises: In response to playing the multimedia element, barrage information is displayed in the playback interface, and the barrage information includes the tag information.

21. The method for playing multimedia resources according to claim 17, characterized in that: The viewpoint is a first type or a second type of viewpoint, the first type is used to indicate that the terminal login object supports the multimedia element, and the second type is used to indicate that the terminal login object opposes the multimedia element.

22. The method for playing multimedia resources according to claim 17, characterized in that: The displaying of the marking information of the multimedia element in the playing interface includes: In the case where the terminal login object has marked a multimedia element in the multimedia resource, displaying a first mark on a playback progress bar of the multimedia resource; In the case that the terminal login object does not mark the multimedia element in the multimedia resource, a second mark is displayed on the playback progress bar of the multimedia resource.

23. The method for playing multimedia resources according to claim 17, characterized in that: The method further comprises: At a position corresponding to any multimedia element on the playback progress bar of the multimedia resource, summary marking information of the multimedia element is displayed, where the summary marking information is generated based on marking information of the multimedia element by at least one object.

24. The method for playing multimedia resources according to claim 17, characterized in that: The method further comprises: In response to playing the multimedia element, displaying summary tag information of the multimedia element in the playback interface, where the summary tag information is generated based on tag information of the multimedia element by at least one object; or In response to the playback progress bar of the multimedia resource being dragged to the position corresponding to the multimedia element or the position corresponding to the multimedia element in the playback progress bar being clicked, the summary mark information is displayed in the playback interface.

25. The method for playing multimedia resources according to claim 17, characterized in that: The displaying of the marking information of the multimedia element in the playing interface includes: A tag list of the multimedia element is displayed in the playback interface, the tag list including tag information corresponding to multiple viewpoint types and the tag quantity corresponding to the multiple viewpoint types, the tag quantity referring to the number of viewers who added the tag information of the viewpoint type to the multimedia element.

26. The method for playing multimedia resources according to claim 17, characterized in that: The tag information is used to represent the view of the associated object of the terminal login object on the multimedia element, and the method further includes: Displaying prompt information in the playback interface, the prompt information is used to prompt that the associated object has marked the multimedia element; In response to a triggering operation on the prompt information, the multimedia resource is played starting from the multimedia element.

27. A multimedia resource marking device, characterized in that: The device comprises: An interface display unit, configured to display a playback interface of multimedia resources; a component display unit, configured to display an information input component of a multimedia element in response to a marking operation on a multimedia element in the playback interface, wherein the multimedia element is any video frame or any video clip of the multimedia resource; an acquisition unit, configured to acquire the mark information input in the information input component, wherein the mark information is used to represent the viewpoint of the terminal login object; The interaction unit is configured to display the interaction control associated with the mark information in the playback interface and perform interaction based on the interaction control.

28. A multimedia resource playback device, characterized in that: The device comprises: An interface display unit, configured to display a playback interface, wherein the playback interface is used to play multimedia resources; an information display unit, configured to display tag information of a multimedia element in the playback interface, wherein the tag information is used to indicate the viewpoint of the audience of the multimedia resource on the multimedia element, and the multimedia element is a video frame or a video clip in the multimedia resource; A control display unit is configured to display the interactive control associated with the mark information in the playback interface and to interact based on the interactive control.

29. An electronic device, characterized in that: The electronic device comprises: one or more processors; a memory for storing program code executable by the processor; The processor is configured to execute the program code to implement the multimedia resource marking method as described in any one of claims 1 to 16, or to implement the multimedia resource playing method as described in any one of claims 17 to 26.

30. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the multimedia resource marking method as described in any one of claims 1 to 16, or execute the multimedia resource playing method as described in any one of claims 17 to 26.

31. A computer program product, comprising a computer program, which, when executed by a processor, implements the multimedia resource marking method described in any one of claims 1 to 16, or implements the multimedia resource playback method described in any one of claims 17 to 26.

Images