Media playing method and device, electronic equipment, storage medium and program product

Abstract

The embodiment of the invention provides a media playing method and device, electronic equipment, a storage medium and a program product. A first media resource is displayed or played based on a first media interface; in response to a first trigger operation for the first media resource, generating mark information of the first media resource, the mark information being used for representing a media resource identifier of the media resource and a playing progress of the media resource when the mark information is generated; and inserting the first media resource into the to-be-played list, and when the first media resource is played based on the to-be-played list, continuously playing the first media resource from the playing progress corresponding to the mark information of the first media resource according to the mark information of the first media resource. Through marking the first media resource, generating the marking information and combining with the to-be-played list, the rapid continuous playing of the first media resource after the playing is interrupted is realized, the playing progress is kept coherent, and the interaction efficiency and the user experience are improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of Internet technologies, and in particular, to a media playing method, apparatus, electronic device, storage medium, and program product. Background Art

[0002] Currently, the resource consumption time of users shows a fragmented characteristic. For example, when a user watches media resources pushed by a media platform, for media resources with a long duration, it is often difficult to complete the playback within a time fragment, resulting in the user being unable to watch the complete content of the media resources.

[0003] In the prior art, media platforms provide functions of historical records and favorites, and users can retrieve and replay media resources through historical records or favorites.

[0004] However, in the solutions of the prior art, during the process of retrieving and replaying media resources, there are still problems such as complex operation processes and low interaction efficiency, which affect the user experience. Summary of the Invention

[0005] Embodiments of the present disclosure provide a media playing method, apparatus, electronic device, storage medium, and program product to overcome the problems of complex operation processes and low interaction efficiency during the process of retrieving and replaying media resources.

[0006] In a first aspect, embodiments of the present disclosure provide a media playing method, including:

[0007] Displaying or playing a first media resource based on a first media interface;

[0008] Responding to a first trigger operation on the first media resource, generating marking information for the first media resource, where the marking information is used to represent the media resource identifier of the media resource and the playback progress of the media resource when the marking information is generated;

[0009] Inserting the first media resource into a to-be-played list, and when playing to the first media resource based on the to-be-played list, resuming playback of the first media resource from the playback progress corresponding to the marking information of the first media resource.

[0010] In a second aspect, embodiments of the present disclosure provide a media playing apparatus, including:

[0011] A display module, configured to display or play a first media resource based on a first media interface;

[0012] A marking module, configured to generate marking information of the first media resource in response to a first trigger operation for the first media resource, where the marking information is used to represent a media resource identifier of the media resource and a playback progress of the media resource when the marking information is generated;

[0013] A playback module, configured to insert the first media resource into a to-be-played list, and when playing to the first media resource based on the to-be-played list, resume playing the first media resource from the playback progress corresponding to the marking information of the first media resource according to the marking information of the first media resource.

[0014] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0015] The memory stores computer-executable instructions;

[0016] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the media playback method described in the first aspect and various possible designs of the first aspect as above.

[0017] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer-executable instructions are stored, and when the processor executes the computer-executable instructions, the media playback method described in the first aspect and various possible designs of the first aspect as above is implemented.

[0018] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, and when the computer program is executed by a processor, the media playback method described in the first aspect and various possible designs of the first aspect as above is implemented.

[0019] The media playback method, device, electronic device, storage medium, and program product provided in this embodiment display or play the first media resource based on the first media interface; in response to a first trigger operation for the first media resource, generate marking information of the first media resource, where the marking information is used to represent a media resource identifier of the media resource and a playback progress of the media resource when the marking information is generated; insert the first media resource into a to-be-played list, and when playing to the first media resource based on the to-be-played list, resume playing the first media resource from the playback progress corresponding to the marking information of the first media resource according to the marking information of the first media resource. By marking the first media resource, generating marking information, and combining with the to-be-played list, fast resume playback of the first media resource after playback interruption is realized, and the playback progress is kept coherent, enabling the user to quickly and accurately retrieve and resume playing the media resource, improving the interaction efficiency and user experience. Description of the Drawings

[0020] To more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are some embodiments of the present disclosure. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can also be obtained based on these drawings.

[0021] Figure 1 It is a schematic diagram of an application scenario of the media playing function provided by the embodiment of the present disclosure;

[0022] Figure 2 It is a schematic flow chart of the media playing method provided by the embodiment of the present disclosure Figure 1 ;

[0023] Figure 3 It is a schematic diagram of a to-be-played list panel provided by the embodiment of the present disclosure;

[0024] Figure 4 It is a step for determining a target sorting position provided by the embodiment of the present disclosure;

[0025] Figure 5 It is a schematic diagram of the process relationship for adjusting a to-be-played list provided by the embodiment of the present disclosure;

[0026] Figure 6 It is a schematic flow chart of the media playing method provided by the embodiment of the present disclosure Figure 2 ;

[0027] Figure 7 It is Figure 6 a flow chart of the specific implementation manner of step S202 in the illustrated embodiment;

[0028] Figure 8 It is a schematic diagram of a marked list panel provided by the embodiment of the present disclosure;

[0029] Figure 9 It is a schematic diagram of the process of inserting a media resource into a to-be-played list provided by the embodiment of the present disclosure;

[0030] Figure 10 It is a structural block diagram of a media playing device provided by the embodiment of the present disclosure;

[0031] Figure 11 It is a schematic structural diagram of an electronic device provided by the embodiment of the present disclosure;

[0032] Figure 12 It is a schematic hardware structure diagram of an electronic device provided by the embodiment of the present disclosure. Specific embodiments

[0033] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are some but not all of the embodiments of the present disclosure. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present disclosure without creative efforts shall fall within the scope of protection of the present disclosure.

[0034] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present disclosure are all information and data authorized by the user or fully authorized by all parties. The collection, use, and processing of relevant data need to comply with relevant laws, regulations, and standards of relevant countries and regions, and corresponding operation entrances are provided for users to choose to authorize or refuse.

[0035] The application scenarios of the embodiments of the present disclosure are explained below:

[0036] The media playback method provided by the embodiments of the present disclosure can be applied to an application program (APP, Application) with media playback functions, such as short video application programs, audiobook application programs, etc. More specifically, it can be applied to an application scenario of media push playback based on an information stream (feed stream). The execution entity of this embodiment can be a terminal device running the above application program with media playback functions, or a server deploying the service end corresponding to the above application program, or other electronic devices with similar functions. Among them, when the execution entity is a terminal device, the terminal device executes the method provided by this embodiment by running the above application program; when the execution entity is a server, part or all of the service end of the above application program with media playback functions can run on the server, and the method provided by this embodiment is executed on the server side, while the terminal device runs the client of the application program. Based on the server-client communication between the server and the terminal device, the terminal device can obtain the execution result of the method provided by this embodiment and display it as needed.

[0037] Among them, in some embodiments, the terminal device or the server can implement the media playback function provided by the embodiments of the present disclosure by running various computer-executable instructions or computer programs. For example, the computer-executable instructions can be program-level commands, machine instructions, or software instructions. The computer program can be a native program or software module in the operating system; it can be a local application, that is, a program that needs to be installed in the operating system to run, or it can be a small program embedded in any APP, that is, a program that runs based on the browser environment. In summary, the above computer-executable instructions can be instructions in any form, and the above computer programs can be application programs, modules, or plugins in any form, and the specific implementation form can be configured according to needs. Further, in the process of implementing the media playback function provided by the embodiments of the present disclosure, the terminal device can execute the method by running the computer-executable instructions or computer programs set locally, or can execute the method by calling the computer-executable instructions or computer programs set in an external server. In some embodiments, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud storage, cloud communication, cloud databases, cloud computing, cloud functions, network services, middleware services, domain name services, security services, Content Delivery Network (CDN), and big data and artificial intelligence platforms. Among them, the cloud service can be an interactive processing service for the terminal device to call.

[0038] Figure 1 FIG. is an application scenario diagram of the media playback function provided by the embodiments of the present disclosure. Refer to Figure 1 As shown in the figure, taking the terminal device as an example, a target application program with a media playback function runs in the terminal device. For example, a short video application program that pushes videos based on the feed stream. While the user is watching video resources (media resources) through the target application program, the user can also operate the terminal device to perform operations such as pause / play, progress jump, and resource switching. For example, by swiping the screen up and down, the currently playing video resources can be switched. In a possible implementation manner, the target application program can also be switched to the audio playback mode (such as the "audiobook mode"). In this mode, the target application program plays the audio content of the video resources through the audio player to meet the user's need to listen to the audio content of the video.

[0039] In the above application scenarios, for media resources with a relatively long duration, since they cannot be played completely within a time fragment (e.g., a 10-minute break in a courseware or a 5-minute waiting period), users have a need to save media resources that they are interested in and have not finished playing, and continue to watch or listen to them in subsequent time fragments. In the prior art, for such needs, media resources are usually recorded and saved by providing a history record and a favorites list. However, the above solutions in the prior art cannot accurately record the playback progress. At the same time, when retrieving media resources, they can only be played according to the selected media resource, that is, the operation mode is to select one and play one at a time, and queue playback cannot be achieved, resulting in a complex operation process and low interaction efficiency, which affects the user experience.

[0040] Embodiments of the present disclosure provide a media playback method to solve the above problems.

[0041] Refer to Figure 2 , Figure 2 for the process schematic of the media playback method provided by the embodiments of the present disclosure Figure 1 The method of this embodiment can be applied to a terminal device or a server. Among them, for the case where the terminal device executes the method provided by this embodiment, in one possible implementation, the terminal device can implement the media playback method provided by this embodiment by executing program code deployed locally. In another possible implementation, the server can be used to deploy a functional service implemented based on the media playback method provided by this embodiment, and the terminal device can access the above server and call the corresponding functional service to implement the media playback method provided by this embodiment. Exemplarily, the media playback method provided by this embodiment includes:

[0042] Step S101: Display or play a first media resource based on a first media interface.

[0043] Step S102: In response to a first trigger operation on the first media resource, generate marking information for the first media resource. The marking information is used to characterize the media resource identifier of the media resource and the playback progress of the media resource when the marking information is generated.

[0044] Step S103: Insert the first media resource into a to-be-played list, and when playing to the first media resource based on the to-be-played list, resume playing the first media resource from the playback progress corresponding to the marking information of the first media resource.

[0045] Refer to Figure 1In the application scenario schematic diagram shown, the terminal device is used as the execution subject to introduce the provided media playback method in this embodiment. Exemplarily, the terminal device runs the target application and provides the media playback function to the user through the target application. The user displays or plays the first media resource through the first media interface of the target application, wherein the first media interface is, for example, the media playback interface of the target application, and the interface is provided with relevant controls and buttons of the media player (such as play, pause, fast forward, next, etc.). The first media resource can be a video resource or an audio resource. When the first media resource is a video resource, the corresponding video screen is played in the first media interface; and when the first media resource is an audio resource, the first media interface displays the relevant information corresponding to the first media resource, such as the title, author, chapter, content text, cover, etc. Among them, the first media resource in the first media interface can be in a playing or non-playing (such as paused) state, that is, the first media resource is displayed or played based on the first media interface, which is not limited here.

[0046] Furthermore, after the first media resource is displayed or played based on the first media interface, in response to the first trigger operation for the first media resource, such as the trigger operation for the "marking control" set in the first media interface, the marking information of the first media resource is generated. Among them, in a possible implementation method, the marking information includes a media resource identifier representing the media resource, such as the title name of the first media resource; the marking information also includes a time information representing the playback progress of the media resource, and the playback progress is the playback progress of the first media resource when the first trigger operation is responded to, that is, the playback progress of the first media resource at the moment when the marking information is generated. The time information representing the playback progress of the media resource can be expressed by a percentage value or by a specific timestamp. The above-mentioned step of generating the marking information, that is, the process of "marking" the first media resource, realizes the first media resource and the playback progress of the first media resource at the "marking moment" by generating the marking information, so that in the subsequent steps, the first media resource can be quickly resumed based on the marking information.

[0047] After generating the marking information, it is equivalent to completing the marking process of the first media resource. After that, when the user needs to retrieve and replay the first media resource, the terminal device responds to the user operation and inserts the first media resource into the playlist to be played. Among them, the playlist to be played is a list in the target application for storing media resources to be played. In the application scenario of media playback based on the feed stream, on the one hand, the target application plays the media resources in the playlist to be played in sequence through the first media interface (media playback interface), and on the other hand, receives the feed media resources pushed by the server and adds the feed media resources to the playlist to be played in sequence. There are various ways to insert the first media resource into the playlist to be played. In one possible implementation, after generating the marking information of the first media resource, the first media resource is directly automatically inserted into the target sorting position in the playlist to be played, such as the end of the playlist to be played. In another possible implementation, the terminal device inserts the first media resource into the playlist to be played by responding to the user operation. For example, insert the first media resource at the beginning of the playlist to be played, that is, the most prioritized playback position. When the current media being played in the first media interface of the target application is played to completion, the first media resource will start to be played continuously; for another example, the terminal device responds to the user operation and inserts the first media resource at the end of the playlist to be played, that is, the last playback position. The first media resource will be played only after all other media resources before the first media resource in the playlist to be played are played to completion in sequence. Of course, in other possible implementations, the first media resource can also be located at other positions in the playlist to be played, which will not be elaborated one by one here.

[0048] Furthermore, the above user operation can be responded to by displaying the playlist panel corresponding to the playlist to be played, and then the user manually inserts the first media resource into the playlist to be played. In one possible implementation, this embodiment further includes at least one of the following:

[0049] Step S100A: Display the playlist panel to be played, which is used to display the marking information of the media resources in the playlist to be played.

[0050] Step S100B: Based on the positions of the respective marking information displayed in the playlist panel to be played, play the media resources corresponding to the respective marking information in sequence based on the marking information.

[0051] Step S100C: Respond to the second trigger operation and adjust the position of the marking information of the first media resource in the playlist panel to be played.

[0052] Figure 3 A schematic diagram of a playlist panel to be played provided by an embodiment of the present disclosure, as Figure 3As shown, the to-be-played playlist panel displays marker information #1, marker information #2, and marker information #3. Each marker information corresponds to a different media resource that makes up the to-be-played playlist. Taking marker information #1 as an example, marker information #1 contains a media identifier video_1 for indicating the first media resource and the corresponding playback progress t1. Optionally, the to-be-played playlist panel also includes the playback duration of the media resource. For example, the playback duration of the media resource corresponding to the media identifier video_1 is T1. In short, the to-be-played playlist panel is a container that displays the to-be-played playlist. The terminal device will play the corresponding media resources according to the order of the marker information displayed in the to-be-played playlist panel, that is, based on the positions of the marker information displayed in the to-be-played playlist panel, the terminal device will play the media resources corresponding to each marker information in sequence. On this basis, by receiving and responding to the second trigger operation input by the user, the terminal device can adjust the position of the marker information of the first media resource in the to-be-played playlist panel. For example Figure 3 as shown in Figure 3 , based on the second trigger operation (drag operation), the marker information #1 of the first media resource can be swapped with the marker information #2, thereby adjusting the playback order of the first media resource.

[0053] After that, the terminal device plays the media items in the to-be-played playlist in sequence. After inserting the first media resource into the to-be-played playlist and when playing to the first media resource based on the to-be-played playlist, the terminal device resumes playing the first media resource from the playback progress corresponding to the marker information of the first media resource obtained previously. For example, the terminal device resumes playing the first media resource from the playback timestamp 3:00 (3 minutes) of the first media resource. This playback timestamp 3:00 is the playback progress of the first media resource when the previous marker information was generated. Through the above steps, non-instant queue playback of the first media resource can be achieved, and the playback progress is coherent with the progress when the previous marker information was generated, achieving the purpose of simplifying the operation steps, avoiding repeated operations, and improving the interaction efficiency.

[0054] Among them, in a possible embodiment, after inserting the first media resource into the to-be-played playlist, it further includes:

[0055] Step S100D: Refresh the to-be-played playlist panel to display the marker information of the first media resource at the target sorting position within the to-be-played playlist panel.

[0056] Exemplarily, in combination with the introduction of the related steps for displaying the to-be-played playlist panel before, the to-be-played playlist panel can be a container / control for displaying the to-be-played playlist. After inserting the first media resource into the to-be-played playlist, since the to-be-played playlist changes, the content of the corresponding to-be-played playlist panel also changes. The terminal device refreshes the to-be-played playlist panel and displays the marker information of the first media resource at the target sorting position within the to-be-played playlist panel, that is, the marker information corresponding to the first media resource is displayed within the to-be-played playlist panel to prompt the user that the first media resource has been successfully inserted into the to-be-played playlist. Further, steps such as adjusting the playback order of the first media resource can be executed through the to-be-played playlist panel.

[0057] Further, for the target sorting position in step S100D, in one possible implementation, the target sorting position can be the same as the position of the first media resource in the to-be-played playlist, that is, according to the position of the first media resource in the to-be-played playlist, the target sorting position within the to-be-played playlist panel is determined, achieving the technical effect of the content displayed by the to-be-played playlist panel, that is, the content of the to-be-played playlist. In another possible implementation, the content displayed in the to-be-played playlist panel is the result of sorting and optimizing the to-be-played playlist. Specifically, before step S100D, there is also a step of determining the target sorting position. Exemplarily, as Figure 4 shown, this step includes:

[0058] Step S100E-1: Obtain the first content feature of the media resource corresponding to each marker information in the to-be-played playlist, and the second content feature of the first media resource.

[0059] Step S100E-2: Determine the target sorting position according to the second content feature and each first content feature, where the second content feature of the first media resource has feature similarity and / or feature continuity with the first content feature of the media resource at the adjacent position of the target sorting position.

[0060] Exemplarily, first, according to the media resources corresponding to each marker information currently recorded in the playlist to be played, the content features corresponding to each media resource are respectively obtained, that is, the first content features. Among them, the content feature is a feature expression characterizing the resource content of the media resource, and the content feature can be implemented in forms such as a feature type identifier, a feature vector, a feature matrix, etc. The first content feature, that is, the content feature of the resource content of the media resources corresponding to each marker information currently recorded in the playlist to be played. Similarly, the second content feature, that is, the content feature of the resource content of the first media resource. The above content features (the first content feature, the second content feature) can be obtained by performing image content analysis on the media resource. It can also be obtained by parsing text description information such as the title and abstract corresponding to the media resource. The specific analysis method can be implemented through a pre-trained image processing model and a text processing model, which will not be elaborated here. After that, according to the obtained first content feature and second content feature, the target sorting position is determined. For example, by calculating the feature similarity and content semantic coherence of the first content feature and the second content feature, the first content feature that is closest to and / or has the most coherent semantics with the second content feature representing the content of the first media resource is determined as the target first content feature, that is, the first content feature of the media resource located at the adjacent position of the target sorting position; then, the adjacent position where the media resource corresponding to the target first content feature is located, that is, the previous or next position of the media resource, is determined as the target sorting position, and the first media resource is inserted into the target sorting position. Since the feature distance between the target first content feature and the second content feature is relatively close, the content similarity and / or content coherence between the first media resource at the target sorting position and the media resource corresponding to the target first content feature at the adjacent position can be realized, so as to achieve the effect of content clustering, and the effect of continuous playback of similar content can be realized when playing based on the playlist to be played.

[0061] Figure 5 Schematic diagram of the process relationship for adjusting the playlist to be played provided by an embodiment of the present disclosure. The following will be combined with Figure 5 to introduce the process of determining the target sorting position, as Figure 5As shown, first, in the playlist to be played, there are a series of media resources pushed by the server and manually added by the user, such as media resource M1, media resource M2, media resource M3, etc. Among them, media resource M2 is the first media resource, and its content is "the third episode of TV drama A". The content of media resource M1 is "the second episode of TV drama A", and the content of media resource M3 is "the fourth episode of TV drama A". In this case, by obtaining the content feature F2 (the second content feature) of media resource M2, the content feature F1 (the first content feature) of media resource M1, the content feature F3 (the first content feature) of media resource M3, and the content features of other media resources (the first content feature), and performing feature similarity, feature continuity calculation and clustering, the content features F1, F2, and F3 will be determined as features with feature continuity in the feature space. Furthermore, the media resource M1 corresponding to the content feature F1 is configured at the t-th position in the playlist to be played, the media resource M2 corresponding to the content feature F2 is configured at the (t + 1)-th position in the playlist to be played, and the media resource M3 corresponding to the content feature F3 is configured at the (t + 2)-th position in the playlist to be played. Thus, the automatic arrangement and sequential playback of relevant and similar media in the playlist to be played are realized, improving the interaction efficiency.

[0062] In this embodiment, the first media resource is displayed or played based on the first media interface; in response to a first trigger operation on the first media resource, marking information of the first media resource is generated, and the marking information is used to represent the media resource identifier of the media resource and the playback progress of the media resource when the marking information is generated; the first media resource is inserted into the playlist to be played, and when playing to the first media resource based on the playlist to be played, the first media resource is resumed from the playback progress corresponding to the marking information of the first media resource. By marking the first media resource, generating marking information, and combining with the playlist to be played, the quick resume playback of the first media resource after playback interruption is realized, and the playback progress is kept coherent, enabling the user to quickly and accurately retrieve and resume playback of the media resource, improving the interaction efficiency and user experience.

[0063] Reference Figure 6 , Figure 6 is a schematic flowchart of the media playback method provided by the embodiments of the present disclosure Figure 2 。This embodiment further refines step S103 and adds related technical features of the target marking list on the basis of the embodiment shown in Figure 2 . The media playback method includes:

[0064] Step S201: Display or play the first media resource based on the first media interface.

[0065] Optionally, after step S201, it further includes:

[0066] Step S201A: When the first media resource is played to the key playback progress, a prompt message is displayed within the first media interface, where the prompt message is used to instruct the user to perform a first trigger operation, and the key playback progress is used to indicate the starting playback position corresponding to the key content of the first media resource, or the playback position corresponding to the demarcation point between two independent contents in the first media resource.

[0067] Exemplarily, after the terminal device runs the target application and displays or plays the first media resource through the first media interface of the target application, in one possible implementation, the user can, based on needs, manually trigger the marking process for the first media resource, that is, perform the first trigger operation, to generate the marking information of the first media resource. The first trigger operation is, for example, clicking on controls such as "Favorite", "Like", etc.

[0068] In another possible implementation, the terminal device can, based on the resource content of the first media resource, pop up a prompt message when playing to the key playback progress to prompt the user to perform marking at the playback progress recommended by the target application to generate marking information with a better content demarcation point. Specifically, in one possible implementation, the terminal device can, before playing the first media resource, obtain in advance the key playback progress of the first media resource. The key playback progress can be a value indicating the playback progress percentage or a playback timestamp, and the key playback progress is used to indicate the starting playback position corresponding to the key content of the first media resource, or to indicate the playback position corresponding to the demarcation point between two independent contents in the first media resource. When the first media resource is played to this key playback progress, a prompt message is displayed within the first media interface. For example, at controls named "Favorite", "Listen Later", etc., indicative special effects such as highlight special effects and animation special effects, or prompt text, that is, the prompt message is displayed, thereby guiding and instructing the user to perform the first trigger operation to mark the first media resource at the current playback progress. When the first media resource is replayed later, the integrity of the playback content of the first media resource can be ensured.

[0069] Among them, the above key playback progress can be generated in advance through manual marking or automatic content recognition. The terminal device can, for example, directly obtain this key playback progress from the feed stream data pushed by the server. It can also be obtained by the terminal device after obtaining the first media resource through content parsing, feature recognition, and classification of the entire first media resource, and there is no limitation here.

[0070] Further, in another possible implementation of determining the key playback progress, during the playback of the first media resource, the terminal device performs real-time processing on the first media resource to determine whether the current playback progress is the key playback progress, and displays a prompt message after determining that the current playback progress is the key playback progress. In one possible implementation, this embodiment further includes: obtaining the real-time content characteristics of the audio and video decoding data after the current playback progress of the first media resource in real time; determining the key playback progress of the first media resource according to the real-time content characteristics. Specifically, during the playback of the first media resource by the terminal device, the audio and video decoding data that has been decoded and is waiting to be played after the current playback progress of the first media resource is obtained periodically. Then, based on the feature extraction of the picture features and sound features in the audio and video decoding data waiting to be played, the real-time content characteristics are obtained. After that, based on the real-time content characteristics, it is determined whether the current video segment contains important information and whether it is new independent content. If so, it is determined that the current playback progress is the key playback progress of the first media resource. Furthermore, a prompt message is displayed in the first media interface. In the steps of this embodiment, the content feature analysis is performed using the decoded audio and video decoding data, thereby realizing the judgment of the key playback progress. Compared with the solution of decoding the entire content of the first media resource in advance and then performing feature extraction, there is no need to perform an additional decoding on the first media resource, which makes full use of the computing resources, reduces the computing resource overhead, and improves the processing efficiency.

[0071] Step S202: In response to a first trigger operation on the first media resource, generate marking information for the first media resource, where the marking information is used to represent the media resource identifier of the media resource and the playback progress of the media resource when the marking information is generated.

[0072] Exemplarily, after receiving the first trigger operation on the first media resource, the terminal device generates marking information for the first media resource based on the media resource identifier of the first media resource and the current playback progress. In one possible implementation, the marking information is further used to represent the summary information of the corresponding media resource. The summary information can be pre-generated. The terminal device can obtain the summary information while obtaining the media resource identifier of the first media resource from the feed stream data. In another possible implementation, the summary information is generated by the terminal device after performing content recognition on the first media resource.

[0073] As Figure 7 shown, exemplarily, the specific implementation manner of step S202 includes:

[0074] Step S2021: In response to a first trigger operation on the first media resource, obtain the current first playback progress of the first media resource;

[0075] Step S2022: Obtain a slice of the media resource content corresponding to the first playback progress in the first media resource;

[0076] Step S2023: Perform semantic understanding on the slice of the media resource content corresponding to the first playback progress, generate summary information, and generate marking information based on the summary information.

[0077] Exemplarily, first, after the terminal device responds to a first trigger operation on the first media resource, it obtains the current first playback progress of the first media resource, and according to this first playback progress, obtains the corresponding slice of the media resource content. For example, the first playback progress is "0:30", that is, the playback timestamp of the first media resource is 0 minutes and 30 seconds. Then, obtain the group of pictures (GOP) corresponding to this playback timestamp, or obtain the image or sound data corresponding to the time interval with the playback timestamp as the midpoint and a preset duration as the interval length as the slice of the media resource content; then extract and perform semantic understanding on the voice content, picture content, and subtitle content in the above slice of the media resource content to generate summary information representing the content summary corresponding to the slice of the media resource content, and then based on the summary information, media resource identifier, and playback progress, construct marking information.

[0078] In the steps of this embodiment, by parsing the first media resource, marking information containing summary information is generated, so that in subsequent steps, when the marking information is displayed through the target marking list panel, the display of the content summary at the playback progress represented by the marking information can be realized, so that the user can more intuitively understand the content at the "marked position" of the first media resource and improve the retrieval efficiency of the media resource.

[0079] Step S203: Determine the corresponding target marking list according to the type of the target control corresponding to the first trigger operation, and insert the first media resource into the target marking list.

[0080] Step S204: Display the target marking list panel corresponding to the target marking list.

[0081] Exemplarily, a marking control for triggering a media marking process is provided in the first media interface, such as a "favorite" control, a "like" control, a "watch later" control, etc. Each of the above marking controls corresponds to a different marking list, and the marking list is a collection of marked media resources. When there are two or more marking controls in the first media interface, there are correspondingly two or more marking lists. For example, the "favorite" control corresponds to a "favorite list", and the "like" control corresponds to a "like list". In this case, the terminal device determines the corresponding target marking list according to the type of the target control triggered by the first trigger operation, and inserts the first media resource into the target marking list. For example, when the user triggers the "favorite" control by a click operation, the first media resource will be inserted into the "favorite list" (target marking list), and when the user triggers the "like" control by a click operation, the first media resource will be inserted into the "like list" (target marking list). Through the above steps, the purpose of marking the first media resource as different types of resources to be played is achieved.

[0082] After that, by responding to the user operation, the terminal device will display the target marking list panel corresponding to the above marking list. The marking list panel is similar in function and form to the to-be-played list panel. The marking list panel is a container / component for carrying the marking list. In the marking list panel, the marking information of multiple media resources is displayed, such as the media resource identifier, playback progress, summary, etc. of the media resources. The terminal device can display multiple marking list panels at the same time, or display the target marking list panel corresponding to the target marking list. After that, by responding to the user's selection operation, a certain media resource in the marking list panel, such as the first media resource in the target marking list panel, is inserted into the to-be-played list and displayed in the to-be-played list panel.

[0083] Further, in a possible implementation manner, before step S204, it further includes:

[0084] Step S204A: Obtain the playback progress of each media resource in the target marking list.

[0085] Step S204B: Arrange the positions of the media resources in the target marking list according to the playback progress of each media resource in the target marking list. Among them, the more the playback progress, the more forward the position of the corresponding media resource in the target marking list.

[0086] Exemplarily, each media resource in the tag list can be arranged based on the order in which the media resources are inserted into the tag list. For example, the most recently added media resource to the tag list is arranged at the front of the tag list. The order can also be adjusted in response to user operations. In one possible implementation, the terminal device can also arrange the positions of the media resources in the target tag list based on the playback progress of the media resources, so that the media resources with more playback progress are arranged in the front positions in the tag list, thereby being preferentially displayed. Figure 8 FIG. 2 is a schematic diagram of a tag list provided by an embodiment of the present disclosure. As shown in the figure, the target tag list includes media resources such as media resource M1, media resource M2, media resource M3, etc. that are sequentially added. The tag information corresponding to media resource M1, media resource M2, and media resource M3 is tag information #1, tag information #2, and tag information #3, respectively. The target tag list is sorted according to the playback progress in the tag information. For example, the playback progress of media resource M2 is 90%, which is the most, and it is arranged in the first position in the tag list; while the playback progress of media resource M1 is 80% and it is arranged in the second position in the tag list, and the playback progress of media resource M3 is 30% and it is arranged in the third position in the tag list, and so on. For the unplayed media resource Mn (tag information #n), it is arranged at the end of the tag list. Then, based on the sorting of the media resources in the target tag list, a corresponding tag list panel is generated. The sorting of the tag information of each media resource (in the tag list panel) is consistent with the sorting of the media resources in the corresponding tag list. As shown in the figure, the target tag list panel includes the above tag information #1, tag information #2, tag information #3, etc. Among them, tag information #1 includes the media identifier video_1 and the corresponding playback progress of 80%, tag information #2 includes the media identifier video_2 and the corresponding playback progress of 90%, tag information #3 includes the media identifier video_3 and the corresponding playback progress of 30%. Tag information #n includes the media identifier video_n and the corresponding playback progress of 0%.

[0087] By arranging the positions of the media resources in the target tag list in the above manner, the unplayed media resources are preferentially displayed in tag lists such as the "favorite" list and the "like" list. Thus, when transferring media resources from the tag list to the to-be-played list subsequently, the user can quickly locate the unplayed media resources, and these unplayed media resources are preferentially added to the to-be-played list, improving the efficiency of media retrieval and re-playback.

[0088] Step S205: In response to a second selection operation on the first media resource in the tag list panel, insert the first media resource into the target to-be-played list.

[0089] Exemplarily, after the marked column surface panel is displayed, according to the content of the marked list shown on the marked column surface panel, the user can select the required first media resource therefrom and transfer it to the target playlist to be queued for playback. Figure 9 FIG. is a schematic diagram of a process for inserting a media resource into a playlist provided by an embodiment of the present disclosure. The following further introduces the above steps, as Figure 9 described below. As shown in Figure 9 , first, the terminal device detects a first trigger operation applied by the user to the first media resource (shown as M1 in the figure), for example, a click operation on the favorite component (shown as a "five-pointed star" in the figure) shown in the figure, and adds the first media resource to the marked list L1. After that, when the user clicks the "marked list" control within the first media interface, multiple marked column surface panels can be switched and displayed in a tabular manner, including the marked column surface panel corresponding to the marked list L1, the marked column surface panel corresponding to the marked list L2, etc. Then, by responding to the user's selection operation, the marked column surface panel corresponding to the marked list L1 is determined as the target marked column surface panel and displayed. As shown in the figure, in the marked column surface panel corresponding to the marked list L1, multiple media resources are displayed, such as media resource M1, media resource N1, media resource P1, etc. The marked information includes the media resource name, the playback progress, and the content summary of the video slice corresponding to the playback progress. Taking the media resource M1 as an example, the media resource name is "Chapter 3 of The Young Hero", the playback progress is 42%, and the content summary of the video slice corresponding to the playback progress is "The sect master is defeated". Then, in response to a second selection operation on the media resource M1 in the target marked column surface panel, for example, after clicking the control named "add to pending play" on the right side of the media resource M1, the media resource M1 is added to the playlist to be played. After that, the user can click on the tab corresponding to the playlist to be played to display the playlist surface panel, and in the playlist surface panel, it can be seen that the media resource M1 is inserted into the second sorting position in the playlist to be played, that is, the target sorting position. Before and after the media resource M1, the media resources M0 and M2 that are content-consistent with the media resource M1 are played respectively. More specifically, the media resource name of the media resource M0 is "Chapter 2 of The Young Hero", the playback progress is 10%, and the content summary of the video slice corresponding to the playback progress is "The enemy invades". The media resource name of the media resource M2 is "Chapter 4 of The Young Hero", the playback progress is 0%, and the content summary of the video slice corresponding to the playback progress is "The young hero appears". The method for determining the target sorting position has been introduced in the previous embodiment and will not be elaborated here.

[0090] In a possible implementation manner, before step S205, it further includes:

[0091] Step S205A: Display at least two to-be-played column panels, with each to-be-played column panel corresponding to a different to-be-played list.

[0092] Step S205B: Determine the target to-be-played column panel corresponding to the target to-be-played list from at least two to-be-played column panels.

[0093] Step S205C: Determine the target sorting position of the first media resource in the target to-be-played column panel.

[0094] Further, in another possible implementation, there can be multiple to-be-played lists, and each to-be-played list corresponds to an independent to-be-played column panel. The terminal device can display multiple to-be-played column panels for the user to view and select through tabs or other means. After that, the terminal device, in response to the user's selection operation, selects the target to-be-played column panel corresponding to the target to-be-played list from multiple to-be-played column panels, that is, determines the target to-be-played list, and determines the target sorting position of the first media resource in the target to-be-played column panel, and then performs the subsequent step of adding the first media resource in the marked list to the to-be-played list. In this implementation step, by maintaining multiple to-be-played lists, queue playback of different media resources based on different sorts is realized, thereby improving the flexibility and personalization degree of queue playback of media resources.

[0095] Step S206: In response to the first selection operation on the target to-be-played column panel, based on the positions of the respective marked information displayed in the target to-be-played column panel, play the media resources corresponding to the marked information in sequence based on the marked information.

[0096] Step S207: When playing to the first media resource based on the target to-be-played list, continue playing the first media resource from the playback progress corresponding to the marked information of the first media resource according to the marked information of the first media resource.

[0097] Further, the first selection operation for the target to-be-played column surface panel is a user operation for determining the target to-be-played column surface panel from multiple to-be-played column surface panels. Based on this first selection operation, the terminal device determines the target to-be-played column surface panel and the target to-be-played list. Subsequently, the target application program plays each media resource in the target to-be-played list in sequence, thereby achieving continuous playback of multimedia resources. When playing the first media resource, the marking information of the first media resource is obtained, and the first media resource is resumed from the playback progress indicated by the marking information, thereby achieving retrieval and resumed playback of the first media resource. At the same time, based on the previous steps, the media resources in the target to-be-played list are sorted based on content features. Therefore, continuous playback of different media resources with content coherence can be achieved. Combining the feature that the marking information can indicate the playback progress corresponding to the key content, this embodiment can further achieve continuous playback of the key content of different media resources with content coherence. For example, in the application scenario of audiobook playback, through this embodiment, marking the audiobook, generating marking information, and inserting it into the to-be-played list for sequential playback can achieve the effect of cutting the non-primary content (such as advertisements, previous episode summaries, etc.) at the beginnings of different chapters in the same audiobook work and performing continuous playback through the to-be-played list, improving the effect of continuous playback of media resources and enhancing the user experience.

[0098] In this embodiment, the implementation manners of steps S201 - S202 are the same as those of steps S101 - S102 in the embodiment shown in Figure 2 this disclosure, and will not be elaborated herein one by one.

[0099] Corresponding to the media playback method in the above embodiment, Figure 10 it is a structural block diagram of a media playback device provided by an embodiment of this disclosure. The method introduced in the above embodiment can be executed by this media playback device. The device can be implemented in software and / or hardware, and the device can be integrated in an electronic device with certain data processing capabilities. Among them, the electronic device may include, but is not limited to, a mobile terminal with big data processing capabilities, and a fixed terminal such as a desktop computer and a supercomputer with big data processing capabilities.

[0100] For the sake of simplicity, only parts related to the embodiments of this disclosure are shown. Referring to Figure 10 , the media playback device 3 includes:

[0101] A display module 31, configured to display or play a first media resource based on a first media interface;

[0102] A marking module 32, configured to generate marking information of a first media resource in response to a first trigger operation for the first media resource, where the marking information is used to characterize a media resource identifier of the media resource and a playing progress of the media resource when the marking information is generated;

[0103] A playing module 33, configured to insert the first media resource into a to-be-played list, and when playing reaches the first media resource based on the to-be-played list, resume playing the first media resource from the playing progress corresponding to the marking information of the first media resource.

[0104] According to one or more embodiments of the present disclosure, it further includes at least one of the following:

[0105] A display module 31 is further configured to: display a to-be-played list panel, where the to-be-played list panel is used to display the marking information of the media resources in the to-be-played list;

[0106] The playing module 33 is further configured to: sequentially play the media resources corresponding to the respective marking information based on the positions of the respective marking information displayed in the to-be-played list panel;

[0107] The playing module 33 is further configured to: in response to a second trigger operation, adjust the position of the marking information of the first media resource in the to-be-played list panel.

[0108] According to one or more embodiments of the present disclosure, after inserting the first media resource into the to-be-played list, the display module 31 is further configured to: refresh the to-be-played list panel to display the marking information of the first media resource at a target sorting position within the to-be-played list panel.

[0109] According to one or more embodiments of the present disclosure, before refreshing the to-be-played list panel to display the marking information of the first media resource at a target sorting position within the to-be-played list panel, the playing module 33 is further configured to: obtain a first content feature of the media resources corresponding to the respective marking information in the to-be-played list, and a second content feature of the first media resource; determine the target sorting position according to the second content feature and the respective first content features, where the second content feature of the first media resource has feature similarity and / or feature continuity with the first content feature of the media resource at an adjacent position to the target sorting position.

[0110] According to one or more embodiments of the present disclosure, when the display module 31 displays the to-be-played column surface panel, it is specifically configured to: display at least two to-be-played column surface panels, and each to-be-played column surface panel corresponds to a different to-be-played list; when the playback module 33 sequentially plays media resources corresponding to the respective marker information based on the positions of the respective marker information displayed in the to-be-played column surface panel, it is specifically configured to: in response to a first selection operation on a target to-be-played column surface panel, sequentially play media resources corresponding to the respective marker information based on the positions of the respective marker information displayed in the to-be-played column surface panel.

[0111] According to one or more embodiments of the present disclosure, when the playback module 33 inserts a first media resource into a to-be-played list, it is specifically configured to: determine a corresponding target marker list according to the type of the target control corresponding to the first trigger operation, and insert the first media resource into the target marker list; display a target marker column surface panel corresponding to the target marker list, and in response to a second selection operation on the first media resource in the marker column surface panel, insert the first media resource into the to-be-played list.

[0112] According to one or more embodiments of the present disclosure, the playback module 33 is further configured to: obtain the playback progress of each media resource in the target marker list; arrange the positions of the respective media resources in the target marker list according to the playback progress of each media resource in the target marker list, wherein the greater the playback progress, the more forward the position of the corresponding media resource in the target marker list.

[0113] According to one or more embodiments of the present disclosure, the marker information is further used to characterize the summary information of the corresponding media resource; when the marking module generates the marker information of the first media resource in response to a first trigger operation on the first media resource, it is specifically configured to: in response to a first trigger operation on the first media resource, obtain the current first playback progress of the first media resource; obtain a media resource content slice corresponding to the first playback progress in the first media resource; perform semantic understanding on the media resource content slice corresponding to the first playback progress to generate summary information, and generate marker information according to the summary information.

[0114] According to one or more embodiments of the present disclosure, after the first media resource is displayed or played based on the first media interface, the display module 31 is further configured to: when the first media resource plays to a key playback progress, display a prompt message in the first media interface, wherein the prompt message is used to instruct the user to perform a first trigger operation, and the key playback progress is used to indicate the starting playback position corresponding to the key content of the first media resource, or the playback position corresponding to the demarcation point between two independent contents in the first media resource.

[0115] According to one or more embodiments of the present disclosure, the display module 31 is further configured to: obtain in real time the real-time content features corresponding to the audio-video decoding data after the current playback progress of the first media resource; determine the key playback progress of the first media resource according to the real-time content features.

[0116] Among them, the display module 31, the marking module 32, and the playback module 33 are connected in sequence. The media playback device 3 provided in this embodiment can execute the technical solutions of the above method embodiments, and the implementation principles and technical effects are similar, which will not be elaborated here.

[0117] Figure 11 The following is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure, as Figure 11 shown. The electronic device 4 includes:

[0118] a processor 41 and a memory 42 communicatively connected to the processor 41;

[0119] The memory 42 stores computer-executable instructions;

[0120] The processor 41 executes the computer-executable instructions stored in the memory 42 to implement the media playback method in the embodiment as Figures 2 - 9 shown.

[0121] Optionally, the processor 41 and the memory 42 are connected through a bus 43.

[0122] For relevant descriptions, reference can be made to Figures 2 - 9 the relevant descriptions and effects corresponding to the steps in the corresponding embodiments, and no further elaboration will be made here.

[0123] The embodiments of the present disclosure provide a computer-readable storage medium, in which computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, they are used to implement the media playback method provided in any one of the embodiments corresponding to the present disclosure Figures 2 - 9 .

[0124] The embodiments of the present disclosure provide a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the media playback method provided in any one of the embodiments corresponding to the present disclosure Figures 2 - 9 .

[0125] To implement the above embodiments, the embodiments of the present disclosure also provide an electronic device.

[0126] Refer to Figure 12, which shows a schematic structural diagram of an electronic device 900 suitable for implementing the embodiments of the present disclosure. The electronic device 900 may be a terminal device or a server. Among them, the terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers, portable media players (PMPs), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 12 The electronic device shown is merely an example and should not impose any limitations on the functions and usage scope of the embodiments of the present disclosure.

[0127] As Figure 12 shown, the electronic device 900 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 901, which may perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 902 or the program loaded from the storage device 908 into the random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. The input / output (I / O) interface 905 is also connected to the bus 904.

[0128] Generally, the following devices may be connected to the I / O interface 905: an input device 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 908 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 12 the electronic device 900 with various devices is shown, it should be understood that it is not required to implement or have all the shown devices. More or fewer devices may be alternatively implemented or had.

[0129] In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, an embodiment of the present disclosure includes a computer program product that includes a computer program carried on a computer-readable medium, and the computer program includes program code for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by a processing device 901, the above-described functions defined in the method of the embodiment of the present disclosure are performed.

[0130] It should be noted that the above-mentioned computer-readable medium in the present disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. And in the present disclosure, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, and the computer-readable signal medium can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0131] The above-mentioned computer-readable medium can be included in the above-mentioned electronic device; or it can exist separately and not be assembled into the electronic device.

[0132] The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device is caused to execute the method shown in the above embodiment.

[0133] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., connected through the Internet using an Internet service provider).

[0134] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0135] The units or modules involved in the embodiments described in the present disclosure may be implemented in software or in hardware. Among them, the name of the unit or module does not constitute a limitation on the unit itself in some cases.

[0136] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), application specific standard products (ASSP), system on a chip (SOC), complex programmable logic devices (CPLD), and the like.

[0137] In the context of the present disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0138] In a first aspect, according to one or more embodiments of the present disclosure, there is provided a media playing method, including:

[0139] Presenting or playing a first media resource based on a first media interface; in response to a first trigger operation for the first media resource, generating marking information for the first media resource, the marking information being used to characterize a media resource identifier of the media resource and a playing progress of the media resource when the marking information is generated; inserting the first media resource into a to-be-played list, and when playing to the first media resource based on the to-be-played list, resuming playing the first media resource from a playing progress corresponding to the marking information of the first media resource.

[0140] According to one or more embodiments of the present disclosure, the method further includes at least one of the following: displaying a to-be-played list panel for presenting the marking information of the media resources in the to-be-played list; sequentially playing each media resource corresponding to the marking information based on the positions of the respective marking information presented in the to-be-played list panel; in response to a second trigger operation, adjusting the position of the marking information of the first media resource in the to-be-played list panel.

[0141] According to one or more embodiments of the present disclosure, after inserting the first media resource into the to-be-played list, it further includes: refreshing the to-be-played list panel to display the marking information of the first media resource at a target sorting position within the to-be-played list panel.

[0142] According to one or more embodiments of the present disclosure, before refreshing the panel of the to-be-played list to display the marking information of the first media resource at a target sorting position within the panel of the to-be-played list, the method further includes: obtaining first content features of media resources corresponding to the marking information in the to-be-played list, and second content features of the first media resource; determining the target sorting position according to the second content features and the first content features, wherein the second content features of the first media resource have feature similarity and / or feature continuity with the first content features of the media resource located at an adjacent position of the target sorting position.

[0143] According to one or more embodiments of the present disclosure, the displaying the panel of the to-be-played list includes: displaying at least two panels of the to-be-played list, each panel of the to-be-played list corresponding to a different to-be-played list; the playing, in sequence based on the positions of the marking information displayed in the panel of the to-be-played list, each media resource corresponding to the marking information includes: in response to a first selection operation on a target panel of the to-be-played list, playing, in sequence based on the positions of the marking information displayed in the panel of the to-be-played list, each media resource corresponding to the marking information.

[0144] According to one or more embodiments of the present disclosure, the inserting the first media resource into the to-be-played list includes: determining a corresponding target marking list according to the type of the target control corresponding to the first trigger operation, and inserting the first media resource into the target marking list; displaying a target marking column panel corresponding to the target marking list, and in response to a second selection operation on the first media resource in the marking column panel, inserting the first media resource into the to-be-played list.

[0145] According to one or more embodiments of the present disclosure, the method further includes: obtaining the playing progress of each media resource in the target marking list; arranging the positions of the media resources in the target marking list according to the playing progress of each media resource in the target marking list, wherein the more the playing progress, the more forward the position of the corresponding media resource in the target marking list.

[0146] According to one or more embodiments of the present disclosure, the marking information is further used to characterize the summary information of the corresponding media resource;

[0147] Generating the marking information of the first media resource in response to a first trigger operation for the first media resource includes: in response to the first trigger operation for the first media resource, obtaining the current first playback progress of the first media resource; obtaining the media resource content slice corresponding to the first playback progress in the first media resource; performing semantic understanding on the media resource content slice corresponding to the first playback progress to generate the summary information, and generating the marking information according to the summary information.

[0148] According to one or more embodiments of the present disclosure, after presenting or playing the first media resource based on the first media interface, the method further includes: when the first media resource is played to a key playback progress, displaying a prompt message within the first media interface, where the prompt message is used to instruct the user to perform the first trigger operation, and the key playback progress is used to indicate the starting playback position corresponding to the key content of the first media resource, or the playback position corresponding to the demarcation point between two independent contents in the first media resource.

[0149] According to one or more embodiments of the present disclosure, the method further includes: obtaining in real time the real-time content features corresponding to the audio-video decoding data after the current playback progress of the first media resource; determining the key playback progress of the first media resource according to the real-time content features.

[0150] In a second aspect, according to one or more embodiments of the present disclosure, there is provided a media playback device, including:

[0151] A display module for presenting or playing the first media resource based on a first media interface;

[0152] A marking module for generating the marking information of the first media resource in response to a first trigger operation for the first media resource, where the marking information is used to represent the media resource identifier of the media resource and the playback progress of the media resource when the marking information is generated;

[0153] A playback module for inserting the first media resource into a to-be-played list, and when playing to the first media resource based on the to-be-played list, resuming playing the first media resource from the playback progress corresponding to the marking information of the first media resource.

[0154] According to one or more embodiments of the present disclosure, it further includes at least one of the following:

[0155] The display module is further configured to: display a to-be-played list panel for presenting the marking information of the media resources in the to-be-played list;

[0156] The playback module is further configured to: sequentially play the media resources corresponding to the respective marker information based on the positions of the respective marker information displayed in the to-be-played column surface panel;

[0157] The playback module is further configured to: in response to a second trigger operation, adjust the position of the marker information of the first media resource in the to-be-played column surface panel.

[0158] According to one or more embodiments of the present disclosure, after inserting the first media resource into the to-be-played list, the display module is further configured to: refresh the to-be-played column surface panel to display the marker information of the first media resource at a target sorting position within the to-be-played column surface panel.

[0159] According to one or more embodiments of the present disclosure, before refreshing the to-be-played column surface panel to display the marker information of the first media resource at a target sorting position within the to-be-played column surface panel, the playback module is further configured to: obtain a first content feature of the media resources corresponding to the respective marker information in the to-be-played list, and a second content feature of the first media resource; determine the target sorting position according to the second content feature and the respective first content features, wherein the second content feature of the first media resource has feature similarity and / or feature continuity with the first content features of the media resources located at adjacent positions of the target sorting position.

[0160] According to one or more embodiments of the present disclosure, when the display module displays the to-be-played column surface panel, it is specifically configured to: display at least two to-be-played column surface panels, each of the to-be-played column surface panels corresponding to a different to-be-played list; when the playback module sequentially plays the media resources corresponding to the respective marker information based on the positions of the respective marker information displayed in the to-be-played column surface panel, it is specifically configured to: in response to a first selection operation on a target to-be-played column surface panel, sequentially play the media resources corresponding to the respective marker information based on the positions of the respective marker information displayed in the to-be-played column surface panel.

[0161] According to one or more embodiments of the present disclosure, when the playback module inserts the first media resource into the to-be-played list, it is specifically configured to: determine a corresponding target marker list according to the type of the target control corresponding to the first trigger operation, and insert the first media resource into the target marker list; display a target marker column surface panel corresponding to the target marker list, and in response to a second selection operation on the first media resource in the marker column surface panel, insert the first media resource into the to-be-played list.

[0162] According to one or more embodiments of the present disclosure, the playback module is further configured to: obtain the playback progress of each media resource in the target tag list; arrange the positions of the media resources in the target tag list according to the playback progress of each media resource in the target tag list, where the more the playback progress, the more forward the position of the corresponding media resource in the target tag list.

[0163] According to one or more embodiments of the present disclosure, the tag information is further used to represent the summary information of the corresponding media resource; when the tagging module generates the tag information of the first media resource in response to a first trigger operation on the first media resource, it is specifically configured to: in response to a first trigger operation on the first media resource, obtain the current first playback progress of the first media resource; obtain the media resource content slice corresponding to the first playback progress in the first media resource; perform semantic understanding on the media resource content slice corresponding to the first playback progress to generate the summary information, and generate the tag information according to the summary information.

[0164] According to one or more embodiments of the present disclosure, after the first media resource is displayed or played based on the first media interface, the display module is further configured to: when the first media resource plays to a key playback progress, display a prompt message in the first media interface, where the prompt message is used to instruct the user to perform the first trigger operation, and the key playback progress is used to indicate the starting playback position corresponding to the key content of the first media resource, or the playback position corresponding to the demarcation point between two independent contents in the first media resource.

[0165] According to one or more embodiments of the present disclosure, the display module is further configured to: obtain the real-time content feature corresponding to the audio and video decoding data after the current playback progress of the first media resource in real time; determine the key playback progress of the first media resource according to the real-time content feature.

[0166] In a third aspect, according to one or more embodiments of the present disclosure, an electronic device is provided, including: at least one processor and a memory;

[0167] The memory stores computer execution instructions;

[0168] The at least one processor executes the computer execution instructions stored in the memory, so that the at least one processor executes the media playback method described in the first aspect above and various possible designs of the first aspect.

[0169] Fourthly, according to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the media playback method as described in the first aspect above and various possible designs of the first aspect.

[0170] Fifthly, according to one or more embodiments of the present disclosure, there is provided a computer program product including a computer program, which, when executed by a processor, implements the media playback method as described in the first aspect above and various possible designs of the first aspect.

[0171] The above description is only a preferred embodiment of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure concept. For example, the technical solutions formed by mutually replacing the above features with the technical features (but not limited to) having similar functions disclosed in the present disclosure.

[0172] In addition, although the operations are depicted in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or in sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although a number of specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features described in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, the various features described in the context of a single embodiment may also be implemented separately or in any suitable sub-combination in multiple embodiments.

[0173] Although the subject matter has been described in language specific to structural features and / or methodological act logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms for implementing the claims.

Claims

1. A media playing method, characterized in that, Including: Displaying or playing a first media resource based on a first media interface; In response to a first trigger operation on the first media resource, generating marking information for the first media resource, where the marking information is used to represent the media resource identifier of the media resource and the playback progress of the media resource when the marking information is generated; Inserting the first media resource into a to-be-played list, and when playing to the first media resource based on the to-be-played list, resuming playing the first media resource from the playback progress corresponding to the marking information of the first media resource.

2. The method according to claim 1, wherein The method further includes at least one of the following: Displaying a to-be-played list panel, where the to-be-played list panel is used to display the marking information of the media resources in the to-be-played list; Based on the positions of the marking information displayed in the to-be-played list panel, sequentially playing the media resources corresponding to the marking information based on the marking information; In response to a second trigger operation, adjusting the position of the marking information of the first media resource in the to-be-played list panel.

3. The method according to claim 2, characterized in that After inserting the first media resource into the to-be-played list, it further includes: Refreshing the to-be-played list panel to display the marking information of the first media resource at a target sorting position within the to-be-played list panel.

4. The method according to claim 3, wherein Before refreshing the to-be-played list panel to display the marking information of the first media resource at a target sorting position within the to-be-played list panel, the method further includes: Obtaining a first content feature of the media resources corresponding to the marking information in the to-be-played list, and a second content feature of the first media resource; Determining the target sorting position according to the second content feature and each of the first content features, where the second content feature of the first media resource has feature similarity and / or feature continuity with the first content features of the media resources at adjacent positions to the target sorting position.

5. The method according to claim 2, wherein The displaying the to-be-played list panel includes: Displaying at least two to-be-played list panels, each to-be-played list panel corresponding to a different to-be-played list; The sequentially playing the media resources corresponding to the marking information based on the positions of the marking information displayed in the to-be-played list panel includes: In response to a first selection operation on a target to-be-played list panel, sequentially playing the media resources corresponding to the marking information based on the positions of the marking information displayed in the to-be-played list panel.

6. The method according to claim 1, wherein The inserting the first media resource into the to-be-played list includes: Determining a corresponding target marking list according to the target control type corresponding to the first trigger operation, and inserting the first media resource into the target marking list; Displaying a target marking list panel corresponding to the target marking list, and in response to a second selection operation on the first media resource in the marking list panel, inserting the first media resource into the to-be-played list.

7. The method according to claim 6, wherein The method further includes: Obtaining the playback progress of each media resource in the target marking list; Arrange the positions of the media resources in the target tag list according to the playback progress of each media resource in the target tag list, where the greater the playback progress, the more forward the position of the corresponding media resource in the target tag list.

8. The method according to claim 1, characterized in that, The tag information is also used to characterize the summary information of the corresponding media resource; Generating the tag information of the first media resource in response to a first trigger operation on the first media resource includes: In response to a first trigger operation on the first media resource, obtain the current first playback progress of the first media resource; Obtain the media resource content slice corresponding to the first playback progress in the first media resource; Perform semantic understanding on the media resource content slice corresponding to the first playback progress to generate the summary information, and generate the tag information according to the summary information.

9. The method according to claim 1, characterized in that, After presenting or playing the first media resource based on the first media interface, the method further includes: When the first media resource plays to a key playback progress, display a prompt message within the first media interface, where the prompt message is used to instruct the user to apply the first trigger operation, and the key playback progress is used to indicate the starting playback position corresponding to the key content of the first media resource, or the playback position corresponding to the demarcation point between two independent contents in the first media resource.

10. The method according to claim 9, characterized in that, The method further includes: Obtain in real time the real-time content features corresponding to the audio-video decoding data after the current playback progress of the first media resource; Determine the key playback progress of the first media resource according to the real-time content features.

11. A media playing device, characterized in that, including: A display module for presenting or playing the first media resource based on the first media interface; A tagging module for generating the tag information of the first media resource in response to a first trigger operation on the first media resource, where the tag information is used to characterize the media resource identifier of the media resource and the playback progress of the media resource when the tag information is generated; A playback module for inserting the first media resource into the pending playback list, and when playing to the first media resource based on the pending playback list, resume playing the first media resource from the playback progress corresponding to the tag information of the first media resource.

12. An electronic device, characterized in that, including: A processor and a memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the media playback method according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that, Computer-executable instructions are stored in the computer-readable storage medium, and when the processor executes the computer-executable instructions, the media playback method according to any one of claims 1 to 10 is implemented.

14. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, the media playback method according to any one of claims 1 to 10 is implemented.

Images