Method, apparatus, device and medium for playing media data

Abstract

Methods, apparatuses, devices, and media for playing media data are provided. In one method, in response to receiving media data, the media data is presented in a first area of a player application. Configuration information associated with the media data is obtained, the configuration information specifying a point of interest in the media data. Based on the configuration information, marker data corresponding to the point of interest is presented in a second area of the player application. With some implementations of the disclosure, a point of interest in media data can be specified using configuration information. During the playing of the media data, the marker data can highlight important data corresponding to the point of interest, thereby improving the efficiency of a user of the media player in obtaining information.

Description

Technical Field

[0001] The implementation of this disclosure generally relates to media data management, and in particular to methods, apparatus, devices, and computer-readable storage media for playing media data. Background Technology

[0002] With the development of computer technology, media data has become a primary source of information for users; for example, users can play media data to gain knowledge. During playback, users may miss important content due to decreased concentration, fatigue, or other reasons, leading to an inaccurate understanding of the content. Therefore, there is a desire for more effective media data playback and for the clearer presentation of key information, enabling users to gain a more comprehensive and accurate understanding of the media data. Summary of the Invention

[0003] In a first aspect of this disclosure, a method for playing media data is provided. In this method, in response to receiving media data, the media data is presented in a first area of ​​a player application. Configuration information associated with the media data is obtained, specifying points of interest in the media data. Based on the configuration information, labeled data corresponding to the points of interest is presented in a second area of ​​the player application.

[0004] In a second aspect of this disclosure, an apparatus for playing media data is provided. The apparatus includes: a first presentation module configured to present the media data in a first area of ​​a player application in response to receiving the media data; an acquisition module configured to acquire configuration information associated with the media data, the configuration information specifying points of interest in the media data; and a second presentation module configured to present labeled data corresponding to the points of interest in a second area of ​​the player application based on the configuration information.

[0005] In a third aspect of this disclosure, an electronic device is provided. The electronic device includes: at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to a first aspect of this disclosure when executed by the at least one processor.

[0006] In a fourth aspect of this disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, causes the processor to implement the method according to a first aspect of this disclosure.

[0007] In a fifth aspect of this disclosure, a computer program product is provided, comprising a computer program that, when executed by a processor, implements the method according to a first aspect of this disclosure.

[0008] It should be understood that the content described in this content section is not intended to limit the key or essential features of the implementation of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0009] In the following detailed description, the above and other features, advantages, and aspects of the various implementations of this disclosure will become more apparent, taken in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0010] Figure 1 A block diagram of an application environment according to one implementation of this disclosure is shown;

[0011] Figure 2 A block diagram illustrating a method for playing media data according to some implementations of this disclosure is shown;

[0012] Figure 3 A block diagram illustrating some implementations of this disclosure for determining labeled data is shown;

[0013] Figure 4 A block diagram of the interface of a media player according to some implementations of this disclosure is shown;

[0014] Figure 5 A block diagram illustrating the interaction with tagged data according to some implementations of this disclosure is shown;

[0015] Figure 6 A block diagram illustrating the interaction with tagged data according to some implementations of this disclosure is shown;

[0016] Figure 7 A flowchart is shown of a method for playing media data according to some implementations of this disclosure;

[0017] Figure 8 A block diagram of an apparatus for playing media data according to some implementations of this disclosure is shown; and

[0018] Figure 9 A block diagram of a device capable of implementing various implementations of the present disclosure is shown. Detailed Implementation

[0019] Implementations of this disclosure will now be described in more detail with reference to the accompanying drawings. While some implementations of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the implementations set forth herein. Rather, these implementations are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and implementations of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0020] In the description of the implementation methods disclosed herein, the term "comprising" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one implementation" or "the implementation" should be understood as "at least one implementation". The term "some implementations" should be understood as "at least some implementations". Other explicit and implicit definitions may also be included below. As used herein, the term "model" can represent the relationships between various data. For example, the aforementioned relationships can be obtained based on various currently known and / or future-developed technical solutions.

[0021] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0022] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and user authorization should be obtained.

[0023] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0024] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, for example, via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose whether to "agree" or "disagree" to provide personal information to the electronic device.

[0025] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0026] The term "in response to" as used herein refers to a state in which a corresponding event occurs or a condition is satisfied. It will be understood that the timing of subsequent actions performed in response to such event or condition is not necessarily strongly correlated with the time when the event occurs or the condition is met. For example, in some cases, subsequent actions may be performed immediately upon the occurrence of the event or the fulfillment of the condition; while in others, they may be performed some time after the occurrence of the event or the fulfillment of the condition.

[0027] Example Environment

[0028] Media data has become a primary source of information for users, and it exists in various formats. For example, users can play media data to gain knowledge. See also Figure 1 This describes the application environment based on some implementations of this disclosure. Figure 1 A block diagram 100 of an application environment according to one implementation of this disclosure is shown. For example... Figure 1 As shown, media data 120 can be played in application 110 (e.g., a media playback application).

[0029] During playback, users can control the playback of media data 120 using multiple controls (e.g., progress bar control 130-1, rewind control 130-2, play control 130-3, fast forward control 130-4, etc., collectively referred to as controls 130). For example, the position of the progress bar control 130-1 can be adjusted to control the playback position, and so on. However, during playback, users can only perform limited interactions with the media data. Furthermore, the player application can only passively present the content originally included in the media data and cannot actively remind users to pay attention to key points within the media data. This may cause users to miss important content in the media data due to decreased focus, fatigue, or other reasons, leading to an inaccurate understanding of the content.

[0030] At this point, the expectation is to play media data in a more effective way and to present the important content of the media data in a clearer manner, so that users can understand the media data more comprehensively and accurately.

[0031] Summary of Media Data Playback

[0032] To at least partially address the shortcomings of the prior art, a method for playing media data is proposed according to one implementation of this disclosure. In summary, configuration information can be provided to the media data, and this configuration information specifies points of interest within the media data. During media data playback, important data corresponding to these points of interest can be highlighted, thereby improving the user's ability to understand the media data. See also... Figure 2 The description outlines one implementation of this disclosure. Figure 2 A block diagram 200 is shown for playing media data according to some implementations of this disclosure.

[0033] For ease of description, the following text will use English training videos as an example of media data. Figure 2 As shown, media data 120 may have corresponding configuration information 240, which can specify the focus 242 in media data 120. A player application (e.g., application 230) may include multiple playback areas: a first area 210 for presenting media data, and a second area 220 for presenting additional data different from the media data. During playback, media data 120 can be received and presented in the first area 210 of the player application. Further, the configuration information 240 associated with media data 120 can be obtained, and based on the configuration information 240, marker data 222 corresponding to the focus 242 is presented in the second area 220 of the player application.

[0034] Specifically, suppose media data 120 includes training videos explaining English vocabulary. The first part of these videos includes explanations of the specific meanings of several English words, and the second part includes test questions to assess users' mastery of these words. In this case, configuration information can be provided by various individuals to specify the content they wish to focus on. For example, the media data administrator (e.g., a teacher) can specify in the configuration information key words they want students to master, or a specific section they want students to watch (e.g., a section explaining common misuses of words), and so on. Similarly, the media data audience (e.g., students) can specify in the configuration information the sections they wish to focus on, such as new words, frequently misspelled words, and so on.

[0035] Using the implementation method disclosed herein, different users can specify points of interest in media data using configuration information. During media playback, important data corresponding to these points of interest can be highlighted, thereby improving the efficiency of information retrieval for users of the media player.

[0036] Detailed process of media data playback

[0037] Having described the overview of the player application, further details regarding the presentation of media data will be described below. According to some implementations of this disclosure, tag data corresponding to points of interest can be determined in the media data based on configuration information. Figure 3 A block diagram 300 illustrating some implementations of this disclosure for determining marker data is shown. For example... Figure 3 As shown, media data 120 may include data in multiple modalities. For example, the attention portion 330 that matches the attention point 242 can be found from audio 310, video 311, image 312 or text 313 in the media data.

[0038] The focus 330 can be determined in several ways. For example, the audio 310 in the media data 120 can first be converted into text, and then the focus 330 can be determined based on text search. Alternatively and / or additionally, video frames in the video 311 can be converted into images, and then the focus 330 can be determined through image recognition. Alternatively and / or additionally, the focus content in the media data 120 can be determined based on a machine learning model (e.g., model 320). For example, cue words can be constructed based on focus point 242, and the capabilities of model 320 can be invoked to determine the focus content 330 in the media data that matches focus point 242.

[0039] According to some implementation methods of this disclosure, one point of interest can correspond to one or more content of interest. Assuming the point of interest is "word A", multiple content of interest can be identified: the explanation of word A (corresponding to segment 1 between time points t1 and t2 in the video), and the practice questions for word A (corresponding to segment 1 between time points t3 and t4 in the video), and so on. Furthermore, the labeled data corresponding to each content of interest can be determined separately.

[0040] According to some implementations of this disclosure, the first region and the second region can be located in different regions of the player application, thereby allowing different formats of annotation data to be presented in different regions of the player application. See also Figure 4 To describe more details, the Figure 4 A block diagram 400 shows the interface of a media player according to some implementations of this disclosure. For example... Figure 4 As shown, the second region may include a progress region 422 for presenting the playback progress of the media data. Alternatively and / or additionally, the second region may include a description region 432 for presenting descriptive data associated with the media data. Using some implementations of this disclosure, annotation data can be presented in different regions, thereby providing the user with more information about the media data.

[0041] According to some implementations of this disclosure, the tagged data is interactive data, and in response to received interaction requests for the tagged data, the player application can provide interactive results corresponding to the interaction requests. Using some implementations of this disclosure, passively playable videos can be converted into interactive media data. This facilitates user interaction with the media data, thereby obtaining richer and more accurate information. In this case, there is no need to re-edit and create new media data; instead, configuration information can be directly used to specify the interactive parts of the media data, thus generating more interactive media data in a simpler and more efficient way. For example, students can adjust the teacher's lecture video to a version more suitable for their own level.

[0042] See Figure 4 To describe more information about the interaction, the second area may include a progress area 422 for presenting the playback progress of the media data, and may present marker data 420 within the progress area 422. Specifically, marker data 420 corresponding to points of interest may be presented in the progress area 422, and the marker data 420 may indicate the position of the content of interest specified by the point of interest in the media data. For example, the marker data 422 may be represented by a star icon and / or other icons.

[0043] According to some implementations of this disclosure, one or more marker data 422 can be provided, and the presentation format of the marker data can be specified. For example, one or more marker data corresponding to a certain point of interest can have the same or different visual representations. Specifically, different colors can be specified to represent multiple marker data corresponding to different points of interest. For example, for the point of interest "word A", one or more corresponding marker data can be displayed in red. Alternatively and / or additionally, different numbers can be used to distinguish each marker data. For example, the red number 1 can represent the position of the first point of interest corresponding to "word A" in the video (e.g., time period t1-t2), the red number 2 can represent the position of the second point of interest corresponding to "word A" in the video (e.g., time period t3-t4), and so on. Similarly, the blue number 1 can represent the position of the first point of interest corresponding to another point of interest "word B" in the video, the blue number 2 can represent the position of the second point of interest corresponding to "word B" in the video, and so on.

[0044] Alternative and / or additional sites, see [link to relevant documentation] Figure 4The labeled data 440 can be presented in the description area 432 used to present the descriptive data associated with the media data. Specifically, the descriptive data can be identified from at least one of the following in the media data: video, audio, text, or image; labeled data corresponding to the points of interest can be determined from the descriptive data; and the descriptive data can be presented in the description area using a first format, and the labeled data can be presented using a second format.

[0045] According to some implementations of this disclosure, descriptive data 430 can be extracted from media data across multiple modalities. For example, a speech processing model can be used to convert audio data into text data, a video processing model can be used to determine the content described in the video, an image processing model can be used to determine the content described in the image, a text processing model can be used to process subtitle information in the media data, and so on. The extracted information can be fused to generate descriptive data 430. Alternatively and / or additionally, prompt words can be constructed and a language model with multimodal processing capabilities can be used to generate descriptive data 430. The prompt words could be, for example, "Please extract descriptive data for the following video, which should include the speech recognition results of all content in the video," and so on.

[0046] According to some implementations of this disclosure, the description data 430 may be represented in text format. Alternatively and / or additionally, the description data 430 may include, for example, images, audio, and video content. Specifically, assuming the point of interest "word A" is "car," the description data 430 may provide an image of "car," audio providing the pronunciation of "car," video providing related explanations of "car," and so on.

[0047] Furthermore, marker data corresponding to points of interest can be determined from the description data 430, and the description data 430 and marker data 440 can be presented in different formats in the description area 440. For example, the description data 430 can be presented in plain text format, and the marker data 440 can be presented using highlighted formats (e.g., color, bold, large font size, highlight, underline, italics, etc.). In this way, more information about the media data 120 can be provided in the description area 432 so that the user can query the desired content. Alternatively and / or additionally, the marker data can be presented in a block diagram format in image and video formats.

[0048] According to some implementations of this disclosure, users can perform various types of interactions with the tagged data to obtain more information. Specifically, the interaction result corresponding to the interaction request can be provided in the player application based on the type of interaction request. See also Figure 5 Describe more information about interacting with the marker data 420 in the progress area 422. Figure 5A block diagram 500 illustrating the interaction with tagged data according to some implementations of this disclosure is shown. For example... Figure 5 As shown, a user can interact with the marked data 420 510. In response to determining that the interaction request is of the preview type, preview information 512 corresponding to the content of interest can be presented. For example, a user can hover the cursor near the marked data 420 to view the preview information 512. The preview information 512 may include a summary of the content of interest, "semantic explanation of word A," and point to a video clip in the video explaining the semantic explanation of word A.

[0049] Alternatively and / or additionally, in response to determining that the type of the interaction request is a jump type, the content of interest is presented in a first area of ​​the player application. For example, a user can double-click marker data 420 to present a video segment in the playback area corresponding to marker data 420. Using some implementations of this disclosure, a user can interact with the marker data, thereby switching to the content segment of interest in the video data in a simpler and more efficient manner. According to some implementations of this disclosure, the progress area 422 may further include marker data 520, which the user can manipulate in a similar manner. For example, when the cursor hovers over marker data 520, preview information 522 may be presented; when marker data 520 is double-clicked, a jump to a video segment in the video explaining the exercises for word A may be performed.

[0050] See below. Figure 6 More details describing the user's interaction with the tagged data 440 in the description area, Figure 6 A block diagram 600 illustrating the interaction with tagged data according to some implementations of this disclosure is shown. For example... Figure 6 As shown, interaction 610 between the user and the labeled data 440 can be detected. According to some implementations of this disclosure, in the process of providing the interaction result corresponding to the interaction request in the player application, in response to determining that the interaction request is a jump type, the content of interest specified by the point of interest is presented in the first area of ​​the player application. Using some implementations of this disclosure, the user can interact with the labeled data, thereby switching to the content segment of interest in the video data in a simpler and more efficient manner. Specifically, the user can double-click the labeled data 440, at which point a video segment corresponding to the labeled data 440 can be presented in the first area of ​​the player application. Assuming that the labeled data 440 corresponds to the semantic explanation of word A, then the user can jump to the video segment in the video explaining the semantic explanation of word A.

[0051] According to some implementations of this disclosure, in the process of providing an interaction result corresponding to an interaction request in a player application, in response to determining that the interaction request is an operation type, an operation corresponding to the interaction request is executed in the player application. For example, a user can right-click on marked data 440 to perform more operations in the pop-up interaction menu 620, whereby the operation may include at least one of the following: searching, editing, or adding annotations, etc. Specifically, information corresponding to marked data 440 can be searched. The search scope can be specified, for example, searching in description data, searching in media data, or searching in an external database. For the example of providing English training videos, the external database may include, but is not limited to, dictionaries, grammar books, exercise books, etc. Alternatively and / or additionally, the search can be performed on an external network, for example, searching in online dictionaries or learning forums on the Internet. Utilizing some implementations of this disclosure, users can be supported in further searching for information of interest, thereby improving information acquisition efficiency.

[0052] According to some implementations of this disclosure, users can click "Add Annotation" to record study notes, etc. For example, users can search for more example sentences about word A and add example sentences to the annotation. Compared to a regular player that only allows video playback, the technical solution of this disclosure allows users to take notes while watching videos, thereby improving their understanding of the video content. Alternatively and / or additionally, users can export annotations, which may include time information corresponding to the annotations; for example, the annotations may correspond to a specific time segment in the video. Furthermore, the annotations can be exported as text files, etc.

[0053] According to some implementations of this disclosure, users can click the "Edit" menu to edit information associated with the marker data 440. For example, users can edit the definition of the focus, the number of marker data to be presented, the display format of the marker data, and so on. For instance, users can specify that for a given focus, a maximum of N marker data points should be presented, N marker data points should be selected from the video according to the video's timeline, and the marker data should be highlighted in yellow, etc. Using some implementations of this disclosure, users can adjust the marker data during video playback to support interactive methods that better meet user needs.

[0054] According to some implementations of this disclosure, a user can click "Create" to create another point of interest based on at least a portion of the description data, and use this new point of interest to update the configuration information. Specifically, a user can create a new point of interest, such as "word C". The new point of interest can be stored in the configuration information. When the video is played again using the player application, since the configuration information has been updated, annotation information corresponding to the updated point of interest (e.g., multiple annotations for word A, word B, and word C) can be displayed during video playback. Alternatively and / or additionally, a user can click "Delete" to remove the point of interest corresponding to tag data 440 from the configuration information.

[0055] According to some implementations of this disclosure, one or more points of interest corresponding to the current video can be presented, and controls for editing these key points can be provided. Utilizing some implementations of this disclosure, it is possible to adjust (e.g., create, delete, update) the points of interest during video playback, thereby supporting a more flexible approach to adjusting the information presented during video playback and improving information retrieval efficiency.

[0056] According to some implementations of this disclosure, at least one interactive action with a player application can be received; and in response to receiving an exit request for exiting media data, the interactive action can be stored in association with the media data. Figure 6 As shown on the right, the action area 630 can display the user's historical interaction actions with the player application. Specifically, the user can jump to position X corresponding to marker data 440, search for content Y, and add annotation Z, etc. At this time, the action area 630 can store the user's various historical operations. After closing video playback, the historical actions can be stored in association with the video. For example, the historical actions can be stored in a separate file, and an association can be established between the file and the video. Alternatively and / or additionally, the historical actions can be stored in a configuration file, etc. Using some implementations of this disclosure, the user's historical actions at various points in time during video playback can be recorded, thereby providing more evidence for subsequent evaluation of the user's mastery of the video content.

[0057] It should be understood that although the accompanying drawings only show the case where the annotation data is presented in a second region separate from the first region, alternatively and / or additionally, the second region may be a part of the first region. For example, the second region may be determined within the first region (upper right corner or other location). For example, the resolution of the electronic device running the player application may be detected, and when the resolution is higher than a predetermined threshold, the second region may be presented at a location different from the first region; otherwise, the second region may be determined within the first region. Alternatively and / or additionally, when the player application is in landscape mode, the first and second regions may be presented separately; when the player application is in portrait mode, the first and second regions may be presented overlapping. Using some implementations of this disclosure, the content of interest in the media data can be presented in a more comprehensive and obvious manner within the limited display area of ​​the electronic device.

[0058] According to some implementations of this disclosure, media data includes at least one of the following: video data, audio data, and presentation data. It should be understood that although the example of English training videos as media data is described above, alternatively and / or additionally, media data 120 may have other content. Media data 120 may include: videos introducing the operation of software applications, or videos explaining knowledge of a certain subject, etc. Alternatively and / or additionally, media data 120 may have other formats, for example, it may include, but is not limited to, audio, or presentation data such as slides, etc.

[0059] Using some implementations of this disclosure, configuration information can be used to specify points of interest in media data. During media playback, the annotation data can highlight important data corresponding to these points of interest, thereby improving the efficiency of information retrieval for media players. According to some implementations of this disclosure, the configuration information can be user-specific. For example, the configuration information can be set based on the user's own points of interest. Based on the same media data, different users can be effectively presented with their respective areas of interest. Furthermore, the annotation data supports interaction between the user and the media data. In this way, media data that originally only supported passive playback can be transformed into interactive media data, thereby allowing for a more convenient and effective way to customize different interactive media data for different users.

[0060] Example process

[0061] Figure 7A flowchart of a method 700 for playing media data according to some implementations of this disclosure is shown. At block 710, in response to receiving media data, the media data is presented in a first area of ​​a player application. At block 720, configuration information associated with the media data is obtained, specifying points of interest in the media data. At block 730, based on the configuration information, labeled data corresponding to the points of interest is presented in a second area of ​​the player application.

[0062] According to some implementations of this disclosure, the marked data is interactive data, and the method further includes: in response to receiving an interaction request for the marked data, providing an interaction result corresponding to the interaction request in a player application.

[0063] According to some implementations of this disclosure, the second region includes a progress region for presenting the playback progress of media data, and presenting marker data includes: presenting marker data corresponding to a point of interest in the progress region, wherein the marker data indicates the position of the content of interest specified by the point of interest in the media data.

[0064] According to some implementations of this disclosure, providing an interaction result corresponding to an interaction request in a player application includes at least one of the following: in response to determining that the interaction request is a preview type, presenting preview information corresponding to the content of interest; or in response to determining that the interaction request is a jump type, presenting the content of interest in a first area of ​​the player application.

[0065] According to some implementations of this disclosure, the second region includes a description region for presenting description data associated with the media data, and presenting the tag data includes: identifying the description data from at least one of the following in the media data: video, audio, text, or image; determining the tag data corresponding to the point of interest from the description data; and presenting the description data in the description region using a first format and presenting the tag data using a second format.

[0066] According to some implementations of this disclosure, providing an interaction result corresponding to an interaction request in a player application includes: in response to determining that the interaction request is a jump type, presenting the content of interest specified by the point of interest in a first area of ​​the player application.

[0067] According to some implementations of this disclosure, providing an interaction result corresponding to an interaction request in a player application includes: in response to determining that the interaction request is an operation type, performing an operation corresponding to the interaction request in the player application, the operation including at least one of the following: searching, editing, or adding annotations.

[0068] According to some implementations of this disclosure, the method further includes: creating another concern based on at least a portion of the description data; and updating configuration information using the other concern.

[0069] According to some implementations of this disclosure, the method further includes: receiving at least one interactive action with a player application; and in response to receiving an exit request for exiting media data, storing the interactive action in association with the media data.

[0070] According to some implementations of this disclosure, media data includes at least one of the following: video data, audio data, and presentation data.

[0071] Example devices and equipment

[0072] Figure 8 A block diagram of an apparatus 800 for playing media data according to some implementations of the present disclosure is shown. The apparatus 800 includes: a first presentation module 810 configured to present media data in a first area of ​​a player application in response to receiving media data; an acquisition module 820 configured to acquire configuration information associated with the media data, the configuration information specifying points of interest in the media data; and a second presentation module 830 configured to present labeled data corresponding to the points of interest in a second area of ​​the player application based on the configuration information.

[0073] According to some implementations of this disclosure, the marker data is interactive data, and the apparatus further includes a processing module configured to: in response to receiving an interaction request for the marker data, provide an interaction result corresponding to the interaction request in a player application.

[0074] According to some implementations of this disclosure, the second region includes a progress region for presenting the playback progress of media data, and the second presentation module is further configured to: present marker data corresponding to a point of interest in the progress region, the marker data indicating the position of the content of interest specified by the point of interest in the media data.

[0075] According to some implementations of this disclosure, the processing module is further configured to: in response to determining that the interaction request is of the preview type, present preview information corresponding to the content of interest; or in response to determining that the interaction request is of the jump type, present the content of interest in the first area of ​​the player application.

[0076] According to some implementations of this disclosure, the second region includes a description region for presenting description data associated with the media data, and the second presentation module is further configured to: identify description data from at least one of the following in the media data: video, audio, text, or image; determine marker data corresponding to points of interest from the description data; and present the description data in the description region using a first format and present the marker data using a second format.

[0077] According to some implementations of this disclosure, the processing module is further configured to: in response to determining that the interaction request is of the jump type, present the content of interest specified by the point of interest in the first area of ​​the player application.

[0078] According to some implementations of this disclosure, the processing module is further configured to: in response to determining that the interaction request is an operation type, perform an operation corresponding to the interaction request in the player application, the operation including at least one of the following: search, edit, or add annotation.

[0079] According to some implementations of this disclosure, the processing module is further configured to: create another concern based on at least a portion of the description data; and update the configuration information using the other concern.

[0080] According to some implementations of this disclosure, the processing module is further configured to: receive at least one interactive action with the player application; and, in response to receiving an exit request for exiting media data, store the interactive action in association with the media data.

[0081] According to some implementations of this disclosure, media data includes at least one of the following: video data, audio data, and presentation data.

[0082] Figure 9 A block diagram of a device 900 capable of implementing various implementations of the present disclosure is shown. It should be understood that... Figure 9 The computing device 900 shown is merely exemplary and should not be construed as limiting the functionality and scope of the implementation described herein. Figure 9 The computing device 900 shown can be used to implement the method described above.

[0083] like Figure 9 As shown, computing device 900 is in the form of a general-purpose computing device. Components of computing device 900 may include, but are not limited to, one or more processors 910, memory 920, storage devices 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. Processor 910 may be a physical or virtual processor and is capable of performing various processes based on programs stored in memory 920. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of computing device 900.

[0084] Computing device 900 typically includes multiple computer storage media. Such media can be any available media accessible to computing device 900, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 920 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 930 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data (e.g., training data for training) and accessible within computing device 900.

[0085] The computing device 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 9 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 920 may include computer program product 925 having one or more program modules configured to perform various methods or actions of various implementations of this disclosure.

[0086] The communication unit 940 enables communication with other computing devices via a communication medium. Additionally, the components of the computing device 900 can function as a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the computing device 900 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0087] Input device 950 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 960 can be one or more output devices, such as a monitor, speaker, printer, etc. Computing device 900 can also communicate as needed with one or more external devices (not shown) via communication unit 940. These external devices, such as storage devices, display devices, etc., can communicate with one or more devices that enable user interaction with computing device 900, or with any device (e.g., network card, modem, etc.) that enables computing device 900 to communicate with one or more other computing devices. Such communication can be performed via input / output (I / O) interfaces (not shown).

[0088] According to an implementation of this disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the method described above. According to an implementation of this disclosure, a computer program product is provided, on which a computer program is stored, which, when executed by a processor, implements the method described above.

[0089] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0090] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0091] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0092] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0093] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for playing media data, comprising: In response to receiving the media data, the media data is presented in a first area of ​​the player application; Obtain configuration information associated with the media data, wherein the configuration information specifies the focus in the media data; as well as Based on the configuration information, labeled data corresponding to the points of interest is presented in the second area of ​​the player application.

2. The method of claim 1, wherein the labeled data is interactive data, and the method further comprises: In response to receiving an interaction request for the tagged data, the player application provides an interaction result corresponding to the interaction request.

3. The method of claim 2, wherein the second region includes a progress region for presenting the playback progress of the media data, and presenting the marker data includes: The progress area displays the marker data corresponding to the point of interest, which indicates the position of the content of interest specified by the point of interest in the media data.

4. The method of claim 3, wherein providing the interaction result corresponding to the interaction request in the player application includes at least one of the following: In response to determining that the interaction request is a preview type, preview information corresponding to the content of interest is presented; or In response to determining that the interaction request is a jump type, the content of interest is presented in the first area of ​​the player application.

5. The method of claim 2, wherein the second region includes a description region for presenting description data associated with the media data, and presenting the tag data includes: The description data is identified from at least one of the following in the media data: video, audio, text, or image; Determine the tag data corresponding to the point of interest from the description data; as well as The description data is presented in the description area using a first format, and the tag data is presented using a second format.

6. The method of claim 5, wherein providing the interaction result corresponding to the interaction request in the player application comprises: In response to determining that the interaction request is a jump type, the content of interest specified by the point of interest is presented in the first area of ​​the player application.

7. The method of claim 5, wherein providing the interaction result corresponding to the interaction request in the player application comprises: In response to determining that the interaction request is an operation type, an operation corresponding to the interaction request is performed in the player application, the operation including at least one of the following: searching, editing, or adding annotations.

8. The method of claim 5, further comprising: Create another point of interest based on at least a portion of the described data; as well as Update the configuration information using the other concern mentioned above.

9. The method of claim 1, further comprising: Receive at least one interactive action with the player application; as well as In response to receiving an exit request for exiting the media data, the interactive action is stored in association with the media data.

10. The method of claim 1, wherein the media data includes at least one of the following: video data, audio data, and presentation data.

11. An apparatus for playing media data, comprising: A first presentation module is configured to present the media data in a first area of ​​the player application in response to receiving the media data. The acquisition module is configured to acquire configuration information associated with the media data, the configuration information specifying the focus in the media data; as well as The second presentation module is configured to present labeled data corresponding to the point of interest in a second area of ​​the player application based on the configuration information.

12. An electronic device, comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 10 when executed by the at least one processor.

13. A computer-readable storage medium having stored thereon computer instructions that, when executed by a processor, cause the processor to perform the method according to any one of claims 1 to 10.

14. A computer instruction product comprising computer instructions, wherein the computer instructions, when executed by a processor, implement the method according to any one of claims 1 to 10.

Images