Media file processing method and device, electronic equipment, storage medium and product

Abstract

The embodiment of the invention provides a media file processing method and device, electronic equipment, a storage medium and a product. The method comprises the following steps: in response to a first trigger operation, displaying text data and audio data of a media file; wherein the text data comprises a plurality of characters; the change time of the display information of the characters is associated with the first playing time of the characters in the audio data; and in response to a target labeling operation for the text data, labeling the text data according to the target labeling operation and the first playing time corresponding to the characters of the text data. According to the technical scheme provided by the embodiment of the invention, labeling of the text data linked with the audio data can be realized through simple interaction operation, the applicability is wider, labeling of the text data is more visual through visual presentation of the labeling information of the text data, and the labeling efficiency is improved. And the linkage between the annotation information of the text data and the audio data can be automatically established, so that the annotation effect and the annotation efficiency of the text data are improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to computer application technology, and more particularly to a media file processing method, device, electronic device, storage medium and product. Background Art

[0002] In the field of multimedia information, the content of media files is becoming more and more abundant. Some media files may include audio data and text data associated with the content, such as music files or dubbing files. With the rapid development of network technology, the application of media files is becoming more and more extensive. In order to ensure the application effect of media files, it is often necessary to include more information in the media files.

[0003] In the related art, professionals modify or re-produce media files based on their professional knowledge to enrich the content of media files. This processing method requires high professionalism, is cumbersome, and time-consuming and laborious, which affects the processing efficiency of media files. Summary of the invention

[0004] The present disclosure provides a media file processing method, device, electronic device, storage medium and product to achieve visual presentation of text data annotations, which can be achieved through simple interactive operations, has wider applicability and improves the annotation efficiency of text data.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for processing a media file, the method comprising:

[0006] In response to a first trigger operation, displaying text data and audio data of a media file; wherein the text data includes a plurality of characters; and a change time of display information of the characters is associated with a first play time of the characters in the audio data;

[0007] In response to a target marking operation on the text data, the text data is marked according to the target marking operation and the first play time corresponding to the character of the text data.

[0008] In a second aspect, an embodiment of the present disclosure further provides a media file processing device, the device comprising:

[0009] A file data display module, for displaying text data and audio data of a media file in response to a first trigger operation; wherein the text data includes a plurality of characters; and a change time of display information of the characters is associated with a first play time of the characters in the audio data;

[0010] The text data marking module is used to respond to a target marking operation on the text data and mark the text data according to the target marking operation and the first playback time corresponding to the characters of the text data.

[0011] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

[0012] one or more processors;

[0013] a storage device for storing one or more programs,

[0014] When the one or more programs are executed by the one or more processors, the one or more processors implement the media file processing method as described in any one of the embodiments of the present disclosure.

[0015] In a fourth aspect, the embodiments of the present disclosure further provide a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the media file processing method as described in any one of the embodiments of the present disclosure.

[0016] In a fifth aspect, an embodiment of the present disclosure further provides a computer program product, wherein the computer program product includes a computer program, and when the computer program is executed by a processor, the media file processing method described in any embodiment of the present invention is implemented.

[0017] The technical solution of the disclosed embodiment can realize the linkage display of text data and audio data by displaying the text data and audio data of the media file in response to the first trigger operation, and provide an operation entry for editing the media file; because the text data includes multiple characters, and the change time of the display information of the character is associated with the first playback time of the character in the audio data, the text data can be fully displayed, and the associated display of audio data and text data can be realized in the time dimension, supporting the effect of synchronously displaying the change of the display information of the corresponding character during the playback of the audio data. Further, in response to the target annotation operation for the text data, the text data is annotated according to the target annotation operation and the first playback time corresponding to the character of the text data, which solves the problem that the process operation of the media file in the related technology is cumbersome and laborious. Through simple interactive operations, the annotation of the text data linked with the audio data can be realized, which has wider applicability. Through the visual presentation of the annotation information of the text data, the annotation of the text data is more intuitive, and the linkage between the annotation information of the text data and the audio data can be automatically established, which improves the annotation effect and annotation efficiency of the text data. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0019] Figure 1 A flowchart of a media file processing method provided by an embodiment of the present disclosure;

[0020] Figure 2 A flowchart of another media file processing method provided by an embodiment of the present disclosure;

[0021] Figure 3 A schematic diagram of an operation interface for marking characters in text data in a media file processing method provided by an embodiment of the present disclosure;

[0022] Figure 4 A flowchart of another media file processing method provided by an embodiment of the present disclosure;

[0023] Figure 5 A schematic diagram of an operation interface for marking components of blank positions in text data in a media file processing method provided by an embodiment of the present disclosure;

[0024] Figure 6 A schematic diagram of the structure of a media file processing device provided by an embodiment of the present disclosure;

[0025] Figure 7 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0026] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0027] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0028] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0029] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0030] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0031] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0032] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0033] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0034] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0035] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0036] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0037] Figure 1 The present invention provides a flow chart of a media file processing method provided by an embodiment of the present invention. The present invention is applicable to the case of annotating text data in a media file. The method can be executed by a media file processing device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, a PC or a server. Figure 1 As shown, the method of this embodiment may specifically include:

[0038] S110. In response to a first trigger operation, display text data and audio data of a media file; wherein the text data includes a plurality of characters; and a change time of display information of a character is associated with a first play time of the character in the audio data.

[0039] The first trigger operation can be understood as an operation of displaying corresponding data included in the media file, that is, triggering an operation capable of displaying corresponding data included in the media file. The media file can be a file displayed on the interface and selected; or, it can be a file randomly retrieved from pre-stored candidate files; or, it can be a file uploaded from an external device, etc.

[0040] A media file may be a file of any multimedia type that includes text data and audio data, and the text data and the audio data are associated in the time dimension. Optionally, the media file may be a song file, a movie file, or a radio drama file, etc. Exemplarily, in the case where the media file is a song file, the audio data may be the song, and the text data may be the lyrics associated with the song; in the case where the media file is a dubbing file in a film or TV series, the audio data may be the dubbing information in the movie, and the text data may be the subtitles associated with the audio information.

[0041] The media file includes text data and audio data. The text data and audio data in the media file can be displayed in association. The text data can be understood as data that represents the audio content in the associated audio data in the form of text. The audio data can be understood as data that represents the text content in the associated text data in the form of audio. The text data includes a plurality of characters. The characters included in the text data can be in various forms, for example, they can be one or more of numbers, Chinese characters, English characters, or characters of other language types. The change time of the display information of the character is associated with the first play time of the character in the audio data. That is to say, during the playback of the audio data, the change time of the display information of the character can be determined based on the first play time of the character in the audio data, so that the character can be displayed in the text data according to the change time. In other words, each character in the text data corresponds to a display timestamp, and the display timestamp is associated with the first play time of the character in the audio data. Thus, the text data and the audio data can be displayed synchronously.

[0042] The display information of the character can be used to indicate the display mode (such as full display or character-by-character display, etc.) and / or display state (including character color and / or character size) of the character in the text data. The change time of the display information can be understood as the time when the display mode and / or display state of the character in the text data changes. The first play time can be the time corresponding to when the corresponding character is played out during the playback of the audio data. Exemplarily, in the case where the display mode of the character in the text data is full display, the change time of the display mode of the character can be the time when the character is highlighted (such as highlighted display, etc.) in the text data. Furthermore, the change time of the display mode of the character is associated with the first playback time of the character in the audio data, and it can be that when the audio data is played to the character, the character can be highlighted in the text data. Or, when the display mode of the character in the text data is displayed character by character, the change time of the display mode of the character can be the time displayed in the character text data. Furthermore, the change time of the display mode of the character is associated with the first playback time of the character in the audio data, and it can be that when the audio data is played to the character, the character is displayed in the text data.

[0043] It should be noted that, when the media file is a song file, in order to ensure that the change time of the display information of the character is associated with the first playback time of the character in the audio data, the file type of the media file can be a lyrics file containing the playback time corresponding to each character.

[0044] In the embodiment of the present disclosure, in response to the first trigger operation, displaying the text data and audio data of the media file may include multiple implementation methods, for example, in response to a file selection operation for the media file, or in response to a file display trigger operation, etc.

[0045] Optionally, in response to a first trigger operation, displaying text data and audio data of a media file includes: displaying a file display interface, wherein the file display interface includes at least one candidate file; in response to a file selection operation for a candidate file, selecting the selected candidate file as a media file, and displaying the text data and audio data of the media file.

[0046] The file display interface can be understood as a visual interface for displaying files. The candidate files can be files that have been pre-downloaded and stored in the target storage space; or files to be downloaded; or files uploaded from an external device, etc. When the candidate files are displayed in the file display interface, the candidate files can be in a selectable state.

[0047] As an optional implementation of the first embodiment of the present disclosure, when a trigger operation for a preset interface display control is detected, a file display interface can be displayed based on the terminal device display interface, and the file display interface can include at least one candidate file. Further, when a file selection operation for a candidate file is detected, the selected candidate file can be used as a media file. Then, the text data and audio data of the media file are obtained, and the text data and audio data of the media file are displayed.

[0048] Optionally, in response to the first trigger operation, displaying the text data and audio data of the media file includes: in response to the file display operation, acquiring the text data and audio data of the media file, and displaying the text data and audio data.

[0049] Among them, the file display operation can be any operation that supports the display of data included in the file. Optionally, the file display operation may include at least one of the following: triggering a preset file display control; receiving a pre-set file display instruction; the received audio information includes a trigger word associated with the file display, etc. The media file can be a file determined from a candidate file pre-downloaded and stored according to a preset rule; or, it can also be a file received and uploaded from an external device. Among them, the preset rule can be randomly determined; or, it can be determined based on the historical file display data of the initiator of the file display operation; or, it can be determined based on the historical display frequency of the media file for each target object, etc.

[0050] As another optional implementation of the disclosed embodiment, when a trigger operation for a preset file display control is detected, at least one candidate file can be determined from the pre-downloaded and stored candidate files according to a preset rule, and the determined candidate file can be used as a media file. Then, the text data and audio data of the media file are obtained, and the obtained text data and audio data are displayed.

[0051] In the embodiments of the present disclosure, the display methods of displaying the text data and audio data of the media file may include multiple methods. Optionally, the text data and audio data of the media file may be displayed based on the file data display interface; wherein the file data display interface may include an audio display area and a text display area. Furthermore, the audio data of the media file may be displayed in the audio display area, and the text data of the media file may be displayed in the text display area.

[0052] Specifically, displaying the text data of the media file in the text display area may be to obtain multiple characters and display formats of the multiple characters contained in the text data, and display the multiple characters in the text display area according to the display formats of the multiple characters. Furthermore, one or more preset annotation controls may be displayed in the text display area so that the text data can be annotated using the preset annotation controls.

[0053] Specifically, displaying the audio data of the media file in the audio display area may be displaying the audio data in the audio display area through a target player. The target player may play or pause the audio data. For the convenience of the target player, the playback progress of the audio data may be displayed. Displaying the playback progress of the audio data may specifically include at least one of the following operations: displaying a playback progress bar, and displaying a progress indicator corresponding to the playback position in the playback progress bar; displaying the playback time of the audio data, such as (2 minutes and 13 seconds); displaying the proportion of the playback time relative to the total duration of the audio data.

[0054] S120 , in response to a target marking operation on the text data, marking the text data according to the target marking operation and a first play time corresponding to a character of the text data.

[0055] Among them, the target annotation operation can be understood as an operation of adding annotation information to the text data. In the embodiment of the present disclosure, when the text data is associated with the audio data, the multiple characters included in the text data can be arranged according to the musical structure represented by the audio data. When the text data includes multiple characters, the spacing positions (i.e., blank positions) between the multiple characters can also be annotated. In other words, the target annotation operation for the text data can include a word annotation operation for the characters and a component annotation operation for the blank positions. The character annotation operation can be used to annotate the type of the performer who interprets the corresponding character. Exemplarily, when the text data includes lyrics data, when the character annotation operation for at least one character is detected, the type of the performer who interprets the at least one character can be annotated. For example, the type of the performer can include at least one of male voice, female voice, chorus, harmony / female voice, harmony / male voice and pure harmony. The component annotation operation can be used to annotate the structural component type corresponding to the corresponding blank position in the text data and / or audio data. Exemplarily, continuing to refer to the above example, in the case where the text data includes lyrics data, when a component marking operation for any blank position in the text data is detected, the structural component type corresponding to the blank position in the text data and / or audio data can be marked. For example, the structural component type can include at least one of a prelude, an interlude, an outro, a verse, a chorus, a pre-chorus, an accompaniment, silence, and a bridge.

[0056] In the embodiment of the present disclosure, when displaying the text data and audio data of the media file, a target annotation operation can be input to the text data according to the preset text annotation requirements. Furthermore, the associated characters associated with the target annotation operation in the text data can be determined according to the target annotation operation. Furthermore, the text data can be annotated according to the first playback time of the target annotation operation and the associated characters in the audio data.

[0057] It should be noted that the text data is annotated according to the target annotation operation and the first playback time corresponding to the characters of the text data, so that the annotated part of the text data is associated with the first playback time of the part in the audio data. In simple terms, inputting a target annotation operation on the text data will affect the playback time of the audio data, and then the text annotation information added in the text data based on the target annotation operation can be represented in the dimension of the audio playback time.

[0058] In the embodiment of the present disclosure, the target labeling operation may include a character labeling operation and / or a component labeling operation. The execution process of these two target labeling operations is described below.

[0059] Optionally, when the target marking operation includes a character marking operation, in response to a character marking operation on at least one character in the text data, a target character to be marked is determined; and the target character is marked according to the character marking operation and the first playback time of the target character in the audio data.

[0060] As an optional implementation of the first embodiment of the present disclosure, a character annotation operation may be input for multiple characters included in the text data. Furthermore, when a character annotation operation for at least one character is detected, a target character to be annotated may be determined according to the character annotation operation. Furthermore, the target character may be annotated according to the character annotation operation and the first playback time of the target character in the audio data.

[0061] Optionally, in a case where the target labeling operation includes a component labeling operation, in response to a component labeling operation on a blank position in the text data, a reference character associated with the blank position in the text data is determined; and structural component labeling information is added at the affected blank position based on the first playback time of the reference character in the audio data.

[0062] As another optional implementation of the disclosed embodiment, a component annotation operation may be input for a blank position in the text data. Furthermore, when a component annotation operation is detected for any blank position, a reference character whose playback time is adjacent to the playback time of the blank position in the text data may be determined. Furthermore, component annotation information may be added to the blank position affected according to the first playback time of the reference character in the audio data.

[0063] In an embodiment of the present disclosure, in order to facilitate a clearer and more intuitive browsing of the annotated media file, after the text data is annotated, in response to an audio playback operation for the audio data, when the audio data is played to the playback portion corresponding to the at least part of the annotated text data, at least part of the text data is displayed according to the annotation information corresponding to at least part of the text data. The at least part of the annotated text data may be all the annotated text data in the text data; or, it may be part of the text data in all the annotated text data in the text data. The annotation information corresponding to at least part of the text data may include character annotation information and / or component annotation information.

[0064] The technical solution of the disclosed embodiment can realize the linkage display of text data and audio data by displaying the text data and audio data of the media file in response to the first trigger operation, and provide an operation entry for editing the media file; because the text data includes multiple characters, and the change time of the display information of the character is associated with the first playback time of the character in the audio data, the text data can be fully displayed, and the associated display of audio data and text data can be realized in the time dimension, supporting the effect of synchronously displaying the change of the display information of the corresponding character during the playback of the audio data. Further, in response to the target annotation operation for the text data, the text data is annotated according to the target annotation operation and the first playback time corresponding to the character of the text data, which solves the problem that the process operation of the media file in the related technology is cumbersome and laborious. Through simple interactive operations, the annotation of the text data linked with the audio data can be realized, which has wider applicability. Through the visual presentation of the annotation information of the text data, the annotation of the text data is more intuitive, and the linkage between the annotation information of the text data and the audio data can be automatically established, which improves the annotation effect and annotation efficiency of the text data.

[0065] Figure 2 A flowchart of another media file processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment is based on the above-mentioned embodiment, wherein the target annotation operation includes a character annotation operation, and in response to the target annotation operation on the text data, the text data is annotated according to the target annotation operation and the first playback time corresponding to the character of the text data, including: in response to the character annotation operation on at least one character in the text data, a target character to be annotated is determined from a plurality of characters, and the target character is annotated according to the character annotation operation and the first playback time corresponding to the target character. For specific implementation methods, please refer to the description of this embodiment. Among them, technical features that are the same or similar to those in the above-mentioned embodiments are not repeated here. Figure 2 As shown, the method of this embodiment may specifically include:

[0066] S210. In response to a first trigger operation, display text data and audio data of a media file; wherein the text data includes a plurality of characters; and a change time of display information of a character is associated with a first play time of the character in the audio data.

[0067] S220 . In response to a character marking operation on at least one character in the text data, determine a target character to be marked from a plurality of characters, and mark the target character according to the character marking operation and a first playback time corresponding to the target character.

[0068] Among them, the character marking operation can be understood as an operation of adding marking information to a character. The target character can be a character to be marked among multiple characters included in the text data. The character to be marked can be one or more. There are many ways to determine the target character from multiple characters. Optionally, a character selection operation can be input for at least one character, and then the selected character is used as the target character; or, in response to a character editing operation, a character editing page is displayed, and the character editing page includes a marking character interval editing item. Further, the start character and the end character to be marked can be input for the marking character interval editing item. Furthermore, all characters between the start character and the end character in the text data can be used as target characters.

[0069] In an embodiment of the present disclosure, when displaying text data and audio data of a media file, a character annotation operation may be input for multiple characters included in the text data. Furthermore, when a character annotation operation input for at least one character is detected, a target character to be annotated may be determined from the multiple characters according to the character annotation operation. Furthermore, the target character may be annotated according to the character annotation operation and the first playback time of the target character in the audio data.

[0070] Optionally, in response to a character labeling operation for at least one character in the text data, a target character to be labeled is determined from multiple characters, and the target character is labeled according to the character labeling operation and a first playback time corresponding to the target character, including: in response to a character selection operation for at least one character in the text data, at least one candidate character labeling identifier is displayed, and the target character to be labeled according to the character selection operation; in response to a second trigger operation for the character labeling identifier, a target character labeling identifier to be used is determined from the character labeling identifiers, and the target character is labeled according to the character labeling type corresponding to the target character labeling identifier and the first playback time corresponding to the target character.

[0071] Among them, the character selection operation may be an operation that makes the corresponding character in a selected state. The character selection operation may be any operation for character input. Optionally, the character selection operation may be a click-triggered operation on any character input through a mouse or a touch point, and in the case where the mouse button or the touch point continues to perform the drag operation without releasing the mouse button or the touch point, at least one character may be updated to a selected state. Furthermore, in the case where a drag-and-release operation is detected, it can be determined that a character selection operation for at least one character input is detected. Alternatively, the character selection operation may also be a character editing operation, and in the case where an editing operation for the marking start character and / or the marking end character is detected, it can be determined that a character selection operation is detected. At this time, all characters between the marking start character and the marking end character may be used as target characters.

[0072] Among them, the character annotation identifier can be used to identify character annotation information (including character annotation method and character annotation type). The character annotation identifier can be a predetermined label associated with the character annotation information that can be added to the text data. The character annotation identifier can be any type of information. Optionally, the character annotation identifier can be the name of the character annotation, the identification diagram corresponding to the character annotation, or the number corresponding to the character annotation. In the embodiment of the present disclosure, the character annotation identifier corresponds to the character annotation type. The character annotation type is associated with the character annotation method. The character annotation type can be understood as the type of expression of the character in the audio data when the corresponding character is annotated. The character annotation method can be understood as a pre-set method used when annotating the character. The character annotation method can be used to change the display style of the character in the text data. The character annotation method can include a variety of methods for marking the annotated characters. Optionally, the character annotation method can include changing the character size, changing the character display color and / or highlighting the character in different colors. For example, assuming that the character annotation type is male voice, the corresponding character annotation method may be to highlight the characters in blue, so that the text display background of the characters is updated to blue for display; assuming that the character annotation type is female voice, the corresponding character annotation method may be to highlight the characters in red, so that the text display background of the characters is updated to red for display; assuming that the character annotation type is chorus, the corresponding character annotation method may be to highlight the characters in yellow, so that the text display background of the characters is updated to yellow for display.

[0073] It should be noted that, in the case where the media file includes text data and audio data, the corresponding audio data can be obtained by interpreting the characters included in the text data. When the characters in the text data are annotated, the character annotation type corresponding to the character annotation identifier can be associated with the type of the interpreter who interprets the character. Exemplarily, in the case where the text data includes lyrics data, the type of the interpreter who interprets the character can include male voice, female voice, chorus, harmony / female voice, harmony / male voice and pure harmony, etc. The second trigger operation can be an identifier selection operation for the character annotation identifier input. The target character annotation identifier can be a character annotation identifier selected from multiple candidate character annotation identifiers.

[0074] In the disclosed embodiment, a character selection operation can be input for multiple characters in the text data. Furthermore, in the case of detecting a character selection operation for at least one character, in response to the character selection operation, a target character to be marked is determined from multiple characters, and at least one candidate character marking identifier is displayed. Further, the character marking type corresponding to the target character to be marked can be determined, and then, a second trigger operation can be input for the character marking identifier corresponding to the character marking type, and in the case of detecting the second trigger operation, in response to the second trigger operation, and the target character marking identifier to be used is determined. Furthermore, the target character can be marked according to the character marking type corresponding to the target character marking identifier and the first playback time of the target character in the audio data. The advantage of such a setting is that it supports determining the target character to be marked according to the character selection operation, and then, in the case of determining the target character marking identifier, the effect of automatically marking the target character according to the target character marking identifier and the playback time of the target character in the audio data is achieved, and the visual presentation of the character marking process is achieved, and the efficiency of character marking is improved.

[0075] It should be noted that the character annotation identifier corresponds to the character annotation type, and the character annotation type is associated with the character annotation method. Furthermore, the target character is annotated according to the character annotation type corresponding to the target character annotation identifier and the first playback time of the target character in the audio data, including: the target character is annotated according to the character annotation method corresponding to the character annotation type and the marked time corresponding to the target character.

[0076] The marked time may be understood as the first playing time of the target character in the audio data, or the marked time may be understood as the playing timestamp corresponding to the target character.

[0077] As an optional implementation of an embodiment of the present disclosure, when the target character annotation identifier is determined, the associated character annotation method can be determined according to the character annotation type corresponding to the target character annotation identifier. Furthermore, the target character can be annotated according to the character annotation method and the time when the target character is marked. It should be noted that by annotating the target character according to the character annotation method and the time when the target character is marked, the display time of the character annotation information of the target character can be displayed synchronously with the playback time of the target character in the audio data.

[0078] Exemplarily, continuing to refer to the above example, in the case where the text data includes lyrics data, the character annotation type may include male voice, female voice, chorus, harmony / female voice (female harmony), harmony / male voice (male harmony) and pure harmony, etc. Further, assuming that the character annotation type corresponding to the determined target character to be annotated is male voice, the character annotation method corresponding to the character annotation type is to highlight the character in blue. Furthermore, when annotating the target character, the target character can be highlighted in blue according to the marked time corresponding to the target character, so that during the playback of the audio data, when the target character is played, the text display background of the target character can be updated to blue for display according to the first playback time of the target character in the audio data.

[0079] For example, Figure 3 This is a schematic diagram of an operation interface for marking characters in text data in a media file processing method provided by an embodiment of the present disclosure. Figure 3 As shown in Figure a, 31 is the audio data display area, and 32 is the text data display area. In the case where the text data includes lyrics data, it is assumed that the lyrics data included in the text data is "abcdefghijk". In response to the character annotation operation on the "abcde" character in the text data, the "abcde" character is used as the target character to be annotated, and 4 candidate character annotation marks are displayed in the vicinity of the target character, which are a male voice mark, a female voice mark, a chorus mark, and a harmony mark. Further, when it is detected that the cursor inputs a click trigger operation for the male voice mark, the male voice mark can be used as the target character annotation mark to be used. The character annotation method corresponding to the male voice mark is to highlight the character in blue. Furthermore, the target character can be highlighted in blue according to the marked time corresponding to the target character.

[0080] In the embodiment of the present disclosure, in order to facilitate a clearer and more intuitive browsing of the media file after character annotation, after the target character in the text data is annotated, in response to the audio playback operation for the audio data, when the audio data is played to the playback part corresponding to the target character, the target character is displayed according to the character annotation information corresponding to the target character. For example, continuing to refer to the above example, when the audio data is played to the character "abcde", the character "abcde" can be highlighted with a blue text background, such as Figure 3 As shown in Figure b.

[0081] The technical solution of the disclosed embodiment determines a target character to be marked from multiple characters in response to a character marking operation on at least one character in text data, marks the target character according to the character marking operation and the first playback time corresponding to the target character, supports fine-grained interactive operations on characters, can realize flexible marking of single characters or multiple characters, and, by marking the target character with the first playback time corresponding to the target character, realizes the effect of synchronously displaying the character marking information during the playback of the target character, thereby enriching the display effect of the text data.

[0082] Figure 4 A flowchart of another media file processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment is based on the above-mentioned embodiment, wherein the target annotation operation includes a component annotation operation; in response to the target annotation operation on the text data, the text data is annotated according to the target annotation operation and the first playback time corresponding to the target character, including: in response to the component annotation operation acting on the blank position in the text data, a reference character corresponding to the blank position in the text data is determined, and component annotation information is added to the blank position according to the first playback time corresponding to the reference character. For specific implementation methods, please refer to the description of this embodiment. Among them, technical features that are the same or similar to those in the above-mentioned embodiments are not repeated here. Figure 4 As shown, the method of this embodiment may specifically include:

[0083] S310. In response to a first trigger operation, display text data and audio data of a media file; wherein the text data includes a plurality of characters; and a change time of display information of a character is associated with a first play time of the character in the audio data.

[0084] S320, in response to a component marking operation acting on a blank position in the text data, determining a reference character corresponding to the blank position in the text data, and adding component marking information at the acted blank position according to a first playback time corresponding to the reference character.

[0085] Among them, the blank position can be understood as the display position other than the characters in the displayed text data. In the embodiment of the present disclosure, the blank position can be the position of the audio content that does not include the characters in the audio data. Exemplarily, in the case where the text data includes lyrics data, the blank position can be the position between two adjacent lyrics; or, it can also be the position before the first sentence of lyrics; or, it can also be the position after the last sentence of lyrics, etc. The component labeling operation can be understood as the operation of adding structural component labeling information in the blank position in the text data. The component labeling operation can be used to mark the component structure division corresponding to the text data. The reference character can be a character in the text data that has a certain correlation with the blank position. Optionally, the reference character includes a character whose playback time in the audio data is adjacent to the playback time of the blank position. Exemplarily, assuming that the blank position to be acted upon is the position between the fifth and sixth lines of lyrics, the corresponding reference characters may include the characters at the end of the fifth line of lyrics and the characters at the first position of the sixth line of lyrics; assuming that the blank position to be acted upon is the position before the first line of lyrics, the corresponding reference characters may be the characters at the first position of the first line of lyrics; assuming that the blank position to be acted upon is the position after the last line of lyrics, the corresponding reference characters may be the characters at the end of the last line of lyrics. The component annotation information is used to indicate the corresponding playback part of the audio data in which the blank position to be acted upon is located. The component annotation information may be used to indicate the structural component corresponding to the blank position to be acted upon in the text data. Exemplarily, in the case where the text data includes lyrics data, the component annotation information may include prelude annotation information, interlude annotation information, coda annotation information, verse annotation information, chorus annotation information, pre-chorus annotation information, accompaniment annotation information, silence annotation information, and bridge annotation information, etc.

[0086] In the disclosed embodiment, a component annotation operation can be input for a blank position in the text data. Furthermore, when a component annotation operation acting on a blank position is detected, the blank position to be acted on can be determined, and a reference character associated with the blank position can be determined according to the playback time of the audio data. Further, the first playback time of the reference character in the audio data can be determined, and component annotation information can be added at the blank position to be acted on according to the first playback time corresponding to the reference character, so as to associate the added component annotation information with the playback time of the audio data.

[0087] It should be noted that, in order to enable the initiator of the component annotation operation to more clearly and intuitively see the location of the blank position affected in the text data, and to facilitate the initiator to continue to perform subsequent component annotation operations, when the blank position affected is determined according to the component annotation operation, a preset structure division mark can be displayed at the blank position affected. The preset structure division mark can be a mark in any form, and can optionally be a structure division mark line or a structure division mark graphic (for example, a triangle, a circle or a rectangle, etc.).

[0088] Optionally, component annotation information is added at the blank position affected according to the first playback time corresponding to the reference character, including: displaying at least one candidate component candidate identifier; determining a target component candidate identifier to be used from the component candidate identifier in response to a third trigger operation on the component candidate identifier; and adding component annotation information at the blank position affected according to the component candidate type corresponding to the target component candidate identifier and the first playback time corresponding to the reference character.

[0089] Among them, the component candidate identifier can be information for identifying the component candidate type. The component candidate identifier can be associated with the component candidate type. Optionally, the component candidate identifier can be the name of the component candidate type, the number of the component candidate type, or other identification information that can characterize the component candidate type. The component candidate type can be understood as a component type that can characterize the structural characteristics of text data. In the embodiment of the present disclosure, the component candidate type is associated with the interpretation information of the text data and / or the audio data. The interpretation information of the text data can be understood as the text features that can be characterized by the text data. The interpretation information of the text data can include the text content (including core information and / or text theme) represented by the text data and / or the arrangement information of the characters in the text data. The interpretation information of the audio data can be understood as the audio features that can be characterized by the audio data. The interpretation information of the audio data can include the melody, rhythm of the audio and / or whether the played audio data includes characters. Optionally, in the case where the text data includes lyrics data, the component candidate type corresponding to the lyrics data includes at least one of the prelude, interlude, outro, verse, chorus, pre-chorus, accompaniment, silence and bridge. It can be understood that the prelude refers to the section before a song or piece of music begins, which foreshadows the theme of the music, expresses emotions, or depicts the mood and atmosphere. The interlude refers to the melody (or harmony) fragment that appears between the sections of the song. During the song, when the singing pauses temporarily or the section changes, the music fragment played by the instrument is the interlude. The coda refers to the ending section of a song or piece of music. The verse is the basic part of the song, usually containing the core information and theme of the song. The chorus is usually the part of the song with repeated melodies and lyrics. The pre-chorus is the transitional part between the verse and the chorus, usually located after the verse and before the chorus. Accompaniment refers to the instrumental accompaniment that accompanies the singing. Silence can refer to the blank or pause in the lyrics, and no audio performance content is included at this position. The bridge usually refers to a melody that is different from both the verse and the chorus.

[0090] As an optional implementation of an embodiment of the present disclosure, at least one component candidate type can be predetermined, the component candidate identifier corresponding to each component candidate type can be determined, and the component annotation information corresponding to each component candidate type can be determined, and a first association relationship between the component candidate type and the component candidate identifier, and a second association relationship between the component candidate type and the component annotation information can be established. Further, in the case of detecting a component candidate identifier display operation, at least one candidate component candidate identifier is displayed in response to the component candidate identifier display operation. Further, a third trigger operation can be input for at least one candidate component candidate identifier. Further, in the case of detecting a third trigger operation for a component candidate identifier, a target component candidate identifier to be used can be determined from the candidate component candidate identifiers according to the third trigger operation. Further, the component annotation information to be added can be determined according to the component candidate type corresponding to the target component candidate identifier. Further, the determined component annotation information can be added at the blank position to be acted on according to the first playback time of the reference character in the audio data. Optionally, the component candidate identification display operation may include at least one of the following operations: a click operation input to the text data display area; triggering a preset candidate identification display control; receiving a preset candidate identification display instruction; the received audio information includes a trigger word associated with displaying the component candidate identification, etc. Exemplarily, when a click operation (such as a single right-click operation) is detected on the text data display area, a text data editing menu may be displayed in an area adjacent to the clicked position in the text data display area, and the text data editing menu includes at least one candidate component candidate identification.

[0091] In the disclosed embodiment, adding component annotation information at the blank position to be acted upon may be to determine the component annotation information based on the target component candidate identifier to be used. Furthermore, the component annotation information may be added at the blank position to be acted upon according to the first playback time corresponding to the reference character. Optionally, adding component annotation information at the blank position to be acted upon includes: determining the component annotation information to be added to the blank position to be acted upon, and determining the reference character from a plurality of characters based on the position information of the blank position in the text data; determining the second playback time of the component annotation information in the audio data based on the first playback time of the reference character in the audio data, and adding the component annotation information at the blank position to be acted upon according to the second playback time.

[0092] The second play time can be understood as the play time of the audio part corresponding to the component annotation information in the audio data. Exemplarily, when the component annotation information is prelude annotation information, the second play time can be the play time of the prelude part in the corresponding audio data.

[0093] As an optional implementation of an embodiment of the present disclosure, the component candidate type corresponding to the target component candidate identifier to be used and the pre-established first association relationship can be used to determine the component candidate type corresponding to it, and the component annotation information corresponding to it can be determined based on the component candidate type and the pre-established second association relationship, and the component annotation information can be used as the component annotation information to be added to the blank position to be affected. Furthermore, the character whose corresponding position information is adjacent to the position information of the blank position can be determined based on the position information of the blank position in the text data, and the character can be used as the reference character corresponding to the blank position. Afterwards, the corresponding playback time of the blank position in the audio data can be determined based on the first playback time of the reference character in the audio data, and the playback time can be used as the second playback time of the component annotation information in the audio data. Furthermore, the component annotation information can be added to the blank position to be affected based on the second playback time.

[0094] Figure 5 The following is a schematic diagram of an operation interface for marking components in a blank position in a media file processing method provided by an embodiment of the present disclosure. Figure 5 As shown in Figure a, it is assumed that the lyrics data included in the text data is "abcdefghijklmnopqrstnvwxyz", and the lyrics data is displayed in the text data display area. Among them, "abcdef" is the first line of lyrics in the lyrics data ( Figure 5 In response to the position selection operation acting on the blank position on the upper side of the first line of lyrics in the lyrics data, a preset structure division identification line ( Figure 5 Further, when a type display operation of a component candidate type is received, nine candidate component candidate identifiers can be displayed in the text data display area, namely, a prelude identifier, an interlude identifier, an outro identifier, a verse identifier, a chorus identifier, a pre-chorus identifier, an accompaniment identifier, a silence identifier, and a bridge identifier, as shown in FIG. Figure 5 As shown in Figure b in . Further, in the case where it is detected that the cursor inputs a trigger operation for the prelude identifier, the prelude identifier is used as the target candidate component identifier. Then, the component annotation information to be added to the blank position is determined to be the prelude according to the prelude identifier, and the reference character corresponding to the blank position determined according to the position information of the blank position in the text data is the first character in the first sentence of the lyrics, that is, the character "a". Then, the second playback time of the component annotation information in the audio data can be determined according to the first playback time of the character "a" in the audio data, and the prelude identifier information can be added to the blank position according to the second playback time, as shown in FIG. Figure 5 As shown in Figure c.

[0095] The technical solution of the disclosed embodiment displays the text data and audio data of the media file in response to a first trigger operation; wherein the text data includes a plurality of characters; the change time of the display information of the characters is associated with the first playback time of the characters in the audio data, and further, in response to the component annotation operation acting on the blank position in the text data, the reference character corresponding to the text data and the blank position is determined, and the component annotation information is added to the blank position being acted on according to the first playback time corresponding to the reference character, thereby realizing the visual presentation of the audio component annotation process, and can be realized through simple interactive operations, thereby improving the efficiency of audio component annotation. Moreover, by adding component annotation information to the blank position being acted on, the audio-related information included in the text data is enriched, and a rich data basis is provided for the training samples for constructing the music generation model.

[0096] Figure 6 A structural diagram of a media file processing device provided by an embodiment of the present disclosure is shown in FIG. Figure 6 As shown, the device includes: a file data display module 410 and a text data annotation module 420. The file data display module 410 is used to display the text data and audio data of the media file in response to a first trigger operation; wherein the text data includes a plurality of characters; the change time of the display information of the characters is associated with the first play time of the characters in the audio data; the text data annotation module 420 is used to respond to a target annotation operation for the text data, and annotate the text data according to the target annotation operation and the first play time corresponding to the characters of the text data.

[0097] The technical solution of the embodiment of the present disclosure is that the text data and audio data of the media file are displayed by the file data display module 410 in response to the first trigger operation, so that the linkage display of the text data and the audio data can be realized, and the operation entry for editing the media file is provided; because the text data includes multiple characters, and the change time of the display information of the characters is associated with the first playback time of the characters in the audio data, the text data can be fully displayed, and the associated display of the audio data and the text data can be realized in the time dimension, supporting the effect of synchronously displaying the change of the display information of the corresponding characters during the playback of the audio data. Further, the text data annotation module 420 responds to the target annotation operation for the text data, and annotates the text data according to the target annotation operation and the first playback time corresponding to the characters of the text data, which solves the problem that the process operation of the media file in the related technology is cumbersome and laborious. Through simple interactive operations, the annotation of the text data linked with the audio data can be realized, which has wider applicability. Through the visual presentation of the annotation information of the text data, the annotation of the text data is more intuitive, and the linkage between the annotation information of the text data and the audio data can be automatically established, which improves the annotation effect and annotation efficiency of the text data.

[0098] Based on any of the above optional technical solutions, optionally, the target annotation operation includes a character annotation operation; and the text data annotation module 420 includes: a character annotation submodule. The character annotation submodule is used to determine a target character to be annotated from a plurality of characters in response to a character annotation operation on at least one of the characters in the text data, and annotate the target character according to the character annotation operation and the first playback time corresponding to the target character.

[0099] On the basis of any of the above optional technical solutions, optionally, the character annotation submodule includes: a target character determination unit and a character annotation unit. The target character determination unit is used to display at least one candidate character annotation identifier in response to a character selection operation for at least one of the characters in the text data, and determine the target character to be annotated according to the character selection operation; wherein the character annotation identifier corresponds to a character annotation type, and the character annotation type is associated with a character annotation method; the character annotation unit is used to determine a target character annotation identifier to be used from the character annotation identifiers in response to a second trigger operation for the character annotation identifier, and annotate the target character according to the character annotation type corresponding to the target character annotation identifier and the first playback time corresponding to the target character.

[0100] Based on any of the above optional technical solutions, optionally, the character annotation type is associated with the type of the interpreter who interprets the character.

[0101] Based on any of the above optional technical solutions, optionally, the text data includes lyrics data; the character annotation type corresponding to the lyrics data includes at least one of male voice, female voice, chorus, harmony / female voice, harmony / male voice and pure harmony.

[0102] Based on any of the above optional technical solutions, optionally, the target annotation operation includes a component annotation operation; the text data annotation module 420 includes: a component annotation submodule. The component annotation submodule is used to respond to the component annotation operation acting on the blank position in the text data, determine the reference character corresponding to the blank position in the text data, and add component annotation information at the blank position acted on according to the first playback time corresponding to the reference character; wherein the component annotation information is used to indicate the corresponding playback part of the blank position acted on in the audio data.

[0103] On the basis of any of the above optional technical solutions, optionally, the component annotation submodule includes: a candidate identification display unit, a target identification determination unit and a component annotation information adding unit. The candidate identification display unit is used to display at least one candidate component candidate identification; the target identification determination unit is used to determine the target component candidate identification to be used from the component candidate identification in response to the third trigger operation for the component candidate identification; the component annotation information adding unit is used to add component annotation information at the blank position to be acted on according to the component candidate type corresponding to the target component candidate identification and the first playback time corresponding to the reference character; wherein the component candidate type is associated with the deductive information of the text data and / or the audio data.

[0104] Based on any of the above optional technical solutions, optionally, the text data includes lyrics data; the component candidate types corresponding to the lyrics data include at least one of a prelude, an interlude, an outro, a verse, a chorus, a pre-chorus, an accompaniment, silence and a bridge.

[0105] Based on any of the above optional technical solutions, optionally, the reference character includes a character whose playing time in the audio data is adjacent to the playing time of the blank position.

[0106] The media file processing device provided in the embodiments of the present disclosure can execute the media file processing method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0107] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0108] Figure 7 This is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Figure 7 , which shows an electronic device (eg, Figure 7 The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0109] like Figure 7 As shown, the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An edit / output (I / O) interface 505 is also connected to the bus 504.

[0110] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 7 The electronic device 500 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0111] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0112] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0113] The electronic device provided by the embodiment of the present disclosure and the media file processing method provided by the above embodiment belong to the same inventive concept. The technical details not fully described in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0114] The embodiments of the present disclosure provide a computer storage medium on which a computer program is stored. When the program is executed by a processor, the media file processing method provided by the above embodiments is implemented.

[0115] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0116] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (Hyper Text Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0117] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0118] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: displays text data and audio data of a media file in response to a first trigger operation; wherein the text data includes multiple characters; the change time of the display information of the characters is associated with the first playback time of the characters in the audio data; and in response to a target marking operation for the text data, marks the text data according to the target marking operation and the first playback time corresponding to the characters of the text data.

[0119] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0120] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0121] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, a file data display module may also be described as a "module for displaying audio data and text data".

[0122] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0123] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0124] According to one or more embodiments of the present disclosure, [Example 1] provides a media file processing method, including: in response to a first trigger operation, displaying text data and audio data of a media file; wherein the text data includes multiple characters; the change time of the display information of the characters is associated with the first playback time of the characters in the audio data; in response to a target marking operation for the text data, marking the text data according to the target marking operation and the first playback time corresponding to the characters of the text data.

[0125] According to one or more embodiments of the present disclosure, [Example 2] provides the method of Example 1, further including: optionally, the target labeling operation includes a character labeling operation; the response to the target labeling operation on the text data, labeling the text data according to the target labeling operation and the first playback time corresponding to the character of the text data, including: in response to the character labeling operation on at least one of the characters in the text data, determining a target character to be labeled from a plurality of the characters, and labeling the target character according to the character labeling operation and the first playback time corresponding to the target character.

[0126] According to one or more embodiments of the present disclosure, [Example Three] provides the method of Example Two, further including: optionally, in response to a character annotation operation for at least one of the characters in the text data, determining a target character to be annotated from a plurality of the characters, and annotating the text data according to the target annotation operation and the first playback time corresponding to the target character, including: in response to a character selection operation for at least one of the characters in the text data, displaying at least one candidate character annotation identifier, and determining the target character to be annotated according to the character selection operation; wherein the character annotation identifier corresponds to a character annotation type, and the character annotation type is associated with a character annotation method; in response to a second trigger operation for the character annotation identifier, determining a target character annotation identifier to be used from the character annotation identifiers, and annotating the target character according to the character annotation type corresponding to the target character annotation identifier and the first playback time corresponding to the target character.

[0127] According to one or more embodiments of the present disclosure, [Example 4] provides the method of Example 3, further comprising: optionally, the character annotation type is associated with the type of the interpreter who interprets the character.

[0128] According to one or more embodiments of the present disclosure, [Example 5] provides the method of Example 4, further including: optionally, the text data includes lyric data; the character annotation type corresponding to the lyric data includes at least one of male voice, female voice, chorus, harmony / female voice, harmony / male voice and pure chorus.

[0129] According to one or more embodiments of the present disclosure, [Example Six] provides the method of Example One, further including: optionally, the target labeling operation includes a component labeling operation; the response to the target labeling operation on the text data, labeling the text data according to the target labeling operation and the first playback time corresponding to the character of the text data, including: in response to the component labeling operation acting on a blank position in the text data, determining a reference character corresponding to the blank position in the text data, and adding component labeling information at the blank position acted on according to the first playback time corresponding to the reference character; wherein the component labeling information is used to indicate the playback part corresponding to the blank position acted on in the audio data.

[0130] According to one or more embodiments of the present disclosure, [Example 7] provides the method of Example 6, further including: optionally, adding component annotation information at the blank position being acted upon according to the first playback time corresponding to the reference character, comprising: displaying at least one candidate component candidate identifier; in response to a third trigger operation for the component candidate identifier, determining a target component candidate identifier to be used from the component candidate identifier; adding component annotation information at the blank position being acted upon according to the component candidate type corresponding to the target component candidate identifier and the first playback time corresponding to the reference character; wherein the component candidate type is associated with the deduction information of the text data and / or the audio data.

[0131] According to one or more embodiments of the present disclosure, [Example 8] provides the method of Example 7, further including: optionally, the text data includes lyric data; the component candidate types corresponding to the lyric data include at least one of a prelude, an interlude, an outing, a verse, a chorus, a pre-chorus, an accompaniment, silence and a bridge.

[0132] According to one or more embodiments of the present disclosure, [Example 9] provides the method of Example 6, further including: optionally, the reference character includes a character whose playback time in the audio data is adjacent to the playback time of the blank position.

[0133] According to one or more embodiments of the present disclosure, [Example 10] provides a media file processing device, including: a file data display module, used to display text data and audio data of a media file in response to a first trigger operation; wherein the text data includes multiple characters; the change time of the display information of the character is associated with the first playback time of the character in the audio data; a text data annotation module, used to respond to a target annotation operation for the text data, and annotate the text data according to the target annotation operation and the first playback time corresponding to the character of the text data.

[0134] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0135] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0136] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A media file processing method, It is characterized in that include: In response to a first trigger operation, displaying text data and audio data of a media file; wherein the text data includes a plurality of characters; and a change time of display information of the characters is associated with a first play time of the characters in the audio data; In response to a target marking operation on the text data, the text data is marked according to the target marking operation and the first play time corresponding to the character of the text data.

2. The media file processing method according to claim 1, It is characterized in that The target marking operation includes a character marking operation; and in response to the target marking operation on the text data, marking the text data according to the target marking operation and the first playback time corresponding to the character of the text data, including: In response to a character marking operation on at least one of the characters in the text data, a target character to be marked is determined from the plurality of characters, and the target character is marked according to the character marking operation and the first playback time corresponding to the target character.

3. The media file processing method according to claim 2, It is characterized in that In response to a character marking operation on at least one of the characters in the text data, determining a target character to be marked from a plurality of the characters, and marking the text data according to the target marking operation and the first playback time corresponding to the target character, comprising: In response to a character selection operation for at least one of the characters in the text data, at least one candidate character annotation identifier is displayed, and a target character to be annotated is determined according to the character selection operation; wherein the character annotation identifier corresponds to a character annotation type, and the character annotation type is associated with a character annotation mode; In response to a second trigger operation on the character annotation identifier, a target character annotation identifier to be used is determined from the character annotation identifiers, and the target character is annotated according to the character annotation type corresponding to the target character annotation identifier and the first playback time corresponding to the target character.

4. The media file processing method according to claim 3, It is characterized in that The character annotation type is associated with a type of interpreter who interprets the character.

5. The media file processing method according to claim 4, It is characterized in that The text data includes lyrics data; the character annotation type corresponding to the lyrics data includes at least one of male voice, female voice, chorus, harmony / female voice, harmony / male voice and pure chorus.

6. The media file processing method according to claim 1, It is characterized in that The target marking operation includes a component marking operation; the response to the target marking operation on the text data, marking the text data according to the target marking operation and the first playback time corresponding to the character of the text data, includes: In response to a component annotation operation acting on a blank position in the text data, a reference character corresponding to the blank position in the text data is determined, and component annotation information is added at the blank position being acted upon according to a first playback time corresponding to the reference character; wherein the component annotation information is used to indicate a playback portion in the audio data corresponding to the blank position being acted upon.

7. The media file processing method according to claim 6, It is characterized in that The adding component marking information at the blank position affected according to the first play time corresponding to the reference character comprises: Displaying at least one candidate component candidate identifier; In response to a third trigger operation on the candidate component identifier, determining a target component candidate identifier to be used from the candidate component identifier; Add component annotation information at the blank position affected according to the component candidate type corresponding to the target component candidate identifier and the first playback time corresponding to the reference character; wherein the component candidate type is associated with the interpretation information of the text data and / or the audio data.

8. The media file processing method according to claim 7, It is characterized in that The text data includes lyrics data; the component candidate types corresponding to the lyrics data include at least one of an intro, an interlude, an outro, a verse, a chorus, a pre-chorus, an accompaniment, silence, and a bridge.

9. The media file processing method according to claim 6, It is characterized in that The reference characters include characters whose playing time in the audio data is adjacent to the playing time of the blank position.

10. A media file processing device, It is characterized in that include: A file data display module, for displaying text data and audio data of a media file in response to a first trigger operation; wherein the text data includes a plurality of characters; and a change time of display information of the characters is associated with a first play time of the characters in the audio data; The text data marking module is used to respond to a target marking operation on the text data and mark the text data according to the target marking operation and the first playback time corresponding to the characters of the text data.

11. An electronic device, It is characterized in that The electronic device comprises: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the media file processing method as described in any one of claims 1-9.

12. A storage medium containing computer executable instructions, It is characterized in that When the computer executable instructions are executed by a computer processor, they are used to execute the media file processing method as described in any one of claims 1-9.

13. A computer program product, It is characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the media file processing method according to any one of claims 1 to 9.

Images