Media content playing method and device, equipment, storage medium and product

Abstract

The embodiment of the invention provides a media content playing method and device, equipment, a storage medium and a product. The method comprises the steps of receiving a video enabling instruction for media content in a playing process of the media content; and in response to the video enabling indication, playing a target video corresponding to the media content, the target video being generated based on one or more pieces of feature information of the media content. Therefore, the video automatically generated based on the media content can be played in the application, the uniqueness and richness of the video content corresponding to the media content are improved, and better watching experience is provided for a user.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, storage media, and products for media content playback. Background Art

[0002] With the development of information technology, there are endless applications that provide users with media content such as songs, audio books, crosstalk, text information, pictures, etc. Users can play the media content they are interested in in the application. However, the current media content playback methods and content are limited. How to improve the richness of media content playback is a technical problem that needs to be explored at present. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for playing media content is provided. The method comprises: during the playing of the media content, receiving a video enabling indication for the media content; and in response to the video enabling indication, playing a target video corresponding to the media content, the target video being generated based on one or more feature information of the media content.

[0004] In a second aspect of the present disclosure, a device for playing media content is provided. The device includes: a receiving module configured to receive a video activation instruction for the media content during the playing of the media content; and a playing module configured to play a target video corresponding to the media content in response to the video activation instruction, the target video being generated based on one or more feature information of the media content.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect of the present disclosure, a computer program product is provided, comprising computer executable instructions, wherein the computer executable instructions implement the method of the first aspect when executed by a processor.

[0008] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0010] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0011] Figure 2 A schematic diagram showing an example process for playing media content according to some embodiments of the present disclosure;

[0012] FIG. 3A to FIG. 3E A schematic diagram showing a playback interface of media content according to some embodiments of the present disclosure is shown;

[0013] FIG. 4A to FIG. 4E A schematic diagram showing an editing interface of a target video according to some embodiments of the present disclosure is shown;

[0014] Figure 5 A flowchart showing a process of media content playback according to some embodiments of the present disclosure is shown;

[0015] Figure 6 A block diagram showing an apparatus for playing media content according to some embodiments of the present disclosure; and

[0016] Figure 7 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0017] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0018] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0019] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0020] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0021] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0022] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0023] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0024] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0025] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0026] As used herein, the term "model" can learn the association between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multiple layers of processing units. In this article, "model" may also be referred to as "machine learning model", "machine learning network" or "network", which are used interchangeably in this article. A model may also include different types of processing units or networks.

[0027] As briefly mentioned above, with the development of information technology, various applications that provide users with media content such as songs, audio books, crosstalk, and image collections have emerged in an endless stream. Users can play the media content they are interested in in the application. However, the current media content playback methods and content are limited. Taking songs as an example, due to various restrictions, users can usually only listen to songs without viewing content or can only play the original music video (MV) of the song, but cannot edit and create the MV. This has a certain impact on the richness of application functions and the user experience.

[0028] Embodiments of the present disclosure propose a solution for playing media content. According to various embodiments of the present disclosure, during the playing of media content, a video enabling indication for the media content is received. Then, in response to the video enabling indication, a target video corresponding to the media content is played, and the target video is generated based on one or more feature information of the media content. In this way, a video automatically generated based on the media content can be played in an application, improving the uniqueness, randomness and richness of the video content corresponding to the media content, thereby providing a better viewing experience for users.

[0029] Example Environment

[0030] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In the example environment 100, an application 120 is installed in a terminal device 110. A user 140 can interact with the application 120 via the terminal device 110 and / or an attached device of the terminal device 110.

[0031] In some embodiments, application 120 may be any appropriate application that can provide services related to media content. For example, application 120 may be a player of media content, such as a song player, an audio book player, etc. Figure 1In the environment 100, if the application 120 is active, the terminal device 110 can present the interface 150 of the application 120. The interface 150 can include various pages that the application 120 can provide, such as a media content playback interface, a content recommendation interface, an information interaction interface, a query interface, a search interface, a search result presentation interface, and the like.

[0032] In some embodiments, the terminal device 110 communicates with the server 130 to provide the service of the application 120. The terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as "wearable" circuits, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0033] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0034] Some example embodiments of the present disclosure will continue to be described with reference to the accompanying drawings. It should be understood that the pages shown in the accompanying drawings are merely examples, and various page designs may actually exist. The various graphic elements in the page may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also exist. The embodiments of the present disclosure are not limited in this respect. In addition, hereinafter, the example embodiments will be described primarily with respect to the terminal device 110. It should be understood that the actions described with respect to the terminal device 110 may be performed by the application 120 on the terminal device 110, or may be performed by the application 120 in collaboration with its service end (e.g., server 130).

[0035] First reference Figure 2 , FIG. 3A to FIG. 3E as well as FIG. 4A to FIG. 4E Example embodiments of the present disclosure for media content playback are described. Figure 2 A schematic diagram of an example process 200 for media content playback according to some embodiments of the present disclosure is shown. FIG. 3A to FIG. 3ESchematic diagrams of playback interfaces 300A to 300E of media content according to some embodiments of the present disclosure are shown. FIG. 4A to FIG. 4E Schematic diagrams of editing interfaces 400A to 400E of a target video according to some embodiments of the present disclosure are shown.

[0036] It should be noted that the media content of the present disclosure includes but is not limited to audio (e.g., songs, audio books, crosstalk, etc.), video, and image collections. For ease of understanding, the following mainly uses songs as an example for description, but it should be understood that this is only exemplary and not intended to be limiting. The embodiments described with reference to songs can be applied to other types of media content.

[0037] like Figure 2 As shown, in some embodiments, in block 201, the terminal device 110 starts the application 120. For example, the terminal device 110 enters the application 120 based on receiving an operation of starting the application 120 (e.g., a song player) from the user 140. After the application 120 is started, if the user 140 selects a certain media content, the terminal device 110 can present a playback interface of the media content. Figure 3A Taking songs as an example, an example of a playback interface 300A of media content is shown. The playback interface 300A includes a song cover 310, a song information presentation area 311, etc. The song information presentation area 311 can present song related information such as song name, singer and lyrics.

[0038] In some embodiments, in block 202, during the playback of the media content, the terminal device 110 receives a video enable indication for the media content. The user 140 may be supported to provide the video enable indication in any suitable manner. For example, the playback interface of the media content may include an entry for providing text input or voice input. The user 140 may send a video enable indication in the form of text or voice through the entry.

[0039] In some embodiments, the playback page of the media content may include a video enablement control. The video enablement indication may be a trigger operation for the video enablement control. For example, the playback interface 300A includes a video enablement control 312. The video enablement control 312 may be configured to enable the target video corresponding to the song in response to the trigger operation of the user 140. For example, based on receiving the trigger operation of the video enablement control 312 by the user 140, the terminal device 110 may present the following: Figure 3B The media content playback interface 300B shown in FIG. The media content playback interface 300B includes a loading area 313 of a target video, and the loading area 313 presents a loading screen of the target video, which lasts for a period of time (eg, 5 to 10 seconds).

[0040] In response to receiving the video activation indication, the terminal device 110 starts to obtain the target video corresponding to the media content. The target video is generated based on one or more feature information of the media content. Such feature information may include feature information of various suitable dimensions related to the media content. For example, the target video may be generated at least in part by machine learning model feature information. An example embodiment for generating a target video will be described in detail below.

[0041] After acquiring the target video, the terminal device 110 plays the target video. In particular, in some embodiments, in block 203, the terminal device 110 may synchronously play the media content and the target video. For example, after the target video is loaded, the terminal device 110 may present the following Figure 3C The media content playback interface 300C is shown. The media content playback interface includes a target video playback area 314. For example, after acquiring a target MV of a certain song, the user 140 can watch the target MV through the playback area 314 while listening to the song.

[0042] In some embodiments, the playback interface of the media content may include one or more interactive controls for the target video. The terminal device 110 performs a target operation corresponding to the triggered interactive control on the target video based on receiving a trigger operation of the interactive control in one or more interactive controls by the user 140. In some embodiments, the interactive control may include a control for starting to edit the target video (e.g., an edit control), a control for forwarding the target video (e.g., a forward control), a control for providing feedback for the target video (e.g., a like control, a step control), and the like. For example, the playback interface 300C includes a like control 315, a forward control 316, and an edit control 317 for the target video. The user can interact with the target video by clicking the above controls in the playback interface.

[0043] In some embodiments, at block 204, the terminal device 110 may further receive feedback from the user 140 on the target video based on receiving a trigger operation on a control for providing feedback on the target video. The feedback may include positive feedback and / or negative feedback. For example, referring to Figure 3D The playback interface 300D of the media content shown in FIG. 1 is a diagram showing a playback interface 300D of the media content shown in FIG. 1. The terminal device 110 receives the user's positive feedback on the target video based on the triggering operation of the like control 315 by the user 140. In some embodiments, the terminal device 110 can recommend or distribute videos based on the user's feedback on the target video. For example, the terminal device 110 can preferentially recommend the target video that has received more positive feedback such as likes to other users.

[0044] In some embodiments, at block 205, the terminal device 110 may forward the target video to other users in the application or to other applications based on receiving a trigger operation on a control for forwarding the target video. For example, after receiving a trigger operation on the forwarding control 316 from the user 140, the terminal device 110 may present the following Figure 3E The playback interface 300E of the media content shown in FIG. The playback interface 300E includes a forwarding window 318, and the forwarding window 318 includes multiple forwarding selection controls 319 for multiple applications. The terminal device 110 can forward the target video to the selected application based on receiving a trigger operation of the forwarding selection control 319 for any application.

[0045] In some embodiments, in box 206, after the target video is generated, the terminal device 110 can receive an editing instruction to the target video. The user 140 can be supported to provide the editing instruction in any suitable manner. For example, the playback interface of the media content may include an entry for providing text input or voice input. The user 140 can issue the editing instruction in the form of text or voice through the entry. For another example, the playback page of the media content may include the above-mentioned editing control 317. The user 140 can issue the editing instruction by clicking the editing control 317.

[0046] In some embodiments, in block 207, in response to receiving an editing instruction for the target video, the terminal device 110 presents an editing interface for the target video. The user 140 can edit the target video through the editing interface. The editing interface can support the user 140 to perform editing operations on the target video in any suitable one or more ways. For example, the editing operations on the target video may include clipping, compositing, adjusting the frame size, adding filters, adding subtitles, etc. The terminal device 110 performs editing operations on the target video based on the editing instructions received via the editing interface to generate an edited video.

[0047] In some embodiments, in block 208, in response to receiving a clipping instruction for a target video, the terminal device 110 may receive a user's selection of a segment in the target video, and extract the selected video segment as an edited video. Figure 4A An example of an editing interface 400A for a target video is shown. The editing interface 400A includes a clipping area 401 for the target video. The terminal device 110 receives the user 140's selection of a segment in the target video via the clipping area 401, and uses the video segment between the start frame 402 and the end frame 403 selected by the user as the edited video. Of course, the above editing methods are only exemplary and are not intended to be limiting. The user 140 can also perform an editing operation on the target video by selecting multiple segments or the like.

[0048] In some embodiments, in box 209, in response to receiving a synthesis instruction for a target video, the terminal device 110 obtains reference content for synthesis based on the input of the user 140. The user can input the reference content by local import, online import, etc. The reference content may include but is not limited to the user's selfie video, landscape video, video generated based on other media content, audio, and the like. In some embodiments, the terminal device 110 may set the duration or size range of the received reference content to ensure the efficiency of video synthesis. In box 210, an edited video is obtained by combining at least a portion of the reference content and at least a portion of the target video. In some embodiments, the user can also perform free editing, synthesis, and other operations on multiple reference contents and multiple target videos to obtain an edited video.

[0049] It should be noted that the order of editing and synthesizing the target video is not limited by blocks 208-210. You can edit first and then synthesize, or synthesize first and then edit, or combine multiple editing and synthesis to edit the target video. Taking editing first and then synthesis as an example, after the target video is edited, the terminal device 110 can present the following Figure 4B The editing interface 400B of the target video shown in FIG. 400B. The user can click the synthesis control 404 in the editing interface 400B to start the synthesis operation. After receiving the trigger operation of the synthesis control 404 by the user 140, the terminal device 110 can present the following Figure 4C The target video editing interface 400C is shown. The user 140 can upload one or more reference contents through the reference content input area 405 in the editing interface 400C. One or more target videos generated based on the media content can be selected through the target video selection area 406, and the uploaded reference contents and the selected target videos can be synthesized to generate an edited video.

[0050] In some embodiments, the video selected by the user 140 through the target video selection area 406 may also include an edited video, that is, the user 140 can select a clipped or synthesized target video to synthesize with the reference content. The terminal device 110 may present the following information based on the confirmation of the user 140 for performing the synthesis operation: Figure 4D The editing interface 400D of the target video is shown. The editing interface 400D includes a loading area 407 for synthesizing the video, and the loading area 407 presents a loading screen for video synthesis. The loading screen may include an estimated waiting time for synthesizing the video.

[0051] In some embodiments, the synthesis of at least a portion of the reference content and at least a portion of the target video can be performed in the following manners: simple splicing or fusion using a machine learning model. If at least a portion of the reference content and at least a portion of the target video are fused using a machine learning model, the style of the target video can be used as the style of the synthesized edited video through the model. For example, if the target video generated based on the media content is a two-dimensional animation style, and the user 140 uploads a selfie video, then after synthesis, the selfie video uploaded by the user is presented in the edited video in the form of a two-dimensional animation.

[0052] In some embodiments, in block 211, the user 140 may share or save the edited video obtained by clipping or synthesis. For example, after the video synthesis is completed, the terminal device 110 may present the video as follows: Figure 4E The editing interface 400E of the target video is shown. The user can click the sharing control 408 in the editing interface 400E to share the video he edited and created.

[0053] In some embodiments, in response to receiving a distribution instruction for the edited video, the terminal device 110 may present recommendation information of the edited video in the content recommendation interface of the application 120. Through the recommendation of the content recommendation interface, the video edited and created by the user can be shared with other users in the application, so that other users can interact with the video (for example, play, like, forward, etc.).

[0054] In some embodiments, the terminal device 110 can associate the edited video with at least one of the media content and the target video. For example, the terminal device 110 can associate the song MV edited by the user with the original song or the target MV generated by the machine learning model. After the edited video is associated with the media content and the target video, when the edited video is recommended, the information of the associated media content and the target video can be presented. Other users can click to watch the media content or the target video based on the information. Similarly, when the media content or the target video is recommended, the information of the associated edited video can also be presented. Other users can click to watch the edited video based on the information.

[0055] The above describes an example of interaction with a target video. Figure 2 As described, the target video is generated based on one or more feature information of the media content. An example embodiment of target video generation is described in detail below.

[0056] In some embodiments, one or more feature information of media content includes, but is not limited to, feature information of one or more dimensions: entity dimension related to media content, content dimension of media content, and consumption dimension of media content. Taking songs as an example, entity dimensions related to media content may include singers, singer timbre, singer's era, lyricists, composers, etc. The content dimension of media content may include song type, lyrics content, song melody, etc. The consumption dimension of media content may include the number of plays of songs, the type of listeners of songs, etc. Of course, the above feature information is only exemplary and is not intended to be limiting. The feature information of media content may also include other information that can be used to generate a target video.

[0057] In some embodiments, each feature information may be assigned a corresponding weight in the generation of the target video. The weight of each feature information can be set according to actual needs, and can be equal or unequal. For example, when generating a target video corresponding to a song, the weight ratios of the lyrics content, singer's timbre, song type, song melody, and other feature information can be set to 60%, 10%, 10%, 10%, and 10% respectively. It should be understood that the specific proportion values ​​described above are only exemplary and are not intended to be limiting.

[0058] As briefly described above, the target video is generated based on one or more feature information of the media content. In some embodiments, the entire material of the target video is generated as a whole based on one or more feature information. In some embodiments, the target video may include picture material and transition material. The terminal device 110 can generate the picture material of the media content based on one or more feature information of the media content, and merge the picture material with the transition material to generate the target video. The transition material can be selected from the preset transition material based on the style of the media content, or it can be generated using a machine learning model based on one or more feature information of the media content.

[0059] In some embodiments, the media content may be merged with the screen material and the transition material to generate a target video. For example, after the screen material and the transition material of a song are generated, the screen material and the transition material are merged with the audio of the song to generate a MV of the song. Of course, the audio of the song may not be merged into the MV. When playing the MV, the time axis of the audio may be aligned with the time axis of the MV and played simultaneously.

[0060] In some embodiments, the picture material of the media content can be generated by a machine learning model based on one or more feature information. The target transition material can be selected from the preset transition materials based on at least a portion of the one or more feature information. Furthermore, the picture material and the target transition material can be merged to generate a target video. Taking the generation of a song MV as an example, the style of the MV is determined according to the style of the song. The picture material can be generated by a machine learning model based on the feature information of the song, such as the song type, lyrics content, song melody, singer timbre, etc. It is also possible to select a target transition material with a matching style from the preset transition materials based on at least a portion of these feature information.

[0061] In some embodiments, a machine learning model can be used to generate screen materials and transition materials for media content based on one or more feature information. The generated screen materials can then be merged with the transition materials to generate a target video. Taking the generation of a song MV as an example, the style of the MV is determined according to the style of the song. The machine learning model can be used to generate screen materials and transition materials based on the feature information of the song, such as the song type, lyrics content, song melody, singer timbre, etc.

[0062] For example, for traditional Chinese style songs, the generated picture materials are more ink-and-wash style, and the transition materials use ink-and-wash switching; for pop songs, the generated picture materials are more realistic, and the transition materials use fade-in and fade-out switching; for rock songs, the generated picture materials are more realistic, and the transition materials use powerful flat cuts; for light music, the generated picture materials are more natural and healing style, and the transition materials use gradual and soft switching; for two-dimensional songs, the generated picture materials are mainly animation style, and the transition materials use movie or animation scenes to switch.

[0063] In some embodiments, the media content includes multiple content units. For example, a song includes multiple lyrics, an audio book includes multiple paragraphs, etc. For each content unit of the media content, one or more images for the content unit can be generated based on the feature information of the content unit under the content dimension. Based on the duration of the content unit in the media content and one or more images, a video clip for the content unit is generated. The duration of the video clip can be consistent with the duration of the content unit in the media content. Taking a song as an example, based on the lyrics content of the lyrics, one or more images for the lyrics are generated, and based on the duration of the lyrics in the song, one or more images are synthesized into a video clip, and the duration of the video clip in the target video is consistent with the duration of the lyrics in the song. Further, a target video can be generated based on the video clips generated for multiple content units. For example, multiple video clips can be directly synthesized into a target video, or appropriate transition materials can be added between video clips to generate a target video.

[0064] In some embodiments, in order to generate one or more images for a certain content unit, an image element representing the text content can be generated based on the text content of the content unit. For example, if a line of lyrics contains text content such as "rainy day" and "hold an umbrella", image elements such as rain and umbrella can be generated. In some embodiments, the image style corresponding to the content style can be determined based on the content style of the content unit. For example, if the song type is a love song and the song melody is sad, the image style is determined to be cold tones. Generally speaking, the content styles of multiple lines of lyrics in a song are the same or similar. One or more images can be generated based on the image elements and image style of the content unit. For example, one or more images of the line of lyrics can be generated based on the image elements such as rain and umbrella and the image style of cold tones in the above example.

[0065] In summary, the present disclosure enables the target video automatically generated based on the media content to be played in the application, thereby improving the uniqueness, randomness and richness of the video content corresponding to the media content. In addition, the user can also perform various editing operations on the target video to obtain the edited video, and perform interactive operations such as publishing, sharing and liking the edited video. This lowers the user's creation threshold, thereby providing users with a better viewing, creation and sharing experience.

[0066] Example Process

[0067] Figure 5 A flowchart of a process 500 for media content playback according to some embodiments of the present disclosure is shown. The process 500 may be implemented at the terminal device 110 or by the terminal device 110 coordinating the server 130. The process 500 is described below with reference to 1.

[0068] In block 510 , during playback of media content, the terminal device 110 receives a video enable indication for the media content.

[0069] In block 520 , in response to the video enabling indication, the terminal device 110 plays a target video corresponding to the media content, where the target video is generated based on one or more feature information of the media content.

[0070] In some embodiments, process 500 also includes presenting an editing interface for the target video in response to receiving an editing instruction for the target video; based on the editing instructions received via the editing interface of the target video, performing editing operations corresponding to the received editing instructions on the target video to generate an edited video.

[0071] In some embodiments, performing an editing operation on a target video includes: in response to receiving a clipping instruction for the target video, receiving a user selection for a segment in the target video; and extracting the selected segment from the target video as an edited video.

[0072] In some embodiments, performing an editing operation on a target video includes: in response to receiving a synthesis instruction for the target video, obtaining reference content for synthesis based on user input; and obtaining an edited video by combining at least a portion of the reference content and at least a portion of the target video.

[0073] In some embodiments, process 500 further includes: in response to receiving a distribution indication for the edited video, presenting recommendation information about the edited video in a content recommendation interface.

[0074] In some embodiments, process 500 also includes associating the edited video with at least one of the media content or the target video.

[0075] In some embodiments, the playback interface of the media content includes a video enablement control, and receiving the video enablement indication includes: receiving a trigger operation on the video enablement control.

[0076] In some embodiments, process 500 also includes: presenting one or more interactive controls for the target video in the playback interface of the target video; in response to triggering an interactive control among the one or more interactive controls, performing a target operation corresponding to the triggered interactive control on the target video.

[0077] In some embodiments, the one or more interactive controls include, but are not limited to, at least one of the following: a control for starting editing of the target video, a control for forwarding the target video, and a control for providing feedback on the target video.

[0078] In some embodiments, the one or more feature information include, but are not limited to, feature information of one or more of the following dimensions: an entity dimension related to the media content, a content dimension of the media content, and a consumption dimension of the media content.

[0079] In some embodiments, one or more feature information is assigned corresponding weights in the generation of the target video.

[0080] In some embodiments, the target video is generated in the following manner: based on one or more feature information, using a machine learning model to generate picture materials for media content; based on at least a portion of one or more feature information, selecting target transition materials from preset transition materials; and generating the target video by merging the picture material and the target transition material.

[0081] In some embodiments, the target video is generated in the following manner: based on one or more feature information, a machine learning model is used to generate picture materials and transition materials for media content; and the target video is generated by merging the picture materials and transition materials.

[0082] In some embodiments, the media content includes multiple content units, and the target video is generated in the following manner: for a content unit among the multiple content units, based on feature information of the content unit under a content dimension, one or more images are generated for the content unit; based on a duration of the content unit in the media content and one or more images, a video segment for the content unit is generated; and based on the video segments generated respectively for the multiple content units, a target video is generated.

[0083] In some embodiments, generating one or more images for the content unit includes: generating image elements representing text content based on the text content of the content unit; determining an image style corresponding to the content style based on the content style of the content unit; and generating one or more images based on the image elements and the image style.

[0084] Example devices and equipment

[0085] Figure 6 A schematic structural block diagram of an apparatus 600 for playing media content according to some embodiments of the present disclosure is shown. The apparatus 600 may be implemented as or included in a terminal device 110. Each module / component in the apparatus 600 may be implemented by hardware, software, firmware, or any combination thereof.

[0086] like Figure 6 As shown, the device 600 includes a receiving module 610, which is configured to receive a video activation instruction for the media content during the playback of the media content. The device 600 also includes a playing module 620, which is configured to play a target video corresponding to the media content in response to the video activation instruction, and the target video is generated based on one or more feature information of the media content.

[0087] In some embodiments, the device 600 further includes an editing interface presentation module configured to present an editing interface for the target video in response to receiving an editing instruction for the target video. The device 600 further includes an editing module configured to perform an editing operation corresponding to the received editing instruction on the target video based on the editing instruction received via the editing interface of the target video to generate an edited video.

[0088] In some embodiments, the editing module is further configured to receive a user selection of a segment in the target video in response to receiving a clipping instruction for the target video; and extract the selected segment from the target video as the edited video.

[0089] In some embodiments, the editing module is further configured to, in response to receiving a synthesis instruction for a target video, obtain reference content for synthesis based on user input; and obtain an edited video by combining at least a portion of the reference content and at least a portion of the target video.

[0090] In some embodiments, the apparatus 600 further includes a recommendation information presentation module configured to present recommendation information about the edited video in the content recommendation interface in response to receiving a distribution instruction for the edited video.

[0091] In some embodiments, the recommendation information presentation module is further configured to associate the edited video with at least one of the media content or the target video.

[0092] In some embodiments, the playback interface of the media content includes a video enabling control, and the receiving module 610 is further configured to receive a triggering operation on the video enabling control.

[0093] In some embodiments, the device 600 further includes an interactive control presentation module configured to present one or more interactive controls for the target video in the playback interface of the target video. The device 600 further includes a target operation execution module configured to execute a target operation corresponding to the triggered interactive control on the target video in response to triggering an interactive control in one or more interactive controls.

[0094] In some embodiments, the one or more interactive controls include, but are not limited to, at least one of the following: a control for starting editing of the target video, a control for forwarding the target video, and a control for providing feedback on the target video.

[0095] In some embodiments, one or more feature information is assigned corresponding weights in the generation of the target video.

[0096] In some embodiments, the device 600 also includes a video generation module, which is configured to generate picture materials for media content based on one or more feature information using a machine learning model; select target transition materials from preset transition materials based on at least a portion of one or more feature information; and generate a target video by merging the picture material and the target transition material.

[0097] In some embodiments, the device 600 also includes a video generation module, which is configured to generate picture materials and transition materials for media content based on one or more feature information using a machine learning model; and generate a target video by merging the picture materials and transition materials.

[0098] In some embodiments, the media content includes multiple content units, and the device 600 further includes a video segment generation module, which is configured to generate one or more images for a content unit in the multiple content units based on feature information of the content unit under the content dimension, and to generate a video segment for the content unit based on the duration of the content unit in the media content and the one or more images. The device 600 further includes a segment synthesis module, which is configured to generate a target video based on the video segments generated for the multiple content units.

[0099] In some embodiments, the video clip generation module is also configured to generate an image element representing the text content based on the text content of the content unit; determine an image style corresponding to the content style based on the content style of the content unit; and generate one or more images based on the image element and the image style.

[0100] Figure 7 A block diagram of an electronic device 700 is shown in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 7 The electronic device 700 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Figure 7 The electronic device 700 shown can be used to implement Figure 1 terminal device 110.

[0101] like Figure 7 As shown, the electronic device 700 is in the form of a general electronic device. The components of the electronic device 700 may include, but are not limited to, one or more processors or processing units 710, a memory 720, a storage device 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. The processing unit 710 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 720. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 700.

[0102] The electronic device 700 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the electronic device 700, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 720 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 730 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 700.

[0103] The electronic device 700 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 7 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 720 may include a computer program product 725 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0104] The communication unit 740 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 700 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 700 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0105] The input device 750 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 760 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 700 may also communicate with one or more external devices (not shown) through the communication unit 740 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 700, or communicate with any device that allows the electronic device 700 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0106] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0107] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0108] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0109] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0110] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0111] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for playing media content, comprising: During playback of the media content, receiving a video activation indication for the media content; as well as In response to the video enabling indication, a target video corresponding to the media content is played, where the target video is generated based on one or more pieces of feature information of the media content.

2. The method according to claim 1, further comprising: In response to receiving an instruction to edit the target video, presenting an editing interface for the target video; as well as Based on the editing instruction received via the editing interface of the target video, an editing operation corresponding to the received editing instruction is performed on the target video to generate an edited video.

3. The method according to claim 2, wherein performing the editing operation on the target video comprises: In response to receiving a clipping instruction for the target video, receiving a user selection for a segment in the target video; as well as The selected segment is extracted from the target video as the edited video.

4. The method according to claim 2, wherein performing the editing operation on the target video comprises: In response to receiving a synthesis instruction for the target video, obtaining reference content for synthesis based on user input; as well as The edited video is obtained by combining at least a portion of the reference content and at least a portion of the target video.

5. The method according to claim 2, further comprising: In response to receiving a distribution indication for the edited video, presenting recommendation information about the edited video in a content recommendation interface.

6. The method according to claim 5, further comprising: The edited video is associated with at least one of the media content or the target video.

7. The method of claim 1, wherein the playback interface of the media content includes a video enable control, and receiving the video enable indication includes: A trigger operation is received to enable a control for the video.

8. The method according to claim 1, further comprising: Presenting one or more interactive controls for the target video in a playback interface of the target video; as well as In response to triggering an interactive control among the one or more interactive controls, a target operation corresponding to the triggered interactive control is performed on the target video.

9. The method of claim 8, wherein the one or more interactive controls include at least one of the following: A control for initiating editing of the target video, a control for forwarding the target video, or A control for providing feedback on the target video. 10 . The method according to claim 1 , wherein the one or more feature information are assigned corresponding weights in the generation of the target video.

11. The method according to claim 1, wherein the target video is generated by: Based on the one or more pieces of feature information, using a machine learning model to generate picture materials for the media content; Based on at least a part of the one or more pieces of characteristic information, selecting a target transition material from preset transition materials; and The target video is generated by merging the picture material and the target transition material.

12. The method according to claim 1, wherein the target video is generated by: Based on the one or more pieces of feature information, using a machine learning model to generate picture materials and transition materials for the media content; and The target video is generated by merging the picture material and the transition material.

13. The method according to claim 1, wherein the media content comprises a plurality of content units, and the target video is generated by: For a content unit among the plurality of content units, Based on feature information of the content unit in a content dimension, generating one or more images for the content unit; generating a video segment for the content unit based on a duration of the content unit in the media content and the one or more images; as well as The target video is generated based on the video segments respectively generated for the plurality of content units.

14. The method of claim 13, wherein generating one or more images for the content unit comprises: Based on the text content of the content unit, generating an image element representing the text content; Based on the content style of the content unit, determining an image style corresponding to the content style; as well as The one or more images are generated based on the image elements and the image style.

15. A device for playing media content, comprising: A receiving module, configured to receive a video activation instruction for the media content during the playback of the media content; as well as The playing module is configured to play a target video corresponding to the media content in response to the video enabling indication, wherein the target video is generated based on one or more feature information of the media content.

16. An electronic device, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1-14 when executed by the at least one processing unit.

17. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 14.

18. A computer program product comprising computer executable instructions, wherein the computer executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 14.

Images