Method and device for processing media resources
Patent Information
- Application Number
- CN202411500098.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-25
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2044-10-25
Smart Images

Figure CN119182980B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of Internet application technology, and in particular to a method and device for processing media resources. Background Art
[0002] With the rapid development of the Internet and mobile communication technologies, media playback services provided for mobile terminals such as mobile phones and tablet computers have been widely used.
[0003] In the process of playing media resources using media playback services, the summary extraction technology can be used to extract the content summary of the media resources, thereby improving the user's information acquisition efficiency. On this basis, how to further improve the user experience of the summary extraction technology is a problem that needs to be solved. Summary of the invention
[0004] The present application provides a method and device for processing media resources to improve the user experience of summary extraction technology.
[0005] In a first aspect, a method for processing media resources is provided, comprising: monitoring playback instructions of media resources; in response to monitoring the playback instructions, playing the media resources on a playback page; during the process of playing the media resources, monitoring a first instruction for the playback page, the first instruction being used to trigger the display of a content summary of the media resources; in response to monitoring the first instruction, displaying the content summary in a display area of the content summary; during the process of displaying the content summary, monitoring a first editing operation for the content summary, the first editing operation being used to edit the content summary; and in response to the first editing operation, displaying the editing result of the content summary in the display area of the content summary.
[0006] By introducing the ability to edit content summaries, users can form personalized content summaries according to their own wishes, thereby improving the user experience of summary extraction technology.
[0007] In some implementations, the method further includes: during displaying the content summary or the editing result, monitoring a publishing operation for the content summary or the editing result; and in response to monitoring the publishing operation for the content summary or the editing result, publishing the content summary or the editing result.
[0008] By introducing the publishing operation of content summaries, users can exchange content summaries or editing results with each other, thus improving the user interaction experience.
[0009] In some implementations, in response to monitoring a publishing operation on the content summary or the editing result, publishing the content summary or the editing result includes: in response to monitoring a publishing operation on the content summary or the editing result, displaying multiple interface elements in a display area of the content summary, the multiple interface elements corresponding one-to-one to multiple publishing methods; in response to a target interface element among the multiple interface elements being triggered, publishing the content summary or the editing result according to the publishing method corresponding to the target interface element.
[0010] In some implementations, in response to a target interface element among the multiple interface elements being triggered, publishing the content summary or the editing result in accordance with the publishing method corresponding to the target interface element includes: in response to the target interface element being triggered and the target interface element being used to indicate that the publishing method of the content summary or the editing result is publishing in a comment area, publishing the content summary or the editing result in the comment area; or, in response to the target interface element being triggered and the target interface element being used to indicate that the publishing method of the content summary or the editing result is publishing and pinning in the comment area, publishing the content summary or the editing result in the comment area, and pinning the content summary or the editing result to the top of the comment area for display; or, in response to the target interface element being triggered and the target interface element being used to indicate that the publishing method of the content summary or the editing result is publishing as a new video, publishing a new video, and the new video contains the content summary or the editing result.
[0011] In some implementations, the first instruction includes at least one of the following: an instruction to trigger a first page element, an instruction triggered by a gesture, and an instruction triggered by a voice.
[0012] In some implementations, the method further includes: at a first moment, displaying the first page element on the playback page; at a second moment, displaying the second page element on the playback page, the display positions of the first page element and the second page element in the playback page overlapping; wherein the first moment and the second moment are different.
[0013] By overlapping and displaying multiple page elements on the playback page, the area occupied by the page elements on the playback page can be reduced, thereby reducing the blocked area of the playback page, making the design of the playback page more concise, thereby improving the viewing experience of media resources.
[0014] In some implementations, in response to the first editing operation, displaying the editing result of the content summary in the display area of the content summary includes: in response to monitoring the first editing operation, and the first editing operation includes editing the text content in the content summary, displaying the editing result of the text content in the display area of the content summary; or, in response to monitoring the first editing operation, and the first editing operation includes inserting stickers in the content summary, displaying the stickers in the display area of the content summary; or, in response to monitoring the first editing operation, and the first editing operation includes inserting a picture in the content summary, displaying the picture in the display area of the content summary; or, in response to monitoring the first editing operation, and the first editing operation includes performing picture editing on the content summary, displaying the picture editing result of the content summary in the display area of the content summary.
[0015] In some implementations, the first editing operation includes inserting a picture in the content summary, and the media resource is a video file. Before displaying the editing result of the content summary, the method also includes: in response to a second instruction to select a picture from the video file, displaying at least one video frame in the video file, the at least one video frame corresponding to a wonderful moment in the video file; and in response to a selection operation of a target video frame in the at least one video frame, inserting the target video frame in the content summary.
[0016] When a user wants to insert a picture into a content summary, providing the user with video frames corresponding to wonderful moments in the video file can help the user quickly select appropriate pictures and improve the user experience.
[0017] In some implementations, the first editing operation includes inserting a picture in the content summary, and the media resource is a video file. Before displaying the editing result of the content summary, the method also includes: in response to a second instruction to select a picture from the video file, displaying a search box, wherein the search box is used to enter picture search information; in response to receiving the picture search information, displaying at least one video frame in the video file related to the picture search information.
[0018] When a user wants to insert an image into a content summary, searching for the corresponding video frame in the video file based on the image search information provided by the user helps to quickly select the appropriate image and improve the user experience.
[0019] In some implementations, the first editing operation includes inserting a picture in the content summary. Before displaying the editing result of the content summary, the method also includes: in response to a third instruction to select a playback screen from the media resource, switching from the editing page of the content summary to the playback page; in response to a selection operation of a target screen on the playback page, inserting a picture associated with the target screen into the content summary.
[0020] Inserting the playback screen of the media resource as an image into the content summary can improve the quality and readability of the content summary, thereby improving the user experience of the summary extraction technology.
[0021] In some implementations, before inserting the picture associated with the target screen into the content summary, the method further includes: generating the picture associated with the target screen in response to a second editing operation on the target screen.
[0022] By providing the ability to edit the target screen, the pictures inserted into the content summary can be made more in line with the user's expectations, which not only helps to improve the quality of the content summary, but also helps to improve the user's interactive experience.
[0023] In some implementations, before displaying the editing result of the content summary, the method further includes: in response to a fourth instruction triggering an editing page of the content summary, switching from the play page to the editing page.
[0024] Editing the content summary on an independent editing page can make the editing of the content summary more convenient and the editing process more free.
[0025] In some implementations, the method further includes: in response to a copy operation on the content summary, copying the content summary; and / or, in response to a copy operation on the editing result, copying the editing result.
[0026] Introducing the ability to copy content summaries or their editing results can make it easier for users to apply content summaries to other purposes and improve the user experience of summary extraction technology.
[0027] In some implementations, the method further includes: in response to a download operation on the content summary, downloading the content summary; and / or, in response to a download operation on the editing result, downloading the editing result.
[0028] By supporting the downloading of content summaries or their editing results, it is convenient for users to learn or use content summaries, thereby improving the user experience of summary extraction technology.
[0029] In some implementations, the media resource includes multiple content segments, and the displaying of the content summary in the display area of the content summary in response to detecting the first instruction includes: in response to detecting the first instruction, displaying at least one of the following in the display area of the content summary: text content corresponding to each of the multiple content segments; playback screens corresponding to each of the multiple content segments; playback times corresponding to each of the multiple content segments.
[0030] In some implementations, the display time of the first page element is determined based on the interaction data of the media resource.
[0031] Dynamically displaying the first page element based on the interactive data can make the display timing of the first page element more in line with the user's expectations, thereby improving the user's interactive experience.
[0032] In some implementations, the display time is selected from at least one playback time of the media resource, and the interactive data of the media resource includes at least one of the number of likes, the number of comments, the number of reposts, the number of favorites, and the number of screenshots corresponding to the at least one playback time.
[0033] In some implementations, the content summary is generated based on artificial intelligence technology.
[0034] In a second aspect, a device for processing media resources is provided, comprising: a monitoring unit, configured to monitor a first instruction and a first editing operation, wherein the first instruction is used to display a content summary of the media resource, and the first editing operation is an editing operation for the content summary; a display unit, configured to play the media resource on a playback page, and display the content summary in response to the first instruction; and display the editing result of the content summary in response to the first editing operation.
[0035] According to a third aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method described in the first aspect or any one of the implementations of the first aspect is implemented.
[0036] In a fourth aspect, an electronic device is provided, comprising: one or more processors; and a memory associated with the one or more processors, the memory being used to store program instructions, and the program instructions, when read and executed by the one or more processors, execute the method described in the first aspect or any one of the implementation methods of the first aspect.
[0037] According to a fifth aspect, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the method according to the first aspect or any one of the implementations of the first aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the drawings described below are only some embodiments of the present application, and for those of ordinary skill in the art, other drawings can also be obtained based on these drawings.
[0039] Figure 1 A system architecture diagram applicable to the embodiments of the present application.
[0040] Figure 2 This is an example diagram of how to trigger the summary extraction technology for media resources.
[0041] Figure 3 An example graph showing a content summary of a media resource.
[0042] Figure 4 A schematic flowchart of a method for processing media resources provided in an embodiment of the present application.
[0043] Figure 5 An example diagram of the content summary provided for an embodiment of the present application.
[0044] Figure 6 This is an example diagram of an editing page for a content summary provided in an embodiment of the present application.
[0045] Figure 7 This is an example diagram of the playback screen selection process provided in an embodiment of the present application.
[0046] Figure 8 This is an example diagram of the editing page of the playback screen provided in an embodiment of the present application.
[0047] Fig. 9 This is an example diagram of the editing process of the playback screen provided in an embodiment of the present application.
[0048] Fig.10 This is an example diagram of the editing results of the content summary provided in an embodiment of the present application.
[0049] Fig.11 This is an example diagram of the picture editing results of the content summary provided in an embodiment of the present application.
[0050] Fig.12 An example diagram of a playback page provided in an embodiment of the present application.
[0051] Fig.13 Another example diagram of the playback page provided in an embodiment of the present application.
[0052] Fig.14A This is an example diagram of the editing page of the playback screen provided in an embodiment of the present application.
[0053] Fig. 14B This is another example diagram of the editing page of the playback screen provided in an embodiment of the present application.
[0054] Fig. 14C This is an example diagram of a media resource comment area provided in an embodiment of the present application.
[0055] Fig.15 A schematic block diagram of an apparatus for processing media resources provided in an embodiment of the present application.
[0056] Fig.16 A schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0057] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0058] In order to facilitate understanding of the embodiments of the present application, a system architecture to which the embodiments of the present application can be applied is first described by way of example. Figure 1 An exemplary system architecture to which the embodiments of the present application can be applied is shown. Figure 1 As shown, the system architecture may include: a terminal device 110 and a server 120. The terminal device 110 may be connected to the server 120 via a wireless network or a wired network. It should be understood that Figure 1 The number of terminal devices 110 and servers 120 in the embodiment is only for illustration. According to the implementation requirements, the system architecture based on the embodiment of the present application can have any number of terminal devices 110 and servers 120.
[0059] The terminal device 110 may include, but is not limited to, a smart mobile terminal, a wearable device, a personal computer (PC), a smart home device, etc. Among them, the smart mobile terminal may include, for example, a mobile phone, a tablet computer, a laptop computer, a personal digital assistant (PDA), an Internet car terminal, etc. Wearable devices may include, for example, smart watches, smart glasses, smart bracelets, virtual reality (VR) devices, augmented reality (AR) devices, mixed reality devices (i.e., devices that can support virtual reality and augmented reality), etc. Smart home devices may include, for example, a smart TV, a smart refrigerator with a display screen, etc.
[0060] The terminal device 110 may be provided with a client 112. The client 112 involved in the embodiment of the present application may be an application (APP), a small program, or a web program running through a browser, etc. running on the terminal device. The client 112 may interact with the server 120 through a network, request and obtain media resources from the server 120, and play the media resources on the display interface of the client 112.
[0061] The server 120 may be a platform that provides media resource playback services. The server 120 may be a single server, a server group consisting of multiple servers, or a cloud server. A cloud server, also known as a cloud computing server or cloud host, is a host product in a cloud computing service system that solves the defects of difficult management and weak service scalability in traditional physical hosts and virtual private servers (VPS) services.
[0062] The server 120 may use streaming to send the media resource to the client 112, and the client 112 plays the media resource while downloading the media stream. Alternatively, the server 120 may use progressive sending, that is, sending the media resource to the client 112, and the client 112 plays the media resource after downloading the entire media resource. In addition, the server 120 may also use other methods to transmit the media resource to the client 112, for example, the server 120 may provide the media resource based on a content delivery network (CDN) and transmit it to the client 112.
[0063] In the process of playing media resources, in order to improve the user's information acquisition efficiency, the media resources can be refined to generate a content summary of the media resources. The extraction of the content summary of the media resource can be implemented based on the summary extraction technology. The summary extraction technology can be implemented based on artificial intelligence (AI) technology. Figure 2 and Figure 3 Introducing AI-based summary extraction technology.
[0064] See also Figure 2 After logging into the media player client, suppose the user browses to a video that introduces how to eat hairy crabs. The user is very interested in how to eat hairy crabs and hopes to quickly learn how to eat hairy crabs through this video. However, in addition to introducing how to eat hairy crabs, the video also introduces how to identify the quality of hairy crabs, how to clean hairy crabs, how to choose appropriate tableware, how to clean food residues, and other content, resulting in a long video. The user may not have the patience to watch the entire video. In this case, the user can click Figure 2 The "AI Refinement" icon in the lower left corner, then see Figure 3 , the client displays a panel 32 at the bottom of the playback page, which displays a content summary extracted from the video based on AI technology, namely, the steps of eating hairy crabs. Through the content summary, the user can quickly understand the main steps of eating hairy crabs, thereby helping the user improve the efficiency of information acquisition.
[0065] After obtaining the content summary of the media resource, the user sometimes wants to edit the content summary to form a personalized content summary according to his own wishes. For example, the user may think that the description of some text content in the content summary is not accurate enough and hopes to correct the text content. For another example, the user may think that the text content in the content summary is too brief and hopes to add some content to make the information in the content summary more comprehensive. For another example, in order to facilitate the understanding of the content summary, the user may want to insert representative pictures into the content summary for auxiliary explanation. However, at present, after the content summary is extracted based on the summary extraction technology, the form of the content summary is fixed and the user cannot edit it. In other words, users can only passively accept the content summary extracted by the summary extraction technology, resulting in a poor user experience of this technology.
[0066] In response to the above problems, the embodiments of the present application introduce the ability to edit content summaries of media resources, so that users can form personalized content summaries according to their own wishes, thereby improving the user experience of summary extraction technology.
[0067] For ease of understanding, the following Figure 4 , the embodiments of the present application are illustrated in more detail.
[0068] Figure 4 A schematic flowchart of a method for processing media resources provided in an embodiment of the present application. Figure 4 The method may be executed by a terminal device, which may be Figure 1 As a more specific example, Figure 4 The method may be executed by a client installed on the terminal device, and the client may be a client supporting the media playback service. For example, the client may be an APP, a small program, or a web program running through a browser on the terminal device. Figure 4 Each step in is described in detail.
[0069] See also Figure 4, in step S410 to step S420, the playback instructions of the media resources are monitored; in response to the monitoring of the playback instructions, the media resources are played on the playback page. The above-mentioned playback instructions can be playback instructions input by the user, or they can be playback instructions generated by the client itself. The media resources (also referred to as media data or media content) mentioned in the embodiment of the present application can be videos. The videos mentioned here can be long videos or short videos. The so-called distinction between long videos and short videos is mainly reflected in the length, content, production method, etc. of the video. Among them, the length of long videos is usually more than tens of minutes; the content is relatively complete and in-depth, and the content quality is relatively high; it usually requires professional photography, editing, sound effects and other teams to complete together, the production cycle is long, and more resources are required; for example, movies, TV series, documentaries, etc. are all long videos. The length of a short video is usually less than ten minutes or a few minutes; the content is usually brief and concise, mainly focusing on highlighting a certain highlight or quickly conveying information; the production is also relatively simple, often shot with a mobile phone or other portable device, and post-editing is relatively easy; short videos pay more attention to rapid production and rapid dissemination, emphasizing timeliness; for example, some funny videos, life record videos, advertising videos, short dramas, etc. are all short videos. In addition to videos, the media resources mentioned in the embodiments of the present application may also be other types of media resources, such as "image + audio". For example, the play page can play a fixed image (or a moving picture), and the anchor broadcasts a piece of content by playing audio.
[0070] In steps S430 to S440, during the playback of the media resource, a first instruction for the playback page is monitored, and the first instruction is used to trigger the display of the content summary of the media resource; in response to the monitoring of the first instruction, the content summary is displayed in the display area of the content summary. The first instruction mentioned here can be used to trigger the display interface to display the content summary. The first instruction may be an instruction generated by a triggering page element. For example, a specific page element may be displayed on the playback page, and the user may generate the first instruction by triggering the page element. Alternatively, the first instruction may also be an instruction triggered by a gesture. For example, the user may input a specific gesture (such as a double-click gesture) on the playback page, and the specific gesture is used to generate the first instruction. Alternatively, the first instruction may also be a voice-triggered instruction. For example, the user may call a voice assistant and generate the first instruction through the voice assistant.
[0071] The content summary of the media resource can be understood as the content formed after summarizing, refining or summarizing the media resource. The embodiment of the present application does not specifically limit the form of the content summary of the media resource. For example, the content summary can be text, pictures, videos, audio or a combination of at least two of the above.
[0072] As an example, the content summary of the media resource may include text. Taking a video as an example, the core content and / or key information expressed in the video may be extracted based on at least one of the video images, audio information, subtitles, etc. Then, the core content and / or key information may be converted into text and output, thereby forming a content summary of the video.
[0073] As another example, the content summary of a media resource may include both text and pictures. Still taking a video as an example, the core content and / or key information expressed in the video may be extracted based on at least one of the video images, audio information, subtitles, etc. Then, the core content and / or key information may be converted into a "text + picture" format for output. The pictures in the content summary may be key frames in the video, or other pictures generated based on key frames in the video.
[0074] The embodiment of the present application does not specifically limit the method for extracting the content summary. In some implementations, the content summary can be extracted from the media resource based on AI technology. Of course, in other implementations, the content summary can also be pre-generated manually.
[0075] There are many display areas for content summaries. For example, Figure 5 As shown, the play page can be reduced and displayed at the top of the display interface, and then the content summary can be displayed at the bottom of the play page. For another example, you can switch from the play page of the media resource to a new page, and display the content summary of the media resource on the new page.
[0076] The content summary of a media resource may be a complete piece of content for the entire media resource. Alternatively, a media resource may include multiple content segments (the content segments in the media resource may be intelligently identified by AI technology, or may be directly divided according to time periods), and the content summary of the media resource may include the content summary corresponding to each of the multiple content segments. For example, the content summary of a media resource may include at least one of the following: the text content corresponding to each of the multiple content segments, the playback screen corresponding to each of the multiple content segments (which may be the first playback screen (first frame) of each of the multiple content segments, or the most representative playback screen of the multiple content segments (which may be intelligently selected by AI technology)), and the playback time corresponding to each of the multiple content segments (which may be the playback start time corresponding to each of the multiple content segments, or the "playback start time + playback end time" corresponding to each of the multiple content segments).
[0077] Below Figure 5 As an example, the format of the content summary corresponding to multiple content fragments is explained. Figure 5Based on AI technology, the video of eating hairy crabs can be intelligently divided into two content segments: the first content segment is "Step 1: Eat crab legs", and the second content segment is "Step 2: Eat crab roe". Figure 5 It can be seen that the content summary of the first content segment includes text content 52a, and the content summary of the second content segment includes text content 52b. In addition, the content summary of the first content segment includes the corresponding playback time 54a of the content segment (indicating that the start playback time of the first content segment is 0 minutes and 0 seconds of the video), and the content summary of the second content segment includes the corresponding playback time 54b of the content segment (indicating that the start playback time of the second content segment is 2 minutes and 15 seconds of the video). In addition, the content summaries corresponding to different content segments may also include one or more representative playback screens ( Figure 5 not shown).
[0078] Continue to see Figure 4 In steps S450-S460, during the display of the content summary, a first editing operation on the content summary is monitored, and the first editing operation is used to edit the content summary; in response to the first editing operation, the editing result of the content summary is displayed in the display area of the content summary. The embodiment of the present application does not specifically limit the type of the first editing operation, and the first editing operation can be any type of editing operation that can change the content or form of expression of the content summary. Several possible examples of the first editing operation are given below.
[0079] As an example, the first editing operation may include an editing operation of the text content in the content summary. For example, the first editing operation may be used to add, delete, or change the text content in the content summary. Before performing the editing operation of the text content, the content summary may be triggered to enter a text editing state. For example, a user may trigger the content summary to enter a text editing state by triggering a specific page element. For another example, a user may trigger the content summary to enter a text editing state by a certain type of operation gesture (such as long pressing or double-clicking the text content in the content summary).
[0080] As another example, the first editing operation may include inserting a sticker in the content summary. For example, the user may select a suitable sticker from a sticker library and then insert the selected sticker into a specific location in the content summary. Before inserting the sticker, the display interface may be triggered to display a sticker panel. There may be multiple ways to trigger the display interface to display a sticker panel. For example, the user may trigger a specific page element, thereby triggering the display interface to display a sticker panel. For another example, the user may trigger the display interface to display a sticker panel through a voice command.
[0081] As another example, the first editing operation may include inserting a picture in the content summary. For example, a user may select a suitable playback screen from the playback screen of the media resource, and insert the selected playback screen into a specific location of the content summary. As another example, a user may select a picture that is compatible with the media resource from the user's local picture library, and then insert the selected picture into a specific location of the content summary. Before inserting the picture, a picture selection page may be triggered first (if a picture is selected from the playback page, the picture selection page may be the playback page). There may be multiple ways to trigger the picture selection page. For example, a user may trigger a specific page element to trigger the picture selection page. As another example, a user may trigger the picture selection page through a specific gesture.
[0082] according to Figure 4 As can be seen from the description, the embodiment of the present application supports editing operations on content summaries, so that users can form personalized content summaries according to their own wishes, thereby improving the user experience of summary extraction technology.
[0083] It should be noted that after displaying the content summary of the media resource, the user can directly perform the first editing operation mentioned above on the content summary. Alternatively, after displaying the content summary of the media resource, the user can also first switch from the playback page to the editing page of the content summary, and then perform the first editing operation mentioned above on the editing page. After switching from the playback page to the editing page of the content summary, the content summary can be edited on a new editing page, which will be more convenient to operate. The switch from the playback page to the editing page of the content summary can be triggered by an instruction. The instruction can be an instruction generated by triggering a page element, an instruction generated by a specific gesture, or a voice instruction.
[0084] For example, see Figure 5 The content summary panel includes an edit control 56a and an edit control 56b, wherein the edit control 56a corresponds to the first content segment (eating crab legs) in the content summary, and the edit control 56b corresponds to the second content segment (eating crab roe) in the content summary. By clicking the edit control 56a, you can enter the edit page of the content summary of the first content segment, such as Figure 6 As shown ( Figure 6 The picture at the reference mark 61 in the figure may be a picture automatically brought into the content summary after entering the editing page, and the picture may be, for example, the first frame of the first content segment). The user may Figure 6 The editing page shown performs the first editing operation mentioned above on the content summary of the first content segment. For example, if the user wants to adjust the text content, he can directly add, delete, modify, etc. the text in the text area 62. For another example, if the user wants to insert a sticker into the content summary, he can click icon 63 to call up the sticker panel ( Figure 6 Then, the user can select a suitable sticker (such as an emoji sticker) from the sticker panel to insert the selected sticker into the content summary.
[0085] As mentioned above, the first editing operation may include inserting a picture in the content summary. There may be multiple ways to insert a picture. For example, assuming that the media resource is a video file, the user may select a picture (i.e., a video frame) from the video file. Exemplarily, in response to a second instruction to select a picture from a video file, at least one video frame in the video file is displayed, and the at least one video frame corresponds to a wonderful moment in the video file (such as a highly praised moment, a highly clicked moment, a highly forwarded moment, and a highly collected moment, and the wonderful moment may be determined by collecting user data); in response to a selection operation of a target video frame in at least one video frame, the target video frame is inserted into the content summary. If a user wishes to insert a picture in a video file, then he or she may very well wish to insert a screen or picture corresponding to a wonderful moment. Based on this, the embodiment of the present application directly presents the video frame corresponding to the wonderful moment in the video file to the user, thereby improving the user's image search efficiency and enhancing the user experience.
[0086] In other implementations, in response to a second instruction to select a picture from a video file, a search box is displayed, the search box is used to input picture search information; in response to receiving the picture search information, at least one video frame in the video file related to the picture search information is displayed. Taking a video file introducing how to eat crabs as an example, a user may want to find pictures related to crab legs or crab shells and add them to the content summary to enhance the readability of the content summary. Taking this into account, the embodiment of the present application introduces a picture search function based on picture search information, which can facilitate users to directly locate relevant pictures and simplify user operations.
[0087] As mentioned above, the first editing operation may include inserting a picture into the content summary. The picture inserted into the content summary may be a picture associated with the playback screen of the media resource. For example, the picture may be a playback screen of the media resource. As another example, the picture may be a picture obtained after editing a playback screen of the media resource. In order to be able to select a suitable playback screen, you can first switch from the editing page of the content summary to the playback page, and then select the target screen on the playback page. After detecting that the user has selected the target screen, the target screen can be directly inserted into the content summary. Alternatively, after the user has selected the target screen, you can first perform an editing operation on the target screen, and then insert the edited target screen into the content summary.
[0088] The "switching from the content summary editing page to the playback page" mentioned above can be triggered by an instruction. There are many ways to generate the instruction. For example, the instruction can be an instruction generated by triggering a page element. For another example, the instruction can be an instruction generated by performing a specific gesture. For another example, the instruction can be a voice-triggered instruction.
[0089] The "editing operation of the target screen" mentioned above can be triggered by an instruction. There are many ways to generate the instruction. For example, the instruction can be an instruction generated by triggering a page element. For another example, the instruction can be an instruction generated by performing a specific gesture. For another example, the instruction can be a voice-triggered instruction.
[0090] Combine the following Figures 6 to 10 , which provides more detailed examples of how to insert images in content summaries.
[0091] Figure 6 The editing page of the content summary of the first content segment (eating crab legs) is shown. A frame selection control 64 is displayed on the editing page. If the user wants to insert one or some playback scenes in the first content segment into the first content segment, the user can click the frame selection control 64. In response to the click operation of the frame selection control 64, the user can select the playback scene from the first content segment. Figure 6 The edit page shown returns to the playback page. Figure 7 On the playback page, users can drag the progress bar to display different playback screens. Then, users can click on a specific playback screen to select the desired playback screen. Or, Figure 7 As shown, some playback pictures in the first content segment can also be displayed at the bottom of the playback page for the user to select. The playback pictures displayed on the playback page can be playback pictures selected at time intervals, or can be wonderful playback pictures selected according to the interactive data of the playback pictures (such as playback pictures with high number of likes, collections, and reposts). Assuming that the user selects the target picture 72 on the playback page, he can return to Figure 6 The target screen 72 is inserted into the content summary (it can be inserted below the text part of the content summary or at any position of the content summary). Alternatively, after the user selects the target screen 72, if the user wishes to edit the target screen 72, the user can click the edit control 74. In response to the click operation of the edit control 74, Figure 8As shown in FIG. 8 , the target screen editing page 82 can be entered. On the editing page 82, the user can use various editing tools provided in the editing page 82 to edit the target screen. Assuming that the user is interested in the local screen area 84 in the target screen 72, the user can use the cropping tool 86 in the editing tool to crop the local screen area 84 from the target screen 72. The cropping result is shown in FIG. Fig. 9 After completing the cropping operation, the user can click Fig. 9 The control 92 in the figure is used to insert the partial screen area 84 into the first content segment, forming a Fig.10 The editing results are shown.
[0092] As mentioned above, the first editing operation may include text editing operations, picture inserting operations, sticker inserting operations, and the like. In other implementations, the first editing operation may also include picture editing of the content summary. That is to say, the content summary can be used as a picture, and operations such as circle drawing, blurring, and cropping can be performed on the surface of the content summary. Since the content summary may contain both text and pictures, the picture editing of the content summary is more free. In addition, through this editing method, users can easily establish an association between text and pictures through tools such as brushes, thereby improving the readability of the content summary. Before performing a picture editing operation on the content summary, the content summary can be triggered to enter the picture editing state. For example, the user can trigger a specific page element, thereby triggering the content summary to enter the picture editing state. For another example, the user can trigger the content summary to enter the picture editing state through a certain type of operation gesture.
[0093] by Fig.10 and Fig.11 For example, the image editing method of the content summary is explained in more detail. Fig.10 If the user wishes to edit the content summary, the user may click on the edit control 104. In response to the click operation on the edit control 104, the user may select a variety of editing tools (not shown in the figure, which may be used with Figure 8 or Fig. 9 Edit the content summary like a picture (using the same editing tools as shown). For example, see Fig.11 , users can freely circle and draw the content summary, thus establishing the relationship between the picture and the text (see Fig.11 The position shown by reference numeral 112 in the figure).
[0094] In some implementations, if the user wants to save the content summary locally, a download operation can be performed on the content summary to download the content summary. The download operation can be implemented by triggering a page element. Figure 6For example, the user can click on the page element 65 to download the content summary. In addition to implementing the download operation based on the page element, the user can also implement the download operation of the content summary through a specific gesture, for example, the user can double-click or long press the content summary to download the content summary. Alternatively, the user can also download the content summary through voice commands.
[0095] Similarly, if the user wants to save the edited result of the content summary locally, the user can perform a download operation on the edited result to download the edited result. The download operation can be implemented by triggering a page element. Fig.10 For example, the user can click on the page element 102 to download the edited result of the content summary. In addition to implementing the download operation based on the page element, the user can also implement the download operation of the content summary through a specific gesture, for example, the user can double-click or long-press the edited result to download the edited result. Alternatively, the user can also download the edited result through voice commands.
[0096] In some implementations, the user can perform a copy operation on the content summary to copy the content summary (the complete content summary can be copied, or only part of the content in the content summary can be copied). The copy operation can be triggered by a specific gesture. For example, the user can long press the content summary or the content in the content summary that he is interested in, so as to copy the corresponding content. Of course, in addition to specific gestures, the above-mentioned copy operation can also be implemented by means of page elements or voice commands. Similarly, in some implementations, the user can perform a copy operation on the editing result of the content summary to copy the editing result (the complete editing result can be copied, or only part of the content in the editing result can be copied). The copy operation can be triggered by a specific gesture. For example, the user can long press the editing result or the content in the editing result that he is interested in, so as to copy the corresponding content. Of course, in addition to specific gestures, the above-mentioned copy operation can also be implemented by means of page elements or voice-triggered instructions.
[0097] In step S420, the display of the content summary can be triggered by a first instruction, which can be an instruction generated by triggering a specific page element on the playback page (for ease of description, the page element is referred to as the first page element hereinafter). The embodiment of the present application does not specifically limit the display position of the first page element on the playback page.
[0098] In some implementations, the first page element may be displayed independently on the play page. Fig.12 , the first page element 122 can be displayed at the top of the play page. The user can trigger the display of the content summary by triggering (such as clicking) the first page element 122.
[0099] In some implementations, the display positions of the first page element and another page element (hereinafter referred to as the second page element) on the play page can be designed so that the display positions of the first page element and the second page element on the play page overlap (can be completely overlapped or partially overlapped). This page design method can reduce the number of page elements displayed simultaneously on the play page, thereby keeping the play page concise and avoiding the play page being blocked by too many page elements. For example, see Fig.13 , the first page element 132 can be displayed in the lower right corner of the playback page, and the display position of the first page element 132 is also the display position of the music turntable (corresponding to the second page element mentioned above). In the case where the display positions of the first page element and the second page element overlap, in order to avoid the user from triggering the page element by mistake, the first page element and the second page element can be displayed alternately (or in time) on the playback page (for example, at a first moment, the first page element is displayed on the playback page, and at a second moment different from the first moment, the second page element is displayed on the playback page). In other words, the first page element can be dynamically displayed on the playback page. It should be noted here that even if the first page element is displayed independently (not overlapping with the display position of other page elements), the first page element can also be displayed in a dynamic display manner, thereby simplifying the page design.
[0100] In the case where the first page element adopts a dynamic display scheme, the embodiment of the present application does not specifically limit the display time of the first page element. For example, the first page element can be displayed on the playback page once every fixed time (such as 15 seconds or 30 seconds). Alternatively, in some implementations, the display time of the first page element can be determined based on the interactive data of the media resource. For example, the interactive data corresponding to at least one playback moment of the media resource can be collected (such as at least one of the following interactive data: the number of likes, the number of favorites, the number of comments, the number of reposts, and the number of favorites). Then, the display time of the first page element can be determined based on the interactive data corresponding to the at least one playback moment. The display time of the first page element can be a high interactive moment (or wonderful moment) in the at least one playback moment. For example, the display moment is a high like moment, a high comment moment, a high repost moment, a high collection moment, or a high screenshot moment in the at least one moment. Determining the display time of the first page element based on the interactive data of the media resource, and setting the display time of the first page element to a high-interaction moment in the playback time of the media resource can make the display time of the first page element more in line with the user's expectations, thereby improving the user's viewing experience (because at a high-interaction moment, the user is more likely to want to obtain a content summary of the media resource (such as wanting to save the content summary)). In addition, displaying the first page element at a high-interaction moment can also increase the click-through rate (CTR) of the first page element, thereby promoting the use of the first page element.
[0101] As mentioned above in step S420, the first instruction is used to trigger the display interface to display the content summary of the media resource. In some implementations, the first instruction can also be used to instruct: extract the content summary of the media resource. In other words, the first instruction can simultaneously implement two functions: extract and display the content summary of the media resource. Once the user triggers the first instruction, the client first extracts the content summary of the media resource and then presents the content summary in the display interface.
[0102] As mentioned above, the first editing operation may include at least one of the following: editing the text content in the content summary, inserting stickers in the content summary, inserting pictures in the content summary, and editing pictures of the content summary. The above operations are all substantive editing operations for the content summary (i.e., operations for the purpose of modifying the information in the content summary). In addition to the above-mentioned editing operations, the first editing operation mentioned in the embodiment of the present application may also include other types of editing operations (i.e., editing operations that are not for the purpose of modifying the information in the content summary). For example, the first editing operation may include a confirmation operation for the content summary (which may refer to an unedited content summary, or a content summary edited by other editing operations, i.e., the editing result mentioned above). For another example, the first editing operation may include a publishing operation for the content summary (which may refer to an unedited content summary, or a content summary edited by other editing operations, i.e., the editing result mentioned above). The following is a detailed example of the implementation method of the publishing operation.
[0103] For example, in the process of displaying a content summary or an editing result, a publishing operation for the content summary or the editing result can be monitored; in response to monitoring a publishing operation for the content summary or the editing result, the content summary or the editing result is published. The publishing operation mentioned here can be triggered by a page element (publishing control), for example. When the user triggers the page element, the content summary or the editing result can be published. Of course, the publishing operation can also be triggered by a voice command or a gesture.
[0104] Furthermore, in some implementations, in response to monitoring a publishing operation for a content summary or an editing result, multiple interface elements may be first displayed in the display area of the content summary. The multiple interface elements correspond to multiple publishing methods one by one. In response to a target interface element among the multiple interface elements being triggered, the content summary or the editing result is published according to the publishing method corresponding to the target interface element.
[0105] For example, in response to the target interface element being triggered, and the target interface element is used to indicate that the content summary or editing result is to be published in the comment area, the content summary or editing result is published in the comment area (such as published at the last position or middle position of the comment area).
[0106] For another example, in response to a target interface element being triggered, and the target interface element is used to indicate that the method of publishing the content summary or editing result is to publish and pin it in the comment area, the content summary or editing result is published in the comment area, and the content summary or editing result is displayed at the top of the comment area.
[0107] For another example, in response to a target interface element being triggered, and the target interface element is used to indicate that the content summary or editing result is to be published as a new video, a new video is published, and the new video includes the content summary or the editing result.
[0108] by FIG. 14A to FIG. 14C For example, see Fig.14A , a publishing control 142 is displayed on the editing page of the content summary. The publishing control 142 can be used to publish the edited content summary. The operation triggered by the publishing control 142 can also belong to one of the first editing operations mentioned above. Fig. 14B , the following two options are displayed: "Pin Comment" and "New Video". If the user clicks the "Pin Comment" option, see Fig. 14C , the content summary can be displayed in the top area 146 of the comment area 144 of the media resource. If the user clicks the "new video" option, the edited content summary can be published as the user's work.
[0109] Combination of the above Figure 1 to Figure 1 4, describes the method embodiment of the present application in detail, and the following is combined with Figure 15 to Figure 16 , describes the device embodiment of the present application in detail. It should be understood that the description of the method embodiment corresponds to the description of the device embodiment, so the parts not described in detail can refer to the previous method embodiment.
[0110] Fig.15 A schematic diagram of the structure of a device for browsing pages provided in an embodiment of the present application. The device 1500 includes a monitoring unit 1510 and a display unit 1520. The monitoring unit 1510 is configured to monitor the playback instruction of the media resource; the display unit 1520 is configured to play the media resource on the playback page in response to the playback instruction being monitored. The monitoring unit 1510 is further configured to monitor a first instruction for the playback page during the playback of the media resource, the first instruction being used to trigger the display of the content summary of the media resource; the display unit 1520 is further configured to display the content summary in the display area of the content summary in response to the first instruction being monitored. The monitoring unit 1510 is further configured to monitor a first editing operation for the content summary during the display of the content summary, the first editing operation being used to edit the content summary; the display unit 1520 is further configured to display the editing result of the content summary in the display area of the content summary in response to the first editing operation.
[0111] In some implementations, the monitoring unit 1510 is further configured to: monitor a publishing operation on the content summary or the editing result during display of the content summary or the editing result; and the processing unit is configured to publish the content summary or the editing result in response to monitoring the publishing operation on the content summary or the editing result.
[0112] In some implementations, the processing unit is further configured to: in response to monitoring a publishing operation for the content summary or the editing result, display multiple interface elements in the display area of the content summary, and the multiple interface elements correspond one-to-one to multiple publishing methods; in response to a target interface element among the multiple interface elements being triggered, publish the content summary or the editing result according to the publishing method corresponding to the target interface element.
[0113] In some implementations, the processing unit is further configured to: in response to the target interface element being triggered and the target interface element being used to indicate that the content summary or the editing result is to be published in a comment area, publish the content summary or the editing result in the comment area; or, in response to the target interface element being triggered and the target interface element being used to indicate that the content summary or the editing result is to be published and pinned in the comment area, publish the content summary or the editing result in the comment area and display the content summary or the editing result at the top of the comment area; or, in response to the target interface element being triggered and the target interface element being used to indicate that the content summary or the editing result is to be published as a new video, publish a new video, and the new video contains the content summary or the editing result.
[0114] In some implementations, the first instruction includes at least one of the following: an instruction to trigger a first page element, an instruction triggered by a gesture, and an instruction triggered by a voice.
[0115] In some implementations, the display unit 1520 is further configured to: at a first moment, display the first page element on the playback page; at a second moment, display the second page element on the playback page, and the display positions of the first page element and the second page element in the playback page overlap; wherein the first moment and the second moment are different.
[0116] In some implementations, the display unit 1520 is further configured to: in response to detecting the first editing operation, and the first editing operation includes editing the text content in the content summary, display the editing result of the text content in the display area of the content summary; or, in response to detecting the first editing operation, and the first editing operation includes inserting stickers in the content summary, display the stickers in the display area of the content summary; or, in response to detecting the first editing operation, and the first editing operation includes inserting a picture in the content summary, display the picture in the display area of the content summary; or, in response to detecting the first editing operation, and the first editing operation includes performing picture editing on the content summary, display the picture editing result of the content summary in the display area of the content summary.
[0117] In some implementations, the first editing operation includes inserting a picture in the content summary, the media resource is a video file, and the display unit 1520 is further configured to: in response to a second instruction to select a picture from the video file, display at least one video frame in the video file, the at least one video frame corresponding to a wonderful moment in the video file; in response to a selection operation of a target video frame in the at least one video frame, insert the target video frame into the content summary.
[0118] In some implementations, the first editing operation includes inserting a picture in the content summary, the media resource is a video file, and the display unit 1520 is further configured to: in response to a second instruction to select a picture from the video file, display a search box for entering picture search information; in response to receiving the picture search information, display at least one video frame in the video file related to the picture search information.
[0119] In some implementations, the first editing operation includes inserting a picture in the content summary. Before displaying the editing result of the content summary, the display unit 1520 is further configured: in response to a third instruction to select a playback screen from the media resource, switch from the editing page of the content summary to the playback page; in response to a selection operation of a target screen on the playback page, insert a picture associated with the target screen into the content summary.
[0120] In some implementations, the display unit 1520 is further configured to: generate a picture associated with the target screen in response to a second editing operation on the target screen.
[0121] In some implementations, the display unit 1520 is further configured to: in response to a fourth instruction triggering an edit page of the content summary, switch from the play page to the edit page.
[0122] In some implementations, the device further includes a processing unit configured to: in response to a copy operation on the content summary, copy the content summary; and / or in response to a copy operation on the editing result, copy the editing result.
[0123] In some implementations, the device further includes a processing unit configured to: download the content summary in response to a download operation on the content summary; and / or download the editing result in response to a download operation on the editing result.
[0124] In some implementations, the media resource includes a plurality of content segments.
[0125] In response to detecting the first instruction, the display unit 1520 is further configured to: in response to detecting the first instruction, display at least one of the following in the display area of the content summary: text content corresponding to each of the multiple content segments; playback screens corresponding to each of the multiple content segments; playback times corresponding to each of the multiple content segments.
[0126] In some implementations, the display time of the first page element is determined based on the interaction data of the media resource.
[0127] In some implementations, the display time is selected from at least one playback time of the media resource, and the interactive data of the media resource includes at least one of the number of likes, the number of comments, the number of reposts, the number of favorites, and the number of screenshots corresponding to the at least one playback time.
[0128] In some implementations, the content summary is generated based on AI technology.
[0129] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The system and device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.
[0130] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0131] In addition, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any one of the methods in the aforementioned method embodiments are implemented.
[0132] The present application also provides an electronic device, including:
[0133] one or more processors; and
[0134] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute any of the methods described in the foregoing method embodiments.
[0135] The present application also provides a computer program product, including a computer program, which implements any one of the methods described in the aforementioned method embodiments when executed by a processor.
[0136] in, Fig.16The architecture of the electronic device is shown as an example, which may include a processor 1610, a video display adapter 1611, a disk drive 1612, an input / output interface 1613, a network interface 1614, and a memory 1620. The processor 1610, the video display adapter 1611, the disk drive 1612, the input / output interface 1613, the network interface 1614, and the memory 1620 may be communicatively connected via a communication bus 1630.
[0137] Among them, the processor 1610 can be implemented by a general-purpose central processing unit (CPU), a microprocessor, an application specific integrated circuit (ASIC), or one or more integrated circuits, etc., to execute relevant programs to implement the technical solutions provided in this application.
[0138] The memory 1620 can be implemented in the form of a read-only memory (ROM), a random access memory (RAM), a static storage device, a dynamic storage device, etc. The memory 1620 can store an operating system 1621 for controlling the operation of the electronic device 1600, and a basic input output system (BIOS) 1622 for controlling the low-level operation of the electronic device 1600. In addition, a web browser 1623, a data storage management system 1624, and a media file playback processing device 1625, etc. can also be stored. The above-mentioned media file playback processing device 1625 can be an application program that specifically implements the aforementioned steps in the embodiment of the present application. In short, when the technical solution provided by the present application is implemented by software or firmware, the relevant program code is stored in the memory 1620 and is called and executed by the processor 1610.
[0139] The input / output interface 1613 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0140] The network interface 1614 is used to connect to a communication module (not shown in the figure) to realize communication interaction between the device and other devices. The communication module can realize communication through wired means (such as universal serial bus (USB), network cable, etc.) or wireless means (such as mobile network, wireless fidelity (WIFI), Bluetooth, etc.).
[0141] The bus 1630 comprises a pathway for transmitting information between the various components of the device (eg, the processor 1610 , the video display adapter 1611 , the disk drive 1612 , the input / output interface 1613 , the network interface 1614 , and the memory 1620 ).
[0142] It should be noted that, although the above device only shows a processor 1610, a video display adapter 1611, a disk drive 1612, an input / output interface 1613, a network interface 1614, a memory 1620, a bus 1630, etc., in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include components necessary for implementing the solution of the present application, and does not necessarily include all the components shown in the figure.
[0143] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly contributed to the prior art in the form of a computer program product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.
[0144] The technical solution provided by the present application is described in detail above. The principle and implementation method of the present application are described in detail using specific examples. The description of the above embodiments is only used to help understand the method and core idea of the present application. At the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as limiting the present application.
Claims
1. A method for processing media resources, characterized in that: include: Monitor playback instructions of media resources; In response to detecting the play instruction, playing the media resource on the play page; During the playing of the media resource, monitoring a first instruction for the playing page, wherein the first instruction is used to trigger the display of a content summary of the media resource; In response to detecting the first instruction, displaying the content summary in the display area of the content summary; During the process of displaying the content summary, monitoring a first editing operation on the content summary, where the first editing operation is used to edit the content summary; In response to the first editing operation, an editing result of the content summary is displayed in a display area of the content summary.
2. The method according to claim 1, characterized in that: The method further comprises: During the process of displaying the content summary or the editing result, monitoring a publishing operation on the content summary or the editing result; In response to detecting a publishing operation for the content summary or the editing result, the content summary or the editing result is published.
3. The method according to claim 2, characterized in that In response to monitoring a publishing operation for the content summary or the editing result, publishing the content summary or the editing result includes: In response to monitoring a publishing operation for the content summary or the editing result, displaying a plurality of interface elements in a display area of the content summary, wherein the plurality of interface elements correspond to a plurality of publishing modes one by one; In response to a target interface element among the multiple interface elements being triggered, the content summary or the editing result is published in a publishing manner corresponding to the target interface element.
4. The method according to claim 3, characterized in that In response to a target interface element among the multiple interface elements being triggered, publishing the content summary or the editing result according to a publishing method corresponding to the target interface element includes: In response to the target interface element being triggered, and the target interface element is used to indicate that the content summary or the editing result is to be published in a comment area, the content summary or the editing result is published in the comment area; or, In response to the target interface element being triggered, and the target interface element is used to indicate that the publishing method of the content summary or the editing result is to publish and pin it in the comment area, the content summary or the editing result is published in the comment area, and the content summary or the editing result is pinned and displayed in the comment area; or, In response to the target interface element being triggered, and the target interface element being used to indicate that the content summary or the editing result is to be published as a new video, a new video is published, and the new video includes the content summary or the editing result.
5. The method according to claim 1, characterized in that The first instruction includes at least one of the following: an instruction for triggering a first page element, an instruction triggered by a gesture, and an instruction triggered by a voice.
6. The method according to claim 5, characterized in that The method further comprises: At a first moment, displaying the first page element on the playback page; At a second moment, displaying a second page element on the playback page, wherein the first page element and the second page element overlap in display positions on the playback page; The first moment and the second moment are different.
7. The method according to any one of claims 1 to 6, characterized in that The step of displaying the editing result of the content summary in the display area of the content summary in response to the first editing operation includes: In response to detecting the first editing operation, and the first editing operation includes editing the text content in the content summary, displaying the editing result of the text content in the display area of the content summary; or, In response to detecting the first editing operation, and the first editing operation includes inserting a sticker into the content summary, displaying the sticker in a display area of the content summary; or, In response to detecting the first editing operation, and the first editing operation includes inserting a picture into the content summary, displaying the picture in a display area of the content summary; or, In response to detecting the first editing operation, and the first editing operation including performing image editing on the content summary, displaying the image editing result of the content summary in the display area of the content summary.
8. The method according to claim 7, characterized in that The first editing operation includes inserting a picture into the content summary, the media resource is a video file, Before displaying the editing result of the content summary, the method further includes: In response to a second instruction to select a picture from the video file, display at least one video frame in the video file, the at least one video frame corresponding to a wonderful moment in the video file; In response to a selection operation of a target video frame in the at least one video frame, the target video frame is inserted into the content summary.
9. The method according to claim 7, characterized in that: The first editing operation includes inserting a picture into the content summary, the media resource is a video file, Before displaying the editing result of the content summary, the method further includes: In response to a second instruction to select a picture from the video file, displaying a search box for inputting picture search information; In response to receiving the picture search information, at least one video frame in the video file associated with the picture search information is displayed.
10. The method according to claim 7, characterized in that The first editing operation includes inserting a picture into the content summary. Before displaying the editing result of the content summary, the method further includes: In response to a third instruction to select a playback screen from the media resource, switching from the editing page of the content summary to the playback page; In response to a selection operation of a target picture on the play page, a picture associated with the target picture is inserted into the content summary.
11. The method according to claim 10, characterized in that Before inserting the picture associated with the target screen into the content summary, the method further includes: In response to a second editing operation on the target screen, a picture associated with the target screen is generated.
12. The method according to any one of claims 1 to 6, characterized in that Before displaying the editing result of the content summary, the method further includes: In response to a fourth instruction triggering an edit page of the content summary, switching from the play page to the edit page.
13. The method according to any one of claims 1 to 6, characterized in that The method further comprises: In response to a copy operation on the content summary, copying the content summary; and / or, In response to a copy operation on the edited result, the edited result is copied.
14. The method according to any one of claims 1 to 6, characterized in that The method further comprises: In response to a download operation for the content summary, downloading the content summary; and / or In response to a download operation for the edited result, the edited result is downloaded.
15. The method according to any one of claims 1 to 6, characterized in that The media resource includes a plurality of content segments, and in response to detecting the first instruction, displaying the content summary in the display area of the content summary includes: In response to detecting the first instruction, at least one of the following is displayed in the display area of the content summary: The text content corresponding to each of the multiple content fragments; The playback screens corresponding to the multiple content clips respectively; The play time corresponding to each of the multiple content segments.
16. The method according to claim 5 or 6, characterized in that: The display time of the first page element is determined based on the interactive data of the media resource.
17. The method according to claim 16, characterized in that The display time is selected from at least one playback time of the media resource, and the interactive data of the media resource includes at least one of the number of likes, the number of comments, the number of reposts, the number of favorites, and the number of screenshots corresponding to the at least one playback time.
18. The method according to any one of claims 1 to 6, characterized in that The content summary is generated based on artificial intelligence technology.
19. A device for processing media resources, characterized in that: include: A monitoring unit is configured to monitor a first instruction and a first editing operation, wherein the first instruction is used to display a content summary of a media resource, and the first editing operation is an editing operation for the content summary; The display unit is configured to play the media resource on the playback page, display the content summary in response to the first instruction, and display the editing result of the content summary in response to the first editing operation.
20. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 18 is implemented.
21. An electronic device, characterized in that: include: one or more processors; as well as A memory associated with the one or more processors, the memory being used to store program instructions, wherein when the one or more processors read and execute the program instructions, the method according to any one of claims 1 to 18 is executed.
22. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 18 is implemented.
Citation Information
Patent Citations
Method for processing video and system thereof
CN101207807A
Method and device for generating video in text mode, equipment and medium
CN112153475A