Method and device for processing video file

Abstract

The invention relates to the technical field of internet application, and provides a video file processing method and device, electronic equipment and a computer program product. The main technical scheme comprises the steps of monitoring a playing instruction of a video file; in response to the monitored playing instruction, playing a video file on a display interface; in the playing process of the video file, a first event for the video file is monitored, the first event is used for triggering the display interface to display at least one video frame, and the at least one video frame is used for representing a wonderful fragment in the video file; and in response to the monitored first event, displaying a video frame display page on the display interface, the video frame display page being used for displaying the at least one video frame. Therefore, the user can quickly obtain the wonderful fragments in the video file, and the efficiency of video consumption is improved.

Description

Technical Field

[0001] The present application relates to the field of Internet application technology, and in particular to a method and device for processing video files. Background Art

[0002] Video consumption refers to the process in which users pay time and / or financial costs to enjoy video content and services in order to meet their audio-visual needs for learning, entertainment, and life. With the diversification of video consumption platforms and the enrichment of video consumption content, how to improve the efficiency of video consumption has become a problem that needs to be solved. Summary of the invention

[0003] The present application provides a method and device for processing video files, which can improve the efficiency of video consumption.

[0004] In a first aspect, a method for processing a video file is provided, the method comprising: monitoring a playback instruction of a video file; in response to monitoring the playback instruction, playing the video file on a display interface; during the playback of the video file, monitoring a first event for the video file, the first event being used to trigger the display interface to display at least one video frame, the at least one video frame being used to represent a highlight segment in the video file; in response to monitoring the first event, displaying a video frame display page on the display interface, the video frame display page being used to display the at least one video frame.

[0005] Through the first event, at least one video frame representing a wonderful segment in the video file is triggered to be displayed on the display interface, so that the user can quickly obtain the wonderful segment in the video file, thereby improving the efficiency of video consumption.

[0006] In one implementation, the first event includes: an event triggered by a two-finger pinch gesture, an event triggered by a first interface element, or an event triggered by a voice command.

[0007] Using a two-finger pinch gesture, a first interface element, or an event triggered by a voice command to display at least one video frame in a video file on a display interface is simple and quick, and is more in line with user operating habits.

[0008] In one implementation, the method further includes: during playback of the video file, in response to detecting a pause operation on the video file, displaying the at least one video frame on the display interface.

[0009] Considering that when a user pauses playing a video file, he may need to browse the highlights. At this time, at least one video frame representing the highlights can be displayed on the display interface for the user to select, thereby improving the user experience.

[0010] In one implementation, the position of the at least one video frame on the video playback progress bar is located near the position corresponding to the pause moment on the video playback progress bar.

[0011] When a user pauses playing a video file at a certain moment, it may mean that there are highlights that the user wants to view near that moment. At this time, showing the user at least one video frame of the highlights near the pause moment on the display interface can better meet the user's expectations.

[0012] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, in response to monitoring a second event on the display interface, displaying a comment page for the video file on the display interface, wherein a target video frame among the at least one video frame is inserted into the comment page; and in response to monitoring a publishing operation on the comment page, publishing comment content with the target video frame as a comment attachment.

[0013] Through the second event, the target video frame is quickly inserted into the comment page as a comment attachment, which can quickly provide users with a comment page with the target video frame inserted, so as to enrich users' comment operations, improve comment efficiency, and enhance users' interactive experience.

[0014] In one implementation, the second event includes: an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between at least one video frame, or an event triggered by a second interface element.

[0015] By clicking on a target video frame in at least one video frame on the display interface, sliding between at least one video frame, or triggering an operation by a second interface element, the target video frame can be quickly inserted into the comment page as a comment attachment. On the one hand, the operation is simple and fast, and on the other hand, it also conforms to the user's cognition and operating habits of operating gestures.

[0016] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, in response to monitoring a third event on the display interface, displaying a co-shooting page for a co-shooting operation on the display interface, the co-shooting page using a target video frame among the at least one video frame as a co-shooting background; in response to monitoring a recording operation for a co-shooting video, recording a co-shooting video using the shown target video frame as a co-shooting background; and in response to monitoring a publishing operation for the co-shooting video, publishing the co-shooting video.

[0017] Through the third event, a page for co-shooting operations with the target video frame as the background is displayed, which can quickly provide the user with a page for co-shooting operations, thereby providing the user with a creative basis with the target video frame as the background, allowing the user to perform co-shooting operations based on the target video frame, thereby improving the user's interactive experience and simplifying the user's operation.

[0018] In one implementation, the third event includes: an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between at least one video frame, or an event triggered by a third interface element.

[0019] By clicking on a target video frame in at least one video frame on the display interface, sliding between at least one video frame, or triggering an operation with a third interface element, a page for co-shooting operations with the target video frame as the background is provided to the user. On the one hand, the operation is simple and fast, and on the other hand, it also conforms to the user's cognition and operating habits of operating gestures.

[0020] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, in response to detecting a fourth event, playing a highlight segment corresponding to a target video frame in the at least one video frame on the display interface.

[0021] Through the fourth event, the highlight clip corresponding to the target video frame in the video file is played, so that the user can not only quickly obtain the various highlight clips in the video file, but also jump to play the highlight clips of interest, further improving the efficiency of video consumption.

[0022] In one implementation, the fourth event includes: an event triggered by a click operation on the target video frame, and / or an event triggered by a sliding operation between the at least one video frame.

[0023] By clicking on a target video frame in at least one video frame on the display interface and / or sliding between at least one video frame, the playback of a highlight clip corresponding to the target video frame in the video file is achieved. On the one hand, the operation is simple and fast, and on the other hand, it also conforms to the user's cognition and operating habits of operating gestures.

[0024] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, in response to monitoring a fifth event, displaying an editing page on the display interface, wherein the editing page is used to edit a target video frame in the at least one video frame.

[0025] Through the fifth event, the editing page is called up, allowing the user to edit the target video frame in at least one video frame in the editing page, meeting the diverse needs of users and improving the user's participation and creative experience in the video consumption process.

[0026] In one implementation, the method further includes: when displaying at least one video frame in the video file on the display interface, displaying an interface element for triggering the fifth event.

[0027] The target video frame is edited by using the interface element for triggering the fifth event, which more intuitively displays the editing function for the video frame and enables the user to enter the editing page simply and quickly.

[0028] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, in response to detecting a sixth event, triggering at least one of the following operations for a target video frame in the at least one video frame: downloading, liking, commenting, sharing, and collecting.

[0029] Through the sixth event, operations such as downloading, liking, commenting, sharing, and collecting of a target video frame in at least one video frame are realized, thereby meeting the diverse needs of users and improving the user's participation and interactive experience in the video consumption process.

[0030] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, displaying an interface element for triggering the sixth event.

[0031] Through the interface elements used to trigger the sixth event, operations such as downloading, liking, commenting, sharing, and collecting the target video frame are realized, which more intuitively displays the interactive functions for the video frame and enables users to perform interactive operations simply and quickly.

[0032] In one implementation, when the at least one video frame is displayed on the display interface, the at least one video frame is arranged on the display interface in the order in which the at least one video frame appears in the video file.

[0033] Arranging at least one video frame on the display interface based on the order in which at least one video frame appears in the video file is conducive to maintaining the continuity of the video content, so that the user can more intuitively determine the order of at least one video frame. In addition, from a technical point of view, arranging at least one video frame on the display interface based on the order in which at least one video frame appears in the video file is a relatively simple and direct implementation method, which does not require complex algorithms or logic to handle the arrangement of video frames and is easier to implement on multiple playback platforms and devices.

[0034] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, in response to detecting a seventh event, switching between the at least one video frames.

[0035] Through the seventh event, switching between at least one video frame is achieved, and the user can easily view the previous video frame or the next video frame without leaving the current interface, thereby maintaining the continuity and smoothness of browsing.

[0036] In one implementation, the seventh event includes: an event triggered by a single-finger sliding gesture in a preset direction, or an event triggered by a fourth interface element.

[0037] By triggering an event of a single-finger sliding gesture in a preset direction or an event triggered by a fourth interface element, switching between at least one video frame is achieved, allowing users to simply and efficiently flip through video frames, improving the efficiency of browsing wonderful clips in video files, and increasing the interactivity between users and video frame content, allowing users to actively participate in the browsing process, thereby improving the interactive experience.

[0038] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, displaying a fifth interface element, wherein the fifth interface element is used to indicate a position of the at least one video frame in a video playback progress bar.

[0039] When at least one video frame is displayed on the display interface, a fifth interface element is displayed to indicate the position of at least one video frame in the video playback progress bar, which helps the user understand the playback progress of the video frames on the display interface and enhances the user's interactive experience.

[0040] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, displaying a sixth interface element, wherein the sixth interface element is used to indicate interactive information corresponding to the at least one video frame.

[0041] When at least one video frame is displayed on the display interface, a sixth interface element is displayed to indicate interactive information corresponding to at least one video frame, which helps users understand the popularity of the video frames on the display interface and enhances the user's interactive experience.

[0042] In one implementation, the interactive information includes at least one of the following: a highly-liked moment, the number of likes corresponding to the highly-liked moment, a highly-reviewed moment, the number of comments corresponding to the highly-reviewed moment, a highly-shared moment, the number of shares corresponding to the highly-shared moment, a highly-replayed moment, and the number of replays corresponding to the highly-replayed moment.

[0043] It is simpler and more intuitive to use highly liked moments, highly rated moments, moments that should be shared, highly replayed moments, or their corresponding numbers to reflect the popularity of video frames.

[0044] In one implementation, the method further includes: when displaying the at least one video frame on the display interface, in response to detecting an eighth event, highlighting a target video frame among the at least one video frame on the display interface.

[0045] Through the eighth event, highlighting the target video frame in at least one video frame on the display interface can provide users with more intuitive visual feedback, help users confirm that they have accurately selected the target video frame of interest, and improve the accuracy and efficiency of operations.

[0046] In one implementation, the eighth event includes: the target video frame is located in the middle of the display interface, or slides to the target video frame based on a sliding operation between the at least one video frame.

[0047] The target video frame is selected by locating the target video frame in the middle of the display interface or sliding to the target video frame based on a sliding operation between at least one video frame, thereby highlighting the target video frame. This is simple and quick on the one hand, and more in line with the user's cognition and operating habits of operating gestures on the other hand.

[0048] In one implementation, the highlight segments in the video file are determined based on user interaction data, and the interaction data includes at least one of the following: the number of likes obtained, the number of comments obtained, the number of times shared, and the number of times replayed.

[0049] At least one video frame representing a wonderful segment in the video file is extracted and displayed based on the interactive data, so that the wonderful images presented to the user may better meet the user's expectations.

[0050] In one implementation, the method further includes: during the playback of the video file, in response to monitoring a pause operation on the video file and / or an operation of dragging a video playback progress bar, playing a guide animation on the display interface, wherein the guide animation is used to prompt the content and / or function of the first event.

[0051] By playing the guide screen, the user can be promptly prompted with the content and / or function of the first event, so that the user knows that the video frame representing the highlight segment can be quickly obtained through the first event without dragging the video playback progress bar.

[0052] In a second aspect, a device for processing video files is provided, the device comprising: an event monitoring unit, configured to monitor a playback instruction of a video file; an interface display unit, configured to: in response to monitoring the playback instruction, play the video file on a display interface; the event monitoring unit is further configured to: during the playback of the video file, monitor a first event for the video file, the first event is used to trigger the display interface to display at least one video frame, the at least one video frame is used to represent a highlight in the video file; the interface display unit is further configured to: in response to monitoring the first event, display a video frame display page on the display interface, the video frame display page is used to display the at least one video frame.

[0053] According to a third aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the steps of the method described in the first aspect or any one of the implementations of the first aspect are implemented.

[0054] In a fourth aspect, an electronic device is provided, comprising: one or more processors; and a memory associated with the one or more processors, the memory being used to store program instructions, and the program instructions, when read and executed by the one or more processors, execute the method described in the first aspect or any one of the implementations of the first aspect.

[0055] According to a fifth aspect, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the steps of the method described in the first aspect or any one of the implementations of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the drawings described below are only some embodiments of the present application, and for those of ordinary skill in the art, other drawings can also be obtained based on these drawings.

[0057] Figure 1 is a system architecture diagram applicable to the embodiments of the present application.

[0058] Figure 2 A flowchart of a method for playing a video file provided in an embodiment of the present application.

[0059] Figure 3 Schematic diagram of various stages of the display interface provided in an embodiment of the present application.

[0060] Figure 4 A schematic diagram of various stages of a display interface provided in yet another embodiment of the present application.

[0061] Figure 5 A schematic diagram of various stages of a display interface provided in yet another embodiment of the present application.

[0062] Figure 6 A schematic diagram of a comment page provided for an embodiment of the present application.

[0063] Figure 7 A schematic block diagram of a device for processing video files provided in an embodiment of the present application.

[0064] Figure 8 A schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0065] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field belong to the scope of protection of this application.

[0066] In order to facilitate understanding of the embodiments of the present application, the system architecture to which the embodiments of the present application can be applied is first described by way of example. Figure 1 The system architecture that can be applied to the embodiments of the present application is shown. Figure 1 As shown, the system architecture may include a terminal device 110 and a server 120. The terminal device 110 may be connected to the server 120 via a wireless network or a wired network. It should be understood that Figure 1 The number of terminal devices 110 and servers 120 in the embodiment is only for illustration. According to the implementation requirements, the system architecture based on the embodiment of the present application can have any number of terminal devices 110 and servers 120.

[0067] The terminal device 110 includes but is not limited to smart mobile terminals, wearable devices, personal computers (PCs), smart home devices, etc. Among them, smart mobile devices may include mobile phones, tablet computers, laptops, personal digital assistants (PDAs), Internet car terminals, etc. Wearable devices may include smart watches, smart glasses, smart bracelets, virtual reality (VR) devices, augmented reality (AR) devices, mixed reality devices (i.e., devices that can support virtual reality and augmented reality), etc. Smart home devices may include smart TVs, smart refrigerators with display screens, etc.

[0068] The terminal device 110 may be provided with a client 112. The client 112 involved in the embodiment of the present application may be an application (APP), a small program, or a web program running through a browser, etc. running on the terminal device. The client 112 may interact with the server 120 through a network, request and obtain media resources from the server 120, and play the media resources on the display interface of the client 112.

[0069] The server 120 may be a platform that provides media resource playback services. The server 120 may be a single server, a server group consisting of multiple servers, or a cloud server. A cloud server, also known as a cloud computing server or cloud host, is a host product in a cloud computing service system to solve the defects of difficult management and weak service scalability in traditional physical hosts and virtual private servers (VPS) services.

[0070] The server 120 may use a streaming transmission method to send the media resource to the client 112, and the client 112 plays the media resource while downloading the media stream. Alternatively, the server 120 may also use a progressive transmission method, that is, send the media resource to the client 112, and the client 112 plays it after downloading the entire media resource. In addition, the server 120 may also use other methods to transmit the media resource to the client 112. For example, the server 120 may provide the media resource based on a content delivery network (CDN) and transmit it to the client 112.

[0071] In some implementations, the client 112 may request a video file from the server, and the server transmits the video file to the client 112 , and the client 112 uses the method provided in the embodiment of the present application to play the video file.

[0072] In the existing playback methods, if users want to obtain highlights from video files for viewing, they usually use the method of dragging the video playback progress bar. On the one hand, the efficiency of finding highlights by dragging the progress bar is very low, and users may need to drag the video playback progress bar several times in a row to find the highlights in the video file; on the other hand, due to the positioning accuracy of the video playback progress bar, it is very easy to miss the highlights by dragging the progress bar. These will lead to low efficiency of video consumption and affect user experience.

[0073] In view of the above problems, an embodiment of the present application provides a method for processing a video file, which displays a highlight in a video file to a user by displaying at least one video frame used to represent a highlight in the video file on a display interface in response to detecting a first event. Since the extraction and display of at least one video frame used to represent a highlight in the video file is triggered by the first event, the highlight can be displayed to the user without the user repeatedly dragging the video playback progress bar, thereby improving the efficiency of video consumption.

[0074] The above-mentioned highlights usually refer to the parts of the video content that are eye-catching, interesting, touching, educational, or have other significant values. These clips can often arouse the audience's emotional resonance, provide a unique visual experience, or convey important information. For example, the highlights in a narrative video can usually be the climax of the story, such as the action scenes in the movie, the scenes of emotional outbursts, or the moments that reveal key information; for example, in comedy or emotional videos, clips that can make the audience laugh or be moved are often regarded as highlights; for example, some videos are famous for their exquisite pictures, unique visual effects or shocking visual effects, and the highlights in these videos are usually those with the strongest visual impact; for example, in sports, dance, magic or other skill display videos, highlights may be moments that show superb skills or break through limits; for example, in education or popular science videos, highlights may be those parts that explain complex concepts in a simple way and vividly show experimental results; for example, sometimes, the highlights in a video are not necessarily planned in advance, but some unexpected and unexpected moments, which can often bring surprises and joy to the audience. In some scenarios, the wonderful clips in the video files may also be called high-energy clips, highlight moments, high-interaction frames, high-quality clips, etc.

[0075] The above-mentioned video consumption refers to, for example, users watching various types of video files, such as movies, TV series, short videos, documentaries, variety shows, etc., through terminal devices such as televisions, computers, and mobile phones to meet their own entertainment, learning, social and other needs. This behavior not only involves watching content, but also includes operations such as evaluating, sharing, and interacting with the content of video files. The efficiency of video consumption, in a broad sense, refers to the amount of information, entertainment experience, or learning effect obtained by users per unit time in the process of watching video files. It reflects the degree to which the content of the video file satisfies the user's needs and the input-output ratio of the user in the process of watching video files.

[0076] It can be understood that in the embodiment of the present application, the at least one video frame triggered by the first event for display may be a video frame used to represent a highlight clip, or a video frame used to represent other types of video clips, for example, video frames for certain specific character clips or scene clips, video frames that meet certain conditions, or video frames with certain common features, etc. In the following, the technical solution of the embodiment of the present application is described only by taking the at least one video frame used to represent a highlight clip in a video file as an example.

[0077] The following, combined Figures 2 to 4 , a method for processing video files provided in an embodiment of the present application is described in detail.

[0078] As an example, Figure 2 A schematic flow chart of a method for processing a video file according to an embodiment of the present application is shown. Figure 2 The method 200 shown may be executed by a terminal device, for example, which may be Figure 1 As a more specific example, Figure 2 The method 200 shown can be executed by a client installed on a terminal device (for example, an application (APP), a mini-program, or a web program running through a browser that supports playing media resources). Figure 2 Each step in is described in detail.

[0079] See also Figure 2 , in step 210 to step 220, the playback instruction of the video file is monitored; in response to the playback instruction being monitored, the video file is played on the display interface. Among them, the video file can refer to a long video or a short video. The distinction between long videos and short videos is mainly reflected in the length, content, and production method of the video. Among them, long videos are usually more than tens of minutes in length; the content is relatively complete and in-depth, and the content quality is relatively high; it usually requires professional photography, editing, sound effects and other teams to complete, the production cycle is long, and more resources are required; for example, movies, TV series, documentaries, etc. are all long videos. Short videos are usually within a dozen minutes or a few minutes; the content is usually relatively short and concise, mainly focusing on highlighting a highlight or quickly conveying information; the production is also relatively simple, often shot with a mobile phone or other portable device, and post-editing is relatively easy; short videos pay more attention to rapid production and rapid dissemination, and emphasize timeliness; for example, some funny videos, life record videos, advertising videos, short dramas, etc. are all short videos.

[0080] In addition, the video file can be a horizontal screen video or a vertical screen video. The so-called horizontal screen video refers to a video whose playback screen width is greater than the height, which is more in line with the natural field of human eyes and more suitable for viewing on wide-screen devices (for example, TVs, computers). A vertical screen video is a video whose playback screen height is greater than the width, which is more suitable for viewing on narrow-screen devices (for example, smartphones, tablets), and is more popular in the fields of social media, short videos, etc. Below, the technical solutions of the embodiments of the present application are described by taking vertical screen videos as an example.

[0081] Continue to see Figure 2 In step 230 to step 240, during the playback of the video file, a first event for the video file is monitored, and the first event is used to trigger the display interface to display at least one video frame used to represent a highlight in the video file; in response to the first event being monitored, a video frame display page is displayed on the display interface, and the video frame display page is used to display the at least one video frame. The video frame display page can be, for example, the entire or partial area of ​​the display interface.

[0082] Triggering the display of at least one video frame in the video file for representing the highlight clip on the display interface through the first event is equivalent to extracting and displaying at least one video frame in the video file for representing the highlight clip, and aggregating them together for display to the user, so that the user can quickly obtain the highlight clip in the video file without having to drag the progress bar to find the highlight clip, which not only improves the efficiency of adjusting the video progress, but also makes it less likely to miss the highlight clip, thereby improving the efficiency of video consumption and enhancing the user experience.

[0083] The highlights in a video file can be associated with the user's interactive data, or in other words, the highlights in a video file can be determined based on the user's interactive data. The interactive data includes at least one of the following: the number of likes obtained, the number of comments obtained, the number of times shared, and the number of times viewed again. At the moment of a certain video frame during playback, if more likes or comments are obtained from users, or the video frame is shared and viewed again more times, then the video frame may include more exciting pictures, surprising moments, or outstanding visual effects, etc., and thus be more popular and loved by users. Therefore, it can be considered that the video frame includes a wonderful moment. At least one video frame used to represent the highlights in the video file is extracted and displayed based on the interactive data, so that the wonderful pictures presented to the user may be more in line with the user's expectations.

[0084] The first event includes, for example, an event triggered by a first gesture (for example, a two-finger pinch gesture), an event triggered by a first interface element, or an event triggered by a voice command (for example, a voice command of "enter the highlight segment"). Among them, the two-finger pinch gesture can be a two-finger zoom-in gesture or a two-finger zoom-out gesture. Using the two-finger pinch gesture, the first interface element, or the event triggered by the voice command to display at least one video frame in the video file on the display interface is simple and fast on the one hand, and more in line with the user's operating habits on the other hand. Preferably, since the focus of the embodiment of the present application is on the display of video frames representing highlight segments in video files, when the first event is triggered by a two-finger pinch gesture (for example, a two-finger zoom-out gesture) for the video file, it is more in line with the process of "aggregation" of the video frames, can give the user a sense of "aggregation", and the user experience is better.

[0085] As an example, see Figure 3 (a) and Figure 4 In (a), if the user uses a two-finger zoom gesture on the display interface, the user can enter the following Figure 3 (b) and Figure 4 The video frame display page shown in (b) in the figure displays at least one video frame for representing a highlight in the video file, for example, video frame A, video frame B, and video frame C. In this way, when the user wants to obtain a highlight in the video file, there is no need to drag the video playback progress bar. By using a two-finger pinch gesture on the display interface, the highlight in the video file can be quickly retrieved for browsing.

[0086] In some implementations, during the playback of a video file, in response to detecting a pause operation on the video file, the at least one video frame may be displayed on the display interface. For example, during the playback of a video file, if the user pauses the video file, he may need to browse the highlights. At this time, at least one video frame representing the highlights may be displayed on the display interface for the user to select, thereby improving the user experience. Figure 3 (a) and Figure 4 The two-finger pinching shown in (a) is replaced with an operation for triggering the pause of the video file, such as a click on the video file or a click on a page element related to the pause on the display interface. When the pause operation on the display interface is detected, the following is entered: Figure 3 (b) and Figure 4 The video frame display page shown in (b) in the figure is displayed, thereby displaying at least one video frame for representing the highlight segment on the video frame display page.

[0087] Among them, the at least one video frame displayed in response to monitoring the pause operation, its position on the video playback progress bar is located near the position corresponding to the pause time on the video playback progress bar. The user pauses the playback of the video file at a certain moment, which may indicate that there are highlights that the user wants to browse near the moment. At this time, at least one video frame of the highlights located near the pause time is displayed to the user on the display interface, which can better meet the user's expectations. Here, the position of the at least one video frame on the video playback progress bar is located near the pause time, for example, it can mean that the time difference between the position of the at least one video frame on the video playback progress bar and the position corresponding to the pause time on the video playback progress bar is less than a preset value, or it means that the at least one video frame is the at least one video frame in the video file that is closest to the position on the video playback progress bar and the corresponding position on the video playback progress bar at the pause time, including video frames located before and / or after the pause time.

[0088] The embodiment of the present application does not limit the arrangement of at least one video frame used to represent a highlight segment on the display interface. As an example, Figure 3 and Figure 4 In the example, at least one video frame is displayed in a left-to-right arrangement. In addition, other arrangements can be used for display. For example, for a horizontal screen video, at least one video frame can be displayed in a top-to-bottom arrangement; for another example, an array arrangement can be used to display more video frames to the user at the same time on the display interface.

[0089] In some implementations, when displaying at least one video frame on a display interface, the at least one video frame is arranged on the display interface in the order in which it appears in the video file. This is conducive to maintaining the continuity of the video content, so that the user can more intuitively determine the order of at least one video frame. In addition, from a technical point of view, arranging at least one video frame on a display interface based on the order in which at least one video frame appears in a video file is a relatively simple and direct implementation method, which does not require complex algorithms or logic to handle the arrangement of video frames, and is easier to implement on a variety of playback platforms and devices.

[0090] Continue to see Figure 3 (b) and Figure 4 In (b), among the video frames A, B and C displayed on the display interface, the playback time corresponding to the video frame A is before the playback time corresponding to the video frame B, and the playback time corresponding to the video frame B is before the playback time corresponding to the video frame C, that is, the order of appearance in the video file is video frame A, video frame B and video frame C, therefore, video frame A, video frame B and video frame C are arranged from left to right on the display interface according to the order of appearance in the video file.

[0091] In some implementations, when displaying at least one video frame used to represent a highlight in a video file on a display interface, other interface elements associated with the at least one video frame, such as a fifth interface element and / or a sixth interface element, may also be displayed. The fifth interface element is used to indicate the position of the at least one video frame in the video playback progress bar. The sixth interface element is used to indicate the interactive information corresponding to the at least one video frame. In this way, while browsing at least one video frame used to represent a highlight, the user can also obtain other information about the video frame, such as the position of the video frame in the video playback progress bar and / or the popularity of the video frame, thereby providing the user with a better interactive experience.

[0092] The above-mentioned interactive information includes, for example, at least one of the following: highly praised moments, the number of praises corresponding to highly praised moments, highly rated moments, the number of comments corresponding to highly rated moments, highly shared moments, the number of shares corresponding to highly shared moments, highly replayed moments, and the number of replays corresponding to highly replayed moments. As important indicators for measuring the quality and influence of video file content, likes, comments, shares, and replays all reflect the popularity and user recognition of video file content, and the playback moments corresponding to more popular highlights in video files often receive more likes, comments, shares, or trigger more replays. Therefore, it is simpler and more intuitive to reflect the popularity of video frames through highly praised moments, highly rated moments, highly shared moments, and highly replayed moments, or their respective corresponding numbers. Among them, highly praised moments, highly rated moments, highly shared moments, and highly replayed moments can also be replaced by other identical or similar expressions, such as highly praised frames, highly rated frames, highly shared frames, and highly replayed frames.

[0093] Continue to see Figure 3 (b) and Figure 4 (b) in the figure, enter the Figure 3 (b) and Figure 4 When the display interface shown in (b) in FIG. 1 is displayed, at least one video frame in the video file for representing a highlight clip is displayed on the display interface, for example, including video frame A, video frame B and video frame C, and a video playback progress bar is also displayed on the display interface, and the relative positions of video frame A, video frame B and video frame C are marked on the progress bar. It can be seen from the video playback progress bar that in the video file, the playback time corresponding to video frame A is before the playback time corresponding to video frame B, and the playback time corresponding to video frame B is before the playback time corresponding to video frame C, that is, the order of appearance in the video file is video frame A, video frame B and video frame C. In addition, Figure 3 (b) and Figure 4The display interface shown in (b) also displays the interactive information corresponding to video frame A, video frame B, and video frame C, wherein the interactive information corresponding to video frame A and video frame C is "highly rated moments", and the interactive information corresponding to video frame B is "highly praised moments". As an example, Figure 3 (b) and Figure 4 (b) in the figure also shows the number of likes corresponding to the video frame B located in the middle of the display interface (for example, "432 users think this moment is very good").

[0094] Among them, as an example, Figure 3 (b) and Figure 4 In the display interface shown in (b), the sixth interface element for indicating interactive information is located below video frame A, video frame B, and video frame C, and the fifth interface element for indicating the progress of video frame playback is located below the sixth interface element. In addition, the navigation components at the bottom of the display interface (such as "Home", "Featured", "Message", "Me", etc.) are still retained and may not be hidden due to the triggering of the first event (for example, a two-finger pinch gesture). Of course, in order to adapt to the screen size of different terminal devices, the positions of at least one video frame, the fifth interface element, and the sixth interface element displayed in the display interface can also be adjusted accordingly.

[0095] In addition, in some cases, when playing a video file on the display interface, some users may not know that they can trigger the aggregate display of the highlights through the first event, or how to execute the first event. In view of this, in some implementations, when playing a video file on the display interface, in response to the preset trigger condition being met, a guide animation can be displayed on the display interface, and the guide animation is used to prompt the content and function of the first event. The embodiment of the present application does not limit the specific form of the guide animation, as long as it can prompt the content of the first event (for example, what the first event is like) and the function of the first event (for example, what function or effect can be achieved through the first event).

[0096] The above-mentioned preset trigger conditions may include but are not limited to the following:

[0097] The first trigger condition: the pause operation of the video file and / or the dragging of the video playback progress bar.

[0098] When the user pauses playing the video file or drags the video playback progress bar, it indicates that the user may need to browse the highlights. At this time, a guide animation can be played on the display interface to prompt the content and / or function of the first event in time, so that the user knows that there is no need to drag the video playback progress bar, but to quickly obtain the video frame representing the highlights through the first event.

[0099] The second trigger condition: the media file currently being played is the first video played after the client is cold started.

[0100] Client cold start refers to when the client is completely closed or the corresponding client process does not exist on the terminal device. When the user opens the client again, the cold start process needs to be triggered, that is, the client process is recreated, necessary resources are loaded, page rendering is performed, other functional modules are initialized, and configuration files are read. If the client has just started playing a video after a cold start, a boot animation can be played on the display interface to promptly remind the user of the content and function of the first event.

[0101] The third trigger condition: the time interval from the last time the boot animation was played meets the preset interval requirement.

[0102] If the boot animation has been played before, the user may forget to trigger the first event after a long time. Therefore, in an embodiment of the present application, the boot animation can be played to the user again if the time interval from the last time the boot animation was played meets the preset interval requirement, for example, more than 7 days.

[0103] The fourth trigger condition: the number of occurrences of the first event is less than or equal to a preset number threshold.

[0104] If the user hardly triggers the first event, for example, the first event occurs less than 2 times, it means that the user probably does not know how to use the first event or does not know the function of the first event. In this case, a guiding animation can be played on the display interface to promptly remind the user of the content and function of the first event.

[0105] It should be noted that the above-mentioned trigger conditions can be combined in any form to form a new trigger condition. For example, the trigger condition may be that the user drags the video playback progress bar, and the number of occurrences of the first event is less than or equal to a preset number threshold and the time interval from the last time the guide animation was played meets the preset interval requirement; for another example, the trigger condition may be that the media file currently being played is the first horizontal screen video played on the display interface after the client is cold started, and the number of occurrences of the first event is less than or equal to a preset number threshold, and the time interval from the last time the guide animation was played meets the preset interval requirement.

[0106] Furthermore, the total number of times the guide animation is played, the duration of the play, the conditions for canceling the play, the conditions for prohibiting the play, etc. can also be restricted for the user, so as to avoid the frequent or long-term play of the guide animation causing adverse effects on the normal viewing experience of the user. For example, the total number of times the guide animation is played is limited to 4 times, that is, the guide animation will not be played after it is displayed 4 times; for another example, if the guide animation is displayed on the display interface for a first preset duration, such as a limited play duration of 7 seconds, and the first event on the display interface is not detected, the guide animation will be canceled from being displayed on the display interface; for another example, if the user triggers the first event more than 3 times, it can be considered that the user has known the content and function of the first event, and the guide animation will be prohibited from being played subsequently.

[0107] In some implementations, when at least one video frame is displayed on the display interface, in response to detecting the seventh event, switching between at least one video frame can be performed. In this way, the user can easily view the previous video frame or the next video frame without leaving the current interface, thereby maintaining the continuity and fluency of browsing.

[0108] The seventh event, for example, includes an event triggered by a single-finger sliding gesture in a preset direction, or an event triggered by a fourth interface element. The preset direction may be the arrangement direction of at least one video frame. For example, if at least one video frame is arranged horizontally on the display interface, the single-finger sliding gesture may include a single-finger sliding gesture to the left and a single-finger sliding gesture to the right. The fourth interface element may be an arrow indicating a preset direction. For example, the fourth interface element may include an arrow indicating to the left and an arrow indicating to the right. By implementing an event triggered by a single-finger sliding gesture in a preset direction, or an event triggered by a fourth interface element, switching between at least one video frame can enable users to simply and efficiently flip through video frames, thereby improving the efficiency of browsing wonderful clips in video files, and increasing the interactivity between users and video frame content, so that users can actively participate in the browsing process, thereby improving the interactive experience.

[0109] Continue to see Figure 3 (b) and Figure 4 In (b), if the user slides left with one finger on the display interface, the following screen will be displayed: Figure 3 (c) and Figure 4 In the display interface shown in (c) of FIG, the position where video frame B was originally displayed on the display interface is now displayed as video frame C located after video frame B. Similarly, if the user uses a right-pointing single-finger sliding gesture on the display interface, the position where video frame B was originally displayed on the display interface will be displayed as video frame A located before video frame B.

[0110] In some implementations, when at least one video frame is displayed on the display interface, in response to monitoring the eighth event, a target video frame in at least one video frame may be highlighted on the display interface. The target video frame may be, for example, a video frame that the user is more interested in. The user may switch between different video frames in at least one video frame on the display interface through the aforementioned seventh event (e.g., an event triggered by a single-finger sliding gesture), and during the switching process of at least one video frame, select the target video frame that the user is more interested in through the eighth event, and the target video frame will be highlighted on the display interface. Highlighting the target video frame in at least one video frame on the display interface can provide users with more intuitive visual feedback, help users confirm that they have accurately selected the target video frame of interest, and improve the accuracy and efficiency of the operation.

[0111] The eighth event, for example, includes the target video frame being located in the middle of the display interface, or sliding to the target video frame based on a sliding operation between at least one video frame. For example, the eighth event may be sliding the target video frame to the middle of the display interface through a sliding operation. In this way, the selection of the target video frame is indicated, and the target video frame is highlighted. On the one hand, it is simple and quick, and on the other hand, it is more in line with the user's cognition and operating habits of the operating gesture.

[0112] Continue to see Figure 3 (c) and Figure 4 In (c), assuming that the target video frame is video frame C, the user can switch the video frame displayed on the display interface from video frame B to video frame C through a single-finger sliding gesture, or in other words, slide video frame C to the middle position of the display interface through a single-finger sliding gesture. At this time, video frame C will be highlighted in the display interface, for example, a border is displayed around video frame C to identify the selected video frame C, while no border is displayed around video frame B and video frame D. At the same time, video frame C can also be highlighted with a higher display brightness than video frame B and video frame D, or in other words, the display brightness of video frame B and video frame D can be reduced.

[0113] Apart from Figure 3 (c) and Figure 4 As shown in (c) of FIG. 1 , video frame C is highlighted by adding a border and increasing the brightness. Other methods can also be used to highlight video frame C. For example, video frame C is displayed in a larger screen size than video frame B and video frame D; for another example, other visual guide elements or text annotations other than the border are used to point to video frame C; for another example, a mask layer is added to video frame B and video frame D to make them blurred, transparent or completely invisible, thereby highlighting video frame C; and so on.

[0114] It should be noted that if the seventh event for triggering the video frame switching is a single-finger sliding gesture, the eighth event for triggering the video frame highlighting can also be regarded as being triggered by the release of the single-finger sliding gesture. For example, when the target video is switched to the middle position of the display interface by the single-finger sliding gesture, the single-finger sliding gesture is stopped and the single finger is removed from the display interface. When the single finger is removed from the display interface, the target video frame is triggered to be highlighted on the display interface.

[0115] Understandably, Figure 3 (a) and Figure 4 The display interface shown in (a) in FIG. 1 shows a playback page of a video file, and Figure 3 (b) and (c) in the above, and Figure 4 The display interface shown in (b) and (c) shows a filtering page for video frames. In response to the first event on the playback page, the client can cancel the playback page of the video file and display the filtering page for video frames, and through the seventh event on the filtering page (for example, an event triggered by a single-finger sliding gesture), switch and browse among at least one video frame, thereby filtering out the target video frame and highlighting it.

[0116] In other implementations, in response to detecting the first event, the client may also simultaneously display a video file playback page and a video frame filtering page to the user. Figure 5 In (a), in response to the first event on the playback page (e.g., an event triggered by a two-finger pinch gesture), enter Figure 5 The display interface shown in (b) in the figure, wherein the playback page is reduced in size and placed above the display interface, and a video frame filtering page pops up below the display interface, the filtering page for example including at least one video frame for representing a highlight clip, a fifth interface element for indicating the playback progress of the video frame, and a sixth interface element for indicating interactive information of the video frame.

[0117] The video content played on the video file playback page is linked to the video frame switching operation on the video frame filtering page. For example, when a video frame is switched to the middle position of the filtering page, the content played on the playback page is also switched to the highlight clip corresponding to the video frame. For example, see Figure 5 In (b) and (c), after the user switches video frame B to video frame C through a single-finger sliding gesture, the content played on the playback page will also switch from the highlight clip corresponding to video frame B to the highlight clip corresponding to video frame C.

[0118] In an embodiment of the present application, after the user selects a target video frame from at least one video frame used to represent a highlight segment in the above manner, other operations may be performed based on the target video frame. That is, the above method may also include, in response to monitoring a trigger event for a specific interactive operation, performing the specific interactive operation based on the target video frame. For example, the specific interactive operation may include jump play, edit, comment, co-shoot, or other interactive operations for the target video frame. These operations are described below.

[0119] The first operation: jump playback based on the target video frame.

[0120] In some implementations, when at least one video frame is displayed on the display interface, in response to the fourth event being detected, a highlight segment corresponding to a target video frame in the at least one video frame may be played on the display interface. That is, when at least one video frame is displayed on the display interface, in response to the fourth event being detected, the highlight segment corresponding to the target video frame may be jumped to for playback. In this way, while allowing the user to quickly obtain each highlight segment in the video file, the highlight segment that the user is interested in may be jumped to for playback, thereby further improving the efficiency of video consumption.

[0121] In the embodiment of the present application, the playing of the video file refers to converting the content of the video file into images, sounds, or a combination of the two that can be directly perceived by humans, and the jump play refers to jumping to a specific time point in the video to start playing the video file. For example, when the jump play is performed based on the target video frame, the specific time point can be the play time corresponding to the target video frame, or the start play time of the highlight clip corresponding to the target video frame, or a predetermined time associated with the target video frame, etc.

[0122] The fourth event includes, for example, an event triggered by a click operation on a target video frame and / or an event triggered by a sliding operation between at least one video frame. By clicking a target video frame in at least one video frame on the display interface and / or sliding between at least one video frame, the wonderful clip corresponding to the target video frame in the video file is played. On the one hand, the operation is simple and fast, and on the other hand, it also conforms to the user's cognition and operating habits in operating gestures.

[0123] Continue to see Figure 3 If the user wants to watch the highlights corresponding to video frame C, he can do so through Figure 3 The single-finger sliding gesture shown in (b) switches the video frame C to the middle position of the display interface, and Figure 3 As shown in (c) in the figure, click on the video frame C to enter Figure 3 In the display interface shown in (d), the display interface will start playing the highlight clip corresponding to the video frame C.

[0124] The second operation: editing the target video frame.

[0125] In some implementations, when at least one video frame is displayed on the display interface, in response to detecting the fifth event, an editing page may be displayed on the display interface. The editing page is used to edit a target video frame in the at least one video frame. The fifth event is used to retrieve the editing page, so that the user can edit the target video frame in the at least one video frame in the editing page, thereby meeting the diverse needs of users and improving the user's participation and creation experience in the video consumption process.

[0126] Here, the editing may include secondary creation (hereinafter referred to as secondary creation). Secondary creation refers to the creative process of reprocessing, editing, synthesizing or adapting video frames without changing the basic content of the original video frames. This process aims to create a video work with new meaning, new perspective or new expression by rearranging, combining, modifying or enhancing video frames.

[0127] The fifth event may be an event triggered by the seventh interface element. For example, when at least one video frame in a video file is displayed on the display interface, the seventh interface element for triggering the fifth event is displayed. The target video frame is edited by the interface element for triggering the fifth event, and the editing function for the video frame is more intuitively displayed, so that the user can enter the editing page simply and quickly.

[0128] Continue to see Figure 4 In (c), the seventh interface element (e.g., “Second Creation”) may be located in the interactive area on the right side of the display interface. If the user clicks on the seventh interface element (e.g., “Second Creation”), the user enters Figure 4 In the editing page shown in (d), the user can use the relevant interface elements in the editing page to perform secondary creation on the target video frame in at least one video frame.

[0129] As an example, Figure 4As shown in (d), the editing page may include page elements such as flip, countdown, challenge, status, beautification, etc. on the right column, or page elements such as photo, text, magic, etc. below, or page elements such as music, etc. above, to achieve corresponding editing functions. Among them, flip refers to the horizontal or vertical flipping of the position of the target video frame; countdown refers to adding a time-decreasing visual effect to the video, which can create a tense or expectant atmosphere and attract the audience's attention; the challenge function is usually related to short video challenge activities on social media platforms, allowing users to participate in specific challenge tasks, such as imitating a certain action, completing a certain task, or creating video content related to a specific theme; the status function can show the user's satisfaction, happiness or positive attitude towards the video content, or be used to attract the attention and interest of other users; the beautification function refers to the visual optimization and modification of the video to improve the look and feel and quality of the video, such as adjusting the color parameters such as brightness, contrast, saturation of the video frame, applying filter effects, and performing advanced processing such as face beautification and background blur. Magic function refers to adding special visual effects to video frames (for example, fantasy, fun or unique visual effects) or changing the way the video is presented. Text function refers to adding text descriptions to video frames. The photo function can add additional pictures or photos to the video file. In addition, you can also add appropriate background music to the newly created video file through the music function on the editing page.

[0130] After performing all or part of the above operations on the target video frame in the editing page, a newly created video file can be formed and published in the platform, for example, Figure 4 As shown in (e) in .

[0131] The third operation: interactive operation on the target video frame.

[0132] In some implementations, when at least one video frame is displayed on the display interface, in response to monitoring the sixth event, an interactive operation may be triggered for a target video frame in the at least one video frame. The interactive operation may include, for example, at least one of the following operations: downloading, liking, commenting, sharing, and collecting. The downloading, liking, commenting, sharing, and collecting operations of the target video frame in the at least one video frame are implemented through the sixth event, thereby meeting the diverse needs of users and improving the user's participation and interactive experience in the video consumption process.

[0133] The sixth event may be an event triggered by the eighth interface element. For example, when at least one video frame is displayed on the display interface, the eighth interface element for triggering the sixth event is displayed. The interface element for triggering the sixth event is used to implement operations such as downloading, liking, commenting, sharing, and collecting the target video frame, which more intuitively displays the interactive functions for the video frame, allowing users to perform interactive operations simply and quickly.

[0134] Continue to see Figure 4 In (c), the eighth interface element may be located in the interactive area on the right side of the display interface, for example, including interface elements corresponding to functions such as download, like, comment, share, etc. If the user clicks on the corresponding interface element, the corresponding download, like, comment, share, etc. function is executed.

[0135] The fourth operation: the target video frame is used as a comment attachment.

[0136] In some implementations, when the at least one video frame is displayed on the display interface, in response to monitoring a second event on the display interface, a comment page for the video file is displayed on the display interface, wherein the comment page has a target video frame from the at least one video frame inserted therein. Then, in response to monitoring a publishing operation on the comment page, a comment content with the target video frame as a comment attachment is published. That is, through the second event, the target video frame from the at least one video frame can be directly used for commenting, and the target video frame appears as a comment attachment on the comment page. Through the second event, the target video frame is quickly inserted into the comment page as a comment attachment, and the comment page with the target video frame inserted can be quickly provided to the user, so as to enrich the user's comment operation, improve the comment efficiency, and enhance the user's interactive experience.

[0137] The second event may include, for example, an event triggered by a click operation on a target video frame, an event triggered by a sliding operation between at least one video frame, or an event triggered by a second interface element. By clicking a target video frame in at least one video frame on the display interface, sliding between at least one video frame, or an operation triggered by a second interface element, the target video frame can be quickly inserted into the comment page as a comment attachment. On the one hand, the operation is simple and fast, and on the other hand, it also conforms to the user's cognition and operating habits in terms of operating gestures.

[0138] As an example, if the user wants to use video frame C of at least one video frame used to represent a highlight as a comment image and make a comment, the user can use a single-finger sliding gesture to switch video frame C of at least one video frame to the middle position of the display interface and click on video frame C (for example, refer to Figure 3 (b) and (c) in the figure), and then enter Figure 6Alternatively, when at least one video frame is displayed on the display interface, a second interface element may be displayed simultaneously (for example, the text "Comment" may be displayed in the interactive area on the right side of the display interface). If the user clicks on the second interface element (for example, Figure 4 (b) and (c) in the above), then enter Figure 6 The comments page shown in Figure 6 As shown, when the comment page is displayed in response to the above operation, the video frame C is automatically inserted into the comment page, without the need to click on the corresponding interface element of the comment page to select an image as in the traditional way of inserting a comment image, so that the user can quickly insert the target video frame into the comment page as a comment image. Afterwards, the user can also enter the text he wants to express in the text input area of ​​the comment page to further enrich the comment content, and publish it, so as to publish the comment with the video frame C.

[0139] The fifth operation: a co-snap operation based on a target video frame.

[0140] Co-shoot is a feature that allows users to interact with other people's video content and jointly create interesting videos. The Co-shoot feature not only enriches the user's creative experience, but also promotes interaction and communication on social media platforms.

[0141] In some implementations, when at least one video frame is displayed on the display interface, in response to monitoring a third event, a co-shooting page for a co-shooting operation is displayed on the display interface, and the co-shooting page uses the target video frame in the at least one video frame as the co-shooting background. Then, optionally, in response to monitoring a recording operation for a co-shooting video, a co-shooting video with the target video frame as the co-shooting background is recorded, and in response to monitoring a publishing operation for the co-shooting video, the co-shooting video is published. That is, through the third event, the user can perform a co-shooting with the target video frame in at least one video frame. For example, the interface of the co-shooting operation may include two areas, one area displays the target video frame, and the other area is the lens area, and the user can adjust the ratio of the display area and the lens area of ​​the target video frame by dragging the dividing line in the middle. Among them, the two areas displayed in the interface for the co-shooting operation can adopt layout methods such as left-right split screen and top-bottom split screen. Through the third event, a page for co-shooting operations with the target video frame as the background is displayed, which can quickly provide the user with a page for co-shooting operations, thereby providing the user with a creative basis with the target video frame as the background, allowing the user to perform co-shooting operations based on the target video frame, thereby improving the user's interactive experience and simplifying the user's operation.

[0142] The third event may include, for example, an event triggered by a click operation on a target video frame, an event triggered by a sliding operation between at least one video frame, or an event triggered by a third interface element. By clicking a target video frame in at least one video frame on the display interface, sliding between at least one video frame, or an operation triggered by a third interface element, a page for co-production operation with the target video frame as the background is provided to the user, which is simple and fast to operate on the one hand, and conforms to the user's cognition and operating habits in terms of operating gestures on the other hand.

[0143] The above describes the related operations that can be performed based on the target video frame after the user selects the target video frame from at least one video frame used to represent the highlight clip, such as jump play, edit, comment, co-shoot, or interactive operation. However, in some cases, after the user triggers the display of at least one video frame on the display interface through the first event, if the user fails to select the target video frame of interest from at least one video frame and wants to exit the video frame screening process and continue to watch the video file, the ninth event can be triggered. In response to detecting the ninth event, the client cancels the display of at least one video frame and switches back to continue playing the video file on the display interface.

[0144] For example, the ninth event may include but is not limited to events triggered by the following gestures:

[0145] The first gesture is a tap operation on the non-display area of ​​the video frame.

[0146] For example, if the user clicks on any area other than the video frame, the display of at least one video frame is canceled, and the display interface is switched back to continue playing the video file.

[0147] Second gesture: a two-finger zoom gesture that is the opposite of the two-finger zoom gesture used in the first event.

[0148] For example, the first event uses a two-finger zoom-out gesture to trigger display of at least one video frame on the display interface. When exiting the display of at least one video frame and switching back to continue playing the video file on the display interface, a two-finger zoom-in gesture can be used.

[0149] The third gesture: a gesture for triggering the ninth interface element on the display interface.

[0150] When the display interface displays at least one video frame, a ninth interface element can be displayed. The user can exit the display of at least one video frame and switch back to continue playing the video file on the display interface by clicking the ninth interface element (for example, "Exit" or "×").

[0151] In addition, in order to facilitate the user to notice the ninth interface element, the ninth interface element can be highlighted on the display interface, and the highlighting method can be such as displaying corresponding text, enlarging the display, using a specific color, etc.

[0152] Furthermore, in order to minimize the impact on the user's viewing experience, when the above-mentioned highlighting duration reaches the second preset duration, that is, the client cancels the highlighting of the ninth interface element in response to the highlighting duration reaching the second preset duration.

[0153] In addition, the number of times the above-mentioned highlighting is performed and the conditions for prohibiting highlighting can also be restricted. For example, after being highlighted three times, the element will no longer be displayed. Or, if the user triggers the ninth interface element more than three times, the ninth interface element will be prohibited from being highlighted subsequently.

[0154] The fourth gesture: the gesture that triggers interface jump.

[0155] The interface jump may be a jump to another interface of the client, such as returning to the desktop, exiting the client, or switching to display a client of another application.

[0156] For example, after the user triggers to return to the desktop, the display of at least one video frame is exited and the video file is switched back to the display interface to continue playing. When the user enters the display interface again, the video file continues to play from the last playback position. If at least one video frame representing a highlight segment needs to be displayed on the display interface, the first event needs to be re-executed.

[0157] It should be noted that the foregoing text introduces multiple embodiments, and these embodiments may be implemented separately or in combination with each other unless there is a conflict.

[0158] The limitations such as "first", "second", and "third" involved in the embodiments of the present application do not have limitations on size, order, and quantity, and are only used to distinguish them in name. For example, "first event" and "second event" are used to distinguish two events in name. For another example, "first interface element", "second interface element", "third interface element", etc. are used to distinguish different interface elements in name.

[0159] It should also be noted that in order to detect the occurrence of various events, the client can pre-register a callback function or method for the event to be monitored, and the function or method includes the logic code to be executed in response to the event. Once the event is triggered, the client automatically calls the corresponding callback function or method. For example, a callback function is pre-registered for the first event, and the callback function triggers the client to display at least one video frame in the video file for representing the highlights in the display interface. The response to the event in the embodiment of the present application can be implemented in this way, which will not be described in detail later.

[0160] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the scope of protection of the present application. The singular forms of "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0161] It should be understood that the term "and / or" used in this application is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this application generally indicates that the associated objects before and after are in an "or" relationship.

[0162] The word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to" depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0163] It should also be noted that the interface elements involved in the embodiments of the present application generally refer to visual elements on the display interface, which may include text, icons, images, videos, components, etc. The so-called component refers to an object obtained by simply encapsulating data and methods, which may also be called a control, such as a button, input box, drop-down menu, dialog box, navigation bar, card, interactive icon, etc.

[0164] Combination of the above Figures 1 to 6 , describes the method embodiment of the present application in detail, and the following is combined with Figures 7 and 8 , describes the device embodiment of the present application in detail. It should be understood that the description of the method embodiment corresponds to the description of the device embodiment, so the parts not described in detail can refer to the previous method embodiment.

[0165] Figure 7A schematic diagram of the structure of a device for processing video files provided in an embodiment of the present application. Figure 7 The device shown can be arranged, for example, in Figure 1 In the client 112 shown. Figure 7 As shown, the device 700 includes an interface display unit 710 and an event monitoring unit 720. The event monitoring unit 720 is configured to monitor the playback instruction of the video file; the interface display unit 710 is configured to play the video file on the display interface in response to the playback instruction; the event monitoring unit 720 is further configured to monitor a first event for the video file during the playback of the video file, the first event is used to trigger the display interface to display at least one video frame, and the at least one video frame is used to represent the highlights in the video file; the interface display unit 710 is further configured to display a video frame display page on the display interface in response to the first event, wherein the video frame display page is used to display the at least one video frame.

[0166] In some implementations, the first event includes: an event triggered by a two-finger pinch gesture, an event triggered by a first interface element, or an event triggered by a voice command.

[0167] In some implementations, the interface display unit 710 is also used to: when displaying the at least one video frame on the display interface, in response to monitoring a second event, display a comment page for the video file on the display interface, wherein a target video frame among the at least one video frame is inserted into the comment page; and in response to monitoring a publishing operation on the comment page, publish comment content with the target video frame as a comment attachment.

[0168] In some implementations, the second event includes: an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between at least one video frame, or an event triggered by a second interface element.

[0169] In some implementations, the interface display unit 710 is also used for: when displaying the at least one video frame on the display interface, in response to monitoring a third event, displaying a co-shooting page for a co-shooting operation on the display interface, the co-shooting page using a target video frame among the at least one video frame as a co-shooting background; in response to monitoring a recording operation for a co-shooting video, recording a co-shooting video using the shown target video frame as a co-shooting background; in response to monitoring a publishing operation for the co-shooting video, publishing the co-shooting video.

[0170] In some implementations, the third event includes: an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between at least one video frame, or an event triggered by a third interface element.

[0171] In some implementations, the interface display unit 710 is further used to: when displaying the at least one video frame on the display interface, in response to monitoring a fourth event, play a highlight segment corresponding to a target video frame in the at least one video frame on the display interface.

[0172] In some implementations, the fourth event includes: an event triggered by a click operation on the target video frame, and / or an event triggered by a sliding operation between the at least one video frame.

[0173] In some implementations, the interface display unit 710 is also used to: when displaying the at least one video frame on the display interface, in response to monitoring a fifth event, display an editing page on the display interface, wherein the editing page is used to edit a target video frame in the at least one video frame.

[0174] In some implementations, the interface display unit 710 is further used to: display an interface element for triggering the fifth event when displaying the at least one video frame on the display interface.

[0175] In some implementations, the interface display unit 710 is also used to: when displaying the at least one video frame on the display interface, in response to monitoring a sixth event, trigger at least one of the following operations for a target video frame in the at least one video frame: download, like, comment, share, and collect.

[0176] In some implementations, the interface display unit 710 is further used to: display an interface element for triggering the sixth event when displaying the at least one video frame on the display interface.

[0177] In some implementations, when the at least one video frame is displayed on the display interface, the at least one video frame is arranged on the display interface in the order in which the at least one video frame appears in the video file.

[0178] In some implementations, the interface display unit 710 is further configured to: when displaying the at least one video frame on the display interface, switch between the at least one video frame in response to detecting a seventh event.

[0179] In some implementations, the seventh event includes: an event triggered by a single-finger sliding gesture in a preset direction, or an event triggered by a fourth interface element.

[0180] In some implementations, the interface display unit 710 is further used to: display a fifth interface element when displaying the at least one video frame on the display interface, and the fifth interface element is used to indicate the position of the at least one video frame in the video playback progress bar.

[0181] In some implementations, the interface display unit 710 is further used to: display a sixth interface element when displaying the at least one video frame on the display interface, and the sixth interface element is used to indicate interactive information corresponding to the at least one video frame.

[0182] In some implementations, the interactive information includes at least one of the following: highly liked moments, the number of likes corresponding to the highly liked moments, highly reviewed moments, the number of comments corresponding to the highly reviewed moments, highly shared moments, the number of shares corresponding to the highly shared moments, highly replayed moments, and the number of replays corresponding to the highly replayed moments.

[0183] In some implementations, the interface display unit 710 is further used to: when displaying the at least one video frame on the display interface, in response to detecting an eighth event, highlight a target video frame among the at least one video frame on the display interface.

[0184] In some implementations, the eighth event includes: the target video frame is located in a middle position of the display interface, or slides to the target video frame based on a sliding operation between the at least one video frame.

[0185] In some implementations, the highlights in the video file are associated with the user's interactive data, and the interactive data includes at least one of the following: the number of likes obtained, the number of comments obtained, the number of times shared, and the number of times replayed.

[0186] In some implementations, the interface display unit 710 is also used to: during the playback of the video file, in response to monitoring the operation of dragging the video playback progress bar, play a guide animation on the display interface, and the guide animation is used to prompt the content and / or function of the first event.

[0187] Each embodiment of the present application is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The system and device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0188] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0189] In addition, the present application also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of any one of the methods in the aforementioned method embodiments are implemented.

[0190] The present application also provides an electronic device, comprising: one or more processors; and a memory associated with the one or more processors, the memory being used to store program instructions, and the program instructions, when read and executed by the one or more processors, execute the steps of any one of the methods described in the aforementioned method embodiments.

[0191] The present application also provides a computer program product, including a computer program, which implements the steps of any one of the methods in the aforementioned method embodiments when executed by a processor.

[0192] in, Figure 8 The architecture of the electronic device is exemplarily shown. Specifically, the electronic device may include a processor 810, a video display adapter 811, a disk drive 812, an input / output interface 813, a network interface 814, and a memory 820. The processor 810, the video display adapter 811, the disk drive 812, the input / output interface 813, the network interface 814, and the memory 820 may be communicatively connected via a communication bus 830.

[0193] The processor 810 can be implemented by a general-purpose CPU, a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application.

[0194] The memory 820 can be implemented in the form of a read-only memory (ROM), a random access memory (RAM), a static storage device, a dynamic storage device, etc. The memory 820 can store an operating system 821 for controlling the operation of the electronic device 800, and a basic input / output system (BIOS) 822 for controlling the low-level operation of the electronic device 800. In addition, a web browser 823, a data storage management system 824, and a playback processing device 825 for media files, etc. can also be stored. The playback processing device 825 of the above-mentioned media files can be an application program that specifically implements the operations of the aforementioned steps in the embodiment of the present application. In short, when the technical solution provided by the present application is implemented by software or firmware, the relevant program code is stored in the memory 820 and is called and executed by the processor 810.

[0195] The input / output interface 813 is used to connect the input / output module to realize information input and output. The input / output module can be configured as a component in the device ( Figure 8 The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0196] The network interface 814 is used to connect the communication module ( Figure 8 The communication module can realize communication through a wired mode (for example, USB, network cable, etc.) or a wireless mode (for example, mobile network, WIFI, Bluetooth, etc.).

[0197] The bus 830 includes pathways for transmitting information between the various components of the device (eg, the processor 810 , the video display adapter 811 , the disk drive 812 , the input / output interface 813 , the network interface 814 , and the memory 820 ).

[0198] It should be noted that, although the above device only shows a processor 810, a video display adapter 811, a disk drive 812, an input / output interface 813, a network interface 814, a memory 820, a bus 830, etc., in the specific implementation process, the device may also include other components necessary for normal operation. In addition, those skilled in the art can understand that the above device may also only include components necessary for implementing the solution of the present application, and does not necessarily include all the components shown in the figure.

[0199] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly contributed to the prior art in the form of a computer program product, which can be stored in a storage medium, such as ROM / RAM, a disk, an optical disk, etc., including several instructions for enabling a computer device (e.g., a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0200] The technical solution provided by the present application is described in detail above. The principles and implementation methods of the present application are described in detail using specific examples in the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present application.

Claims

1. A method for processing a video file, characterized in that: The method comprises: Monitor the playback instructions of video files; In response to detecting the play instruction, playing the video file on the display interface; During the playback of the video file, a first event for the video file is monitored, where the first event is used to trigger the display interface to display at least one video frame, where the at least one video frame is used to represent a highlight segment in the video file; In response to detecting the first event, a video frame display page is displayed on the display interface, wherein the video frame display page is used to display the at least one video frame.

2. The method according to claim 1, characterized in that: The first event includes: an event triggered by a two-finger pinch gesture, an event triggered by a first interface element, or an event triggered by a voice command.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: During the playback of the video file, in response to detecting a pause operation on the video file, the at least one video frame is displayed on the display interface.

4. The method according to claim 3, characterized in that The position of the at least one video frame on the video playback progress bar is located near the position corresponding to the pause moment on the video playback progress bar.

5. The method according to claim 1 or 2, characterized in that: The method further comprises: When the at least one video frame is displayed on the display interface, in response to detecting a second event, a comment page for the video file is displayed on the display interface, wherein a target video frame of the at least one video frame is inserted into the comment page; In response to monitoring a publishing operation on the comment page, a comment content with the target video frame as a comment attachment is published.

6. The method according to claim 5, characterized in that The second event includes: an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between at least one video frame, or an event triggered by a second interface element.

7. The method according to claim 1 or 2, characterized in that: The method further comprises: When the at least one video frame is displayed on the display interface, in response to detecting a third event, a co-shooting page for a co-shooting operation is displayed on the display interface, wherein the co-shooting page uses a target video frame in the at least one video frame as a co-shooting background; In response to monitoring a recording operation for a co-produced video, recording a co-produced video with the target video frame as a co-produced background; In response to detecting a publishing operation for the co-produced video, the co-produced video is published.

8. The method according to claim 7, characterized in that The third event includes: an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between at least one video frame, or an event triggered by a third interface element.

9. The method according to claim 1 or 2, characterized in that: The method further comprises: When the at least one video frame is displayed on the display interface, in response to detecting a fourth event, a highlight segment corresponding to a target video frame in the at least one video frame is played on the display interface.

10. The method according to claim 9, characterized in that The fourth event includes: an event triggered by a click operation on the target video frame, and / or an event triggered by a sliding operation between the at least one video frame.

11. The method according to claim 1 or 2, characterized in that: The method further comprises: When the at least one video frame is displayed on the display interface, in response to detecting a fifth event, an editing page is displayed on the display interface, where the editing page is used to edit a target video frame in the at least one video frame.

12. The method according to claim 11, characterized in that The method further comprises: When the at least one video frame is displayed on the display interface, an interface element for triggering the fifth event is displayed.

13. The method according to claim 1 or 2, characterized in that: The method further comprises: When the at least one video frame is displayed on the display interface, in response to detecting a sixth event, at least one of the following operations is triggered for a target video frame in the at least one video frame: downloading, liking, commenting, sharing, and collecting.

14. The method according to claim 13, characterized in that The method further comprises: When the at least one video frame is displayed on the display interface, an interface element for triggering the sixth event is displayed.

15. The method according to claim 1 or 2, characterized in that: When displaying the at least one video frame on the display interface, the at least one video frame is arranged on the display interface in the order in which the at least one video frame appears in the video file.

16. The method according to claim 1 or 2, characterized in that: The method further comprises: When the at least one video frame is displayed on the display interface, switching is performed between the at least one video frame in response to detecting a seventh event.

17. The method according to claim 16, characterized in that The seventh event includes: an event triggered by a single-finger sliding gesture in a preset direction, or an event triggered by a fourth interface element.

18. The method according to claim 1 or 2, characterized in that: The method further comprises: When the at least one video frame is displayed on the display interface, a fifth interface element is displayed, and the fifth interface element is used to indicate the position of the at least one video frame in the video playback progress bar.

19. The method according to claim 1 or 2, characterized in that: The method further comprises: When the at least one video frame is displayed on the display interface, a sixth interface element is displayed, and the sixth interface element is used to indicate interactive information corresponding to the at least one video frame.

20. The method according to claim 19, characterized in that The interactive information includes at least one of the following: highly liked moments, the number of likes corresponding to the highly liked moments, highly reviewed moments, the number of comments corresponding to the highly reviewed moments, highly shared moments, the number of shares corresponding to the highly shared moments, highly replayed moments, and the number of replays corresponding to the highly replayed moments.

21. The method according to claim 1 or 2, characterized in that: The method further comprises: When the at least one video frame is displayed on the display interface, in response to detecting an eighth event, a target video frame among the at least one video frame is highlighted on the display interface.

22. The method according to claim 21, characterized in that The eighth event includes: the target video frame is located in the middle position of the display interface, or slides to the target video frame based on a sliding operation between the at least one video frame.

23. The method according to claim 1 or 2, characterized in that The highlight clips in the video file are associated with the user's interactive data, and the interactive data includes at least one of the following: the number of likes obtained, the number of comments obtained, the number of times shared, and the number of times replayed.

24. The method according to claim 1 or 2, characterized in that The method further comprises: During the playback of the video file, in response to monitoring a pause operation on the video file and / or an operation of dragging the video playback progress bar, a guide animation is played on the display interface, and the guide animation is used to prompt the content and / or function of the first event.

25. A device for processing video files, characterized in that: The device comprises: An event monitoring unit, configured to monitor a playback instruction of a video file; The interface display unit is configured to: in response to detecting the play instruction, play the video file on the display interface; The event monitoring unit is further configured to: during the playback of the video file, monitor a first event for the video file, the first event is used to trigger the display interface to display at least one video frame, the at least one video frame is used to represent a wonderful segment in the video file; The interface display unit is further configured to: in response to detecting the first event, display a video frame display page on the display interface, wherein the video frame display page is used to display the at least one video frame.

26. An electronic device, characterized in that: include: One or more processors; as well as, A memory associated with the one or more processors, the memory being used to store program instructions, wherein when the program instructions are read and executed by the one or more processors, the steps of the method according to any one of claims 1 to 24 are performed.

27. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 24.

Images