Method and apparatus for processing a video file
By monitoring the first event and displaying highlights from the video file on the display interface, the problem of low efficiency in finding highlights in video files is solved, enabling fast acquisition and efficient video consumption.
Patent Information
- Application Number
- CN202411586782.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-07
- Publication Date
- 2025-11-21
- Estimated Expiration
- 2044-11-07
AI Technical Summary
In existing technologies, users are inefficient and prone to missing exciting clips when searching for them in video files, which affects the efficiency of video consumption and user experience.
By monitoring first events (such as pinch-to-zoom gestures, interface elements, or voice commands) to display highlights from video files on the display interface, user operations are simplified and video consumption efficiency is improved.
Users can quickly access exciting clips from video files, improving the efficiency of video consumption and user experience, simplifying the operation process, and conforming to user operating habits.
Smart Images

Figure CN119583911B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of Internet application, and in particular, to a method and device for processing a video file. BACKGROUND
[0002] Video consumption refers to a process in which a user enjoys video content and services by paying time cost and / or fund cost in order to meet the audio-visual demand of learning, entertainment and life and the like. With the diversification of video consumption platforms and the richness of video consumption content, how to improve the efficiency of video consumption becomes a problem to be solved. SUMMARY
[0003] The present application provides a method and device for processing a video file, which can improve the efficiency of video consumption.
[0004] In a first aspect, a method for processing a video file is provided, which includes: monitoring a play instruction of a video file; in response to monitoring the play instruction, playing the video file on a display interface; in a playing process of the video file, monitoring a first event for the video file, the first event being used to trigger the display interface to display at least one video frame, the at least one video frame being used to represent a highlight segment in the video file; in response to monitoring the first event, displaying a video frame display page on the display interface, the video frame display page being used to display the at least one video frame.
[0005] Through the first event, the at least one video frame in the video file used to represent the highlight segment is displayed on the display interface, so that the user can quickly obtain the highlight segment in the video file, and the efficiency of video consumption is improved.
[0006] In an implementation manner, the first event includes an event triggered by a double-finger pinch gesture, an event triggered by a first interface element, or an event triggered by a voice instruction.
[0007] The event triggered by the double-finger pinch gesture, the first interface element or the voice instruction is used to display the at least one video frame in the video file on the display interface, which is simple and fast on one hand, and is more in line with the operation habit of the user on the other hand.
[0008] In an implementation manner, the method further includes: in the playing process of the video file, in response to monitoring a pause operation for the video file, displaying the at least one video frame on the display interface.
[0009] Considering that the user may have the demand of browsing the highlight segment when pausing the playing of the video file, the at least one video frame used to represent the highlight segment can be displayed on the display interface for the user to select, thereby improving the user experience.
[0010] In an implementation manner, the position of the at least one video frame on the video playback progress bar is located in the vicinity of the position corresponding to the pause moment on the video playback progress bar.
[0011] The user pauses the playing of the video file at a moment, which may indicate that there is a highlight segment near the moment that the user wants to browse. At this time, the display interface displays at least one video frame of the highlight segment near the pause moment for the user, which can better meet the user's expectation.
[0012] In an implementation manner, the method further includes: when the display interface displays the at least one video frame, in response to monitoring a second event on the display interface, displaying a comment page for the video file on the display interface, the comment page being inserted with a target video frame in the at least one video frame; and in response to monitoring a publishing operation on the comment page, publishing comment content with the target video frame as a comment attachment.
[0013] The target video frame is quickly inserted into the comment page as a comment attachment through the second event, which can quickly provide the user with the comment page inserted with the target video frame, enrich the user's comment operation, improve the comment efficiency, and improve the user's interactive experience.
[0014] In an implementation manner, the second event includes an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between the at least one video frame, or an event triggered by a second interface element.
[0015] The target video frame is quickly inserted into the comment page as a comment attachment through the click operation on the target video frame in the at least one video frame on the display interface, the sliding operation between the at least one video frame, or the operation triggered by the second interface element, which is simple and quick on the one hand, and conforms to the user's cognition and operation habit on the operation gesture on the other hand.
[0016] In an implementation manner, the method further includes: when the display interface displays the at least one video frame, in response to monitoring a third event on the display interface, displaying a collage page for a collage operation on the display interface, the collage page taking a target video frame in the at least one video frame as a collage background; in response to monitoring a recording operation on the collage video, recording a collage video with the target video frame as the collage background; and in response to monitoring a publishing operation on the collage video, publishing the collage video.
[0017] The third event is used to display the page for the video frame combination operation, so that the user can quickly obtain the page for the video frame combination operation, and the user can create based on the target video frame, thereby improving the user experience and simplifying the operation of the user.
[0018] In an implementation manner, the third event includes an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between the at least one video frame, or an event triggered by a third interface element.
[0019] The third event is used to display the page for the video frame combination operation, so that the user can quickly obtain the page for the video frame combination operation, and the user can create based on the target video frame, thereby improving the user experience and simplifying the operation of the user.
[0020] In an implementation manner, the method further includes: when the at least one video frame is displayed on the display interface, in response to monitoring a fourth event, playing a highlight clip corresponding to a target video frame in the at least one video frame on the display interface.
[0021] The fourth event is used to play the highlight clip corresponding to the target video frame in the video file, so that the user can quickly obtain each highlight clip in the video file, and can play the highlight clip of interest, thereby further improving the video consumption efficiency.
[0022] In an implementation manner, the fourth event includes an event triggered by a click operation on the target video frame, and / or an event triggered by a sliding operation between the at least one video frame.
[0023] The fourth event is used to play the highlight clip corresponding to the target video frame in the video file, so that the user can quickly obtain each highlight clip in the video file, and can play the highlight clip of interest, thereby further improving the video consumption efficiency.
[0024] In an implementation manner, the method further includes: when the at least one video frame is displayed on the display interface, in response to monitoring a fifth event, displaying an editing page on the display interface, the editing page being used to edit a target video frame in the at least one video frame.
[0025] The fifth event is triggered to call the editing page, so that the user can edit a target video frame in the at least one video frame in the editing page, thereby meeting the diversified needs of the user and improving the participation and creation experience of the user in the video consumption process.
[0026] In an implementation manner, the method further includes: when the at least one video frame in the video file is displayed on the display interface, displaying an interface element for triggering the fifth event.
[0027] The interface element for triggering the fifth event is used to edit the target video frame, which intuitively displays the editing function of the video frame and enables the user to simply and quickly enter the editing page.
[0028] In an implementation manner, the method further includes: when the at least one video frame is displayed on the display interface, in response to monitoring a sixth event, triggering at least one of the following operations for a target video frame in the at least one video frame: downloading, liking, commenting, sharing, and collecting.
[0029] The sixth event is used to trigger the operations such as downloading, liking, commenting, sharing, and collecting for the target video frame in the at least one video frame, thereby meeting the diversified needs of the user and improving the participation and interaction experience of the user in the video consumption process.
[0030] In an implementation manner, the method further includes: when the at least one video frame is displayed on the display interface, displaying an interface element for triggering the sixth event.
[0031] The interface element for triggering the sixth event is used to trigger the operations such as downloading, liking, commenting, sharing, and collecting for the target video frame, which intuitively displays the interaction function of the video frame and enables the user to simply and quickly perform the interaction operation.
[0032] In an implementation manner, when the at least one video frame is displayed on the display interface, the at least one video frame is arranged on the display interface according to the order in which the at least one video frame appears in the video file.
[0033] The at least one video frame is arranged on the display interface according to the order in which the at least one video frame appears in the video file, which is conducive to maintaining the coherence of the video content and enabling the user to intuitively determine the order of the at least one video frame. In addition, from a technical point of view, arranging the at least one video frame on the display interface according to the order in which the at least one video frame appears in the video file is a relatively simple and direct implementation manner, which does not need a complex algorithm or logic to process the arrangement of the video frame and is easier to implement on various playback platforms and devices.
[0034] In an implementation manner, the method further includes: in response to monitoring the seventh event while displaying the at least one video frame on the display interface, switching between the at least one video frame.
[0035] By the seventh event, switching between the at least one video frame is realized, and the user can easily view the previous video frame or the next video frame without leaving the current interface, thereby maintaining the continuity and fluency of browsing.
[0036] In an implementation manner, the seventh event includes: an event triggered by a single-finger sliding gesture in a preset direction, or an event triggered by a fourth interface element.
[0037] By the event triggered by the single-finger sliding gesture in the preset direction, or the event triggered by the fourth interface element, switching between the at least one video frame is realized, so that the user can easily and efficiently flip through the video frames, improve the browsing efficiency of the wonderful moments in the video file, and increase the interactivity between the user and the content of the video frames, so that the user can actively participate in the browsing process, and improve the interactive experience.
[0038] In an implementation manner, the method further includes: displaying a fifth interface element while displaying the at least one video frame on the display interface, the fifth interface element being used to indicate the position of the at least one video frame in a video playback progress bar.
[0039] When displaying the at least one video frame on the display interface, the fifth interface element is displayed to indicate the position of the at least one video frame in the video playback progress bar, which is beneficial to the user to understand the playback progress of the video frames on the display interface, and improves the interactive experience of the user.
[0040] In an implementation manner, the method further includes: displaying a sixth interface element while displaying the at least one video frame on the display interface, the sixth interface element being used to indicate the interactive information corresponding to the at least one video frame.
[0041] When displaying the at least one video frame on the display interface, the sixth interface element is displayed to indicate the interactive information corresponding to the at least one video frame, which is beneficial to the user to understand the popularity of the video frames on the display interface, and improves the interactive experience of the user.
[0042] In an implementation manner, the interactive information includes at least one of the following: a high-up moment, the number of likes corresponding to the high-up moment, a high-rated moment, the number of comments corresponding to the high-rated moment, a high-shared moment, the number of shares corresponding to the high-shared moment, a high-looked moment, and the number of looks corresponding to the high-looked moment.
[0043] The high moment, the high comment moment, the sharing moment, the high review moment, or the corresponding number is used to reflect the popularity of the video frame, which is simple and intuitive.
[0044] In an implementation manner, the method further includes: in response to monitoring the eighth event, highlighting a target video frame in the at least one video frame on the display interface when displaying the at least one video frame on the display interface.
[0045] By the eighth event, the target video frame in the at least one video frame is highlighted on the display interface, which can provide more intuitive visual feedback for the user, help the user to confirm that they have accurately selected the target video frame of interest, and improve the accuracy and efficiency of the operation.
[0046] In an implementation manner, the eighth event includes that the target video frame is located at a middle position of the display interface or is slid to the target video frame based on a sliding operation between the at least one video frame.
[0047] By making the target video frame located at the middle position of the display interface or slid to the target video frame based on the sliding operation between the at least one video frame, the selection of the target video frame is represented, and the target video frame is highlighted, which is simple and fast on the one hand, and is more consistent with the cognition and operation habit of the user on the operation gesture on the other hand.
[0048] In an implementation manner, the highlight clip in the video file is determined based on user interaction data, and the interaction data includes at least one of the following: the number of obtained likes, the number of obtained comments, the number of sharing times, and the number of review times.
[0049] Based on the interaction data, the at least one video frame in the video file for representing the highlight clip is extracted and highlighted, so that the highlight picture presented to the user is more consistent with the user's expectation.
[0050] In an implementation manner, the method further includes: in response to monitoring a pause operation and / or a drag video playing progress bar operation for the video file during playing of the video file, playing a guide animation on the display interface, the guide animation being used to prompt the content and / or effect of the first event.
[0051] By playing the guide picture, the user can be prompted in time about the content and / or effect of the first event, so that the user knows that the video playing progress bar does not need to be dragged, but the video frame for representing the highlight clip can be quickly obtained through the first event.
[0052] In a second aspect, an apparatus for processing a video file is provided. The apparatus includes an event monitoring unit configured to monitor a play instruction of a video file; an interface display unit configured to play the video file on a display interface in response to monitoring the play instruction; the event monitoring unit is further configured to monitor a first event for the video file during playing of the video file, the first event being used to trigger the display interface to display at least one video frame, the at least one video frame being used to represent a highlight segment in the video file; and the interface display unit is further configured to display a video frame display page on the display interface in response to monitoring the first event, the video frame display page being used to display the at least one video frame.
[0053] In a third aspect, a computer-readable storage medium is provided, and the computer-readable storage medium stores a computer program. The computer program is executed by a processor to implement the steps of the method according to the first aspect or any one of the implementation manners of the first aspect.
[0054] In a fourth aspect, an electronic device is provided. The electronic device includes one or more processors and a memory associated with the one or more processors. The memory is configured to store program instructions. The program instructions, when executed by the one or more processors, perform the method according to the first aspect or any one of the implementation manners of the first aspect.
[0055] In a fifth aspect, a computer program product is provided. The computer program product includes a computer program. The computer program, when executed by a processor, implements the steps of the method according to the first aspect or any one of the implementation manners of the first aspect. BRIEF DESCRIPTION OF DRAWINGS
[0056] In order to more clearly illustrate the technical solutions in the embodiments of the present application or in the related art, the drawings needed in the embodiments will be briefly introduced below. It should be understood that the drawings described below are only some embodiments of the present application, and other drawings can also be obtained by those skilled in the art based on these drawings.
[0057] Figure 1 A system architecture diagram to which the embodiments of the present application are applicable.
[0058] Figure 2 A flowchart of a video file playing processing method provided by the embodiments of the present application.
[0059] Figure 3 A schematic diagram of each stage of a display interface provided by the embodiments of the present application.
[0060] Figure 4 A schematic diagram of each stage of a display interface provided by another embodiment of the present application.
[0061] Figure 5 This is a schematic diagram of the various stages of the display interface provided in another embodiment of this application.
[0062] Figure 6 A schematic diagram of a comment page provided for an embodiment of this application.
[0063] Figure 7 A schematic block diagram of an apparatus for processing video files provided in an embodiment of this application.
[0064] Figure 8 A schematic block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation
[0065] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0066] To facilitate understanding of the embodiments of this application, a system architecture applicable to the embodiments of this application will first be described as an example. Figure 1 The system architecture that can be applied to the embodiments of this application is shown, such as Figure 1 As shown, the system architecture may include a terminal device 110 and a server 120. The terminal device 110 can connect to the server 120 via a wireless network or a wired network. It should be understood that... Figure 1 The number of terminal devices 110 and servers 120 shown is merely illustrative. Depending on the implementation requirements, the system architecture based on this application embodiment can have any number of terminal devices 110 and servers 120.
[0067] Terminal devices 110 include, but are not limited to, smart mobile terminals, wearable devices, personal computers (PCs), and smart home devices. Smart mobile devices may include devices such as mobile phones, tablets, laptops, personal digital assistants (PDAs), and internet-connected car terminals. Wearable devices may include devices such as smartwatches, smart glasses, smart bracelets, virtual reality (VR) devices, augmented reality (AR) devices, and mixed reality devices (i.e., devices that support both virtual and augmented reality). Smart home devices may include devices such as smart TVs and smart refrigerators with displays.
[0068] A client 112 can be arranged in the terminal device 110. The client 112 involved in the embodiments of the present application can be an application (APP) running on the terminal device, a mini-program, or a Web program running through a browser, etc. The client 112 can interact with the server 120 through a network, request and obtain media resources from the server 120, and play the media resources on the display interface of the client 112.
[0069] The server 120 can be a platform providing a media resource playing service. The server 120 can be a single server, a server group composed of multiple servers, or a cloud server. The cloud server is also called a cloud computing server or a cloud host, which is a host product in the cloud computing service system to solve the defects of large management difficulty and weak service scalability in traditional physical hosts and virtual private servers (VPS) services.
[0070] The server 120 can send the media resources to the client 112 in a streaming manner, and the client 112 plays the media resources while downloading the media stream. Alternatively, the server 120 can also send the media resources to the client 112 in a progressive transmission manner, and the client 112 plays the media resources after downloading the entire media resources. In addition, the server 120 can also transmit the media resources to the client 112 in other manners, for example, the server 120 can provide the media resources based on a content delivery network (CDN) and transmit them to the client 112.
[0071] In some implementations, the client 112 can request a video file from the server, and the server transmits the video file to the client 112, and the client 112 plays the video file by using the method provided in the embodiments of the present application.
[0072] In the existing playing mode, if a user wants to watch a wonderful segment from a video file, the user usually drags the video playing progress bar. On the one hand, the efficiency of finding the wonderful segment by dragging the progress bar is very low, and the user may need to drag the video playing progress bar for multiple times to find the wonderful segment in the video file. On the other hand, due to the positioning accuracy of the video playing progress bar, it is very easy to miss the wonderful segment when finding the wonderful segment by dragging the progress bar. These will result in low efficiency of video consumption and affect the user experience.
[0073] To solve the above problems, the embodiment of the present application provides a method for processing a video file, which shows the highlights in the video file to the user by displaying at least one video frame representing the highlights on the display interface in response to monitoring a first event. Since the extraction and display of the at least one video frame representing the highlights in the video file are triggered by the first event, the user does not need to repeatedly drag the video playback progress bar to show the highlights to the user, thereby improving the video consumption efficiency.
[0074] The highlights mentioned above generally refer to the parts of the video content that are eye-catching, interesting, moving, educational, or have other significant values. These parts often evoke emotional resonance in the audience, provide unique visual experiences, or convey important information. For example, in narrative videos, the highlights are usually the climax of the story, such as action scenes, emotional outbursts, or moments revealing key information in movies; for example, in comedy or emotional videos, the parts that make the audience laugh or feel moved are often considered highlights; for example, some videos are famous for their exquisite pictures, unique visual effects, or shocking visual effects, and the highlights in these videos are usually the parts with the strongest visual impact; for example, in sports, dance, magic, or other skill demonstration videos, the highlights may be the moments that demonstrate superb skills or break through limits; for example, in educational or popular science videos, the highlights may be the parts that explain complex concepts in a simple way or vividly demonstrate experimental results; for example, in some cases, the highlights in a video are not necessarily planned in advance, but are unexpected and surprising moments that often bring surprises and joy to the audience. In some scenarios, the highlights in a video file can also be referred to as high-energy segments, highlight moments, high-interactive frames, high-quality segments, etc.
[0075] The video consumption mentioned above refers to the user watching various types of video files, such as movies, TV series, short videos, documentaries, variety shows, etc., through terminals such as televisions, computers, and mobile phones to meet their entertainment, learning, socializing, etc. needs. This behavior not only involves watching content, but also includes evaluating, sharing, interacting, etc. operations on the content of the video file. The efficiency of video consumption, in a broad sense, refers to the amount of information, entertainment experience, or learning effectiveness that the user obtains per unit of time during the process of watching the video file, which reflects the degree to which the content of the video file meets the user's needs and the input-output ratio of the user during the process of watching the video file.
[0076] It can be understood that the at least one video frame triggered to be displayed by the first event in the embodiments of the present application can be a video frame for representing a highlight segment, or can be a video frame for representing other types of video segments, for example, a video frame for a certain specific character segment or scene segment, a video frame meeting certain conditions, or a video frame having certain common characteristics, etc. Hereinafter, only taking the at least one video frame for representing a highlight segment in a video file as an example, the technical solutions of the embodiments of the present application are described.
[0077] Hereinafter, the technical solutions of the embodiments of the present application are described in detail in combination with Figures 2 to 4 The method for processing a video file provided by the embodiments of the present application is described in detail.
[0078] As an example, Figure 2 The method for processing a video file of the embodiments of the present application is shown in a schematic flowchart. Figure 2 The method 200 shown can be executed by a terminal device, for example, the terminal device can be Figure 1 The terminal device 110 shown. As a more specific example, Figure 2 The method 200 shown can be executed by a client (for example, an application (APP) supporting media resource playing, a mini program, or a Web program running through a browser) installed on the terminal device. The steps in Figure 2 are described in detail below.
[0079] Referring to Figure 2 In steps 210 to 220, a playing instruction of a video file is monitored; and in response to monitoring the playing instruction, the video file is played on a display interface. The video file can be a long video or a short video. The distinction between long video and short video mainly reflects in the length, content, and production method of the video. The long video is usually more than several tens of minutes in length; the content is relatively complete and in-depth, and the content quality is relatively high; it usually needs a professional team of photography, editing, sound effects, etc. to complete together, and the production cycle is longer, and more resources are needed; for example, movies, TV series, documentaries, etc. belong to long videos. The short video is usually within several minutes or tens of minutes; the content is usually short, concise, and mainly highlights a certain highlight or quickly transmits information; the production is relatively simple, and usually uses a mobile phone or other portable device to shoot, and the post-editing is relatively easy; the short video pays more attention to quick production and quick dissemination, and emphasizes timeliness; for example, some funny videos, life record videos, advertisement videos, short dramas, etc. belong to short videos.
[0080] In addition, the video file can be a horizontal video or a vertical video. The horizontal video refers to a video file whose playing picture width is greater than the height, which is more consistent with the natural field of view of the human eye and is more suitable for watching on a wide screen device (for example, a television or a computer). The vertical video refers to a video file whose playing picture height is greater than the width, which is more suitable for watching on a narrow screen device (for example, a smart phone or a tablet computer) and is more popular in the field of social media and short videos. Hereinafter, the technical solutions of the embodiments of the present application are described taking a vertical video as an example.
[0081] Continuing to refer to Figure 2 In steps 230 to 240, during the playing of the video file, a first event for the video file is monitored, the first event being used to trigger the display interface to display at least one video frame in the video file for representing a highlight segment; in response to monitoring the first event, a video frame display page is displayed on the display interface, the video frame display page being used to display the at least one video frame. The video frame display page may, for example, be the entire or partial area of the display interface.
[0082] Displaying at least one video frame in the video file for representing a highlight segment on the display interface triggered by the first event is equivalent to extracting and exposing the at least one video frame in the video file for representing a highlight segment and aggregating them together to show the user, so that the user can quickly obtain the highlight segment in the video file without having to find the highlight segment by dragging the progress bar, which improves the efficiency of adjusting the video progress and is less likely to miss the highlight segment, improves the efficiency of video consumption and enhances the user experience.
[0083] The highlight segment in the video file may, for example, be associated with the interaction data of the user, or in other words, the highlight segment in the video file can be determined based on the interaction data of the user. The interaction data includes at least one of the following: the number of likes obtained, the number of comments obtained, the number of times shared, and the number of times looked back. If a video frame at a certain time during playing obtains more likes or comments from the user, or the video frame is shared and looked back more times, the video frame is likely to include a more exciting picture, a surprising moment, or a prominent visual effect, and thus is more popular and loved by the user, so it can be considered that the video frame includes a highlight moment. Based on the interaction data, at least one video frame in the video file for representing a highlight segment is extracted and exposed, so that the highlight picture presented to the user is more likely to meet the user's expectations.
[0084] The first event may include an event triggered by a first gesture (e.g., a two-finger pinch gesture), an event triggered by a first interface element, or an event triggered by a voice command (e.g., a voice command to "enter the highlight clip"). The two-finger pinch gesture can be a two-finger zoom-in gesture or a two-finger zoom-out gesture. Using events triggered by two-finger pinch gestures, first interface elements, or voice commands to display at least one video frame from a video file on the display interface is simple, quick, and more in line with user operating habits. Preferably, since the focus of this application embodiment is on displaying video frames representing highlight clips in a video file, an event triggered by a two-finger pinch gesture (e.g., a two-finger zoom-out gesture) on a video file is more consistent with the process of "aggregating" video frames, providing users with a sense of "aggregation" and a better user experience.
[0085] As an example, see Figure 3 (a) and Figure 4 In (a), if the user uses a two-finger pinch gesture on the display interface, they can enter... Figure 3 (b) and Figure 4 The video frame display page shown in (b) displays at least one video frame from the video file representing a highlight segment, such as video frame A, video frame B, and video frame C. Thus, when a user wants to access a highlight segment of the video file, they don't need to drag the video playback progress bar; they can quickly retrieve and browse the highlight segment by using a two-finger zoom-out gesture on the display interface.
[0086] In some implementations, during video playback, at least one video frame can be displayed on the screen in response to a detected pause operation. For example, if a user pauses playback of a video file to view highlights, at least one video frame representing those highlights can be displayed on the screen for the user to select, improving the user experience. As an example, one could... Figure 3 (a) and Figure 4 The two-finger pinch gesture shown in (a) is replaced with an operation used to trigger video file pause, such as clicking on a video file or clicking on a pause-related page element on the display interface. Upon detecting a pause operation on the display interface, the following steps are taken: Figure 3 (b) and Figure 4 The video frame display page shown in (b) displays at least one video frame representing a highlight segment.
[0087] The at least one video frame displayed in response to the monitoring of the pausing operation is located at a position on the video playback progress bar that is near a position on the video playback progress bar corresponding to the pausing time. The pausing of the video file by the user at a time point can indicate that there is a highlight segment near the time point that the user wants to browse. At this time, the display of the at least one video frame of the highlight segment near the pausing time on the display interface can better meet the expectation of the user. Here, the position of the at least one video frame on the video playback progress bar is near the pausing time, for example, the time difference between the position of the at least one video frame on the video playback progress bar and the position on the video playback progress bar corresponding to the pausing time is less than a preset value, or the at least one video frame is the at least one video frame in the video file that is closest to the position on the video playback progress bar corresponding to the pausing time, including the video frame before and / or after the pausing time.
[0088] The embodiments of the present application do not limit the arrangement manner of the at least one video frame of the highlight segment on the display interface. As an example, Figure 3 and Figure 4 adopt the arrangement manner from left to right to display the at least one video frame. In addition, other arrangement manners can also be adopted for display. For example, for a horizontal screen video, the arrangement manner from top to bottom can also be adopted to display the at least one video frame; for another example, the array arrangement manner can also be adopted to display more video frames to the user on the display interface at the same time.
[0089] In some implementations, when the at least one video frame is displayed on the display interface, the at least one video frame is arranged on the display interface according to the order of occurrence of the at least one video frame in the video file. This is beneficial to maintaining the coherence of the video content, so that the user can more intuitively determine the order of the at least one video frame. In addition, from a technical point of view, arranging the at least one video frame on the display interface based on the order of occurrence of the at least one video frame in the video file is a relatively simple and direct implementation, without the need for complex algorithms or logic to process the arrangement of the video frames, and is easier to implement on various playback platforms and devices.
[0090] Continuing to refer to (b) in Figure 3 and (b) in Figure 4 , among the video frame A, the video frame B and the video frame C displayed on the display interface, the playing time corresponding to the video frame A is before the playing time corresponding to the video frame B, and the playing time corresponding to the video frame B is before the playing time corresponding to the video frame C, that is, the order of occurrence in the video file is video frame A, video frame B and video frame C in turn, and therefore, the video frame A, the video frame B and the video frame C are arranged in turn from left to right on the display interface according to the order of occurrence of each in the video file.
[0091] In some implementations, when displaying at least one video frame representing a highlight from a video file on the display interface, other interface elements associated with that video frame may also be displayed, such as a fifth interface element and / or a sixth interface element. The fifth interface element indicates the position of the at least one video frame within the video playback progress bar. The sixth interface element indicates interactive information corresponding to the at least one video frame. In this way, while browsing the at least one video frame representing the highlight, users can also obtain other information about the video frame, such as its position within the video playback progress bar and / or its popularity, thus providing a better interactive experience.
[0092] The interactive information mentioned above includes at least one of the following: highly praised moments, the number of likes corresponding to highly praised moments, highly rated moments, the number of comments corresponding to highly rated moments, highly shared moments, the number of shares corresponding to highly shared moments, highly rewatched moments, and the number of rewatches corresponding to highly rewatched moments. As important indicators for measuring the quality and influence of video file content, likes, comments, shares, and rewatches all reflect the popularity and user recognition of the video file content. The playback moments corresponding to more popular and exciting segments in a video file often receive more likes, comments, shares, or trigger more rewatches. Therefore, reflecting the popularity of video frames through highly praised moments, highly rated moments, highly shared moments, highly rewatched moments, or their respective numbers is simpler and more intuitive. Highly praised moments, highly rated moments, highly shared moments, and highly rewatched moments can also be replaced with other similar or identical expressions, such as highly praised frames, highly rated frames, highly shared frames, and highly rewatched frames.
[0093] See also Figure 3 (b) and Figure 4 (b) in the example describes entering the gesture by using two fingers to narrow the gesture. Figure 3 (b) and Figure 4 When displaying the interface shown in (b), the interface displays at least one video frame from the video file representing a highlight segment, such as video frame A, video frame B, and video frame C. The interface also displays a video playback progress bar, indicating the relative positions of video frames A, B, and C. From the progress bar, it can be seen that in the video file, the playback time corresponding to video frame A precedes the playback time corresponding to video frame B, and the playback time corresponding to video frame B precedes the playback time corresponding to video frame C. That is, the order in which they appear in the video file is video frame A, video frame B, and video frame C, respectively. Furthermore, Figure 3 (b) and Figure 4The display interface shown in (b) in the first embodiment further displays the interactive information corresponding to the video frame A, the video frame B and the video frame C. As an example, the interactive information corresponding to the video frame A and the video frame C is “high evaluation moment”, and the interactive information corresponding to the video frame B is “high praise moment”. Figure 3 The display interface shown in (b) in the first embodiment further displays the interactive information corresponding to the video frame A, the video frame B and the video frame C. As an example, the interactive information corresponding to the video frame A and the video frame C is “high evaluation moment”, and the interactive information corresponding to the video frame B is “high praise moment”. Figure 4 The display interface shown in (b) in the first embodiment further displays the number of praises corresponding to the video frame B (for example, “432 users think this moment is great”) located in the middle of the display interface.
[0094] As an example, in the display interface shown in (b) in the first embodiment, the sixth interface element for indicating the interactive information is located below the video frame A, the video frame B and the video frame C, and the fifth interface element for indicating the video frame playing progress is located below the sixth interface element. Figure 3 The display interface shown in (b) in the first embodiment further displays the number of praises corresponding to the video frame B (for example, “432 users think this moment is great”) located in the middle of the display interface. Figure 4 The display interface shown in (b) in the first embodiment further displays the number of praises corresponding to the video frame B (for example, “432 users think this moment is great”) located in the middle of the display interface. The display interface shown in (b) in the first embodiment further displays the number of praises corresponding to the video frame B (for example, “432 users think this moment is great”) located in the middle of the display interface.
[0095] In addition, in some cases, when playing the video file on the display interface, some users may not know that they can trigger the aggregated display of the highlight clips through the first event or how to perform the first event. Therefore, in some implementations, when playing the video file on the display interface, a guide animation is displayed on the display interface in response to a preset trigger condition being met. The guide animation is used to prompt the content and effect of the first event. The specific form of the guide animation is not limited in the embodiments of the present application, as long as it can prompt the content (for example, what the first event is) and the effect (for example, what function or effect can be achieved through the first event) of the first event.
[0096] The preset trigger condition can include but is not limited to the following conditions:
[0097] The first trigger condition: the pause operation of the video file and / or the operation of dragging the video playing progress bar.
[0098] When the user pauses the playing of the video file or drags the video playing progress bar, it indicates that the user may have the demand to browse the highlight clips. At this time, the guide animation can be displayed on the display interface, so as to timely prompt the content and / or effect of the first event, and make the user know that the video frame representing the highlight clip can be quickly obtained through the first event without dragging the video playing progress bar.
[0099] The second trigger condition is that the currently played media file is the first video played after the client is cold started.
[0100] The client cold start refers to that the client is completely closed or the terminal device does not exist the process corresponding to the client. When the user opens the client again, the cold start process needs to be triggered, that is, the process of the client is re-created, the necessary resources are loaded, the page is rendered, other function modules are initialized, and the configuration file is read. If the client is cold started and the video is played at the beginning, a guide animation can be played on the display interface to timely prompt the user about the content and effect of the first event.
[0101] The third trigger condition is that the time interval from the last time the guide animation is played meets a preset interval requirement.
[0102] If the guide animation has been played before, the user can forget to trigger the first event after a long time. Therefore, in the embodiment of the application, the guide animation can be played to the user again when the time interval from the last time the guide animation is played meets a preset interval requirement, for example, more than 7 days.
[0103] The fourth trigger condition is that the occurrence number of the first event is less than or equal to a preset number threshold.
[0104] If the user almost does not trigger the first event, for example, the occurrence number of the first event is less than 2, it is indicated that the user can not know how to use the first event or can not know the effect of the first event. Therefore, the guide animation can be played on the display interface to timely prompt the user about the content and effect of the first event.
[0105] It should be noted that the above several trigger conditions can be combined in any form to constitute a new trigger condition. For example, the trigger condition can be that the user drags the video playing progress bar, the occurrence number of the first event is less than or equal to a preset number threshold, and the time interval from the last time the guide animation is played meets a preset interval requirement. For another example, the trigger condition can be that the currently played media file is the first horizontal screen video played on the display interface after the client is cold started, the occurrence number of the first event is less than or equal to a preset number threshold, and the time interval from the last time the guide animation is played meets a preset interval requirement.
[0106] Further, the total number of playing times, the playing time length, the canceling playing condition, the prohibiting playing condition, etc. of the guide animation can be limited for the user to avoid the frequent playing or long time playing of the guide animation from causing adverse effects on the normal viewing experience of the user. For example, the total number of playing times of the guide animation is limited to 4 times, i.e. the guide animation is not played after being displayed for 4 times; for another example, the guide animation is displayed on the display interface for a first preset time length, e.g. the playing time length is limited to 7 seconds, and the first event on the display interface is not detected, then the display of the guide animation on the display interface is canceled; for another example, if the user triggers the first event more than 3 times, it can be considered that the user has known the content and the function of the first event, and the subsequent playing of the guide animation is prohibited.
[0107] In some implementations, the at least one video frame can be displayed on the display interface, and the switching between the at least one video frame can be performed in response to monitoring a seventh event. In this way, the user can easily view the previous video frame or the next video frame without leaving the current interface, thereby maintaining the continuity and fluency of the browsing.
[0108] The seventh event includes, for example, an event triggered by a single-finger sliding gesture in a preset direction, or an event triggered by a fourth interface element. The preset direction can be the arrangement direction of the at least one video frame. For example, if the at least one video frame is arranged horizontally on the display interface, the single-finger sliding gesture can include a leftward single-finger sliding gesture and a rightward single-finger sliding gesture. The fourth interface element can be an arrow indicating the preset direction. For example, the fourth interface element can include a leftward indicating arrow and a rightward indicating arrow. The switching between the at least one video frame can be realized by the event triggered by the single-finger sliding gesture in the preset direction, or the event triggered by the fourth interface element, which can enable the user to flip through the video frames simply and efficiently, improve the browsing efficiency of the highlights in the video file, and increase the interactivity between the user and the content of the video frames, so that the user can actively participate in the browsing process and improve the interactive experience.
[0109] Continuing to refer to (b) in Figure 3 and (b) in Figure 4 , if the user uses a leftward single-finger sliding gesture on the display interface, the display interface shown in (c) in Figure 3 and (c) in Figure 4 is entered, and the position originally displaying the video frame B on the display interface now displays the video frame C located after the video frame B. Similarly, if the user uses a rightward single-finger sliding gesture on the display interface, the position originally displaying the video frame B on the display interface displays the video frame A located before the video frame B.
[0110] In some implementations, the target video frame in the at least one video frame can be highlighted on the display interface in response to monitoring the eighth event while the at least one video frame is displayed on the display interface. The target video frame can be, for example, a video frame that the user is more interested in. The user can switch different video frames in the at least one video frame on the display interface by the aforementioned seventh event (e.g., a single-finger sliding gesture triggered event), and select the target video frame that he or she is more interested in during the switching of the at least one video frame, and the target video frame can be highlighted on the display interface by the eighth event. Highlighting the target video frame in the at least one video frame on the display interface can provide more intuitive visual feedback to the user, helping the user to confirm that he or she has accurately selected the target video frame of interest, and improving the accuracy and efficiency of the operation.
[0111] The eighth event can include, for example, the target video frame being located at the middle position of the display interface, or being slid to the target video frame based on a sliding operation between the at least one video frame. For example, the eighth event can be sliding the target video frame to the middle position of the display interface by a sliding operation. In this way, the selection of the target video frame is indicated and the target video frame is highlighted, which is simple and fast, and also more consistent with the user's cognitive and operation habits in the operation gesture.
[0112] Continuing to refer to (c) in Figure 3 and (c) in Figure 4 , assuming that the target video frame is video frame C, the user can switch the video frame displayed on the display interface from video frame B to video frame C by a single-finger sliding gesture, or in other words, slide video frame C to the middle position of the display interface by a single-finger sliding gesture. At this time, video frame C can be highlighted in the display interface, for example, a frame is displayed around video frame C to identify the selected video frame C, while no frame is displayed around video frame B and video frame D. At the same time, video frame C can also be highlighted by using a higher display brightness than video frame B and video frame D, or in other words, reducing the display brightness of video frame B and video frame D.
[0113] In addition to highlighting video frame C by adding a frame and increasing brightness as shown in (c) in Figure 3 and (c) in Figure 4 , other ways can also be used to highlight video frame C. For example, video frame C can be displayed in a larger picture size than video frame B and video frame D; for another example, other visual guide elements or text annotations can be used to point to video frame C in addition to the frame; for another example, a mask layer can be added to video frame B and video frame D to make them blurred, transparent or completely invisible, thereby highlighting video frame C; and the like.
[0114] It should be noted that if the seventh event used to trigger video frame switching is a single-finger swipe gesture, then the eighth event used to trigger video frame highlighting can also be seen as being triggered by the release of the single-finger swipe gesture. For example, when switching the target video to the middle position of the display interface using a single-finger swipe gesture, stopping the single-finger swipe gesture and removing the finger from the display interface will trigger the target video frame to be highlighted on the display interface when the finger leaves the display interface.
[0115] Understandable. Figure 5 (a) and Figure 5 The display interface shown in (a) displays a video file playback page, while Figure 5 (b) and (c) in the middle, and First operation: skip play based on target video frame. The display interface shown in (b) and (c) displays a video frame filtering page. In response to the first event on the playback page, the client can cancel the display of the video file playback page and display the video frame filtering page. By using the seventh event on the filtering page (e.g., an event triggered by a single-finger swipe gesture), the client can switch between at least one video frame to filter out the target video frame and highlight it.
[0116] In other implementations, in response to detecting the first event, the client can also simultaneously display a video file playback page and a video frame filtering page to the user. See [example example]. Figure 3 In (a), in response to the first event on the playback page (e.g., an event triggered by a two-finger pinch gesture), enter Figure 3 The display interface shown in (b) has a playback page that is minimized and placed above the display interface, while a video frame filter page pops up below the display interface. The filter page includes, for example, at least one video frame for representing highlights, a fifth interface element for indicating the playback progress of the video frame, and a sixth interface element for indicating interactive information of the video frame.
[0117] The video content played on the video playback page is linked to the video frame switching operations on the video frame filtering page. For example, when a video frame is switched to the middle of the filtering page, the content played on the playback page will correspondingly switch to the highlight clip of that video frame. See [example example] for details. Figure 3 In (b) and (c), after the user switches video frame B to video frame C using a single-finger swipe gesture, the content playing on the playback page will also switch from the highlight segment corresponding to video frame B to the highlight segment corresponding to video frame C.
[0118] In the embodiments of the present application, after the user selects the target video frame in the at least one video frame representing the highlight segment in the above manner, the user can also perform other operations based on the target video frame. That is, the above method can further include, in response to monitoring the trigger event for the specific interactive operation, performing the specific interactive operation based on the target video frame. For example, the specific interactive operation can include jump playing, editing, commenting, or other interactive operations on the target video frame. The following describes these operations respectively.
[0119] Figure 3
[0120] In some implementations, when the at least one video frame is displayed on the display interface, in response to monitoring the fourth event, the highlight segment corresponding to the target video frame in the at least one video frame is played on the display interface. That is, when the at least one video frame is displayed on the display interface, in response to monitoring the fourth event, the highlight segment corresponding to the target video frame is jumped to and played. In this way, in the case of enabling the user to quickly obtain each highlight segment in the video file, the user can also jump to play based on the highlight segment of interest to the user, further improving the video consumption efficiency.
[0121] In the embodiments of the present application, the playing of the video file refers to converting the content of the video file into images, sounds, or a combination of both that can be directly perceived by humans, and the jump playing refers to jumping to a specific time point in the video to start playing the video file. For example, when the jump playing is performed based on the target video frame, the specific time point can be the playing time corresponding to the target video frame, or the starting playing time of the highlight segment corresponding to the target video frame, or a certain predetermined time associated with the target video frame, and the like.
[0122] The fourth event includes, for example, an event triggered by a click operation on the target video frame, and / or an event triggered by a sliding operation between the at least one video frame. By the click operation on the target video frame in the at least one video frame and / or the sliding operation between the at least one video frame, the playing of the highlight segment corresponding to the target video frame in the video file is realized, which is simple and fast on the one hand, and also conforms to the user's cognition and operation habit on the operation gesture on the other hand.
[0123] Continuing to refer to Second operation: edit for target video frame. , if the user wants to watch the highlight segment corresponding to the video frame C, the user can switch the video frame C to the middle position of the display interface by the single-finger sliding gesture shown in (b) of Figure 4 , and click the video frame C as shown in (c) of Figure 4 , so as to enter the display interface shown in (d) of , and the display interface starts playing the highlight segment corresponding to the video frame C.
[0124] Figure 4
[0125] In some implementations, the editing page can be displayed on the display interface in response to monitoring the fifth event while displaying the at least one video frame on the display interface. The editing page is used to edit a target video frame in the at least one video frame. The fifth event enables the calling of the editing page, so that the user can edit the target video frame in the at least one video frame in the editing page, meeting the diversified needs of the user and improving the user's participation and creation experience in the video consumption process.
[0126] Here, the editing can include secondary creation (hereinafter referred to as secondary creation). Secondary creation refers to a creation process of reprocessing, editing, synthesizing or adapting video frames without changing the basic content of the original video frames. This process aims to create a new video work with new meaning, new perspective or new expression by rearranging, combining, modifying or enhancing video frames.
[0127] The fifth event can be an event triggered by the seventh interface element. For example, the seventh interface element for triggering the fifth event is displayed while displaying the at least one video frame in the video file on the display interface. The editing of the target video frame is realized through the interface element for triggering the fifth event, which more intuitively displays the editing function of the video frame, enabling the user to enter the editing page simply and quickly.
[0128] Referring back to (c) in Third operation: interactive operation for target video frame. The seventh interface element (e.g., secondary creation) can be located in the interactive area on the right side of the display interface. If the user clicks the seventh interface element (e.g., secondary creation), the editing page shown in (d) in Figure 4 The user can use the relevant interface elements in the editing page to perform secondary creation on the target video frame in the at least one video frame.
[0129] As an example, as shown in Fourth operation: target video frame as comment attachment.As shown in (d) of FIG. 1, the editing page can include, for example, page elements such as flipping, countdown, challenge, status, beautification, etc. in the right column, or page elements such as photo, text, magic, etc. below, or page elements such as music, etc. above, to realize the corresponding editing functions. Among them, flipping refers to horizontal or vertical flipping of the position of the target video frame; countdown refers to adding a time-decreasing visual effect in the video, which can create a tense or expectant atmosphere and attract the attention of the audience; challenge function is usually related to short video challenge activities on social media platforms, allowing users to participate in specific challenge tasks, such as imitating a certain action, completing a certain task, or creating video content related to a specific theme; status function can show the user's satisfaction, happiness or positive attitude towards the video content, or be used to attract the attention and interest of other users; beautification function refers to visual optimization and modification of the video to improve the visual and quality of the video, such as adjusting color parameters such as brightness, contrast, saturation of video frames, applying filter effects, and performing advanced processing such as face beautification and background blurring. Magic function refers to adding special visual effects (such as fantastic, interesting or unique visual effects) to the video frame or changing the presentation of the video. The text function refers to adding text descriptions to the video frame. The photo function can add additional pictures or photos to the video file. In addition, the music function on the editing page can also be used to add appropriate background music to the newly created video file.
[0130] After performing all or part of the above operations on the target video frame in the editing page, a newly created video file can be formed and published in the platform, for example, as shown in (e) of FIG. 1. Figure 3
[0131] Figure 6
[0132] In some implementations, when displaying the at least one video frame, the interaction operation can be triggered for the target video frame in the at least one video frame in response to monitoring the sixth event. The interaction operation may, for example, include at least one of the following operations: downloading, liking, commenting, sharing, and collecting. Through the sixth event, the downloading, liking, commenting, sharing, and collecting operations on the target video frame in the at least one video frame are realized, meeting the diversified needs of users and improving the participation and interaction experience of users in the video consumption process.
[0133] The sixth event can be an event triggered by the eighth interface element, for example, the eighth interface element for triggering the sixth event is displayed when the at least one video frame is displayed on the display interface. The downloading, liking, commenting, sharing, and collecting operations on the target video frame are realized through the interface element for triggering the sixth event, which more intuitively displays the interactive function for the video frame and enables the user to simply and quickly perform the interactive operation.
[0134] With reference back to Figure 4 (c), the eighth interface element can be located in the interactive area on the right side of the display interface, for example, including the interface elements corresponding to the functions of downloading, liking, commenting, sharing, and the like. If the user clicks the corresponding interface element, the corresponding downloading, liking, commenting, sharing, and the like are performed.
[0135] Figure 6
[0136] In some implementations, when the at least one video frame is displayed on the display interface, a comment page for the video file is displayed on the display interface in response to monitoring a second event on the display interface, and a target video frame in the at least one video frame is inserted in the comment page. Then, in response to monitoring a publishing operation on the comment page, comment content with the target video frame as a comment attachment is published. That is, through the second event, the target video frame in the at least one video frame can be directly used for commenting, and the target video frame appears as a comment attachment in the comment page. Through the second event, the target video frame is quickly inserted into the comment page as a comment attachment, which can quickly provide the user with the comment page inserted with the target video frame, enrich the user's comment operation, improve the comment efficiency, and improve the user's interactive experience.
[0137] The second event may, for example, include an event triggered by a clicking operation on the target video frame, an event triggered by a sliding operation between the at least one video frame, or an event triggered by a second interface element. Through the clicking operation on the target video frame in the at least one video frame on the display interface, the sliding operation between the at least one video frame, or the operation triggered by the second interface element, the target video frame is quickly inserted into the comment page as a comment attachment, which is simple and fast on the one hand, and also conforms to the user's cognitive and operation habits on the operation gesture.
[0138] As an example, if the user wants to publish a comment with a video frame C in the at least one video frame representing a highlight segment as a comment attachment, the video frame C in the at least one video frame can be switched to the middle position of the display interface through a single-finger sliding gesture and clicked on the video frame C (for example, refer to the operations shown in (b) and (c) of Figure 6 Fifth operation: joint play based on target video frame. the comment page shown in (b) and (c) in FIG. 10B; or, the second interface element (e.g., the text "comment" displayed in the interactive area on the right side of the display interface) can be displayed simultaneously when at least one video frame is displayed on the display interface (e.g., refer to the operation shown in (b) and (c) in FIG. 10B), and if the user clicks the second interface element, the comment page shown in (d) in FIG. 10B is entered. Figures 1 to 6 Figures 7 to 8 As shown in (d) in FIG. 10B, when the comment page is displayed in response to the above operation, the video frame C is automatically inserted in the comment page, without the need for the user to click the corresponding interface element of the comment page to select a picture as in the conventional way of inserting a comment picture, so that the user can quickly insert the target video frame into the comment page as a comment attachment. Thereafter, the user can also input the text that he or she wants to express in the text input area of the comment page to further enrich the comment content and publish it, so that the comment with the video frame C is published. Figure 7
[0139] Figure 7
[0140] Dubbing is a function that enables users to interact with and co-create interesting videos with other video content, which not only enriches the user's creation experience, but also promotes interaction and communication on social media platforms.
[0141] In some implementations, when at least one video frame is displayed on the display interface, a dubbing page for dubbing operation can be displayed on the display interface in response to monitoring a third event, the dubbing page taking a target video frame in the at least one video frame as a dubbing background. Then, optionally, in response to monitoring a recording operation for a dubbed video, a dubbed video taking the target video frame as a dubbing background is recorded, and in response to monitoring a publishing operation for the dubbed video, the dubbed video is published. That is, through the third event, the user can dub between the target video frame in the at least one video frame. For example, the interface for dubbing operation can include two areas, one area displaying the target video frame and the other area being a lens area, and the user can adjust the proportion of the display area of the target video frame and the lens area by dragging the dividing line in the middle. The two areas displayed in the interface for dubbing operation can adopt layout modes such as left-right split screen and top-bottom split screen, for example. Through the third event, the page for dubbing operation taking the target video frame as a background is displayed, which can quickly provide the user with a page for dubbing operation, thereby providing the user with a creation basis taking the target video frame as a background, enabling the user to perform dubbing operation based on the target video frame, improving the user's interactive experience, and simplifying the user's operation.
[0142] The third event may include, for example, an event triggered by a click operation on a target video frame, an event triggered by a sliding operation between at least two video frames, or an event triggered by a third interface element. By means of the click operation on the target video frame, the sliding operation between at least two video frames, or the operation triggered by the third interface element on the display interface, a page of the retouch operation with the target video frame as the background is provided for the user, which is simple and fast in operation and conforms to the user's cognitive and operation habits in the operation gesture.
[0143] The above describes the related operations that can be performed by the user based on the target video frame after the user selects the target video frame in the at least one video frame for representing the highlight clip, such as the jump play, the editing, the comment, the retouch, or the interactive operation, etc. However, in some cases, after the user triggers the display of the at least one video frame by the first event, if the user fails to select the target video frame of interest in the at least one video frame and wishes to exit the selection process of the video frame and continue to watch the video file, the ninth event can be triggered. In response to the monitoring of the ninth event, the client cancels the display of the at least one video frame and switches back to continue to play the video file on the display interface.
[0144] For example, the ninth event may include, but is not limited to, the following gestures:
[0145] The first gesture: a click operation on a non-display area of the video frame.
[0146] For example, a click operation on any other area outside the video frame cancels the display of the at least one video frame and switches back to continue to play the video file on the display interface.
[0147] The second gesture: a double-finger zoom gesture opposite to the double-finger zoom gesture adopted by the first event.
[0148] For example, the first event adopts a double-finger zoom-out gesture to trigger the display of the at least one video frame on the display interface, and a double-finger zoom-in gesture is adopted when the display of the at least one video frame is exited and switched back to continue to play the video file on the display interface.
[0149] The third gesture: a gesture triggering the ninth interface element on the display interface.
[0150] The display interface may display the ninth interface element when displaying the at least one video frame. The user exits the display of the at least one video frame and switches back to continue to play the video file on the display interface by means of the gesture of clicking the ninth interface element (for example, "exit" or "X").
[0151] In addition, in order to facilitate the user to notice the ninth interface element, the ninth interface element can be highlighted on the display interface. The highlighting manner can be, for example, displaying corresponding text, magnifying display, using a specific color, and the like.
[0152] Further, in order to reduce the impact on the user's viewing experience as much as possible, when the duration of the highlighting reaches the second preset duration, the client cancels the highlighting of the ninth interface element in response to the duration of the highlighting reaching the second preset duration.
[0153] In addition, the number of times of highlighting, the condition of prohibiting highlighting, and the like can also be limited. For example, the highlighting is not displayed after 3 times of highlighting. For another example, the user triggers the ninth interface element more than 3 times, and subsequent highlighting of the ninth interface element is prohibited.
[0154] The fourth gesture: a gesture of triggering interface jumping.
[0155] The interface jumping can be jumping to other interfaces of the client, for example, returning to the desktop, exiting the client, or switching to display other application clients, and the like.
[0156] For example, after the user triggers the return to the desktop, the display of the at least one video frame is exited and the video file is continued to be played on the display interface. When the user enters the display interface again, the video file is continued to be played from the last playing position. If it is necessary to display the at least one video frame for representing the highlight segment on the display interface, the first event needs to be re-executed.
[0157] It should be noted that the foregoing introduces a plurality of embodiments, which can be implemented independently or combined with each other without conflict.
[0158] The "first", "second", "third", and the like involved in the embodiments of the present application do not have the restriction of size, order, and quantity, and are only used to distinguish in name. For example, "first event" and "second event" are used to distinguish two events in name. For another example, "first interface element", "second interface element", "third interface element", and the like are used to distinguish different interface elements in name.
[0159] It should be noted that, in order to detect the occurrence of each event, the client can pre-register a callback function or method for the event to be monitored, which includes the logic code to be executed in response to the event. Once the event is triggered, the client automatically calls the corresponding callback function or method. For example, a callback function is registered in advance for the first event, which triggers the client to display at least one video frame for representing the highlight segment in the video file on the display interface. The response to the event in the embodiments of the present application can be implemented in this way, and subsequent details are not described.
[0160] The terminology used in the embodiments of the present application is merely for the purpose of describing specific embodiments, and is not intended to limit the protection scope of the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.
[0161] It should be understood that the term "and / or" used in the present application is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can represent the three cases of A alone, A and B together, and B alone. In addition, the character " / " in the present application generally represents an "or" relationship between the front and rear associated objects.
[0162] Depending on the context, the word "if" as used herein can be interpreted as "when" or "upon" or "in response to". Similarly, the phrase "if determined" or "if detecting (a stated condition or event)" can be interpreted as "when determined" or "in response to determining" or "when detecting (a stated condition or event)" or "in response to detecting (a stated condition or event)", depending on the context.
[0163] It should be noted that the interface elements involved in the embodiments of the present application generally refer to visual elements on the display interface, which can include text, icons, images, videos, components, etc. The so-called component refers to an object obtained by simply encapsulating data and methods, which can also be called a control, for example, including buttons, input boxes, drop-down menus, dialog boxes, navigation bars, cards, icons that can produce interaction, etc.
[0164] The method embodiments of the present application are described in detail above Figure 1 , and the device embodiments of the present application are described in detail below Figure 7 . It should be understood that the description of the method embodiments corresponds to the description of the device embodiments, and therefore, the parts not described in detail can be referred to the foregoing method embodiments.
[0165] Figure 8A structural schematic diagram of an apparatus for processing a video file is provided in the embodiments of the present application. Figure 8 The apparatus shown can be arranged in, for example Figure 8 The client 112 shown can be arranged in, for example As shown, the apparatus 700 includes an interface display unit 710 and an event monitoring unit 720. The event monitoring unit 720 is configured to monitor a play instruction of a video file. The interface display unit 710 is configured to play the video file on a display interface in response to monitoring the play instruction. The event monitoring unit 720 is further configured to monitor a first event for the video file in a process of playing the video file, the first event being used to trigger the display interface to display at least one video frame, the at least one video frame being used to represent a highlight segment in the video file. The interface display unit 710 is further configured to display a video frame display page on the display interface in response to monitoring the first event, wherein the video frame display page is used to display the at least one video frame.
[0166] In some implementations, the first event includes an event triggered by a double-finger pinch gesture, an event triggered by a first interface element, or an event triggered by a voice instruction.
[0167] In some implementations, the interface display unit 710 is further configured to, when the at least one video frame is displayed on the display interface, display a comment page for the video file on the display interface in response to monitoring a second event, the comment page being inserted with a target video frame in the at least one video frame; and in response to monitoring a publishing operation on the comment page, publish comment content with the target video frame as a comment illustration.
[0168] In some implementations, the second event includes an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between the at least one video frame, or an event triggered by a second interface element.
[0169] In some implementations, the interface display unit 710 is further configured to, when the at least one video frame is displayed on the display interface, display a photo-taking page for a photo-taking operation on the display interface in response to monitoring a third event, the photo-taking page taking a target video frame in the at least one video frame as a photo-taking background; in response to monitoring a recording operation on a photo-taken video, record the photo-taken video with the target video frame as the photo-taking background; and in response to monitoring a publishing operation on the photo-taken video, publish the photo-taken video.
[0170] In some embodiments, the third event includes: an event triggered by a click operation on the target video frame, an event triggered by a sliding operation between the at least one video frame, or an event triggered by a third interface element.
[0171] In some embodiments, the interface display unit 710 is further configured to: in response to monitoring a fourth event, while displaying the at least one video frame on the display interface, play a highlight clip corresponding to a target video frame in the at least one video frame on the display interface.
[0172] In some embodiments, the fourth event includes: an event triggered by a click operation on the target video frame, and / or an event triggered by a sliding operation between the at least one video frame.
[0173] In some embodiments, the interface display unit 710 is further configured to: in response to monitoring a fifth event, while displaying the at least one video frame on the display interface, display an editing page on the display interface, the editing page being used for editing a target video frame in the at least one video frame.
[0174] In some embodiments, the interface display unit 710 is further configured to: while displaying the at least one video frame on the display interface, display an interface element used for triggering the fifth event.
[0175] In some embodiments, the interface display unit 710 is further configured to: in response to monitoring a sixth event, while displaying the at least one video frame on the display interface, trigger at least one of the following operations for a target video frame in the at least one video frame: downloading, liking, commenting, sharing, and collecting.
[0176] In some embodiments, the interface display unit 710 is further configured to: while displaying the at least one video frame on the display interface, display an interface element used for triggering the sixth event.
[0177] In some embodiments, while displaying the at least one video frame on the display interface, the at least one video frame is arranged on the display interface according to an order in which the at least one video frame appears in the video file.
[0178] In some embodiments, the interface display unit 710 is further configured to: in response to monitoring a seventh event, while displaying the at least one video frame on the display interface, switch between the at least one video frame.
[0179] In some embodiments, the seventh event includes: an event triggered by a single-finger sliding gesture in a preset direction, or an event triggered by a fourth interface element.
[0180] In some embodiments, the interface presentation unit 710 is further configured to: display a fifth interface element when the at least one video frame is displayed on the display interface, the fifth interface element being used to indicate a position of the at least one video frame in a video playback progress bar.
[0181] In some embodiments, the interface presentation unit 710 is further configured to: display a sixth interface element when the at least one video frame is displayed on the display interface, the sixth interface element being used to indicate the interactive information corresponding to the at least one video frame.
[0182] In some embodiments, the interactive information comprises at least one of: a high-upvoted moment, a number of upvotes corresponding to the high-upvoted moment, a high-rated moment, a number of comments corresponding to the high-rated moment, a high-shared moment, a number of shares corresponding to the high-shared moment, a high-rewatched moment, and a number of rewatches corresponding to the high-rewatched moment.
[0183] In some embodiments, the interface presentation unit 710 is further configured to: when the at least one video frame is displayed on the display interface, in response to monitoring an eighth event, highlight a target video frame in the at least one video frame on the display interface.
[0184] In some embodiments, the eighth event comprises: the target video frame being located at a middle position of the display interface, or sliding to the target video frame based on a sliding operation between the at least one video frame.
[0185] In some embodiments, the highlight moment in the video file is associated with user interaction data, the interaction data comprising at least one of: a number of obtained upvotes, a number of obtained comments, a number of times of being shared, and a number of times of being rewached.
[0186] In some embodiments, the interface presentation unit 710 is further configured to: in response to monitoring an operation of dragging a video playback progress bar during playback of the video file, play a guide animation on the display interface, the guide animation being used to prompt content and / or effect of the first event.
[0187] The various embodiments of the present application are described in progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the difference from other embodiments. In particular, for system or device embodiments, since they are basically similar to the method embodiments, they are described more simply, and the relevant parts can be referred to the part of the method embodiments. The system and device embodiments described above are only illustrative, and the units described as separate components can be or can not be physically separated, and the components shown as units can be or can not be physical units, i.e. they can be located in one place or distributed on multiple network units. Some or all of the modules can be selected to achieve the purpose of the present embodiment according to actual needs. Those skilled in the art can understand and implement without creative labor.
[0188] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation portal for user to choose authorization or refusal.
[0189] In addition, the present application also provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to implement the steps of the method of any one of the preceding method embodiments.
[0190] The present application also provides an electronic device, comprising: one or more processors; and a memory associated with the one or more processors, the memory being configured to store program instructions that, when executed by the one or more processors, perform the steps of the method of any one of the preceding method embodiments.
[0191] The present application also provides a computer program product comprising a computer program that, when executed by a processor, implements the steps of the method of any one of the preceding method embodiments.
[0192] Among them, An exemplary architecture of an electronic device is shown, specifically, the electronic device can include a processor 810, a video display adapter 811, a disk drive 812, an input / output interface 813, a network interface 814, and a memory 820. The above-mentioned processor 810, video display adapter 811, disk drive 812, input / output interface 813, network interface 814, and memory 820 can be connected by a communication bus 830.
[0193] The processor 810 can be implemented by a general-purpose CPU, a microprocessor, an application specific integrated circuit (ASIC), or one or more integrated circuits, etc., for executing relevant programs to implement the technical solutions provided by the embodiments of the present application.
[0194] The memory 820 can be implemented by a read only memory (ROM), a random access memory (RAM), a static storage device, a dynamic storage device, etc. The memory 820 can store an operating system 821 for controlling the operation of the electronic device 800, a basic input / output system (BIOS) 822 for controlling the low-level operation of the electronic device 800. In addition, a web browser 823, a data storage management system 824, and a media file playing processing apparatus 825, etc. can also be stored. The media file playing processing apparatus 825 can be an application program for implementing the foregoing steps in the embodiments of the present application. In general, when the technical solutions provided by the present application are implemented by software or firmware, the relevant program codes are stored in the memory 820 and are called and executed by the processor 810.
[0195] The input / output interface 813 is configured to connect input / output modules to realize information input and output. The input / output modules can be configured as components in the device (not shown in the figure), or can be externally connected to the device to provide corresponding functions. The input devices can include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output devices can include a display, a speaker, a vibrator, an indicator light, etc. The network interface 814 is configured to connect a communication module (not shown in the figure) to realize the communication interaction between the device and other devices. The communication module can realize communication through a wired manner (for example, a USB, a network cable, etc.), or can realize communication through a wireless manner (for example, a mobile network, WIFI, Bluetooth, etc.).
[0196] The bus 830 includes a channel for transmitting information between various components (for example, the processor 810, the video display adapter 811, the disk drive 812, the input / output interface 813, the network interface 814, and the memory 820) of the device.
[0197] The bus 830 includes a channel for transmitting information between various components (for example, the processor 810, the video display adapter 811, the disk drive 812, the input / output interface 813, the network interface 814, and the memory 820) of the device.
[0198] It should be noted that although the above device only shows the processor 810, the video display adapter 811, the disk drive 812, the input / output interface 813, the network interface 814, the memory 820, the bus 830 and the like, in the specific implementation process, the device can also include other components necessary for normal operation. In addition, those skilled in the art can understand that the above device can also only contain the components necessary to implement the scheme of the present application, and does not have to contain all the components shown in the figure.
[0199] From the above description of the embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software and the necessary general hardware platform. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer program product, which can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., including a number of instructions to make a computer device (such as a personal computer, server, or network device, etc.) execute the methods described in various embodiments or some parts of the embodiments of the present application.
[0200] The above describes the technical solutions provided by the present application in detail, and the principles and implementation manners of the present application are described by applying specific examples. The above description of the embodiments is only to help understand the method and its core idea of the present application; at the same time, for those skilled in the art, according to the idea of the present application, the specific implementation manner and application range will be changed. In conclusion, the content of the specification should not be understood as a limitation of the present application.
Claims
1. A method of processing a video file, characterized by, The method comprises: monitoring a playing instruction of a video file; in response to monitoring the playing instruction, playing the video file on a display interface; monitoring a first event for the video file during playing of the video file, the first event being used to trigger the display interface to display at least one video frame, the at least one video frame being used to represent a highlight segment in the video file; in response to monitoring the first event, displaying a video frame display page on the display interface, the video frame display page being used to display the at least one video frame; wherein the method further comprises: when the at least one video frame is displayed on the display interface, in response to monitoring a second event, displaying a comment page for the video file on the display interface, a target video frame in the at least one video frame being inserted into the comment page; in response to monitoring a publishing operation on the comment page, publishing comment content with the target video frame as a comment attachment; and / or, when the at least one video frame is displayed on the display interface, in response to monitoring a third event, displaying a collage page for a collage operation on the display interface, the collage page taking a target video frame in the at least one video frame as a collage background; in response to monitoring a recording operation for a collage video, recording the collage video with the target video frame as the collage background; in response to monitoring a publishing operation for the collage video, publishing the collage video.
2. The method of claim 1, wherein, The first event comprises: an event triggered by a double-finger pinch gesture, an event triggered by a first interface element, or an event triggered by a voice instruction.
3. The method according to claim 1 or 2, characterized in that, The method further comprises: during playing of the video file, in response to monitoring a pause operation for the video file, displaying the at least one video frame on the display interface.
4. The method of claim 3, wherein, The position of the at least one video frame on a video playing progress bar is near the position corresponding to the pause moment on the video playing progress bar.
5. The method of claim 1, wherein, The second event comprises: an event triggered by a click operation for the target video frame, an event triggered by a sliding operation between the at least one video frame, or an event triggered by a second interface element.
6. The method of claim 1, wherein, The third event comprises: an event triggered by a click operation for the target video frame, an event triggered by a sliding operation between the at least one video frame, or an event triggered by a third interface element.
7. The method according to claim 1 or 2, characterized in that, The method further comprises: when the at least one video frame is displayed on the display interface, in response to monitoring a fourth event, playing a highlight segment corresponding to a target video frame in the at least one video frame on the display interface.
8. The method of claim 7, wherein, The fourth event comprises: an event triggered by a click operation for the target video frame, and / or an event triggered by a sliding operation between the at least one video frame.
9. The method of claim 1 or 2, wherein, The method further comprises: when the at least one video frame is displayed on the display interface, in response to monitoring a fifth event, displaying an editing page on the display interface, the editing page being used to edit a target video frame in the at least one video frame.
10. The method of claim 9, wherein, The method further comprises: When the at least one video frame is displayed on the display interface, display an interface element for triggering the fifth event.
11. The method of claim 1 or 2, wherein, The method further includes: When the at least one video frame is displayed on the display interface, in response to monitoring a sixth event, trigger at least one of the following operations for a target video frame in the at least one video frame: downloading, liking, commenting, sharing, and collecting.
12. The method of claim 11, wherein, The method further includes: When the at least one video frame is displayed on the display interface, display an interface element for triggering the sixth event.
13. The method of claim 1 or 2, wherein, When the at least one video frame is displayed on the display interface, the at least one video frame is arranged on the display interface according to the order in which the at least one video frame appears in the video file.
14. The method of claim 1 or 2, wherein, The method further includes: When the at least one video frame is displayed on the display interface, in response to monitoring a seventh event, switch between the at least one video frame.
15. The method of claim 14, wherein, The seventh event includes an event triggered by a single-finger sliding gesture in a preset direction or an event triggered by a fourth interface element.
16. The method of claim 1 or 2, wherein, The method further includes: When the at least one video frame is displayed on the display interface, display a fifth interface element, which is used to indicate the position of the at least one video frame in a video playback progress bar.
17. The method of claim 1 or 2, wherein, The method further includes: When the at least one video frame is displayed on the display interface, display a sixth interface element, which is used to indicate the interaction information corresponding to the at least one video frame.
18. The method of claim 17, wherein, The interaction information includes at least one of the following: a high-liked moment, the number of likes corresponding to the high-liked moment, a high-commented moment, the number of comments corresponding to the high-commented moment, a high-shared moment, the number of shares corresponding to the high-shared moment, a high-replayed moment, and the number of replays corresponding to the high-replayed moment.
19. The method of claim 1 or 2, wherein, The method further includes: When the at least one video frame is displayed on the display interface, in response to monitoring an eighth event, highlight a target video frame in the at least one video frame on the display interface.
20. The method of claim 19, wherein, The eighth event includes that the target video frame is located at a middle position of the display interface or is slid to the target video frame based on a sliding operation between the at least one video frame.
21. The method of claim 1 or 2, wherein, The highlight moment in the video file is associated with user interaction data, and the interaction data includes at least one of the following: the number of obtained likes, the number of obtained comments, the number of times of being shared, and the number of times of being replayed.
22. The method of claim 1 or 2, wherein, The method further includes: During the playback of the video file, in response to monitoring a pause operation and / or an operation of dragging a video playback progress bar for the video file, play a guide animation on the display interface, the guide animation being used to prompt the content and / or the effect of the first event.
23. An apparatus for processing a video file, the apparatus comprising: The device includes: An event monitoring unit configured to monitor a playback instruction of a video file; An interface display unit configured to, in response to monitoring the playback instruction, play the video file on a display interface; The event monitoring unit is further configured to monitor a first event for the video file during playing of the video file, the first event being used to trigger the display interface to display at least one video frame, the at least one video frame being used to represent a highlight clip in the video file. The interface presentation unit is further configured to display, in response to monitoring the first event, a video frame display page on the display interface, the video frame display page being used to display the at least one video frame. The interface presentation unit is further configured to: when the at least one video frame is displayed on the display interface, in response to monitoring a second event, display a comment page for the video file on the display interface, the comment page being inserted with a target video frame in the at least one video frame; in response to monitoring a publishing operation on the comment page, publish comment content with the target video frame as a comment illustration; and / or, when the at least one video frame is displayed on the display interface, in response to monitoring a third event, display a photo-taking page for a photo-taking operation on the display interface, the photo-taking page taking the target video frame in the at least one video frame as a photo-taking background; in response to monitoring a recording operation for a photo-taking video, record the photo-taking video with the target video frame as the photo-taking background; in response to monitoring a publishing operation for the photo-taking video, publish the photo-taking video.
24. An electronic device, comprising: comprise: one or more processors; and a memory associated with the one or more processors, the memory being used to store program instructions, the program instructions being read and executed by the one or more processors to perform the steps of the method of any one of claims 1 to 22.
25. A computer program product, characterised in that, comprise a computer program, the computer program being executed by a processor to implement the steps of the method of any one of claims 1 to 22.
Citation Information
Patent Citations
Animation display method and device, electronic equipment and storage medium
CN112235635A
Resource transmission method and device, terminal and storage medium
CN113141524A