Multimedia display method, electronic device and program product
By displaying the multimedia interface on electronic devices, users can edit videos online, solving the problem of traditional video editing requiring downloading video files, and improving editing efficiency and user experience.
Patent Information
- Application Number
- CN202411943865.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-26
- Publication Date
- 2025-04-25
AI Technical Summary
Traditional video editing technology requires downloading video files to local devices, especially high-definition videos and 4K videos, which seriously affects the efficiency of video editing.
A multimedia display method is provided. By displaying a multimedia interface on an electronic device, including a first display area, a second display area and an operation area, the user can display a keyframe sequence of the video in the second display area, and edit the video through operation controls (such as splitting, sequential adjustment, copying, deleting, etc.). The edited video can be previewed and saved without downloading.
By editing videos online, the video file download time is avoided, the video editing efficiency and user experience is improved, and users can instantly preview the editing effect without waiting for the video to be rendered.
Smart Images

Figure CN119893160A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to technical fields such as multimedia processing, and more particularly to a multimedia display method, electronic equipment, and program product. Background Art
[0002] With the development of Internet technology and the popularization of digital content, video has become one of the main media for modern information transmission and entertainment. From personal short video creation, to corporate promotional video production, to film editing in the film and television industry, video editing technology has been widely used in various fields.
[0003] In the traditional technical context, video editing usually relies on local processing, which requires users to download or import materials to local devices before editing and exporting.
[0004] However, since video files are usually large, especially HD and 4K videos, the download time may be very long; even under good network conditions, users still need to spend a long time waiting for the download to complete, which seriously affects the efficiency of video editing. Summary of the invention
[0005] The present disclosure provides a multimedia display method, an electronic device, and a program product.
[0006] According to one aspect of the present disclosure, there is provided a multimedia display method, comprising:
[0007] Displaying a multimedia interface, the multimedia interface comprising a first display area, a second display area and an operation area, the first display area being used to display an online video, the second display area being used to display at least one first key frame sequence of the online video in partitions, and the operation area being configured with operation controls;
[0008] Receiving an operation of the operation control by a user;
[0009] In response to an operation on the operation control, at least one first key frame sequence displayed in the second display area is replaced with at least one second key frame sequence of the online video corresponding to the operation.
[0010] According to at least one embodiment of the multimedia display method of the present disclosure, before replacing the at least one first key frame sequence displayed in the second display area with the at least one second key frame sequence of the online video corresponding to the operation, the method further includes:
[0011] The at least one first key frame sequence is adjusted according to the operation to obtain the at least one second key frame sequence.
[0012] According to the multimedia display method of at least one embodiment of the present disclosure, the at least one first key frame sequence is adjusted according to the operation to obtain the at least one second key frame sequence, including:
[0013] Acquire at least one first time interval of the online video pointed to by the at least one first key frame sequence;
[0014] Acquire at least one second time interval after adjusting the at least one first time interval according to the operation;
[0015] At least one second key frame sequence of at least one video segment of the online video pointed to by the at least one second time interval is obtained.
[0016] According to at least one embodiment of the present disclosure, the multimedia display method further includes, after receiving the user's operation on the operation control:
[0017] Acquire the correspondence between the timeline before the operation and the timeline after the operation of the online video according to the operation; send the correspondence to a first server, the first server is used to store the online video, and is used to edit the online video according to the correspondence to obtain an edited video; or,
[0018] The operation information is sent to a second server, where the second server is used to store the online video, and to obtain the correspondence between the pre-operation timeline and the post-operation timeline of the online video according to the operation information, and then edit the online video according to the correspondence to obtain an edited video.
[0019] According to at least one embodiment of the multimedia display method of the present disclosure, before sending the corresponding relationship to the first server, the method further includes: receiving a preview instruction sent by a user; obtaining a preview time point of the online video indicated by the preview according to the corresponding relationship; obtaining a preview video unit from the first server according to the preview time point and displaying it in the second display area;
[0020] The sending the corresponding relationship to the first server includes: sending the corresponding relationship to the first server in response to a save instruction sent by the user according to the display in the second display area.
[0021] According to the multimedia display method of at least one embodiment of the present disclosure, the operation control includes:
[0022] One or more of a split control, an order adjustment control, a copy control, and a delete control.
[0023] According to a multimedia display method of at least one embodiment of the present disclosure,
[0024] In response to the operation on the operation control including the operation on the split control, the at least one second key frame sequence is specifically: a sequence after the sequence to be split in the at least one first key frame sequence is replaced by a plurality of split sequences, the plurality of split sequences correspond to a plurality of split videos obtained after the video to be split is split, and the video to be split is a video corresponding to the sequence to be split in the online video;
[0025] In response to the operation on the operation control including the operation on the copy control, the at least one second key frame sequence is specifically: a sequence after a copy of the sequence to be copied in the at least one first key frame sequence is inserted into a position specified by the operation of the copy control in the at least one first key frame sequence;
[0026] In response to the operation on the operation control including the operation on the delete control, the at least one second key frame sequence is specifically: a sequence after the sequence to be deleted in the at least one first key frame sequence is deleted;
[0027] In response to the operation of the operating control including the operation of the sequence adjustment control, the at least one second key frame sequence is specifically: a sequence after the sequence to be adjusted in the at least one first key frame sequence is sequence adjusted.
[0028] According to the multimedia display method of at least one embodiment of the present disclosure, when the first display area is further provided with a first progress bar, after replacing the at least one first key frame sequence displayed in the second display area with the at least one second key frame sequence of the online video corresponding to the operation, the method further includes:
[0029] Receiving a first click event of the user on the first progress bar;
[0030] The online video displayed in the first display area is adjusted to a playback position corresponding to the first click event.
[0031] According to the multimedia display method of at least one embodiment of the present disclosure, when the second display area is further provided with a second progress bar, after replacing the at least one first key frame sequence displayed in the second display area with the at least one second key frame sequence of the online video corresponding to the operation, the method further includes:
[0032] Receiving a second click event of the user on the second progress bar;
[0033] In response to the second click event, receiving a click image sent by a server storing the online video;
[0034] The click image is displayed in the second display area.
[0035] According to the multimedia display method of at least one embodiment of the present disclosure, the receiving the click image sent by the server storing the online video includes: receiving the click image sent by the server and a subsequent image of the click image;
[0036] The displaying of the click image in the second display area includes: displaying the click image and subsequent images in the second display area in chronological order.
[0037] According to another aspect of the present disclosure, an electronic device is provided, comprising: a memory storing execution instructions; and a processor executing the execution instructions stored in the memory, so that the processor executes the multimedia display method of any embodiment of the present disclosure.
[0038] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, the multimedia display method of any embodiment of the present disclosure is implemented. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The accompanying drawings illustrate exemplary embodiments of the present disclosure and together with the description serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.
[0040] Figure 1 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 1 .
[0041] Figure 2 yes Figure 1 A schematic diagram of a multimedia interface before operation in the multimedia display method shown.
[0042] Figure 3 yes Figure 1 An example diagram of a multimedia interface before operation in the multimedia display method shown.
[0043] Figure 4 yes Figure 1 A schematic diagram of a multimedia interface after operation in the multimedia display method shown.
[0044] Figure 5 yes Figure 1 An example diagram of a multimedia interface after operation in the multimedia display method shown.
[0045] Figure 6 yes Figure 1 A schematic diagram of a split multimedia interface in the multimedia display method shown.
[0046] Figure 7 yes Figure 1 An example diagram of a split multimedia interface in the multimedia display method shown.
[0047] Figure 8 yes Figure 1 A schematic diagram of a multimedia interface after copying in the multimedia display method shown.
[0048] Fig. 9 yes Figure 1 An example diagram of a multimedia interface after copying in the multimedia display method is shown.
[0049] Fig.10 yes Figure 1 A schematic diagram of a multimedia interface after deletion in the multimedia display method shown.
[0050] Fig.11 yes Figure 1 An example diagram of a multimedia interface after deletion in the multimedia display method shown.
[0051] Fig.12 yes Figure 1 A schematic diagram of the multimedia interface after adjustment in the multimedia display method shown.
[0052] Fig.13 yes Figure 1 An example diagram of an adjusted multimedia interface in the multimedia display method is shown.
[0053] Fig.14 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 2 .
[0054] Fig.15 yes Fig.14 The flowchart of the sequence adjustment method in the multimedia display method is shown.
[0055] Fig.16 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 3 .
[0056] Fig.17 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 4 .
[0057] Fig.18 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 5 .
[0058] Fig.19 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 6 .
[0059] Fig. 20The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 7 .
[0060] Fig.21 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 8 .
[0061] Fig. 22 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 9 .
[0062] Fig.23 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 10 .
[0063] Fig.24 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 10 one.
[0064] Fig.25 The process of the multimedia display method provided in Embodiment 1 of the present disclosure is Figure 10 two.
[0065] Fig.26 It is a schematic block diagram of the structure of a multimedia display device according to another embodiment of the present disclosure.
[0066] Fig. 27 FIG. 1 is a schematic structural diagram of an electronic device equipped with a multimedia display device according to another embodiment of the present disclosure. Figure 1 . DETAILED DESCRIPTION
[0067] The present disclosure is further described in detail below in conjunction with the accompanying drawings and examples. It is understood that the specific examples described herein are only used to explain the relevant content, rather than to limit the present disclosure. It should also be noted that, for ease of description, only the parts related to the present disclosure are shown in the accompanying drawings.
[0068] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in the present disclosure can be combined with each other. The technical solution of the present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.
[0069] Whether in film production, advertising, online education, live broadcast editing, wedding commemoration, social media publishing and other fields, video editing is required to edit, optimize and process the original materials to remove redundant information, add special effects, insert music, etc., so as to improve the viewing and dissemination effect of the video. Due to the limitations of traditional technology and network conditions, when editing videos, it is necessary to download the videos to the local computer before editing. However, video files are usually large and the download process takes a long time, resulting in low efficiency of video editing.
[0070] To this end, the present disclosure proposes a multimedia display method, electronic device and program product. The present disclosure can be implemented by display software configured on a desktop, laptop, tablet computer, or mobile phone, or the display software can be configured on a server, and the electronic devices such as desktop, laptop, tablet computer, or mobile phone establish a communication connection with the display software on the server by using a browser, and the display software on the server responds to instructions of the electronic devices such as mobile phones to implement the present disclosure.
[0071] Figure 1 FIG. 1 is a schematic diagram showing the overall process of a multimedia display method M100 according to an embodiment of the present disclosure. Figure 1 The method shown includes steps S110 to S130. The method can be performed by electronic devices such as desktop computers, laptop computers, tablet computers, and mobile phones.
[0072] Specifically, Figure 1 The methods shown include:
[0073] Step S110, displaying a multimedia interface.
[0074] In some embodiments of the present disclosure, the multimedia interface displayed by step S110 includes a first display area, a second display area and an operation area, the first display area is used to display online videos, the second display area is used to display at least one first key frame sequence of online videos in partitions, and the operation area is configured with operation controls. The multimedia interface can be an interface when the display software is opened, or it can be an interface switched from other interfaces of the display software. Online video refers to digital video content that is transmitted and played in real time or non-real time through the Internet; online video is usually hosted on a server.
[0075] The first display area can be specifically a separate video window for previewing online videos; in particular, when the user wants to operate multiple online videos at the same time, the first display area can also be multiple video windows. When the second display area displays one key frame sequence, the second display area can be specifically a separate video window; when the second display area displays multiple key frame sequences, the second display area can be a multi-window layout or a multi-panel layout, and different windows or panels display different key frame sequences. The operation controls configured in the operation area are used to represent editing operations on online videos, such as splitting (dividing a complete video file into multiple independent video units according to the timeline or other standards), sequence adjustment (changing the arrangement order of video units on the timeline), copying (copying video units and pasting them at other locations), deleting (deleting unnecessary video units on the timeline), etc.
[0076] When the number of first key frame sequences displayed in the second display area is 1, the first key frame sequence may be composed of multiple key frames of a complete online video, or may be composed of multiple key frames of a video clip in the online video. When the number of first key frame sequences displayed in the second display area is multiple, different key frame sequences may be composed of multiple key frames of different video clips.
[0077] The above key frames can be extracted by display software using the HTML Canvas element. Specifically, the process may include: using the document.createElement method to create a new video element, which returns a new DOM element object; for example, the new video element is obtained by scaling the original height and width of the online video to 720 pixels wide. Set the new DOM element object to be silent and hidden, for example, set the level of the new DOM element object to -1, and set the sound volume to silent. Jump to the specified time when the key frame needs to be extracted and pause. Create a new Canvas DOM. Read the video content at the specified time through the CanvasDOM. Convert and export the content through Canvas to obtain the key frame. Among them, the specified time when the key frame needs to be extracted can be determined based on the time interval, can be determined based on motion detection, can also be determined based on content changes, etc.
[0078] Figure 2 is a schematic diagram of a multimedia interface before operation of one embodiment of the present disclosure; Figure 3 is an example diagram of a multimedia interface before operation according to an embodiment of the present disclosure. Figure 2 and Figure 3 The key frame sequence displayed in the second display area of the multimedia interface is a first key frame sequence extracted from the complete online video.
[0079] refer to Figure 2 and Figure 3 In some embodiments of the present disclosure, a play control button (a button for controlling the play and pause of a video) and / or a horizontal progress bar may be configured on the multimedia interface; a vertical progress bar may be configured on the second interface; controls configured in the operation area may include a recall control, a redo control, a split control, a delete control, a copy control, a set cover control, a return control, and a save control, and the above controls may be in the form of buttons, icons, or text labels. Inspired by the technical solution of the present disclosure, those skilled in the art may adjust the specific control type of the operation control, which shall fall within the protection scope of the present disclosure.
[0080] Displaying at least one first key frame sequence in the second display area can help users better understand the video content, thereby performing more precise editing and improving editing efficiency.
[0081] Step S120: receiving the user's operation on the operation control.
[0082] In some embodiments of the present disclosure, the operation on the operation control may be a single-click operation or a double-click operation on the operation control, and the present disclosure does not specifically limit this. The operation on the operation control received in step S120 may be an operation on one control in the operation control or a combined operation on multiple controls in the operation control.
[0083] Step S130: in response to the operation on the operation control, replacing at least one first key frame sequence displayed in the second display area with at least one second key frame sequence of the online video corresponding to the operation.
[0084] In some embodiments of the present disclosure, after receiving the operation on the operation control, the display software can modify, delete, split and / or copy one or more of the at least one first key frame sequence in step S110 according to the operation, and obtain at least one second key frame sequence and then display it through step S130. When the operation on the operation control is a combined operation, the at least one second key frame sequence is the final sequence after all operations are executed in sequence. The number of the second key frame sequences can be the same as the number of the first key frame sequences, or it can be different.
[0085] Take the split operation as an example. Figure 4 is a schematic diagram of a multimedia interface after operation of an embodiment of the present disclosure, Figure 5 is an example diagram of a multimedia interface after operation according to an embodiment of the present disclosure.
[0086] Figure 4 The second display area is exemplarily shown in the figure, and a sequence adjustment control is exemplarily shown in the second display area. The sequence adjustment control can be in the form of a button, an icon, or a text label, etc. By configuring the sequence adjustment control on each key frame sequence in the second display area, the sequence of each key frame sequence can be conveniently adjusted.
[0087] The multimedia display method provided by the present disclosure represents the editing process of the online video by operating the operation control, and displays the immediate effect of the operation in the second display area during the video editing process, which can make the video editing process more intuitive; and the second key frame sequence can be directly intercepted from the online video to achieve an overview of the editing process, without the need for video rendering, thereby improving the efficiency of video editing. This method solves the problem in the prior art that the video files are usually large, especially high-definition videos and 4K videos, and the download time may be very long; even under good network conditions, users still need to spend a long time waiting for the download to complete, which seriously affects the efficiency of video editing.
[0088] In some embodiments of the present disclosure, the operation controls configured in the operation area of the multimedia interface may include one or more of a split control, a sequence adjustment control, a copy control, and a delete control.
[0089] In some embodiments of the present disclosure, in response to an operation on an operating control including an operation on a split control, at least one second key frame sequence displayed in the second display area may be specifically: a sequence to be split in at least one first key frame sequence is replaced by a sequence after multiple split sequences, the multiple split sequences correspond to multiple split videos obtained after splitting the video to be split, and the video to be split is a video corresponding to the sequence to be split in the online video.
[0090] Figure 6 is a schematic diagram of a multimedia interface after a split operation according to an embodiment of the present disclosure, Figure 6 For the general Figure 4 The second key frame sequence displayed in the second display area is used as a display diagram after the sequence to be split is replaced by multiple split sequences.
[0091] Figure 7 is an example diagram of a multimedia interface after a split operation according to an embodiment of the present disclosure, Figure 7 For the general Figure 5 The second key frame sequence displayed in the second display area is replaced by a plurality of split sequences as a display instance of the sequence to be split.
[0092] In some embodiments of the present disclosure, in response to an operation on an operation control including an operation on a copy control, at least one second key frame sequence displayed in the second display area may specifically be: a sequence after a copy of the sequence to be copied in at least one first key frame sequence is inserted into a position specified by the operation of the copy control in at least one first key frame sequence.
[0093] Figure 8 is a schematic diagram of a multimedia interface after a copy operation according to an embodiment of the present disclosure, Figure 8 For the general Figure 4 The second key frame sequence displayed in the second display area is used as a copy of the sequence to be copied, and the copy is inserted into the end position of the second display area.
[0094] Fig. 9 is an example diagram of a multimedia interface after a copy operation according to an embodiment of the present disclosure, Fig. 9 For the general Figure 5 A display instance in which the second key frame sequence displayed in the second display area is copied as the sequence to be copied, and the copy is inserted into the end position of the second display area.
[0095] In some embodiments of the present disclosure, in response to the operation on the operating control including the operation on the deletion control, the at least one second key frame sequence displayed in the second display area may specifically be: a sequence after the sequence to be deleted in the at least one first key frame sequence is deleted.
[0096] Fig.10 is a schematic diagram of a multimedia interface after a deletion operation according to an embodiment of the present disclosure, Fig.10 For the general Figure 6 Schematic diagram of the display after the second key frame sequence displayed in the second display area is deleted.
[0097] Fig.11 is an example diagram of a multimedia interface after a deletion operation according to an embodiment of the present disclosure, Fig.11 For the general Figure 7 An example of display after the second key frame sequence displayed in the second display area is deleted.
[0098] In some embodiments of the present disclosure, in response to an operation on an operating control including an operation on a sequence adjustment control, at least one second key frame sequence displayed in the second display area may specifically be: a sequence after a sequence to be adjusted in at least one first key frame sequence is sequence adjusted.
[0099] Fig.12 is a schematic diagram of a multimedia interface after a sequence adjustment operation according to an embodiment of the present disclosure, Fig.12 For the general Figure 6 Schematic diagram of the display after the second and third key frame sequences displayed in the second display area are swapped in order.
[0100] Fig.13 is an example diagram of a multimedia interface after a sequence adjustment operation according to an embodiment of the present disclosure, Fig.13 For the general Figure 7 An example of display after the order of the second and third key frame sequences displayed in the second display area is swapped.
[0101] Before step S130, in some embodiments of the present disclosure, the following steps may also be included: Fig.14 Step S121 shown.
[0102] Step S121: adjust at least one first key frame sequence according to the operation to obtain at least one second key frame sequence.
[0103] In some embodiments of the present disclosure, when the operation received through step S120 is an operation on a sequence adjustment control, step S121 can be specifically to adjust the order of part or all of the sequences in at least one first key frame sequence; when the operation received through step S120 is an operation on a copy control, step S121 can be specifically to determine a sequence to be copied from at least one key frame sequence according to the operation, and after copying the sequence to be copied to obtain a sequence copy, insert the sequence copy into the position specified by the operation in at least one key frame sequence; when the operation received through step S120 is an operation on a deletion control, step S121 can be specifically to delete part of the sequence from at least one first key frame sequence.
[0104] When the operation received in step S120 is an operation on the split control, step S121 may specifically be to adjust the content of at least one first key frame sequence. In this case, step S121 may include the following: Fig.15 Steps S1211 to S1213 are shown.
[0105] Step S1211: Obtain at least one first time interval of an online video pointed to by at least one first key frame sequence.
[0106] In some embodiments of the present disclosure, each first key frame sequence corresponds to a video segment of an online video. Step S1211 can obtain at least one first time interval according to the video segment corresponding to at least one first key frame sequence through multimedia display software; or send an acquisition request to a server storing the online video, so that the server obtains at least one first time interval according to the acquisition request and then returns.
[0107] Step S1212: Acquire at least one second time interval after adjusting at least one first time interval according to the operation.
[0108] In some embodiments of the present disclosure, one or more first time intervals in at least one first time interval may be split according to an operation, and after obtaining the split time intervals, the split time intervals may be combined with the unsplit time intervals in at least one first time interval to obtain at least one second time interval.
[0109] Step S1213: Acquire at least one second key frame sequence of at least one video segment of the online video pointed to by at least one second time interval.
[0110] In some embodiments of the present disclosure, the process of obtaining at least one second key frame sequence through step S1213 may include: first, obtaining at least one video segment of the online video pointed to by at least one second time interval; second, extracting multiple key frames from each video segment; and finally, respectively composing the multiple key frames of each video segment into a key frame sequence to obtain at least one second key frame sequence. The extraction of key frames may be implemented based on time intervals, based on scene change detection, based on content analysis, etc.
[0111] In some embodiments of the present disclosure, the process of displaying an online video in the first display area by the display software may include: obtaining a video path of the online video, the video path refers to a network path of the online video stored in the server, and the video path is a path for locating and accessing resources located on different network devices; obtaining a display script of the online video according to the video path; and displaying the online video from the starting point by displaying the script. The display of the online video by displaying the script can improve the flexibility and efficiency of the online video display. It can also respond to the playback control instruction of the online video and display it at the playback position corresponding to the playback control instruction by displaying the script.
[0112] The obtained display script usually involves technologies such as HTML, CSS and JavaScript. HTML is used to define the structure and content of a web page, and is specifically used to embed online videos, such as using <video>The label is embedded in the video path, and video controls such as play buttons and volume controls are added through the controls attribute; CSS is used to control the style and layout of the web page, such as setting the overall layout of the page, the size and border style of the player, etc.; JavaScript is used to implement the interactivity and dynamic functions of the web page, such as adding time listeners to each button to control the play, pause, and stop of the online video. In particular, function extensions can also be achieved through display scripts, such as volume control functions and full-screen functions.
[0113] During the operation of the operation control, to facilitate the display software to understand the impact of the operation on the online video, the display software can obtain the correspondence between the time axes before and after the operation during the operation, and this time axis represents the arrangement order of the video in time. The correspondence between the time axes before and after the operation can be the correspondence between the time axis after the operation and the time axis before the operation corresponding to one or more video units.
[0114] For example: when the time axis after the operation is from 0 to t and corresponds to only one video unit, it can correspond to the time axis from m to (m + t) before the operation; when the time axis after the operation is from 0 to t and corresponds to two video units, where 0 to n (0 < n < t) is one video unit, it can correspond to the time axis from a to (a + n) before the operation; (n + Δt) to t is one video unit, and it can correspond to the time axis from b (the relationship between a and b is not limited) to (b + t - n - Δt) before the operation. Where Δt is a very small time interval, which can theoretically approach 0, but in practical applications, it may be the time length of one frame, such as 1 / 24 second (for a video with 24 frames per second).
[0115] After step S120, the multimedia display method provided by the present disclosure may also include steps S122 to S123 as Fig.16 shown.
[0116] Step S122, obtaining the correspondence between the time axis before the operation and the time axis after the operation of the online video according to the operation.
[0117] In some embodiments of the present disclosure, the time axis in step S122 represents the arrangement order of the video units in time; the correspondence obtained through step S122 can be the correspondence between the time axis after the operation and the time axis before the operation corresponding to one or more video units.
[0118] Step S123, sending the correspondence to the first server.
[0119] In some embodiments of the present disclosure, the first server in step S123 is used to store the online video and is used to edit the online video according to the correspondence to obtain the edited video.
[0120] Before sending the corresponding relationship to the first server in step S123, the multimedia display method provided by the present disclosure may further include: Fig.17 Steps S124 to S126 are shown.
[0121] Step S124: receiving a preview instruction sent by the user.
[0122] Step S125, obtaining the preview time point of the online video indicated by the preview according to the corresponding relationship.
[0123] In some embodiments of the present disclosure, the process of obtaining the preview time point through step S125 may include: obtaining the preview video unit and the playback time point corresponding to the preview indication according to the post-operation timeline; obtaining the playback ratio of the playback time point in the preview video unit; obtaining the pre-operation start time and the pre-operation end time of the preview video unit according to the pre-operation timeline; obtaining the unit duration of the preview video unit according to the difference between the pre-operation end time and the pre-operation start time; obtaining the playback length according to the product of the unit duration and the playback ratio; obtaining the preview time point of the online video corresponding to the preview indication according to the sum of the playback length and the pre-operation start time.
[0124] Step S126, obtaining the preview video unit from the first server according to the preview time point and displaying it in the second display area.
[0125] In order to improve the display smoothness, subsequent video units can be cached while displaying the current preview video unit.
[0126] At this time, step S123 specifically includes sending the corresponding relationship to the first server in response to the saving instruction sent by the user according to the display in the second display area.
[0127] Through steps S124 to S126, the user can intuitively see whether the modified video meets expectations, thereby improving the efficiency and quality of video modification.
[0128] After step S120, the multimedia display method provided by the present disclosure may also include the following steps: Fig.18 Step S127 shown.
[0129] Step S127: Send operation information to the second server.
[0130] In some embodiments of the present disclosure, in step S127, the second server is used to store the online video, and to obtain the correspondence between the pre-operation timeline and the post-operation timeline of the online video according to the operation information, and then edit the online video according to the correspondence to obtain the edited video.
[0131] Take the online video starting from T(a) (T(a) can be equal to 0) and ending at T(z) (T(z) minus T(a) is the total duration of the video) as an example. Assuming that the operations include T(m) splitting operation, T(s) splitting operation (T(s) is between T(m) and T(z)), deletion operation and order adjustment operation, when processing the T(m) splitting operation, the online video is split into two video units, T(a) to T(m) and T(m) to T(z); when processing the T(s) splitting operation, the T(m) to T(z) video unit is split into two video units. The video is divided into two video units, T(m) to T(s) and T(s) to T(z). At this time, the online video is divided into three video units, T(a) to T(m), T(m) to T(s) and T(s) to T(z); when processing the deletion operation, the video unit T(m) to T(s) is deleted. At this time, the remaining two video units are T(a) to T(m) and T(s) to T(z); when processing the order adjustment operation, the play order is adjusted to play the video from T(s) to T(z) first, and then play the video from T(a) to T(m). Through the above processing, the corresponding relationship can be obtained as follows: 0 to (T(z)-T(s)) of the video after the operation corresponds to T(s) to T(z) of the online video, and (T(z)-T(s)+Δt) to (T(z)-T(s)+T(m)-T(a)) of the video after the operation corresponds to (T(a)+Δt) to T(m) of the online video.
[0132] If a copy operation is processed, the corresponding duration will be calculated multiple times. For example, after obtaining the two video units T(a) to T(m) and T(s) to T(z), the video unit T(s) to T(z) is copied. At this time, there are three video units T(s) to T(z), T(s) to T(z) and T(a) to T(m). The total playback duration is (T(z)-T(s))+(T(z)-T(s))+(T(m)-T(a)). The playback order can be to play T(s) to T(z) first, then play T(s) to T(z), and finally play T(a) to T(m).
[0133] In some embodiments of the present disclosure, in order to improve management efficiency, the timeline can be managed through JSON, XML (eXtensibleMarkup Language), YAML (YAML Ain't Markup Language) and other format files, such as recording the pre-operation timeline corresponding to the online video, modifying the pre-operation timeline according to editing instructions, etc.
[0134] In some embodiments of the present disclosure, the specific process of obtaining the corresponding relationship may include: obtaining the pre-operation timeline of the online video; modifying the pre-operation timeline according to the operation to obtain the post-operation timeline; and obtaining the corresponding relationship based on the pre-operation timeline and the post-operation timeline.
[0135] When the operation is an operation on a split control, the process of modifying the timeline may include: obtaining the split time point corresponding to the operation; and segmenting the timeline before editing according to the split time point. When the operation is an operation on a sequence adjustment control, the process of modifying the timeline may include: obtaining the adjustment time corresponding to the operation; and modifying the timeline before editing according to the adjustment time. When the operation is an operation on a copy control, the process of modifying the timeline may include: obtaining the copy time corresponding to the operation; and adding the copy time to the timeline before editing. When the operation is an operation on a delete control, the process of modifying the timeline may include: obtaining the delete time corresponding to the delete indication; and deleting the delete time from the timeline before editing.
[0136] The pre-operation timeline may include: the start time of the online video (the time point when the online video starts playing, usually expressed in the format of "hours: minutes: seconds"), the end time of the online video (the time point when the online video ends, indicating the end position of the online video playback) and the key frame time (used to record the key frame position in the video). When managing the pre-operation timeline through a JSON file, taking an online video with a length of 68 minutes and 08 seconds and 6 key frames as an example, the content of the JSON file storing the pre-operation timeline may be as follows:
[0137]
[0138] In some embodiments of the present disclosure, when the operation includes only one editing action, the timeline before the operation can be directly modified according to the operation to obtain the timeline after the operation; when the operation includes multiple editing actions, the timeline before the operation can be modified in sequence according to the order of the operations, and the timeline modified by the last operation is the timeline after the operation.
[0139] In some embodiments of the present disclosure, during operation, the start time and end time of each video unit may be stored in a JSON file; in particular, in order to reduce the stored information content, only the start time of each video unit may be stored in the JSON file.
[0140] In some embodiments of the present disclosure, the videos corresponding to the timeline before the operation and the timeline after the operation may be compared frame by frame to obtain a corresponding relationship; in order to improve the comparison efficiency, the comparison may also be based on video units.
[0141] Taking the operation of splitting the above online video with a length of 68 minutes and 8 seconds at 13 minutes and 35 seconds, and each video unit contains 5 key frames as an example, the timeline after the operation obtained by segmenting the timeline before the operation can be as follows:
[0142]
[0143]
[0144] Taking the operation order adjustment indication as an example, where the timeline before the order adjustment indication includes three segments: 00:00:00 - 00:13:35, 00:13:35 - 00:45:25, and 00:45:25 - 01:08:08. Assuming that the first and third segments are adjusted in order, the post-operation timeline obtained through the pre-operation timeline can be as follows:
[0145]
[0146]
[0147] In some embodiments of the present disclosure, taking the copying of the third video segment as an example, the post-operation timeline obtained by copying can be as follows:
[0148]
[0149]
[0150] In some embodiments of the present disclosure, taking the deletion of the current first video unit as an example, the post-operation timeline obtained by deletion can be as follows:
[0151]
[0152]
[0153] In some embodiments of the present disclosure, taking the editing of three online videos A, B, and C as an example, assuming that the post-operation timeline 0 - p corresponds to five video units, the obtained corresponding relationship can be as follows: 0 - q (0 < q < p) corresponds to the a unit of online video A, q - w (q < w < p) corresponds to the b unit of online video B, w - e (w < e < p) corresponds to the c unit of online video A, e - r (e < r < p) corresponds to the d unit of online video C, and r - p corresponds to the y unit of online video B.
[0154] In some embodiments of the present disclosure, when a first progress bar is further provided in the first display area, as Fig.19 shown, after step S130, the multimedia display method provided by the present disclosure may further include:
[0155] Step S140, receiving a first click event of the user on the first progress bar.
[0156] In some embodiments of the present disclosure, the first progress bar set in the first display area may be a horizontal progress bar or a vertical progress bar, etc.
[0157] Step S150: adjusting the online video displayed in the first display area to the play position corresponding to the first click event.
[0158] In some embodiments of the present disclosure, the display software can add a first click event listener for the first progress bar. When the user clicks on the first progress bar, the listener will be triggered and the first click event will be received. After receiving the first click event, the display software calculates the percentage of the position clicked by the user relative to the total length of the first progress bar. Then, according to the calculated percentage, the online video is adjusted to the corresponding playback position (such as setting the current playback time of the online video to a corresponding proportion of the total length of the online video according to the calculated percentage, and the setting process can be set through the currenttime attribute) and the first progress bar is updated.
[0159] By adjusting the progress of the online video displayed in the first display area through steps S140 to S150, the user can quickly view the online video at any location, thereby improving the efficiency of video editing.
[0160] In some embodiments of the present disclosure, when the second display area is further provided with a second progress bar, such as Fig. 20 As shown, after step S130, the multimedia display method provided by the present disclosure may further include:
[0161] Step S160: receiving a second click event of the user on the second progress bar.
[0162] In some embodiments of the present disclosure, the second progress bar set in the second display area can be a horizontal progress bar, or a vertical progress bar, etc. When the second display area displays multiple key frame sequences, the multiple key frame sequences can share a progress bar, or a progress bar can be set for each key frame sequence.
[0163] In particular, when the first display area is provided with a first progress bar and the second display area is provided with a second progress bar, for the sake of easy distinction, the first progress bar provided in the first display area may be a horizontal progress bar and the second progress bar provided in the second display area may be a vertical progress bar.
[0164] In some embodiments of the present disclosure, when a user wants to check whether an edited video is the desired effect, the user can preview it before generating the edited video, which can be achieved by dragging the second progress bar.
[0165] Step S170: In response to the second click event, receiving a click image sent by the server storing the online video.
[0166] In some embodiments of the present disclosure, the display software receives the second click event in a manner similar to the manner in which it receives the first click event; after receiving the second click event, the display software can calculate the position of the second click event in the online video based on the correspondence between the current post-operation video and the initial online video, and send the calculated position to the server, so that the server returns the click image based on the position.
[0167] The process of calculating the position may include: obtaining the preview video unit and the playback time point corresponding to the second click event; obtaining the playback ratio of the playback time point in the preview video unit; obtaining the pre-editing start time and the pre-editing end time of the preview video unit according to the timeline before the operation; obtaining the unit length of the preview video unit according to the difference between the pre-editing end time and the pre-editing start time; obtaining the playback length according to the product of the unit length and the playback ratio; and obtaining the preview time point of the online video corresponding to the preview indication according to the sum of the playback length and the pre-editing start time.
[0168] Taking the edited video 0 to (T(z)-T(s)) corresponding to the online video T(s) to T(z), and the edited video (T(z)-T(s)+Δt) to (T(z)-T(s)+T(m)-T(a)) corresponding to the online video (T(a)+Δt) to T(m) as an example, assuming that the preview indication indicates the video unit 3 corresponding to (T(z)-T(s)+Δt) to (T(z)-T(s)+T(m)-T(a)) Preview at 0%; the obtained playback ratio is 30%; the obtained start time before editing is (T(a)+Δt) and the obtained end time before editing is T(m); the obtained unit duration is T(m)-(T(a)+Δt)=T(m)-T(a)-Δt; the obtained playback length is 30%*(T(m)-T(a)-Δt); the obtained preview time point of the online video is (T(a)+Δt)+30%*(T(m)-T(a)-Δt).
[0169] Step S180: display the click image in the second display area.
[0170] In some embodiments of the present disclosure, all currently displayed content displayed in the second display area can be replaced with a click image through step S180, or part of the currently displayed content displayed in the second display area (such as a key frame sequence corresponding to the second click event) can be replaced with a click image through step S180.
[0171] Previewing the edited video through steps S160 to S180 allows users to instantly view the editing effects without the need for video rendering, thereby further improving video editing efficiency.
[0172] In some embodiments of the present disclosure, Fig.21 As shown, step S170 may specifically include receiving a click image and subsequent images of the click image sent by the server; step S180 may specifically include: displaying the click image and subsequent images in the second display area in chronological order.
[0173] The subsequent image of the clicked image may be an image after the clicked image in the current video unit to which the clicked image belongs; in addition to the image after the clicked image in the current video unit to which the clicked image belongs, the subsequent image may also include one or more video units after the current video unit.
[0174] For example, the current image frame is 64 minutes and 9 seconds, and the current video unit corresponding to this image frame is indexed as m, and the end time is 65 minutes and 11 seconds; the image after 64 minutes and 9 seconds in the video unit with index m and the video unit with index m+1 can be cached, for example, the video unit m+1 is a video unit with a start time of 33 minutes and 33 seconds; when playing to 65 minutes and 11 seconds, jump to 33 minutes and 33 seconds to start playing, and at this time cache the video unit with index m+2 until all video units are played.
[0175] By receiving the click image and subsequent images through the above steps, the display smoothness can be improved and the viewing experience can be enhanced.
[0176] When the operation area is also configured with a save control, such as Fig. 22 As shown, the multimedia display method provided by the present disclosure may also include:
[0177] Step S190, receiving the user's operation on the save control.
[0178] In some implementations of the present disclosure, the save control configured in the operation area may be embodied in the form of a button, an icon, or a text label.
[0179] Step S200: In response to an operation on a save control, receiving an edited video sent by a server storing online videos.
[0180] In some embodiments of the present disclosure, the edited video in step S200 may be obtained by the server editing the online video based on the corresponding relationship. The server's editing operations on the online video may include basic editing (such as cutting and splicing, copying and pasting, etc.), timeline operations (such as adjusting the order, speeding up or slowing down, etc.); in addition to the above operations, it may also include special effect operations based on editing instructions, such as color adjustment, special effects and filters.
[0181] In some embodiments of the present disclosure, in order to prevent the editing process from damaging the online video, the edited video may be obtained by editing a copy of the online video.
[0182] Step S210: displaying the edited video in the second display area.
[0183] In some embodiments of the present disclosure, the edited video can be shared on social media; it can also be used as a promotional video or trailer to attract users to watch the full video; it can also be used to promote user products or services, etc.
[0184] By displaying the edited video through steps S190 to S210, video editing can be achieved without downloading online videos, thereby improving video editing efficiency.
[0185] When the operation area is also configured with an undo control, such as Fig.23 As shown, after step S130, the multimedia display method provided by the present disclosure may further include:
[0186] Step S220: receiving a user's operation on canceling a control.
[0187] In some implementations of the present disclosure, the undo control configured in the operation area may be embodied in the form of a button, an icon, or a text label.
[0188] Step S230: in response to the operation on the undo control, displaying a previous sequence of the current at least one key frame sequence in the second display area.
[0189] Steps S220 to 230 allow the user to undo the most recent editing operation, thereby avoiding losses caused by misoperation and significantly improving user experience.
[0190] When the operation area is also configured with a redo control, such as Fig.24 As shown, after step S130, the multimedia display method provided by the present disclosure may further include:
[0191] Step S240: receiving the user's operation on the redo control.
[0192] In some implementations of the present disclosure, the redo control configured in the operation area may be embodied in the form of a button, an icon, or a text label.
[0193] Step S250: In response to the operation on the redo control, a subsequent sequence of the current at least one key frame sequence is displayed in the second display area.
[0194] Steps S240 to S250 allow the user to easily restore the undone editing operation, thereby avoiding losses caused by misoperation and significantly improving the user experience.
[0195] When the operation area is also configured with a return control, such as Fig.25 As shown, after step S130, the multimedia display method provided by the present disclosure may further include:
[0196] Step S260: receiving a user's operation on a return control.
[0197] In some implementations of the present disclosure, the return control configured in the operation area may be embodied in the form of a button, an icon, or a text label.
[0198] Step S270: In response to the operation on the return control, a previously saved sequence corresponding to the current at least one key frame sequence is displayed in the second display area.
[0199] Steps S260 to 270 allow the user to easily return to the previous editing page or step, thereby better managing and organizing the editing process, which can significantly improve the user experience.
[0200] In some embodiments of the present disclosure, in order to facilitate the user to implement the sequence adjustment process, a sequence adjustment control can also be set above each key frame sequence displayed in the second display area. At this time, after step S130, the multimedia display method can also include: receiving the user's operation on the sequence adjustment control of a sequence in the current key frame sequence displayed in the second display area; in response to the operation of the sequence adjustment control, the current key frame sequence displayed in the second display area is sequence adjusted and displayed.
[0201] Based on the above embodiments, the present disclosure also provides a multimedia display device (corresponding to a multimedia display method).
[0202] Fig.26 It is a schematic block diagram of the structure of a multimedia display device according to an embodiment of the present disclosure.
[0203] like Fig.26 As shown, the multimedia display device includes:
[0204] The first display module 110 is used to display a multimedia interface, which includes a first display area, a second display area and an operation area. The first display area is used to display online videos, and the second display area is used to partition and display at least one first key frame sequence of the online video. The operation area is configured with operation controls.
[0205] The operation receiving module 120 is used to receive the user's operation on the operation control.
[0206] The second display module 130 is used to replace at least one first key frame sequence displayed in the second display area with at least one second key frame sequence of the online video corresponding to the operation in response to the operation of the operation control.
[0207] The above modules can be implemented by computer program modules.
[0208] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.
[0209] The execution subject of the multimedia display method in the specific implementation manner of the present disclosure may be an electronic device such as a mobile phone or a tablet computer.
[0210] Therefore, based on the above embodiments, the present disclosure further provides an electronic device, which can execute the multimedia display method of any embodiment described above in the present disclosure, and the video editing device of any embodiment described above can be configured on the electronic device.
[0211] Fig. 27 FIG. 1 is a schematic block diagram of the structure of an electronic device 1000 equipped with a video editing device according to an embodiment of the present disclosure.
[0212] The hardware structure of the electronic device 1000 can be implemented using a bus architecture. The bus architecture can include any number of interconnected buses and bridges, depending on the specific application and overall design constraints of the hardware. The bus 1100 connects various circuits including one or more processors 1200, memory 1300 and / or hardware modules together. The bus 1100 can also connect various other circuits 1400 such as peripherals, voltage regulators, power management circuits, external antennas, etc.
[0213] The bus 1100 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Component (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the figure only uses one connecting line, but does not mean that there is only one bus or one type of bus.
[0214] The present disclosure also provides a readable storage medium, in which a computer program is stored, and the computer program is used to implement the above method when executed by a processor. "Readable storage medium" can be any device that can contain, store, communicate, propagate or transmit a program for use with an instruction execution system, device or equipment or in combination with these instruction execution systems, devices or equipment. More specific examples of readable storage media include the following: an electrical connection portion (electronic device) with one or more wirings, a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and editable read-only memory (EPROM or flash memory), an optical fiber device, and a portable read-only memory (CDROM), etc.
[0215] The present disclosure also provides a computer program product. The method of the present disclosure can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed, the process or function of the present disclosure is executed in whole or in part.
[0216] The computer program or instructions may be stored in a readable storage medium or transmitted from one readable storage medium to another readable storage medium, for example, the computer program or instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The readable storage medium may be any available medium that can be accessed or a data storage device such as a server, data center, etc. that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid state drive. The computer readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.
[0217] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0218] The present disclosure is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present disclosure. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0219] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0220] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0221] In the description of this specification, the description with reference to the terms "one embodiment / method", "some embodiments / methods", "example", "specific example", or "some examples" etc. means that the specific features, structures, or characteristics described in conjunction with the embodiment / method or example are included in at least one embodiment / method or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment / method or example. Moreover, the specific features, structures, or characteristics described may be combined in any one or more embodiments / methods or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments / methods or examples described in this specification and features of different embodiments / methods or examples, unless they are contradictory.
[0222] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0223] Those skilled in the art should understand that the above embodiments are only for the purpose of clearly illustrating the present disclosure, and are not intended to limit the scope of the present disclosure. For those skilled in the art, other changes or modifications may be made based on the above disclosure, and these changes or modifications are still within the scope of the present disclosure.< / video>
Claims
1. A multimedia display method, characterized in that: include: Displaying a multimedia interface, the multimedia interface comprising a first display area, a second display area and an operation area, the first display area being used to display an online video, the second display area being used to display at least one first key frame sequence of the online video in partitions, and the operation area being configured with operation controls; Receiving an operation of the operation control by a user; In response to an operation on the operation control, at least one first key frame sequence displayed in the second display area is replaced with at least one second key frame sequence of the online video corresponding to the operation.
2. The multimedia display method according to claim 1, characterized in that: Before replacing the at least one first key frame sequence displayed in the second display area with the at least one second key frame sequence of the online video corresponding to the operation, the method further includes: The at least one first key frame sequence is adjusted according to the operation to obtain the at least one second key frame sequence.
3. The multimedia display method according to claim 2, characterized in that: The step of adjusting the at least one first key frame sequence according to the operation to obtain the at least one second key frame sequence includes: Acquire at least one first time interval of the online video pointed to by the at least one first key frame sequence; Acquire at least one second time interval after adjusting the at least one first time interval according to the operation; At least one second key frame sequence of at least one video segment of the online video pointed to by the at least one second time interval is obtained.
4. The multimedia display method according to any one of claims 1 to 3, characterized in that: After receiving the user's operation on the operation control, the method further includes: Acquire the correspondence between the timeline before the operation and the timeline after the operation of the online video according to the operation; send the correspondence to a first server, the first server is used to store the online video, and is used to edit the online video according to the correspondence to obtain an edited video; or, The operation information is sent to a second server, where the second server is used to store the online video, and to obtain the correspondence between the pre-operation timeline and the post-operation timeline of the online video according to the operation information, and then edit the online video according to the correspondence to obtain an edited video.
5. The multimedia display method according to claim 4, characterized in that: Before sending the corresponding relationship to the first server, the method further includes: receiving a preview instruction sent by a user; obtaining a preview time point of the online video indicated by the preview according to the corresponding relationship; obtaining a preview video unit from the first server according to the preview time point and displaying it in the second display area; The sending the corresponding relationship to the first server includes: sending the corresponding relationship to the first server in response to a save instruction sent by the user according to the display in the second display area.
6. The multimedia display method according to any one of claims 1 to 3, characterized in that: The operation controls include: One or more of a split control, an order adjustment control, a copy control, and a delete control.
7. The multimedia display method according to claim 6, characterized in that: In response to the operation on the operation control including the operation on the split control, the at least one second key frame sequence is specifically: a sequence after the sequence to be split in the at least one first key frame sequence is replaced by a plurality of split sequences, the plurality of split sequences correspond to a plurality of split videos obtained after the video to be split is split, and the video to be split is a video corresponding to the sequence to be split in the online video; In response to the operation on the operation control including the operation on the copy control, the at least one second key frame sequence is specifically: a sequence after a copy of the sequence to be copied in the at least one first key frame sequence is inserted into a position specified by the operation of the copy control in the at least one first key frame sequence; In response to the operation on the operation control including the operation on the delete control, the at least one second key frame sequence is specifically: a sequence after the sequence to be deleted in the at least one first key frame sequence is deleted; In response to the operation on the operation control including the operation on the sequence adjustment control, the at least one second key frame sequence is specifically: a sequence after the sequence to be adjusted in the at least one first key frame sequence is sequence adjusted.
8. The multimedia display method according to any one of claims 1 to 3, characterized in that: When the first display area is further provided with a first progress bar, after replacing the at least one first key frame sequence displayed in the second display area with the at least one second key frame sequence of the online video corresponding to the operation, the method further includes: Receiving a first click event of the user on the first progress bar; The online video displayed in the first display area is adjusted to a playback position corresponding to the first click event.
9. The multimedia display method according to any one of claims 1 to 3, characterized in that: When the second display area is further provided with a second progress bar, after replacing the at least one first key frame sequence displayed in the second display area with the at least one second key frame sequence of the online video corresponding to the operation, the method further includes: Receiving a second click event of the user on the second progress bar; In response to the second click event, receiving a click image sent by a server storing the online video; The click image is displayed in the second display area.
10. The multimedia display method according to claim 9, characterized in that: The receiving the click image sent by the server storing the online video includes: receiving the click image sent by the server and a subsequent image of the click image; The displaying of the click image in the second display area includes: displaying the click image and subsequent images in the second display area in chronological order.
11. An electronic device, characterized in that: include: A memory storing execution instructions; as well as A processor, wherein the processor executes the execution instruction stored in the memory, so that the processor executes the multimedia display method according to any one of claims 1 to 10.
12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the multimedia display method according to any one of claims 1 to 10 is implemented.