Video processing method, video editing method, device, and storage medium

Abstract

Embodiments of the present application provide a video processing method, a video editing method, a device, and a storage medium. The video processing method comprises: acquiring a video material; analyzing the video material to obtain a plurality of highlight video clips, wherein the plurality of highlight video clips include a first video clip and a second video clip, and time information of the first video clip and time information of the second video clip in the video material overlap with each other; and displaying clip information of the first video clip and clip information of the second video clip in association on a video editing interface. The technical solution provided in the embodiments of the present application can improve the editing experience of users.

Description

Video processing methods, editing methods, equipment and storage media Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a video processing method, editing method, device and storage medium. Background Technology

[0002] With the development of computer technology, many electronic products with shooting functions have emerged, such as cameras, drones, and mobile phones.

[0003] In daily life, users are accustomed to using electronic products to shoot a lot of video footage. In order to obtain rich and content-rich videos, it is necessary to edit the video footage, for example, to cut out multiple highlight video clips from the video footage, and then combine or splice multiple highlight video clips to obtain the final video.

[0004] Currently, most video editing solutions suffer from inconvenience in operation. Summary of the Invention

[0005] This application provides a video processing method, editing method, device, and storage medium, which can solve the problem of inconvenient operation in existing video editing solutions, thereby improving the user's video editing experience.

[0006] The first aspect of this application provides a video processing method, comprising:

[0007] Obtain video footage;

[0008] The video footage is analyzed to obtain multiple highlight video clips, wherein the multiple highlight video clips include a first video clip and a second video clip, and the time information of the first video clip and the second video clip overlaps in the video footage;

[0009] In the video editing interface, the segment information of the first video segment and the segment information of the second video segment are displayed together.

[0010] A second aspect of this application provides a video editing method, comprising:

[0011] Based on the video material, a first video clip and a second video clip are obtained. The first video clip and the second video clip correspond to different local perspectives in the video material, and the time information of the first video clip and the second video clip in the video material overlaps.

[0012] The segment information of the first video segment and the segment information of the second video segment are displayed on the same video editing interface;

[0013] In response to an editing operation performed on a target video segment in the video editing interface, the target video segment is updated, the editing operation being used to modify the viewpoint information of the target video segment, the target video segment being either the first video segment or the second video segment.

[0014] A third aspect of this application provides a video processing method, comprising:

[0015] Obtain video footage;

[0016] The video material is analyzed to obtain multiple sets of highlight video clips. Among these multiple sets of highlight video clips, the time information of any two sets of highlight video clips in the video material does not overlap. Each set of highlight video clips includes a first video clip and a second video clip, and the time information of the first video clip and the second video clip in the video material overlaps.

[0017] In the video editing interface, at least one set of time markers corresponding to the multiple sets of highlight video clips is displayed, wherein the time markers are used to indicate the time information of the set corresponding to the time marker in the video material;

[0018] The video editing interface displays the segment information of the first video segment and the segment information of the second video segment from at least one of the multiple sets of highlight video segments.

[0019] A fourth aspect of this application provides an electronic device comprising:

[0020] At least one processor; and

[0021] At least one memory including computer program code, wherein at least one of the memory and the computer program code, together with at least one of the processors, are configured to cause the electronic device to perform the methods described in the first, second and third aspects above.

[0022] The fifth aspect of this application provides a machine-readable storage medium including instructions stored thereon, which, when executed by a processor, are used to implement the methods described in the first, second, and third aspects above.

[0023] The first aspect of the technical solution provided in this application enriches the display format of highlight video clips on electronic devices by associating and displaying two video clips with overlapping times on the same interface. Users can intuitively understand which video clips among the automatically analyzed highlight video clips have overlapping times through the electronic device.

[0024] The second aspect of the technical solution provided in this application allows an electronic device to display video clips from different perspectives on the same interface, and to edit these clips based on editing operations, thus enriching the ways in which video clips are displayed and edited on the electronic device. Simultaneously, users can conveniently edit video clips from different perspectives that overlap in time using the electronic device, meeting their actual editing needs and improving the editing experience.

[0025] The third aspect of the technical solution provided in this application embodiment enables an electronic device to display multiple groups of highlight video clips, enriching the display format of highlight video clips. Users can intuitively and quickly locate groups of highlight video clips with overlapping times. Furthermore, users can edit the highlight video clips within the highlight video clip group to meet their editing needs for different video clips, thereby improving the user's editing experience. Attached Figure Description

[0026] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0027] Figure 1 is a flowchart illustrating a video processing method provided in an embodiment of this application;

[0028] Figure 2 is a set of interface diagrams provided in an embodiment of this application;

[0029] Figures 3a-3e are schematic diagrams of a video editing interface provided in an embodiment of this application;

[0030] Figures 4a-4i are schematic diagrams of a custom editing interface provided in an embodiment of this application;

[0031] Figure 5 is a flowchart illustrating a video editing method provided in an embodiment of this application;

[0032] Figure 6 is a flowchart illustrating a video processing method provided in an embodiment of this application;

[0033] Figure 7 is a schematic diagram of a family photography device provided in an embodiment of this application;

[0034] Figure 8 is a structural block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0035] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0036] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.

[0037] In traditional video editing, after performing highlight analysis on video footage (e.g., panoramic video footage) to obtain multiple highlight segments, these segments are either displayed indiscriminately in the video editing interface, or grouped according to scene category (e.g., people, scenery) and then displayed according to the grouping results. In the grouping-based display approach, two video segments with overlapping times among the multiple highlight segments may belong to different scene categories. Therefore, these two video segments will be displayed in different groups. For example, video segments A1 and B1 correspond to time periods a and b in the panoramic video footage, respectively, where time periods a and b overlap. Video segment A mainly shows a sunset and its scene category is scenery, while video segment B mainly shows people and its scene category is people. Therefore, video segment A1 will be displayed in the "scenery" group, and video segment B1 will be displayed in the "people" group.

[0038] It's evident that traditional video editing solutions fail to provide users with a clear and quick way to identify which video segments among the automatically analyzed highlight clips overlap in time, thus hindering their editing needs (e.g., a user might want one of two overlapping video segments to be displayed as a picture-in-picture within the other). For instance, in panoramic shooting scenarios, if a user simultaneously captures both a landscape video and a selfie video, the generated highlight clips will often categorize these two videos into different segments. Users struggle to quickly pinpoint the overlapping video segments from different perspectives and are unaware of which segments overlap. This complicates both the selection and editing of video segments.

[0039] To address or partially address the aforementioned technical problems, this application provides a video processing method. In this method, video footage is analyzed to obtain multiple highlight video clips. Two video clips with overlapping times are displayed together in a video editing interface. By displaying two overlapping video clips together on the same interface, the display format of highlight video clips on the electronic device is enriched. Users can intuitively understand which video clips among the automatically analyzed highlight video clips have overlapping times. Furthermore, users can quickly edit two overlapping video clips using the electronic device, thereby meeting their editing needs and improving their editing experience.

[0040] The following describes some embodiments of this application in detail with reference to the accompanying drawings.

[0041] Figure 1 is a schematic flowchart of a video processing method provided in an embodiment of this application. This method can be applied to electronic devices, such as mobile phones, panoramic shooting devices, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, netbooks, personal digital assistants (PDAs), and other terminal devices. For example, the electronic device can implement this solution by installing corresponding video processing software or plugins.

[0042] As shown in Figure 1, the method may include the following steps:

[0043] 101. Obtain video footage.

[0044] The video footage can be either 2D or panoramic. 2D videos offer a smaller field of view than panoramic videos. Panoramic videos provide a panoramic perspective, meaning they are videos shot from a panoramic viewpoint. 2D videos can be obtained from panoramic videos through cropping and perspective transformation. It should be noted that the field of view provided by the video footage in this article refers to the maximum field of view offered by the video footage itself.

[0045] The panoramic view includes a vertical view and a horizontal view. The angle of the vertical view can be greater than or equal to 120°, and the angle of the horizontal view can be greater than or equal to 120°.

[0046] When the vertical and horizontal viewing angles of a panoramic view are both 360°, the corresponding video can be called a 360° video or a spherical panoramic video. The panoramic view in this embodiment is not limited to a spherical panoramic view; it can also include wide-angle and ultra-wide-angle views.

[0047] In some embodiments, the video footage may be captured by an electronic device or other electronic devices. For example, the electronic device may be a mobile phone, and the video footage may be captured by a panoramic camera, which can send the captured video footage to the mobile phone for storage.

[0048] In some embodiments, the video material mentioned above may be video material downloaded by an electronic device from the network.

[0049] It should be noted that the embodiments of this application do not specifically limit the source of the video material.

[0050] Optionally, the electronic device displays information about multiple candidate video clips, and in response to a user's selection of one of the video clips, retrieves the selected video clip. The information about the video clips indicates at least a portion of the image content, such as a thumbnail representing the video clip. For example, the thumbnail may be generated based on any frame (e.g., the starting frame) in the video clip.

[0051] For example, an electronic device displays a media list interface, which includes thumbnails of multiple video clips to be selected. In response to a user's selection of one of the video clip's thumbnails, the selected video clip is retrieved. Optionally, after retrieving the selected video clip, a playback interface can be displayed, where the video clip is played.

[0052] 102. The video material is analyzed to obtain multiple highlight video clips.

[0053] Electronic devices can use local computing resources to analyze video footage and obtain multiple highlight video clips (also known as exciting clips), or electronic devices can use the computing resources of a server (such as a cloud server) to analyze video footage and obtain multiple highlight video clips. This application embodiment does not specifically limit this.

[0054] In one alternative implementation, artificial intelligence (AI) algorithms can be used to analyze video footage to obtain multiple highlight video clips. The AI ​​model can be deployed on an electronic device or on a server. When the AI ​​model is deployed on an electronic device, the device uses the locally deployed AI model to analyze the video footage. When the AI ​​model is deployed on a server, the electronic device requests the server to use the AI ​​model to analyze the video footage.

[0055] The specific implementation of using AI models to extract highlight video clips from video footage can be found in existing technologies, and will not be detailed in this application. Of course, electronic devices can also automatically analyze video footage using preset rules to obtain multiple highlight video clips.

[0056] The plurality of highlight video clips include a first video clip and a second video clip, and the time information of the first video clip and the second video clip overlaps in the video material.

[0057] The timing information of each video segment within the video footage refers to: the time period of that video segment within the video footage, where the start time point is the time point of the starting frame of that video segment within the video footage, and the end time point is the time point of the ending frame of that video segment within the video footage. In other words, the overlap in timing information between the first and second video segments within the video footage means that there is an overlap between the time periods of the first and second video segments within the video footage. This overlap can be partial or complete.

[0058] In this context, the starting frame of a video clip refers to the point in time within the video footage where the first source frame is located. The first source frame can be a single frame image, and the video footage includes the first source frame. The starting frame of the video clip is generated based on the first source frame. The generation method can include using the first source frame as the starting frame of the video clip, or obtaining the starting frame by cropping the first source frame.

[0059] In this context, the ending frame of a video segment refers to the point in time within the video footage where the second source frame is located. The second source frame can be a single frame image, and the video footage includes the second source frame. The ending frame of the video segment is generated based on the second source frame. The generation method can include using the second source frame as the ending frame of the video segment, or obtaining the ending frame by cropping the first source frame. Multiple frames between the first and second source frames can collectively form the video segment.

[0060] In some embodiments, in response to a pause playback operation triggered on the playback interface for video footage, playback of the video footage is paused, and the viewfinder interface is entered, such as interface 200 shown in FIG2(a). As shown in FIG2(a), interface 200 includes a video preview area 201 and an automatic analysis control 202. The video preview area 201 is used to preview the video footage. In response to a trigger operation on the automatic analysis control 202, step 102 is executed, that is, the video footage is analyzed to obtain multiple highlight video clips. Optionally, in response to a trigger operation on the automatic analysis control 202, in addition to executing step 102, an analysis interface 203 shown in FIG2(b) may also be displayed, which includes prompt information 204 for indicating the analysis progress.

[0061] In some embodiments, the aforementioned highlight video clips are planar video clips. In this application embodiment, when the video material is a planar video or a panoramic video, the final highlight video clip obtained through analysis is a planar video clip.

[0062] 103. In the video editing interface, display the segment information of the first video segment and the segment information of the second video segment together.

[0063] In this document, the segment information for each video segment includes content identifiers that indicate at least a portion of the image content within that video segment, such as thumbnails. For example, the thumbnail may be generated based on any frame (e.g., the starting frame) within the video segment.

[0064] Optionally, the segment information for each video clip may further include: scene tags. The scene tags indicate the scene category to which the video clip belongs. For example, the scene tag is the scene category to which the video clip belongs. The scene category indicates the objects and / or events contained in the corresponding video clip. The scene category includes: object categories and / or event categories. As shown in Figure 3a, the scene tag could be scene categories such as sunset, cycling at high speed, sports, or lake.

[0065] The scene category to which each video segment belongs can be obtained by classifying each video segment using the aforementioned AI model.

[0066] Optionally, as shown in Figure 3a, after the video material is analyzed, a video editing interface 301 can be displayed, in which the segment information of the first video segment and the segment information of the second video segment are displayed together.

[0067] For example, as shown in Figure 3a, in the video editing interface 301, the segment information of video segment A (including thumbnail 1 and scene label: Rainbow) and the segment information of video segment B (including thumbnail 2 and scene label: Accelerated Cycling) are displayed together. The time information of video segment A and video segment B in the video material overlaps.

[0068] The technical solution provided in this application enriches the display format of highlight video clips on electronic devices by associating and displaying two video clips with overlapping times on the same interface. Users can intuitively understand which video clips among the automatically analyzed highlight video clips have overlapping times. Furthermore, users can quickly edit the two video clips with overlapping times using the electronic device, thereby meeting their editing needs and improving their editing experience.

[0069] In some embodiments, the plurality of highlight video clips further includes a third video clip, wherein the time information of the third video clip does not overlap with that of the first video clip in the video footage, and the time information of the third video clip does not overlap with that of the second video clip in the video footage. The method may further include:

[0070] 104. In the video editing interface, display the segment information of the third video segment.

[0071] In the video editing interface, the segment information of the third video segment is not displayed in association with the segment information of the first video segment, nor is the segment information of the third video segment displayed in association with the segment information of the second video segment.

[0072] For example, as shown in Figure 3a, on interface 301, the segment information of video segment C is displayed (including thumbnail 3a and scene label: lake). The segment information of video segment C is not displayed in association with the segment information of video segment A and video segment B.

[0073] In other words, in the video editing interface, there is a time overlap between two related video clips, and no time overlap between two unrelated video clips. This allows users to intuitively and quickly determine which video clips among the multiple highlight video clips obtained through automatic analysis have a time overlap and which do not, thus facilitating user editing.

[0074] In some embodiments, step 103 above, "displaying the segment information of the first video segment and the segment information of the second video segment in association in the video editing interface," can be implemented in one or more of the following ways:

[0075] Method 1: In the video editing interface, display the segment information of the first video segment and the segment information of the second video segment adjacent to each other.

[0076] In Method 1, within the video editing interface, the display position of the segment information for the first video clip is adjacent to the display position of the segment information for the second video clip. The display position of the segment information can be understood as the location of the display area for the segment information.

[0077] Among them, "display positions are adjacent" means that the distance (or gap) between display positions is less than or equal to the preset distance, and "display positions are not adjacent" means that the distance between display positions is greater than the preset distance.

[0078] Continuing with the previous example, as shown in Figure 3a, on interface 301, the distance between the display position of video clip A and the display position of video clip B is less than or equal to a preset distance, the distance between the display position of video clip C and the display position of video clip A is greater than a preset distance, and the distance between C and the display position of video clip B is also greater than a preset distance.

[0079] Method 2: In the video editing interface, display the segment information of the first video clip and the segment information of the second video clip according to the same type of visual effects.

[0080] In other words, in the visual editing interface, the visual effects of the segment information of the first video clip and the segment information of the second video clip are of the same type, while the visual effects of the segment information of the third video clip are of a different type than those of the segment information of the first and second video clips.

[0081] For example: add the same type of visual effect to the segment information of the first video segment and the second video segment (hereinafter referred to as the first type of visual effect for ease of description), such as: add the same color border to the thumbnails of the two video segments, or set the same font color for the scene labels of the first video segment and the second video segment.

[0082] For example, a second type of visual effect is added to the segment information of a third video segment. The second type of visual effect is different from or different from the first type of visual effect. The difference between the first type of visual effect and the second type of visual effect may be in the form of color, shape, size, etc.

[0083] Method 3: In the video editing interface, display the segment information of the first video segment, the segment information of the second video segment, and visual elements used to associate the segment information of the first video segment and the segment information of the second video segment.

[0084] The specific form of the visual elements used to associate the segment information of the first video segment and the segment information of the second video segment can be designed according to actual needs, and this application embodiment does not impose specific limitations on this.

[0085] Furthermore, in the video editing interface, no visual elements are displayed to associate the segment information of the third video segment with the segment information of the first video segment, nor are any visual elements displayed to associate the segment information of the third video segment with the segment information of the second video segment.

[0086] In some embodiments, in a video editing interface, the video element can be used to connect the segment information of a first video segment and the segment information of a second video segment.

[0087] In other embodiments, the segment information of the first video segment and the segment information of the second video segment are displayed in the same area of ​​the video editing interface, and the display position of the visual element corresponds to the same area.

[0088] The display position of the visual element corresponding to the aforementioned "same area" can be understood as follows: the aforementioned "same area" is defined by the display position of the visual element; for example, the aforementioned "same area" is the display area of ​​the visual element. In the video editing interface, the segment information of the first video clip and the second video clip are overlaid and displayed on top of this visual element.

[0089] In addition, in the video editing interface, the segment information of the third video clip is displayed in another area of ​​the video editing interface, and this other area does not overlap with the same area mentioned above.

[0090] In this embodiment, the video editing interface displays visual elements that associate segment information of multiple time-overlapping video segments, and displays the segment information of the multiple time-overlapping video segments within the area corresponding to the visual element. This allows for a more intuitive demonstration of which video segments have time overlap.

[0091] In some other embodiments, the segment information of the first video segment and the segment information of the second video segment are displayed in the same container on the video editing interface, and the display position of the visual element corresponds to the same container.

[0092] As shown in Figure 3a, the visual element can be container 302.

[0093] Continuing with the previous example, as shown in Figure 3a, the first container 302 of the video editing interface displays the segment information of video segment A and video segment B, while the second container 303 of the video editing interface displays the segment information of video segment C. The first and second containers are different containers.

[0094] In this embodiment, the segment information of video segments with overlapping times can be displayed in the same container, while the segment information of video segments with non-overlapping times can be displayed in different containers. Users can easily distinguish which video segments have overlapping times and which do not through these containers.

[0095] In some embodiments, the first video clip and the second video clip correspond to partial viewpoints within the video footage. A partial viewpoint refers to a portion, not the entirety, of the viewpoints provided by the video footage.

[0096] In other words, the first video clip offers a smaller viewpoint than the original video footage, and the second video clip offers a smaller viewpoint than the original video footage. It should be noted that the viewpoint provided by a video clip in this article refers to the maximum viewpoint offered by that video clip.

[0097] In this embodiment, the video footage is extracted from a local perspective, which helps to refine the selection of the most exciting content. For example, if the video footage fully records the competition between multiple athletes on a court, and athlete B performs exceptionally well, contributing several brilliant moments, then the video clip can be obtained by extracting the footage from a local perspective centered on athlete B.

[0098] In some embodiments, the video material provides a panoramic view, that is, the video material is a panoramic video, and the aforementioned local view is smaller than the panoramic view.

[0099] In some embodiments, the video material is a panoramic video, and the first video clip and the second video clip can be planar video clips.

[0100] In some embodiments, the first video clip and the second video clip are obtained by cropping images from the video material, that is, the first video clip and the second video clip are obtained by cropping image frames from the video material.

[0101] For example, when the video footage is a panoramic video, the image frames in that footage can be called panoramic image frames.

[0102] In some embodiments, the first video segment includes a first image frame, the second video segment includes a second image frame, and the first image frame and the second image frame are obtained by cropping the same image frame from the video material.

[0103] Optionally, the content of the first image frame and the second image frame are different.

[0104] In practical applications, the first video clip and the second video clip can correspond to different local perspectives within the video footage. In other words, the content of the first video clip is different from the content of the second video clip.

[0105] In some embodiments, the first video segment is obtained based on the content of a first frame located in a first partial viewpoint of the video material, and the second video segment is obtained based on the content of a second frame located in a second partial viewpoint of the video material, wherein the content of the first frame and the content of the second frame are different.

[0106] The first local perspective and the second local perspective are different.

[0107] The difference between the first local viewpoint and the second local viewpoint refers to the fact that the first local viewpoint and the second local viewpoint do not overlap or partially overlap.

[0108] For example, the video material is a panoramic video, the first video segment includes a first image frame, the second video segment includes a second image frame, the first image frame is obtained by cropping the image content located in a first local viewpoint from the target image frame of the video material, and the second image frame is obtained by cropping the image content located in a second local viewpoint from the target image frame of the video material.

[0109] In practical applications, some video footage is obtained by stitching together original image frames captured by multiple cameras at the same time. In this case, the first video segment was captured by the first camera, and the second video segment was captured by the second camera.

[0110] The first and second shooting devices have different shooting angles when shooting the original image frames. In other words, the first video clip and the second video clip correspond to different local perspectives in the video material.

[0111] Furthermore, some video footage was captured using the same camera device, which includes multiple visual sensors. Alternatively, the first video clip and the second video clip may have been captured using different visual sensors of the same camera device.

[0112] Different visual sensors have different shooting angles, meaning that the first video clip and the second video clip correspond to different local perspectives in the video material.

[0113] Please refer to Figure 7, which illustrates a panoramic shooting device 700, including a main body 701 and two cameras 702 disposed on both sides of the main body. Each camera 702 has a field of view (FOV) greater than 180°, thus allowing a spherical panoramic video image to be obtained by stitching together the video images acquired by the two cameras 702. The panoramic video clips and / or video materials mentioned in this application can all be obtained by the panoramic shooting device 700 through shooting and / or processing. Different partial perspectives of the panoramic video clips in this application can be the partial perspectives of different cameras 702. The panoramic shooting device 700 in this application can send video clips or video materials to other electronic devices for display, editing, or other processing operations.

[0114] Of course, in other alternative implementations, video clips and / or video footage can also be captured by other shooting devices, and the specific settings can be made according to the actual scenario.

[0115] In the above embodiments, video material refers to a video segment selected by the user. Optionally, the video material may include multiple video segments selected by the user. For example, multiple video segments selected by the user can be spliced ​​together in the time dimension to obtain video material. For instance, if the user selects video q and video p, the spliced ​​video material will have video q as the first segment and video p as the second segment, where the duration of video q is t1, the duration of video p is t2, and the duration of the spliced ​​video material is t1+t2.

[0116] It should be noted that multiple videos selected by the user can be of the same video type, including the 2D video type and the panoramic video type mentioned above.

[0117] In this embodiment, users can select multiple video segments for editing simultaneously, which meets the user's need to extract highlight segments from multiple original videos and edit them at the same time, thus improving the user's editing experience.

[0118] In some embodiments, the video editing interface may further include information about the video material.

[0119] The information in the video footage may include, but is not limited to: the timing information of the video footage and the playback screen of the video footage. The timing information of the video footage may include: duration and / or timeline.

[0120] In other words, in some embodiments, the above method may further include:

[0121] 105. Display the information of the video material on the same video editing interface.

[0122] For example, as shown in Figure 3a, the video editing interface 301 displays the time information of the video material (e.g., timeline 304) and the playback screen.

[0123] In this embodiment of the application, users can view the segment information of the automatically analyzed highlight clips and the information of the video material in the same video editing interface, which facilitates user editing.

[0124] In some embodiments, the above method may further include:

[0125] 106. In the video editing interface, the segment information of the first video segment, the segment information of the second video segment, and the time information of the video material are displayed in association.

[0126] In one optional implementation, a first time period (e.g., 00:33-01:54) of the first video segment in the video material is determined, and a second time period (e.g., 2:33-3:22) of the second video segment in the video material is determined. The segment information of the first video segment is then associated with the first time period indication information (e.g., 00:33-01:54), and the segment information of the second video segment is also associated with the second time period indication information (e.g., 2:33-3:22). The time information of the video material may include the first time period indication information and the second time period indication information. The associated display in this embodiment can be a proximity display; the specific implementation of proximity display can be referred to the corresponding content above, and will not be repeated here.

[0127] In an optional implementation, as shown in FIG3a, the time information of the video material is displayed in the form of a timeline 304 in the video editing interface. Accordingly, step 106 above, "in the video editing interface, the segment information of the first video segment, the segment information of the second video segment, and the time information of the video material are displayed in association," can be implemented using the following steps:

[0128] 1061. Along the timeline, highlight the first time segment of the first video segment and the second time segment of the second video segment.

[0129] Wherein, the first time period refers to the time period of the first video segment in the video material, and the second time period refers to the time period of the second video segment in the video material.

[0130] Optionally, a timeline is displayed in the video editing interface, along which visual elements for identifying the first time segment and visual elements for identifying the second time segment are displayed. Optionally, the visual elements for identifying the first time segment and the visual elements for identifying the second time segment can be different. Optionally, in the video editing interface, the segment information of the first video clip is displayed in association with the first time segment on the timeline, and the segment information of the second video clip is displayed in association with the second time segment on the timeline.

[0131] For example, in the video editing interface, the segment information of the first video clip is displayed together with the visual elements used to identify the first time period, and the segment information of the second video clip is displayed together with the visual elements used to identify the second time period.

[0132] Optionally, visual elements for identifying the first time period and visual elements for identifying the second time period can be displayed overlappingly along the time axis. The length of the visual elements is positively correlated with the length of the time period; greater overlap indicates a greater overlap between the first and second time periods.

[0133] In this embodiment of the application, the amount of time overlap between the first video segment and the second video segment, as well as the time period of overlap, can be intuitively shown by overlay display.

[0134] In some embodiments, as shown in FIG3a, the video editing interface 301 includes a video playback area 305, which is used to play the video material. That is, the video material is played within the video playback area 305.

[0135] The playback screen of the video material in the above embodiment is also the playback screen displayed in the video playback area 305.

[0136] Optionally, the video footage can be played from the perspective provided by the video footage itself, or from a partial perspective. For example, when the video footage is a panoramic video, it can be played from a partial perspective of the video footage. For example, when the video footage is a planar video, it can be played from the perspective of the video footage itself.

[0137] In some embodiments, the playback view of the video footage corresponds to a partial viewpoint of the video footage. That is, in the video editing interface, the video footage is played from a partial viewpoint. The playback view of the video footage is the content within that partial viewpoint of the video footage.

[0138] In practical applications, as shown in Figure 3a, in the video editing interface 301, in response to a trigger operation targeting a target video segment (e.g., a trigger operation targeting segment information of the target video segment), the video playback area 305 plays a segment of the video material located at the target time period. The target time period is the time segment of the target video segment within the video material, and the target video segment can be any one of the aforementioned highlight segments. In other words, in response to a trigger operation targeting a target video segment, the playback progress of the video material is adjusted to the starting point of the target time period, and the video material begins playing from that starting point in the video playback area 305.

[0139] Optionally, video footage can be played from the beginning of the target time period and paused at the end of the target time period.

[0140] Optionally, in the video playback area 305, the video material is played from a target local perspective, which corresponds to a target video segment. That is, the target video segment is generated based on the scene content of the video material located within the target local perspective.

[0141] Play the video footage from the target's local perspective. At this time, the playback screen of the video footage corresponds to the target's local perspective.

[0142] In some embodiments, the playback progress can be displayed in the video playback area 305, for example, “00:35 / 12:24” 306 in Figure 3a, where 12:24 is used to indicate that the total duration of the video material is 12 minutes and 24 seconds, and 00:35 is used to indicate the current time point of the video material.

[0143] In practical applications, the highlight video clips automatically obtained by electronic devices may not perfectly match the user's expectations. For example, the selected time period or viewing angle may be inappropriate. Therefore, to allow users to further edit highlight video clips to meet their expectations, the above method may further include:

[0144] 107. In response to an editing operation performed on the target video segment in the video editing interface, update the target video segment.

[0145] The target video segment is the current editing object in the video editing interface.

[0146] For example, the target video segment is either the first video segment or the second video segment.

[0147] For example, the target video segment is any one of the aforementioned multiple highlight video segments.

[0148] In one optional implementation, the above method may further include:

[0149] 107-1. In the video editing interface, in response to a trigger operation on the target video segment (e.g., a trigger operation on the segment information of the target video segment), the target video segment is identified as the current editing object in the video editing interface.

[0150] Alternatively, as shown in Figure 3a, in response to a trigger operation on the target video segment in the video editing interface 301, the video playback area 305 plays the video clip located at the target time period, where the target time period refers to the time period of the target video segment in the video clip.

[0151] It should be noted that the current editing object in the video editing interface can be switched. For example, if the current editing object in the video editing interface is the first video clip, in response to a trigger operation on the clip information of the second video clip, the current editing object in the video editing interface can be switched to the second video clip.

[0152] The editing operations may include time editing and / or perspective editing.

[0153] In some embodiments, the target video segment corresponds to a first partial viewpoint of the video material, and the editing operation is used to adjust the target video segment to a second partial viewpoint corresponding to the video material. The first and second partial viewpoints are different. For example, the difference between the first and second partial viewpoints lies in their orientation (i.e., the direction of the line of sight).

[0154] The updated target video clip may include footage not included in the target video clip.

[0155] In other words, step 107 above, "updating the target video segment in response to an editing operation performed on the target video segment in the video editing interface," can be achieved through the following steps:

[0156] 1071. In response to an editing operation performed on a target video segment in the video editing interface, the target video segment is adjusted to a second local perspective corresponding to the video material.

[0157] In some embodiments, the video editing interface includes: a playback screen of the video material; and the ability to perform perspective editing operations on the playback screen to change the perspective of a target video segment. This may include one or more of the following steps to edit the perspective:

[0158] Optionally, the perspective editing operation can determine the perspective based on the drag operation performed by the user on the playback screen. Step 1071 may specifically include: 1071a, updating the local perspective corresponding to the target video segment in response to the drag operation performed on the playback screen.

[0159] For example, in response to a drag operation performed on the playback screen, the playback perspective of the video material is updated, the updated playback perspective is determined as the second local perspective, and the target video segment is adjusted to correspond to the second local perspective.

[0160] For example, in response to a drag operation performed on the playback screen, the playback perspective of the video material is updated and a confirmation message is displayed; in response to a confirmation operation on the confirmation message, the updated playback perspective is determined as the second local perspective.

[0161] As shown in Figure 3b, the video editing interface 301 displays a pending confirmation message 308. The pending confirmation message includes the prompt "Update viewpoint change?", a cancel control 3081, and a confirmation control 3082. In response to a trigger operation on the confirmation control 3082, the target video segment is adjusted to correspond to the second local viewpoint (i.e., the current playback viewpoint of the video material). In response to a trigger operation on the cancel control 3081, the local viewpoint corresponding to the target video segment is not updated.

[0162] Optionally, the perspective editing operation can also determine the perspective based on the user-selected tracking object. Step 1071 may specifically include: 1071b, in response to the selection operation related to the tracking object performed on the playback screen, updating the local perspective corresponding to the target video segment to the local perspective in the video material used for tracking the tracking object.

[0163] The local viewpoint of the object to be tracked can be a second local viewpoint. The electronic device can adjust the target video segment to correspond to the second local viewpoint. In the updated target video segment, the object to be tracked can be located in the center of the screen area. For example, the above selection operation can be a click or double-click operation on the object to be tracked; this application embodiment does not specifically limit this.

[0164] In some embodiments, the editing operation is used to adjust the time period of the target video segment in the video footage.

[0165] Optionally, the video editing interface includes: a timeline of the video material. Step 107 above, "updating the target video segment in response to an editing operation performed on the target video segment in the video editing interface," can be implemented using the following steps:

[0166] 1072. In response to a time period modification operation performed on the time axis, update the time period of the target video segment.

[0167] The time period of the target video segment refers to the time period of the target time segment in the video footage.

[0168] Time period modification operations may include: modifying the start time and / or modifying the end time.

[0169] For example, the start time of the time period of the updated target video segment is different from the start time of the time period of the target video segment before the update, and / or the end time of the time period of the updated target video segment is different from the end time of the time period of the target video segment before the update.

[0170] For example, at least one of the start and end times of the time period of the updated target video segment is not within the time period of the target video segment before the update.

[0171] In other words, the start time of the time period of the target video segment after the update can be earlier than the start time of the time period of the target video segment before the update, and the end time of the time period of the target video segment after the update can be later than the end time of the time period of the target video segment before the update.

[0172] In other words, the editing of the start and end times of the target video segment's time period in the technical solution provided in this application is not limited to the time period of the target video segment before the update, but can be performed beyond that time period. Thus, when the highlight video segment does not fully cover the exciting content, the user can extend the time period of the highlight video segment forward or backward. Therefore, the time editing solution provided in this application can meet the user's actual editing needs and improve the user's video editing experience.

[0173] In this embodiment of the application, the target video segment can be re-extracted from the video material according to the updated time period of the target video segment and / or the second local perspective. This target video segment is also the updated target video segment.

[0174] In the above embodiments, the current editing object of the video editing interface is a video clip. Optionally, the current editing object of the video editing interface can be multiple video clips that overlap in time. The above method may further include:

[0175] 108. In response to a synchronous editing operation triggered on the video editing interface for the first video segment and the second video segment, the editing area corresponding to the first video segment and the editing area corresponding to the second video segment are displayed on the video editing interface.

[0176] For example, in response to a trigger operation on a visual element used to associate a first video clip and a second video clip in the video editing interface, the editing area corresponding to the first video clip and the editing area corresponding to the second video clip are displayed in the video editing interface.

[0177] Optionally, information about the video footage, such as time information and playback details, can be displayed in each editing area. Within each editing area, video clips are edited based on this information. The specific implementation of editing video clips based on video footage information can be found in the corresponding content of the above embodiments, and will not be repeated here.

[0178] In this embodiment of the application, multiple video segments with overlapping times can be edited simultaneously in the same video editing interface, which makes it convenient for users to edit.

[0179] In some embodiments, the above method may further include:

[0180] 109. In the video editing interface, display the segment information of the fourth video segment.

[0181] The fourth video segment is extracted from the video material and is obtained in response to an editing operation triggered by the user based on information from the video material.

[0182] The editing operations may include time editing operations and / or perspective editing operations.

[0183] The fourth video clip can be a flat video.

[0184] The fourth video clip mentioned above was manually extracted by the user, rather than automatically analyzed. This manually extracted video clip can be referred to as a user-defined video clip.

[0185] In this embodiment, both automatically analyzed video clips and user-defined video clips are simultaneously displayed on the same video editing interface. In other words, by employing the technical solution provided in this embodiment, users can simultaneously edit both automatically analyzed video clips and user-defined video clips on the same video editing interface, meeting their editing needs and thus improving their editing experience.

[0186] In an optional embodiment, the above method may further include:

[0187] 110. Based on the time editing operation performed by the user on the video editing interface for the time information of the video material and / or the perspective editing operation performed on the playback screen of the video material, the fourth video segment is extracted from the video material.

[0188] Time editing operations can include: time period selection operations, such as: time period selection operations performed on the timeline of video footage.

[0189] The fourth video segment's time period within the video material is determined by the user through the time editing operation, and the perspective provided by the fourth video segment is determined by the user from the perspective provided by the video material through the perspective editing operation. The perspective provided by the fourth video segment is a partial perspective provided by the video material.

[0190] In practical applications, as shown in Figure 3a, the video editing interface 301 also includes a custom control 307. In response to a user's trigger operation on the custom control 307, a cutting start control and a cutting end control (not shown) are displayed on the timeline 304. In response to a user's drag operation on the cutting start control and / or the cutting end control, the target segment time is determined. After the user triggers the custom control 307, in response to a user's drag operation on the playback screen of the video material, the playback perspective of the video material is updated, and the updated playback perspective is determined as the target segment perspective. A fourth video segment is extracted from the video material according to the target segment time and the target segment perspective. The target segment time is the time period of the fourth video segment within the video material, and the perspective provided by the fourth video segment is the target segment perspective. The target segment perspective is a local perspective provided by the video material.

[0191] In another optional embodiment, as shown in FIG3a, the video editing interface 301 further includes a custom control 307. The method may also include the following steps:

[0192] 111. Display the custom editing interface in response to user actions on the custom control.

[0193] The custom editing interface includes information about the video material. This information may include: time information and / or playback details.

[0194] As shown in Figure 4a, the custom editing interface 401 includes a timeline 402 for the video footage and / or a playback screen. Optionally, the custom editing interface 401 may include a video playback area 403, which is used to play the video footage. That is, the video footage is played within the video playback area 403 to obtain the playback screen.

[0195] 112. Based on the time editing operation performed by the user on the video material's time information in the custom editing interface and / or the perspective editing operation performed on the playback screen of the video material, a fourth video segment is extracted from the video material.

[0196] In one optional implementation, as shown in Figure 4b, a cutting start control 404 and a cutting end control 405 are displayed on the timeline 402. In response to a user's drag operation on the cutting start control 404 and / or the cutting end control 405, a target segmentation time period is determined. In response to a user's drag operation on the playback screen of the video material in the custom editing interface, the playback perspective of the video material is updated, and the updated playback perspective is determined as the target segmentation perspective. A fourth video segment is extracted from the video material according to the target segmentation time period and the target segmentation perspective, wherein the time period of the fourth video segment within the video material is the target segmentation time period, and the perspective provided by the fourth video segment is the target segmentation perspective. The target segmentation perspective is a local perspective provided by the video material.

[0197] For example, in response to a user's confirmation of a target time segment and a target viewing angle, a fourth video segment can be extracted from the video footage according to the target time segment and the target viewing angle. This confirmation operation could be, for example, a trigger operation targeting a specified area on a custom editing interface, such as a click operation, where the specified area is distinct from the timeline and the area where the playback screen is located.

[0198] Specifically, the drag operation of the cutting start control 404 is used to adjust the start time point of the target intercepted time period, and the drag operation of the cutting end control 405 is used to adjust the end time point of the target intercepted time period.

[0199] Optionally, as shown in Figure 4a, the custom editing interface 401 further includes a custom control 406, which, in response to a trigger operation on the custom control 406, displays a cut start control 404 and a cut end control 405 on the timeline 402 (as shown in Figure 4b). Alternatively, in response to a trigger operation on the custom control 406, the custom control 406 may also be hidden and / or the initial segment information 407 of the fourth video segment may be displayed. The initial segment information 407 of the fourth video segment is generated based on any video frame in the video segment initially defined by the cut start control 404 and the cut end control 405.

[0200] For example, the duration of the video segment initially defined by the cut start control 404 and the cut end control 405 is a default value, such as 5 seconds. For example, the start time of the video segment initially defined by the cut start control 404 is the current playback time of the video material.

[0201] In some embodiments, the above method may further include:

[0202] 113. In the video editing interface, the segment information of the fourth video segment and the segment information of the first video segment are displayed according to different types of visual effects.

[0203] In the video editing interface, the fourth video clip information is displayed according to the first type of visual effect, the first video clip information is displayed according to the second type of visual effect, or any one of multiple highlight video clips is displayed according to the second type of visual effect. The first and second types are different.

[0204] The first type of visual effect is used to indicate that the corresponding video segment belongs to a user-defined video segment, while the second type of visual effect is used to indicate that the corresponding video segment belongs to an automatically analyzed video segment.

[0205] In practical applications, after the fourth video clip is generated, the clip information of the fourth video clip is displayed in the video editing interface.

[0206] When the fourth video segment is obtained by the user in the video editing interface, the segment information of the fourth video segment can be directly displayed in the video editing interface after the fourth video segment is generated (e.g., 408 in Figure 4c).

[0207] When the fourth video clip is obtained by the user in the custom editing interface, the clip information of the fourth video clip can be directly displayed in the custom editing interface after the fourth video clip is generated, and / or, in response to the user's operation of exiting the custom editing interface, the video editing interface is displayed and the clip information of the fourth video clip is displayed in the video editing interface.

[0208] Optionally, in the custom editing interface, the segment information of the fourth video clip is displayed in association with the time information of the video material.

[0209] For example, as shown in Figure 4c, in the custom editing interface 401, the time information of the video material is displayed in the form of a timeline 402. The fourth time segment of the fourth video clip can be highlighted along the timeline 402, where the fourth time segment refers to the time period of the fourth video clip within the video material.

[0210] For example, as shown in Figure 4c, a visual element 409 for identifying the fourth time segment is displayed in the custom editing interface 401, which highlights the fourth time segment of the fourth video clip.

[0211] As shown in Figure 4c, the custom editing interface 401 displays the associated element 412, which is used to associate the segment information of the fourth video clip with the fourth time segment on the timeline. For example, the associated element 412 is used to associate the segment information of the fourth video clip with the visual element 409 used to identify the fourth time segment.

[0212] As shown in Figure 4c, the timeline 402 includes a video editing track, which is composed of multiple frames of video footage.

[0213] In practical applications, electronic devices may miss some interesting content when automatically analyzing it. This application provides a customizable editing interface that allows users to manually extract video clips from video footage to supplement the automatic analysis results.

[0214] Optionally, the clip information of multiple highlight video clips can be displayed in the custom editing interface 401.

[0215] Optionally, in the custom editing interface 401, the segment information of the user-selected video segment and the segment information of the user-unselected video segment can be displayed according to different types of visual effects. For example, a red border can be added to the segment information of the user-selected video segment, and a white border can be added to the segment information of the user-unselected video segment.

[0216] Optionally, in the custom editing interface, the segment information of the first video clip, the segment information of the second video clip, and the time information of the video material are displayed in association.

[0217] For example, as shown in Figure 4c, in the custom editing interface 401, the first time segment of the first video clip and the second time segment of the second video clip are highlighted along the timeline.

[0218] For example, as shown in Figure 4c, visual elements 410 for identifying the first time period and visual elements 411 for identifying the second time period are displayed overlapping along the time axis.

[0219] In the custom editing interface 401, the segment information of the first video clip is displayed in association with the first time segment on the timeline, and the segment information of the second video clip is displayed in association with the second time segment on the timeline. For example, as shown in Figure 4c, in the custom editing interface 401, the segment information of the first video clip is displayed in association with the visual elements used to identify the first time segment, and the segment information of the second video clip is displayed in association with the visual elements used to identify the second time segment.

[0220] Optionally, further editing operations can be performed on the automatically analyzed highlight video clips in the custom editing interface 401, such as time editing and / or perspective editing.

[0221] In some embodiments, in response to an editing operation performed on a target video segment in the custom editing interface, the target video segment is updated. The target video segment is the current editing object of the custom editing interface, and the target video segment is one of a plurality of highlight video segments, such as the first video segment or the second video segment.

[0222] As shown in Figure 4d, in response to a user's trigger operation on the segment information of the target video segment in the custom editing interface, a cutting start control 413 and a cutting end control 414 are displayed on the timeline. The cutting start control 413 corresponds to the start point of the time segment of the target video segment, and the cutting end control 414 corresponds to the end point of the time segment. In response to a user's drag operation on the cutting start control 413 and / or the cutting end control 414, the time segment of the target video segment is updated.

[0223] The specific implementation of editing the target video segment in the custom editing interface can be referred to in the above embodiments for the specific implementation of editing the target video segment in the video editing interface, and will not be described in detail here.

[0224] Optionally, as shown in Figure 4f, when the target video segment is a video segment cropped based on a local view of the tracked target object, in response to the user's trigger operation on the segment information of the target video segment in the custom editing interface, a box 416 for surrounding the target object (i.e., the tracked object) is displayed in the playback screen of the video material in the custom editing interface. In response to the user's drag operation on the cut start control 413 and / or drag operation on the cut end control 414, the time period of the target video segment is updated. As shown in Figure 4g, when the updated time period exceeds the tracking time range (the tracked object is always in the visual center area within the tracking time range of the target video segment), a prompt message 418 is displayed in the custom editing interface 403. This prompt message is used to indicate that the tracked target has been lost, such as "The tracked target has been lost, but the segment can still be stretched".

[0225] Optionally, in response to a user's trigger operation on the segment information of the target video segment in the custom editing interface, the selection status of the target video segment is displayed in the custom editing interface, such as a selected state or an unselected state. For example, as shown in Figure 4d, a filter control for the target video segment is displayed in the custom editing interface, and the filter control is configured to be in a selected state or an unselected state.

[0226] Optionally, in response to the user's selection operation on the filter control 415 for the target video segment in the custom editing interface, the target video segment is identified as the video segment selected by the user, and the filter control 415 is set to the selected state.

[0227] Optionally, in response to the user's deselection operation performed on the filter control 415 for the target video segment in the custom editing interface, the target video segment is identified as a video segment not selected by the user, and the filter control 415 is set to an unselected state (as shown in Figure 4e).

[0228] Optionally, in response to a user's trigger action on the segment information of a target video clip in the custom editing interface, the segment information of the target video clip can be enlarged for display. This allows the user to intuitively understand which video clip is currently being edited.

[0229] Optionally, the custom editing interface may also include a reset control (e.g., 417 in Figure 4f) that, in response to a triggering operation on the reset control, cancels the editing operations performed in the custom editing interface, including time editing operations, view editing operations, and / or filtering operations, and restores the custom editing interface to the interface state when it was last entered.

[0230] For example, as shown in Figure 4h, in response to a trigger operation on the reset control, a prompt message 420 and a confirmation control 419 are displayed in the custom editing interface. The prompt message 420 is used to indicate the reset content, for example, as shown in Figure 4h, the prompt message 420 reads "Reset all automatically selected videos and clear manually marked videos." Here, manually marked videos refer to video segments selected using the video segment filtering control, and automatically selected videos refer to user-defined video segments. In response to a trigger operation on the confirmation control 419, the editing operation performed in the custom editing interface is canceled, and the custom editing interface is restored to its state when it was last entered.

[0231] Optionally, as shown in Figure 4h, in response to a triggering operation on the reset control, a cancel control 421 is also displayed. In response to a triggering operation on the cancel control 421, the reset is canceled, and the display of prompt message 420, confirmation control 419, and cancel control 421 is also canceled.

[0232] In this embodiment, when a user needs to reset, a second confirmation can be performed to avoid accidental triggering.

[0233] Optionally, the custom editing interface 401 may also include an export control 422. In response to a trigger operation on the export control 422, multiple export options 423 are displayed on the custom editing interface 401 for the user to select. Different export options correspond to different export methods, which may include, but are not limited to: exporting the user-selected video segments separately (corresponding to the "Export to System Album" export option in Figure 4i), exporting manually merged videos (corresponding to the "Free Editing" export option in Figure 4i), and exporting automatically merged videos (corresponding to the "One-Click Create" export option in Figure 4i). Exporting can refer to storing the video locally on the electronic device or sending the video to other devices.

[0234] In response to the user's selection of a target option among multiple export options 423, the video segment selected by the user is exported according to the export method corresponding to the target option.

[0235] For example, as shown in Figure 4i, in response to the user's trigger operation of "Export to System Album", the video clips selected by the user are exported to the system album.

[0236] For example, as shown in Figure 4i, in response to the user's trigger operation for "Free Editing", the Free Editing interface is displayed. According to the editing operation performed by the user in the Free Editing interface, the video segments selected by the user are merged to obtain a merged video, and the merged video is exported to the system album.

[0237] For example, as shown in Figure 4i, in response to the user's trigger operation for "one-click video creation", the video segments selected by the user are automatically merged to obtain a merged video, and the merged video is exported to the system album.

[0238] Optionally, in response to a triggering operation on the export control 422, a cancellation control 421 is displayed in the custom editing interface 401. In response to a triggering operation on the cancellation control 421, the export is cancelled, and the display of multiple export options 423 and the cancellation control 421 is also cancelled.

[0239] Optionally, the custom editing interface may also include a confirmation control (e.g., 418 in Figure 4f), which, in response to the confirmation control, redisplays the video editing interface and displays segment information of the video clips that the user has customized in the custom editing interface, as well as the highlight video clips that the user has updated.

[0240] In some embodiments, the step 101 above, "analyzing the video material to obtain multiple highlight video clips," can be achieved using the following steps:

[0241] 1011. Perform scene recognition on the video material to obtain scene recognition results.

[0242] The scene recognition results include indication information of highlight video clips belonging to each scene category among multiple scene categories.

[0243] The scene category is used to indicate the objects and / or events contained in the corresponding video clip. That is, the scene category includes: object category and / or event category.

[0244] The indication information includes indication information for indicating the time information of the highlight video clip in the video material and / or indication information for indicating the local viewpoint corresponding to the highlight video clip in the video material.

[0245] Optionally, the scene recognition results include indication information for each highlight video clip and the scene category to which each highlight video clip belongs.

[0246] Optionally, video footage can be used as input to an AI model to obtain scene recognition results. The AI ​​model can be trained using training samples.

[0247] When an AI model is deployed on an electronic device, the device uses video footage as input to the AI ​​model and executes the AI ​​model to obtain scene recognition results.

[0248] When the AI ​​model is deployed on the server, video footage is sent to the server. The server uses the video footage as input to the AI ​​model, executes the AI ​​model to obtain scene recognition results, and returns the scene recognition results to the electronic device.

[0249] 1012. According to the instruction information, extract the plurality of highlight video clips from the video material.

[0250] Highlight video clips are extracted from the video footage according to the time information (e.g., time period) and / or local perspective indicated by the highlight video clip instruction information.

[0251] Optionally, the scene category is manually entered by the user before analyzing the video footage.

[0252] In some embodiments, the method further includes:

[0253] 114. Before analyzing the video material, a selection interface is displayed.

[0254] The selection interface displays multiple alternative scene categories.

[0255] 115. In response to the selection operation triggered by the user on the selection interface, determine the multiple scene categories.

[0256] The multiple scene categories selected by the user from a range of alternative scene categories are defined as multiple scene categories. Subsequently, when analyzing video footage, it is only necessary to identify the highlight video clips corresponding to each of these scene categories.

[0257] In some embodiments, the first video clip and the second video clip correspond to the same scene category. That is, the first video clip and the second video clip belong to the same scene category.

[0258] In some embodiments, the first video clip and the second video clip correspond to different scene categories. That is, the first video clip and the second video clip belong to different scene categories.

[0259] Optionally, the above method may also include:

[0260] 116. Based on the filtering operation performed by the user on the multiple highlight video clips, display the clip information of the video clip selected by the user in the video editing interface.

[0261] The number of video clips selected by the user can be one or more.

[0262] The aforementioned filtering operation can be performed by the user on multiple highlight video clips within the video editing interface.

[0263] In some embodiments, as shown in FIG3c, the video editing interface 301 includes multiple scene categories 310. In response to the user's filtering operation on the multiple scene categories 310, the scene category selected by the user is determined, and the video segment belonging to the scene category selected by the user among the multiple highlight video segments is determined as the video segment selected by the user. The segment information of the video segment selected by the user is displayed in the video editing interface.

[0264] The scene category is used to indicate the objects and / or events contained in the corresponding video clip. For example, the scene category includes: object category and / or event category.

[0265] For example, as shown in Figure 3c, in response to a user's selection operation triggered for a target scene category among multiple scene categories 310, the target scene category is determined as the scene category selected by the user.

[0266] In other words, in this embodiment of the application, the filtering operation performed by the user on the plurality of highlight video clips includes the filtering operation by the user on scene category, and the video clip selected by the user includes the video clip that belongs to the scene category selected by the user among the plurality of highlight video clips.

[0267] Optionally, as shown in Figure 3a, the video editing interface displays an expand control 309. In response to a trigger operation on the expand control 309, multiple scene categories 310 and the number of highlight video clips under each scene category are displayed in the video editing interface.

[0268] In another embodiment, the filtering operation includes: a user filtering operation for video segments.

[0269] Among them, the user's filtering operation for video clips refers to the filtering operation triggered by the user's filtering control for video clips.

[0270] For example, in the video editing interface, filter controls for multiple highlight video clips are displayed. In response to the user's filtering operation on these filter controls, the selected video clip is determined.

[0271] In this process, the filter controls for multiple highlight video clips can be simultaneously displayed in the video editing interface for user selection. Alternatively, as shown in Figure 3a, the filter control 311 for the target video clip is displayed in the video editing interface, where the target video clip is the current editing object in the video editing interface. That is, only the filter control for the current editing object is displayed in the video editing interface at any given time, and filter controls for other video clips are not displayed.

[0272] In response to a user's selection operation triggered by the filter control 311 on a target video segment, the target video segment is identified as the user-selected video segment. Optionally, the filter control 311 has two states: selected and unselected. When the filter control 311 on the target video segment is unselected (as shown in Figure 3a), in response to a user's trigger operation on the filter control 311 on the target video segment, the target video segment is identified as the user-selected video segment, and the filter control 311 is set to the selected state (as shown in Figure 3d). When the filter control 311 on the target video segment is selected, in response to a user's trigger operation on the filter control 311 on the target video segment, the target video segment is identified as the user-unselected video segment, and the filter control 311 is set to the unselected state.

[0273] Optionally, as shown in Figure 3c, in response to an expansion operation triggered by the expansion control 309, one or more of the following can also be displayed in the video editing interface: custom option 315, selected option 314, and all options 313. In response to a user's selection of custom option 315, a user-defined video clip is displayed in the video editing interface. In response to a user's selection of selected option 314, the video clip selected by the user using the filter controls for each video clip is displayed in the video editing interface. In response to a user's selection of all options 315, the video editing interface displays clip information for multiple automatically analyzed highlight video clips and clip information for the user-defined video clip.

[0274] In response to the collapse operation triggered by the expand control 309 on the video editing interface 301 in Figure 3c, the display of multiple scene categories 310, custom options 315, selected options 314, and all options 313 is canceled in the video editing interface 301 (as shown in Figure 3d).

[0275] To distinguish between video segments selected and unselected by the user, the step 116 above, "displaying the segment information of the video segment selected by the user in the video editing interface based on the filtering operation performed by the user on the multiple highlight video segments," can be achieved through the following steps:

[0276] 1161. Based on the filtering operation performed by the user on the multiple highlight video clips, the video editing interface displays the clip information of the video clip selected by the user and the video clips not selected by the user in different display methods.

[0277] In some embodiments, based on the filtering operation performed by the user on the plurality of highlight video clips, the video editing interface displays the segment information of the video clip selected by the user, and does not display the video clips not selected by the user.

[0278] For example, when the above filtering operation is a user-selected scene category filtering operation, the video editing interface displays the segment information of the video segment selected by the user, and does not display the video segments not selected by the user. For instance, when the user selects the scene category "cyclists," the video editing interface only displays video segments with the scene category "cyclists," and does not display other video segments.

[0279] In other embodiments, based on the filtering operation performed by the user on the plurality of highlight video clips, the video editing interface displays the segment information of the video clip selected by the user and the video clips not selected by the user according to different types of visual effects.

[0280] For example, when the above filtering operation is a user's filtering operation for video clips, the video editing interface displays the clip information of the video clip selected by the user and the video clips not selected by the user according to different types of visual effects. As shown in Figure 3d, video clip B is the video clip selected by the user. In the video editing interface, a selected identifier 312 is displayed at the display position of the clip information of video clip B. This identifier is used to indicate that the corresponding video clip has been selected. In the video editing interface, the selected identifier 312 is not displayed at the display position of the clip information of the unselected video clip B.

[0281] In practical applications, after completing the editing and selection of video clips, users can export the selected video clips. Therefore, the above method may also include:

[0282] 117. In response to an export operation triggered by the user in the video editing interface, export the video segment selected by the user.

[0283] In some embodiments, in response to an export operation triggered by the user in the video editing interface, the video segments selected by the user are exported respectively.

[0284] In other embodiments, in response to an export operation triggered by the user in the video editing interface, the video segments selected by the user are merged and exported, that is, a merged video generated based on multiple video segments selected by the user is exported.

[0285] In some other embodiments, in response to an export operation triggered by the user in the video editing interface, the video segment selected by the user and the merged video are exported respectively.

[0286] As shown in Figure 3d, the video editing interface 301 includes an export control 316. In response to a user's trigger operation on the export control 316, the video segment selected by the user is exported. For example, the video segment selected by the user through the filter controls for each video segment is exported.

[0287] In practical applications, in response to a user's filtering operation for multiple scene categories, the video editing interface displays video clip information belonging to the scene category selected by the user. After displaying the video clip information belonging to the scene category selected by the user in the video editing interface, in response to a filtering operation triggered by the user's filtering control for the video clip, the final video clip selected by the user is determined.

[0288] In this embodiment, the filtering operation for scene categories is to reduce the number of video clips that need to be displayed in the video editing interface, and the filtering operation for video clips is to filter out the video clips that the user finally selects.

[0289] Furthermore, the aforementioned video editing interface also supports switching the aspect ratio of the playback screen. In some embodiments, the above method may further include:

[0290] 118. In response to a user's switching operation triggered in the video editing interface to change the aspect ratio, switch the currently displayed playback screen in the video editing interface.

[0291] The video editing interface supports multiple aspect ratios for users to choose from. For example, the video editing interface supports aspect ratios of 9:16 and 16:9.

[0292] As shown in Figure 3d, a switching control 317 is displayed on the video editing interface 301. In response to the user's trigger operation on the switching control 317, as shown in Figure 3e, the aspect ratio of the currently displayed playback screen in the video editing interface is switched from the first aspect ratio (e.g., 9:16) to the second aspect ratio (e.g., 16:9).

[0293] Figure 5 is a flowchart illustrating a video editing method according to another embodiment of this application. This method can be applied to electronic devices, such as mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, netbooks, personal digital assistants (PDAs), and other terminal devices. For example, the electronic device can implement this solution by installing corresponding video processing software or plugins.

[0294] As shown in Figure 5, the method may include the following steps:

[0295] 501. Based on the video footage, obtain the first video clip and the second video clip.

[0296] The first video clip and the second video clip correspond to different local perspectives in the video material, and the time information of the first video clip and the second video clip overlaps in the video material.

[0297] The first video clip and the second video clip may be obtained by the electronic device through automatic analysis of the video material, or the first video clip and the second video clip may be obtained by the user through manual extraction from the video material, or one of the first video clip and the second video clip may be obtained by the electronic device through automatic analysis of the video material, and the other may be obtained by the user through manual extraction from the video material.

[0298] The first video clip and the second video clip can be obtained using one or more of the following methods:

[0299] Method 1: In response to the user's editing operation on the video material, obtain the first video segment and / or the second video segment.

[0300] In Method 1, a first video segment and / or a second video segment can be obtained in response to editing operations performed by the user on the information of the video material. The information of the video material may include time information and / or playback frames. The time information may include a timeline. For example, the first video segment and / or the second video segment can be obtained in response to time editing operations performed by the user on the time information (e.g., timeline) of the video material and / or perspective editing operations performed on the playback frames of the video material.

[0301] Optionally, the video editing interface may include information about the video material. Users can perform the above editing operations in the video editing interface to obtain the first video segment and / or the second video segment. For specific implementation, refer to the editing process of the fourth video segment in the above embodiments, which will not be repeated in this application embodiment.

[0302] In Method 1, users obtain video clips by manually trimming / editing them.

[0303] Method 2: Analyze the video material to obtain the first video segment and / or the second video segment.

[0304] In Method 2, the video footage is analyzed to obtain multiple highlight video clips, which include a first video clip and / or a second video clip.

[0305] The process of analyzing video footage to obtain multiple highlight video clips can be found in step 101 of the embodiment shown in Figure 1 above, and will not be repeated here.

[0306] 502. Display the segment information of the first video segment and the segment information of the second video segment in the same video editing interface.

[0307] The segment information of the first video segment and the segment information of the second video segment can be displayed simultaneously in the same video editing interface.

[0308] 503. In response to an editing operation performed on the target video segment in the video editing interface, update the target video segment.

[0309] The target video segment is either the first video segment or the second video segment.

[0310] The target video segment can be the currently edited object in the video editing interface.

[0311] The editing operation is used to modify the perspective information of the target video segment; that is, the editing operation is used to adjust / modify the local perspective of the target video segment in the video material.

[0312] In this embodiment, video clips from different perspectives that overlap in time within the same video material can be displayed on the same editing interface. Furthermore, the perspective of these overlapping video clips can be edited within the same editing interface. This allows the electronic device to display video clips from different perspectives on the same interface and to edit these clips based on editing operations, enriching the ways in which video clips are displayed and edited on the electronic device. Simultaneously, users can conveniently edit the perspective of overlapping video clips from different perspectives using the electronic device, meeting their actual editing needs and improving the editing experience.

[0313] The difference between the embodiment corresponding to Figure 5 and the embodiment corresponding to Figure 1 is that in the embodiment corresponding to Figure 5, the video segment is not limited to being obtained by analysis by an electronic device, but can also be selected by the user. In the embodiment corresponding to Figure 5, editing operations of editing the local viewpoint corresponding to the video segment can be performed on the target video segment. Other implementation methods can be referred to the specific description of the embodiment corresponding to Figure 1, and can be combined with the specific implementation methods of Figure 1.

[0314] Optionally, the target video segment corresponds to a first partial viewpoint in the video material; step 503 above, "updating the target video segment in response to an editing operation performed on the target video segment in the video editing interface," may include:

[0315] 5031. In response to an editing operation performed on a target video segment in the video editing interface, the target video segment is adjusted to correspond to a second local perspective in the video material.

[0316] The first local perspective is different from the second local perspective.

[0317] The specific methods and principles of steps 5031 and 1071 are the same. For a detailed description, please refer to the relevant content of step 1071 in the above embodiments, which will not be repeated here.

[0318] Optionally, the updated video clip may include visual content not present in the target video clip.

[0319] Optionally, the video editing interface includes: a playback screen of the video material. The step 503 above, "in response to an editing operation performed on the target video segment in the video editing interface, update the target video segment," can be implemented using one or more of the following steps:

[0320] 5032. In response to a drag operation performed on the playback screen, update the local viewpoint corresponding to the target video segment.

[0321] 5033. In response to a selection operation on the playback screen regarding the object to be tracked, update the local viewpoint corresponding to the target video segment to the local viewpoint in the video material used to track the object to be tracked.

[0322] The specific implementation and principle of step 5032 are the same as those of step 1071a. For a detailed description, please refer to the relevant content of step 1071a in the above embodiments, which will not be repeated here.

[0323] The specific implementation and principle of step 5033 are the same as those of step 1071b. For a detailed description, please refer to the relevant content of step 1071b in the above embodiments, which will not be repeated here.

[0324] Optionally, the editing operation can also be used to modify the time period of the target video segment.

[0325] In some embodiments, the video editing interface includes: a timeline of the video material. Step 503 above, "updating the target video segment in response to an editing operation performed on the target video segment in the video editing interface," may further include the following steps:

[0326] 5034. In response to a time period modification operation performed on the time axis, update the time period of the target video segment.

[0327] The specific implementation and principle of step 5034 are the same as those of step 1072. For a detailed description, please refer to the relevant content of step 1072 in the above embodiments, which will not be repeated here.

[0328] Optionally, at least one of the start and end times of the time period of the updated target video segment is not within the time period of the target video segment before the update.

[0329] Optionally, the target video segment is the currently edited object in the video editing interface; the method may further include:

[0330] 504. In the video editing interface, in response to a trigger operation on the segment information of the target video segment, the target video segment is determined as the current editing object of the video editing interface.

[0331] Alternatively, as shown in Figure 3a, in response to a trigger operation on the target video segment in the video editing interface 301, the video playback area 305 plays the video clip located at the target time period, where the target time period refers to the time period of the target video segment in the video clip.

[0332] It should be noted that the current editing object in the video editing interface can be switched. For example, if the current editing object in the video editing interface is the first video clip, in response to a trigger operation on the clip information of the second video clip, the current editing object in the video editing interface can be switched to the second video clip.

[0333] Optionally, the first video clip and the second video clip correspond to local perspectives in the video material.

[0334] Optionally, the video footage provides a panoramic view, and the local view is smaller than the panoramic view.

[0335] Optionally, the first video clip and the second video clip are obtained by cropping images from the video material.

[0336] Optionally, the first video segment includes a first image frame, and the second video segment includes a second image frame, wherein the first image frame and the second image frame are obtained by cropping the same image frame from the video material.

[0337] Optionally, the content of the first image frame and the second image frame are different.

[0338] Optionally, the first video segment and the second video segment correspond to different local perspectives in the video material.

[0339] Optionally, the first video segment is obtained based on the content of a first frame located in a first partial viewpoint of the video material, and the second video segment is obtained based on the content of a second frame located in a second partial viewpoint of the video material, wherein the content of the first frame and the content of the second frame are different.

[0340] Optionally, the first video segment is captured by a first shooting device, and the second video segment is captured by a second shooting device; or, the first video segment and the second video segment are captured by different visual sensors of the same shooting device.

[0341] Optionally, the video material includes one or more video segments selected by the user. In some embodiments, the video material is a video obtained by stitching together multiple video segments selected by the user along a time dimension.

[0342] Optionally, the video editing interface includes information about the video material.

[0343] In some embodiments, the method further includes:

[0344] 505. Display the information of the video material on the same video editing interface.

[0345] The information of the video material includes: the time information and / or the playback screen of the video material.

[0346] For example, as shown in Figure 3a, the video editing interface 301 displays the time information of the video material (e.g., timeline 304) and the playback screen.

[0347] Optionally, the above method may also include:

[0348] 506. In the video editing interface, the segment information of the first video segment, the segment information of the second video segment, and the time information of the video material are displayed in association.

[0349] The specific methods and principles of steps 506 and 106 are the same. For a detailed description, please refer to the relevant content of step 106 in the above embodiments, which will not be repeated here.

[0350] Optionally, the video editing interface includes a video playback area for playing the video footage.

[0351] Optionally, the playback frame of the video material corresponds to a partial viewpoint of the video material.

[0352] Optionally, the first video segment and the second video segment are obtained by an electronic device analyzing the video material. The method further includes:

[0353] 507. In the video editing interface, display the segment information of the fourth video segment.

[0354] The fourth video segment is extracted from the video material and is obtained in response to an editing operation triggered by the user based on information from the video material.

[0355] The specific methods and principles of steps 507 and 109 are the same. For a detailed description, please refer to the relevant content of step 106 in the above embodiments, which will not be repeated here.

[0356] Optionally, the method further includes:

[0357] 508. Based on the time editing operation performed by the user on the video editing interface for the time information of the video material and / or the perspective editing operation performed on the playback screen of the video material, the fourth video segment is extracted from the video material.

[0358] The specific methods and principles of steps 508 and 110 are the same. For a detailed description, please refer to the relevant content of step 106 in the above embodiments, which will not be repeated here.

[0359] Optionally, the method further includes:

[0360] 509. In the video editing interface, the segment information of the fourth video segment and the segment information of the first video segment are displayed according to different types of visual effects.

[0361] In the video editing interface, the fourth video clip's information is displayed using the first type of visual effect, while the first video clip's information is displayed using the second type of visual effect. The first and second types are different.

[0362] The first type of visual effect is used to indicate that the corresponding video segment belongs to a user-defined video segment, while the second type of visual effect is used to indicate that the corresponding video segment belongs to an automatically analyzed video segment.

[0363] Optionally, the step 501 above, "obtaining the first video clip and the second video clip based on the video material," can be achieved using the following steps:

[0364] 5011. Perform scene recognition on the video material to obtain scene recognition results.

[0365] The scene recognition results include indication information of highlight video clips belonging to each scene category among multiple scene categories.

[0366] 5012. According to the instruction information, extract multiple highlight video clips from the video material.

[0367] The plurality of highlight video clips include the first video clip and the second video clip.

[0368] The specific methods and principles of steps 5011 and 1011 are the same. For a detailed description, please refer to the relevant content of step 1011 in the above embodiments, which will not be repeated here.

[0369] The specific methods and principles of steps 5012 and 1012 are the same. For a detailed description, please refer to the relevant content of step 1012 in the above embodiments, which will not be repeated here.

[0370] Optionally, the scene category is manually entered by the user before analyzing the video footage.

[0371] In some embodiments, the method further includes:

[0372] 510. Before analyzing the video material, a selection interface is displayed.

[0373] The selection interface displays multiple alternative scene categories.

[0374] 511. In response to the selection operation triggered by the user on the selection interface, determine the multiple scene categories.

[0375] The specific methods and principles of steps 511 and 115 are the same. For a detailed description, please refer to the relevant content of step 115 in the above embodiments, which will not be repeated here.

[0376] Optionally, the method further includes:

[0377] 512. Based on the filtering operation performed by the user on multiple highlight video clips, display the clip information of the video clip selected by the user in the video editing interface.

[0378] The plurality of highlight video clips are obtained by analyzing the video material using an electronic device, and the plurality of highlight video clips include the first video clip and the second video clip.

[0379] In some embodiments, the filtering operation includes: a user filtering operation for scene categories; the video clip selected by the user includes video clips belonging to the scene category selected by the user among the plurality of highlight video clips.

[0380] In other embodiments, the filtering operation includes: a user filtering operation for video segments.

[0381] The specific methods and principles of steps 512 and 116 are the same. For a detailed description, please refer to the relevant content of step 116 in the above embodiments, which will not be repeated here.

[0382] Optionally, the method further includes:

[0383] 513. In response to the export operation triggered by the user in the video editing interface, export the video segment selected by the user.

[0384] The specific methods and principles of steps 513 and 117 are the same. For a detailed description, please refer to the relevant content of step 117 in the above embodiments, which will not be repeated here.

[0385] Optionally, the phrase "displaying the segment information of the first video segment and the segment information of the second video segment in the same video editing interface" in section 502 above may include:

[0386] 5021. In the video editing interface, the segment information of the first video segment and the segment information of the second video segment are displayed together.

[0387] The specific methods and principles of steps 5021 and 103 are the same. For a detailed description, please refer to the relevant content of step 103 in the above embodiments, which will not be repeated here.

[0388] It should be noted that any steps in the method provided in this application that are not fully described in detail can be found in the corresponding content of the above embodiments, and will not be repeated here. Furthermore, the method provided in this application may include other parts or all of the steps in the above embodiments in addition to the steps described above; for details, please refer to the corresponding content of the above embodiments, and will not be repeated here.

[0389] Figure 6 is a flowchart illustrating a video editing method according to another embodiment of this application. This method can be applied to electronic devices, such as mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, netbooks, personal digital assistants (PDAs), and other terminal devices. For example, the electronic device can implement this solution by installing corresponding video processing software or plugins.

[0390] As shown in Figure 6, the method may include the following steps:

[0391] 601. Obtain video footage.

[0392] The specific methods and principles of steps 601 and 101 are the same. For a detailed description, please refer to the relevant content of step 101 in the above embodiments, which will not be repeated here.

[0393] 602. Analyze the video material to obtain multiple sets of highlight video clips.

[0394] In this context, the time information of any two sets of highlight video clips in the video material does not overlap. Each set of highlight video clips includes a first video clip and a second video clip, and the time information of the first video clip and the second video clip overlaps in the video material.

[0395] In some embodiments, the step 602 above, "analyzing the video material to obtain multiple sets of highlight video clips," can be achieved using the following steps:

[0396] 6021. Analyze the video material to obtain multiple highlight video clips.

[0397] 6022. Based on the time information of multiple highlight video clips in the video footage, group the multiple highlight video clips to obtain multiple groups of highlight video clips.

[0398] The specific methods and principles of steps 6021 and 102 are the same. For a detailed description, please refer to the relevant content of step 102 in the above embodiments, which will not be repeated here.

[0399] In step 6022 above, any one highlight video clip in each group of highlight video clips overlaps in time with at least one other highlight video clip in that group of highlight video clips.

[0400] 603. In the video editing interface, display at least one set of time markers corresponding to the multiple sets of highlight video clips.

[0401] The time identifier is used to indicate the time information of the group corresponding to the time identifier in the video footage, that is, the time period. The time period of the highlight video clip group in the video footage refers to the union of the time periods of at least one video clip within the group in the video footage. For example, if the time period of video clip 1 in the video footage is 1 minute 13 seconds to 2 minutes 25 seconds, and the time period of video clip 2 in the video footage is 1 minute 30 seconds to 2 minutes 36 seconds, then the time period of the highlight video clip group in the video footage is 1 minute 13 seconds to 2 minutes 36 seconds. If there is also a video clip 3 in the video footage with a time period of 1 minute 40 seconds to 2 minutes 50 seconds, then the time period of the highlight video clip group in the video footage is 1 minute 13 seconds to 2 minutes 50 seconds.

[0402] As shown in Figure 3a, the video editing interface 301 displays the time stamps 318 corresponding to each of the multiple sets of highlight video clips.

[0403] For example, as shown in Figure 3a, in the video editing interface 301, at least one set of corresponding time markers 318 is displayed along the timeline 304 of the video material.

[0404] 604. In the video editing interface, display the segment information of the first video segment and the segment information of the second video segment of at least one of the multiple sets of highlight video segments.

[0405] In some embodiments, video clip information is displayed in groups in the video editing interface.

[0406] In the video editing interface, the segment information of the first and second video clips in the same group is displayed together, while video clips from different groups are not displayed together.

[0407] The specific implementation of associated and unassociated display can be found in the relevant content of step 103, and will not be described in detail here.

[0408] The technical solution provided in this application analyzes video footage to obtain multiple sets of highlight video clips. Furthermore, the timing information of any two sets of highlight video clips within the video footage does not overlap. Each set of highlight video clips includes a first video clip and a second video clip, and the timing information of the first and second video clips overlaps within the video footage. Then, the clip information of the video clips is displayed as a group in the video editing interface. In this way, the electronic device can display multiple sets of highlight video clips, enriching the display format of highlight video clips. Users can intuitively and quickly locate groups of highlight video clips with temporal overlap. Furthermore, users can edit the highlight video clips within the highlight video clip groups to meet their editing needs for different video clips, thereby improving the user's editing experience.

[0409] The difference between the embodiment corresponding to Figure 6 and the embodiment corresponding to Figure 1 is that the embodiment corresponding to Figure 6 introduces the concept of a highlight video clip group, and displays the segment information of the first video clip and the segment information of the second video clip from at least one of the multiple groups of highlight video clips in the video editing interface. Further implementation methods can be found in the detailed description of the embodiment corresponding to Figure 1, and can be combined with the specific implementation method of Figure 1.

[0410] In some embodiments, the aforementioned plurality of highlight video clips includes a first set of highlight video clips, wherein the first set of highlight video clips refers to any one of the plurality of highlight video clips. Step 604 above, "displaying the segment information of the first video clip and the segment information of the second video clip from at least one of the plurality of highlight video clips in the video editing interface," may include:

[0411] 6041. In the video editing interface, display the segment information of the first video segment and the segment information of the second video segment in the first group of highlight video segments.

[0412] For example, in the video editing interface, visual elements are displayed for associating the segment information of the first video segment and the segment information of the second video segment with at least one of the multiple sets of highlight video segments.

[0413] The specific implementation of the association display of the segment information of the first video segment and the segment information of the second video segment can be found in the corresponding content of step 103 above, and will not be repeated here.

[0414] Figure 8 shows an electronic device provided according to an embodiment of this application. As shown in Figure 8, the electronic device includes: at least one processor 1001; and at least one memory 1002 including computer program code.

[0415] In some embodiments, at least one memory 1002 and computer program code, together with at least one processor 1001, are configured to cause the electronic device to perform the methods shown in FIG1, FIG5 and FIG6.

[0416] The specific implementation principle, process, and effect of the electronic device shown in Figure 8 are basically the same as those of the methods shown in Figures 1, 5, and 6. For parts not described in detail in this embodiment, please refer to the relevant descriptions of the embodiments shown in Figures 1, 5, and 6.

[0417] This application provides a machine-readable storage medium including instructions stored thereon, which, when executed by a processor, are used to implement the methods shown in Figures 1, 5, and 6.

[0418] The technical solutions and features in the above embodiments can be used individually or in combination if they conflict with this invention. As long as they do not exceed the knowledge of those skilled in the art, they are all equivalent embodiments within the scope of protection of this application.

[0419] The above are merely embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

[0420] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A video processing method, characterized in that, include: Obtain video footage; The video footage is analyzed to obtain multiple highlight video clips, wherein the multiple highlight video clips include a first video clip and a second video clip, and the time information of the first video clip and the second video clip overlaps in the video footage; In the video editing interface, the segment information of the first video clip and the segment information of the second video clip are displayed together.

2. The method according to claim 1, characterized in that, The step of displaying the segment information of the first video segment and the segment information of the second video segment in the video editing interface includes: In the video editing interface, the segment information of the first video segment and the segment information of the second video segment are displayed adjacent to each other; In the video editing interface, the segment information of the first video clip and the segment information of the second video clip are displayed according to the same type of visual effects; and / or, The video editing interface displays segment information of the first video segment, segment information of the second video segment, and visual elements used to associate the segment information of the first video segment and the segment information of the second video segment.

3. The method according to claim 2, characterized in that, The video editing interface displays segment information of the first video segment, segment information of the second video segment, and visual elements for associating the segment information of the first video segment and the segment information of the second video segment, including: The segment information of the first video clip and the segment information of the second video clip are displayed in the same area of ​​the video editing interface, and the display position of the visual element corresponds to the same area.

4. The method according to claim 3, characterized in that, Displaying the segment information of the first video segment and the segment information of the second video segment in the same area of ​​the video editing interface includes: The segment information of the first video segment and the segment information of the second video segment are displayed in the same container on the video editing interface, and the display position of the visual element corresponds to the same container.

5. The method according to claim 1, characterized in that, The plurality of highlight video clips also includes a third video clip, wherein the time information of the third video clip and the first video clip in the video material does not overlap, and the time information of the third video clip and the second video clip in the video material does not overlap; The method further includes: The video editing interface displays the segment information of the third video clip; In the video editing interface, the segment information of the third video segment is not displayed in association with the segment information of the first video segment, nor is the segment information of the third video segment displayed in association with the segment information of the second video segment.

6. The method according to claim 1, characterized in that, The first video clip and the second video clip correspond to local perspectives in the video material.

7. The method according to claim 6, characterized in that, The video footage provides a panoramic view, and the local view is smaller than the panoramic view.

8. The method according to claim 6, characterized in that, The first video clip and the second video clip are obtained by cropping images from the video material.

9. The method according to claim 8, characterized in that, The first video segment includes a first image frame, and the second video segment includes a second image frame. The first image frame and the second image frame are obtained by cropping the same image frame from the video material.

10. The method according to claim 9, characterized in that, The content of the first image frame is different from that of the second image frame.

11. The method according to claim 6, characterized in that, The first video clip and the second video clip correspond to different local perspectives in the video material.

12. The method according to claim 11, characterized in that, The first video clip is obtained based on the content of a first frame within a first partial viewpoint in the video material, and the second video clip is obtained based on the content of a second frame within a second partial viewpoint in the video material. The content of the first frame and the content of the second frame are different.

13. The method according to claim 11, characterized in that, The first video clip was captured by a first shooting device, and the second video clip was captured by a second shooting device; or, the first video clip and the second video clip were captured by different visual sensors of the same shooting device.

14. The method according to claim 6, characterized in that, The video materials include one or more videos selected by the user.

15. The method according to claim 1, characterized in that, The video editing interface includes: information about the video material; and / or, The method further includes displaying information about the video material on the same video editing interface.

16. The method according to claim 15, characterized in that, The information of the video material includes: the time information of the video material; and / or, The method further includes: In the video editing interface, the segment information of the first video clip, the segment information of the second video clip, and the time information of the video material are displayed together.

17. The method according to claim 16, characterized in that, In the video editing interface, the time information of the video material is displayed in the form of a timeline; and / or, In the video editing interface, the segment information of the first video segment, the segment information of the second video segment, and the time information of the video material are displayed in association, including: Along the timeline, a first time period of the first video clip and a second time period of the second video clip are highlighted, wherein the first time period refers to the time period in which the first video clip is located within the video material, and the second time period refers to the time period in which the second video clip is located within the video material.

18. The method according to claim 17, characterized in that, The step of highlighting a first time segment of the first video clip and a second time segment of the second video clip along the timeline includes: Along the timeline, visual elements for identifying the first time period and visual elements for identifying the second time period are displayed overlappingly.

19. The method according to claim 15, characterized in that, The information of the video material includes the playback screen of the video material.

20. The method according to claim 19, characterized in that, The video editing interface includes a video playback area, which is used to play the video material.

21. The method according to claim 19, characterized in that, The playback screen of the video material corresponds to a partial viewpoint of the video material.

22. The method according to claim 15, characterized in that, The method further includes: The video editing interface displays the segment information of the fourth video clip, which is extracted from the video material and is obtained in response to the user's editing operation triggered by the information of the video material.

23. The method according to claim 22, characterized in that, The method further includes: Based on the time editing operation performed by the user on the video editing interface for the time information of the video material and / or the perspective editing operation performed on the playback screen of the video material, the fourth video segment is extracted from the video material.

24. The method according to claim 22, characterized in that, In the video editing interface, the segment information of the fourth video segment and the segment information of the first video segment are displayed according to different types of visual effects.

25. The method according to claim 1, characterized in that, The method further includes: Based on the filtering operation performed by the user on the multiple highlight video clips, the clip information of the video clip selected by the user is displayed on the video editing interface.

26. The method according to claim 25, characterized in that, The filtering operation includes: a user filtering operation based on scene category; the video clip selected by the user includes video clips belonging to the scene category selected by the user among the plurality of highlight video clips.

27. The method according to claim 25, characterized in that, The filtering operation includes: the user's filtering operation for video clips.

28. The method according to claim 25, characterized in that, The step of displaying the segment information of the video segment selected by the user in the video editing interface based on the filtering operation performed by the user on the multiple highlight video segments includes: Based on the filtering operation performed by the user on the multiple highlight video clips, the video editing interface displays the clip information of the video clip selected by the user and the clip information of the video clips not selected by the user in different display methods.

29. The method according to claim 28, characterized in that, The step of displaying the segment information of the selected video segment and the unselected video segments in the video editing interface according to different display methods based on the user's filtering operation on the multiple highlight video segments includes: Based on the filtering operation performed by the user on the multiple highlight video clips, the video editing interface displays the clip information of the video clip selected by the user, and does not display the video clips not selected by the user.

30. The method according to claim 28, characterized in that, The step of displaying the segment information of the selected video segment and the unselected video segments in the video editing interface according to different display methods based on the user's filtering operation on the multiple highlight video segments includes: Based on the filtering operation performed by the user on the multiple highlight video clips, the video editing interface displays the clip information of the video clip selected by the user and the video clips not selected by the user according to different types of visual effects.

31. The method according to claim 25, characterized in that, The method further includes: In response to an export operation triggered by the user in the video editing interface, the video segment selected by the user is exported.

32. The method according to claim 31, characterized in that, In response to an export operation triggered by the user in the video editing interface, the video segment selected by the user is exported, including: In response to an export operation triggered by the user in the video editing interface, the video segments selected by the user are exported separately, and / or the video segments selected by the user are exported in a combined manner.

33. The method according to claim 1, characterized in that, The method further includes: In response to an editing operation performed on a target video segment in the video editing interface, the target video segment is updated. The target video segment is the current editing object of the video editing interface, and the target video segment is either the first video segment or the second video segment.

34. The method according to claim 33, characterized in that, The editing operations include time editing and / or perspective editing.

35. The method according to claim 34, characterized in that, The target video segment corresponds to a first local perspective in the video material, and the editing operation is used to adjust the target video segment to another local perspective corresponding to the video material. And / or, in response to an editing operation performed on a target video segment in the video editing interface, updating the target video segment includes: In response to the editing operation performed on the target video segment in the video editing interface, the target video segment is adjusted to correspond to the second local perspective in the video material; The first local perspective is different from the second local perspective.

36. The method according to claim 34, characterized in that, The updated video clip contains visual content not included in the target video clip.

37. The method according to claim 34, characterized in that, The video editing interface includes: the timeline of the video material; In response to an editing operation performed on a target video segment in the video editing interface, updating the target video segment includes: In response to a time period modification operation performed on the time axis, the time period of the target video segment is updated.

38. The method according to claim 37, characterized in that, At least one of the start and end times of the time period of the target video segment after the update is not within the time period of the target video segment before the update.

39. The method according to claim 34, characterized in that, The video editing interface includes: the playback screen of the video material; In response to an editing operation performed on a target video segment in the video editing interface, updating the target video segment includes: In response to a dragging operation performed on the playback screen, update the local viewpoint corresponding to the target video segment; and / or In response to a selection operation on the playback screen regarding the object to be tracked, the local viewpoint corresponding to the target video segment is updated to the local viewpoint in the video material used to track the object to be tracked.

40. The method according to claim 33, characterized in that, The method further includes: In response to a trigger operation on the segment information of the target video segment, the target video segment is identified as the current editing object of the video editing interface.

41. The method according to claim 33, characterized in that, The method further includes: In response to a synchronous editing operation triggered on the video editing interface for the first video segment and the second video segment, the editing area corresponding to the first video segment and the editing area corresponding to the second video segment are displayed on the video editing interface.

42. The method according to claim 1, characterized in that, The analysis of the video footage yields multiple highlight video clips, including: Scene recognition is performed on the video material to obtain scene recognition results, wherein the scene recognition results include indication information of highlight video clips belonging to each scene category in multiple scene categories; According to the indicated information, the plurality of highlight video clips are extracted from the video material.

43. The method according to claim 42, characterized in that, The indication information includes indication information for indicating the time information of the highlight video clip in the video material and / or indication information for indicating the local viewpoint corresponding to the highlight video clip in the video material.

44. The method according to claim 42, characterized in that, The scene category is used to indicate the objects and / or events contained in the corresponding video clip.

45. The method according to claim 42, characterized in that, The scene categories include: object categories and / or event categories.

46. ​​The method according to claim 42, characterized in that, The first video clip and the second video clip correspond to different scene categories.

47. The method according to claim 42, characterized in that, The scene category is manually entered by the user before analyzing the video footage.

48. The method according to claim 47, characterized in that, The method further includes: Before analyzing the video footage, a selection interface is displayed, which shows multiple alternative scene categories; In response to the user's selection operation triggered on the selection interface, the multiple scene categories are determined.

49. A video editing method, characterized in that, include: Based on the video material, a first video clip and a second video clip are obtained. The first video clip and the second video clip correspond to different local perspectives in the video material, and the time information of the first video clip and the second video clip in the video material overlaps. The segment information of the first video segment and the segment information of the second video segment are displayed on the same video editing interface; In response to an editing operation performed on a target video segment in the video editing interface, the target video segment is updated, the editing operation being used to modify the viewpoint information of the target video segment, the target video segment being either the first video segment or the second video segment.

50. The method according to claim 49, characterized in that, The target video segment corresponds to the first local perspective in the video material; In response to an editing operation performed on a target video segment in the video editing interface, updating the target video segment includes: In response to the editing operation performed on the target video segment in the video editing interface, the target video segment is adjusted to correspond to the second local perspective in the video material; The first local perspective is different from the second local perspective.

51. The method according to claim 49, characterized in that, The updated video clip contains visual content not included in the target video clip.

52. The method according to claim 49, characterized in that, The video editing interface includes: the playback screen of the video material; In response to an editing operation performed on a target video segment in the video editing interface, updating the target video segment includes: In response to a dragging operation performed on the playback screen, update the local viewpoint corresponding to the target video segment; and / or In response to a selection operation on the playback screen regarding the object to be tracked, the local viewpoint corresponding to the target video segment is updated to the local viewpoint in the video material used to track the object to be tracked.

53. The method according to claim 49, characterized in that, The editing operation is also used to modify the time period of the target video segment; the video editing interface includes: the timeline of the video material; In response to an editing operation performed on a target video segment in the video editing interface, updating the target video segment includes: In response to a time period modification operation performed on the time axis, the time period of the target video segment is updated.

54. The method according to claim 53, characterized in that, At least one of the start and end times of the time period of the target video segment after the update is not within the time period of the target video segment before the update.

55. The method according to claim 49, characterized in that, The target video segment is the current editing object of the video editing interface; the method further includes: In the video editing interface, in response to a trigger operation on the segment information of the target video segment, the target video segment is identified as the current editing object of the video editing interface.

56. The method according to claim 49, characterized in that, Based on the video material, obtain a first video clip and a second video clip, including at least one of the following: In response to the user's editing operation on the video material, the first video segment and / or the second video segment are obtained; The video material is analyzed to obtain the first video segment and / or the second video segment.

57. The method according to claim 49, characterized in that, The first video clip and the second video clip correspond to local perspectives in the video material.

58. The method according to claim 57, characterized in that, The video footage provides a panoramic view, and the local view is smaller than the panoramic view.

59. The method according to claim 57, characterized in that, The first video clip and the second video clip are obtained by cropping images from the video material.

60. The method according to claim 59, characterized in that, The first video segment includes a first image frame, and the second video segment includes a second image frame. The first image frame and the second image frame are obtained by cropping the same image frame from the video material.

61. The method according to claim 60, characterized in that, The content of the first image frame is different from that of the second image frame.

62. The method according to claim 57, characterized in that, The first video clip and the second video clip correspond to different local perspectives in the video material.

63. The method according to claim 62, characterized in that, The first video clip is obtained based on the content of a first frame within a first partial viewpoint in the video material, and the second video clip is obtained based on the content of a second frame within a second partial viewpoint in the video material. The content of the first frame and the content of the second frame are different.

64. The method according to claim 62, characterized in that, The first video clip was captured by a first shooting device, and the second video clip was captured by a second shooting device; or, the first video clip and the second video clip were captured by different visual sensors of the same shooting device.

65. The method according to claim 57, characterized in that, The video materials include one or more videos selected by the user.

66. The method according to claim 49, characterized in that, The video editing interface includes: information about the video material; and / or, The method further includes displaying information about the video material on the same video editing interface.

67. The method according to claim 66, characterized in that, The information of the video material includes: the time information of the video material; and / or, The method further includes: In the video editing interface, the segment information of the first video clip, the segment information of the second video clip, and the time information of the video material are displayed together.

68. The method according to claim 67, characterized in that, In the video editing interface, the time information of the video material is displayed in the form of a timeline; and / or, In the video editing interface, the segment information of the first video segment, the segment information of the second video segment, and the time information of the video material are displayed in association, including: Along the timeline, a first time period of the first video clip and a second time period of the second video clip are highlighted, wherein the first time period refers to the time period in which the first video clip is located within the video material, and the second time period refers to the time period in which the second video clip is located within the video material.

69. The method according to claim 68, characterized in that, The step of highlighting a first time segment of the first video clip and a second time segment of the second video clip along the timeline includes: Along the timeline, visual elements for identifying the first time period and visual elements for identifying the second time period are displayed overlappingly.

70. The method according to claim 66, characterized in that, The information of the video material includes the playback screen of the video material.

71. The method according to claim 70, characterized in that, The video editing interface includes a video playback area, which is used to play the video material.

72. The method according to claim 70, characterized in that, The playback screen of the video material corresponds to a partial viewpoint of the video material.

73. The method according to claim 66, characterized in that, The first video clip and the second video clip were obtained by the electronic device analyzing the video material; The method further includes: The video editing interface displays the segment information of the fourth video clip, which is extracted from the video material and is obtained in response to the user's editing operation triggered by the information of the video material.

74. The method according to claim 73, characterized in that, The method further includes: Based on the time editing operation performed by the user on the video editing interface for the time information of the video material and / or the perspective editing operation performed on the playback screen of the video material, the fourth video segment is extracted from the video material.

75. The method according to claim 73, characterized in that, Also includes: In the video editing interface, the segment information of the fourth video segment and the segment information of the first video segment are displayed according to different types of visual effects.

76. The method according to claim 49, characterized in that, The method further includes: Based on the filtering operation performed by the user on multiple highlight video clips, the video editing interface displays the clip information of the video clip selected by the user. The multiple highlight video clips are obtained by the electronic device analyzing the video material, and the multiple highlight video clips include the first video clip and the second video clip.

77. The method according to claim 76, characterized in that, The filtering operation includes: a user filtering operation based on scene category; the video clip selected by the user includes video clips belonging to the scene category selected by the user among the plurality of highlight video clips.

78. The method according to claim 76, characterized in that, The filtering operation includes: the user's filtering operation for video clips.

79. The method according to claim 76, characterized in that, The step of displaying the segment information of the video segment selected by the user in the video editing interface based on the filtering operation performed by the user on the multiple highlight video segments includes: Based on the filtering operation performed by the user on the multiple highlight video clips, the video editing interface displays the clip information of the video clip selected by the user and the clip information of the video clips not selected by the user in different display methods.

80. The method according to claim 79, characterized in that, The step of displaying the segment information of the selected video segment and the unselected video segments in the video editing interface according to different display methods based on the user's filtering operation on the multiple highlight video segments includes: Based on the filtering operation performed by the user on the multiple highlight video clips, the video editing interface displays the clip information of the video clip selected by the user, and does not display the video clips not selected by the user.

81. The method according to claim 79, characterized in that, The step of displaying the segment information of the selected video segment and the unselected video segments in the video editing interface according to different display methods based on the user's filtering operation on the multiple highlight video segments includes: Based on the filtering operation performed by the user on the multiple highlight video clips, the video editing interface displays the clip information of the video clip selected by the user and the video clips not selected by the user according to different types of visual effects.

82. The method according to claim 76, characterized in that, The method further includes: In response to an export operation triggered by the user in the video editing interface, the video segment selected by the user is exported.

83. The method according to claim 82, characterized in that, In response to an export operation triggered by the user in the video editing interface, the video segment selected by the user is exported, including: In response to an export operation triggered by the user in the video editing interface, the video segments selected by the user are exported separately, and / or the video segments selected by the user are exported in a combined manner.

84. The method according to claim 49, characterized in that, Based on the video footage, obtain the first video clip and the second video clip, including: Scene recognition is performed on the video material to obtain scene recognition results, wherein the scene recognition results include indication information of highlight video clips belonging to each scene category in multiple scene categories; According to the instruction information, multiple highlight video clips are extracted from the video material, and the multiple highlight video clips include the first video clip and the second video clip.

85. The method according to claim 84, characterized in that, The indication information includes indication information for indicating the time information of the highlight video clip in the video material and / or indication information for indicating the local viewpoint corresponding to the highlight video clip in the video material.

86. The method according to claim 84, characterized in that, The scene category is used to indicate the objects and / or events contained in the corresponding video clip.

87. The method according to claim 84, characterized in that, The scene categories include: object categories and / or event categories.

88. The method according to claim 84, characterized in that, The first video clip and the second video clip correspond to different scene categories.

89. The method according to claim 84, characterized in that, The scene category is manually entered by the user before analyzing the video footage.

90. The method according to claim 89, characterized in that, The method further includes: Before analyzing the video footage, a selection interface is displayed, showing multiple alternative scene categories; in response to a selection operation triggered by the user on the selection interface, the multiple scene categories are determined.

91. The method according to claim 49, characterized in that, Displaying segment information of the first video clip and segment information of the second video clip within the same video editing interface includes: The video editing interface displays the segment information of the first video segment and the segment information of the second video segment together.

92. The method according to claim 91, characterized in that, The step of displaying the segment information of the first video segment and the segment information of the second video segment in the video editing interface includes: In the video editing interface, the segment information of the first video segment and the segment information of the second video segment are displayed adjacent to each other; In the video editing interface, the segment information of the first video clip and the segment information of the second video clip are displayed according to the same type of visual effects; and / or, The video editing interface displays segment information of the first video segment, segment information of the second video segment, and visual elements used to associate the segment information of the first video segment and the segment information of the second video segment.

93. The method according to claim 92, characterized in that, The video editing interface displays segment information of the first video segment, segment information of the second video segment, and visual elements for associating the segment information of the first video segment and the segment information of the second video segment, including: The segment information of the first video clip and the segment information of the second video clip are displayed in the same area of ​​the video editing interface, and the display position of the visual element corresponds to the same area.

94. The method according to claim 93, characterized in that, Displaying the segment information of the first video segment and the segment information of the second video segment in the same area of ​​the video editing interface includes: The segment information of the first video segment and the segment information of the second video segment are displayed in the same container on the video editing interface, and the display position of the visual element corresponds to the same container.

95. A video processing method, characterized in that, include: Obtain video footage; The video material is analyzed to obtain multiple sets of highlight video clips. Among these multiple sets of highlight video clips, the time information of any two sets of highlight video clips in the video material does not overlap. Each set of highlight video clips includes a first video clip and a second video clip, and the time information of the first video clip and the second video clip in the video material overlaps. In the video editing interface, at least one set of time markers corresponding to the multiple sets of highlight video clips is displayed, wherein the time markers are used to indicate the time information of the set corresponding to the time marker in the video material; The video editing interface displays the segment information of the first video segment and the segment information of the second video segment from at least one of the multiple sets of highlight video segments.

96. The method according to claim 95, characterized in that, Also includes: Visual elements that display at least one of the multiple sets of highlight video clips, used to associate the clip information of the first video clip and the clip information of the second video clip.

97. An electronic device, characterized in that, include: At least one processor; as well as At least one memory including computer program code, wherein at least one of the memory and the computer program code, together with at least one of the processors, are configured to cause the electronic device to perform the method of any one of claims 1 to 96.

98. A machine-readable storage medium, characterized in that, Includes instructions stored thereon, which, when executed by a processor, are used to implement the method according to any one of claims 1 to 96.

Images