Video extraction methods and electronic devices
By displaying excerpt cards and controls in the video playback interface, it is possible to switch between different applications and record video clips, solving the problem of the single video excerpting method in the existing technology and improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HONOR DEVICE CO LTD
- Filing Date
- 2023-07-12
- Publication Date
- 2026-05-26
AI Technical Summary
The existing methods for extracting video clips are too simplistic, resulting in a poor user experience.
A video excerpting method is provided, which displays an icon for the video excerpt file on the interface, displays excerpt cards and controls in response to user operations, and allows switching between different applications and recording video clips to form new video excerpts.
It enriches the forms of video excerpts and improves the user experience.
Smart Images

Figure CN119316670B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and more specifically, to a method for extracting video and an electronic device. Background Technology
[0002] Video, as a carrier of information, conveys information more accurately, intuitively, and more easily for users to understand. Content distribution and information retrieval based on video have become important information transmission channels. Consequently, users' needs for extracting and organizing video content are increasing. In some cases, users can extract a portion of a video, annotate that portion, and obtain a video excerpt. Users can then review the excerpt to extract key information. However, currently, the methods for extracting video content are relatively limited, resulting in a poor user experience.
[0003] Therefore, how to expand the ways of video excerpting and improve user experience has become an urgent problem to be solved. Summary of the Invention
[0004] This application provides a method for video extraction that expands the ways of video extraction and improves user experience.
[0005] Firstly, a method for extracting video content is provided, including:
[0006] The first interface is displayed, which includes the first icon corresponding to the first video excerpt file, and the first video excerpt file includes the first video.
[0007] In response to the user's operation on the first icon, a second interface of the first application is displayed. The second interface includes a first video excerpt card and a first control. The first video excerpt card includes a first video.
[0008] In response to the user's operation on the first control, a first excerpt window and a third interface of the second application are displayed. The first excerpt window obscures part of the content of the third interface. The first excerpt window includes a recording control and a first video excerpt card.
[0009] In response to the user opening a third application, a first excerpt window and a fourth interface of the third application are displayed. The first excerpt window obscures part of the content of the fourth interface, which includes a second video that is currently playing.
[0010] In response to the operation of the recording control, the recording of the video clip of the second video in the fourth interface begins, and the second excerpt window is displayed. The recording control in the second excerpt window is updated to a pause control, and the second excerpt window obscures part of the content of the fourth interface.
[0011] In response to the pause control, the recording of the video segment of the second video in the fourth interface ends, and the third excerpt window is displayed. The third excerpt window obscures part of the content of the fourth interface. The third excerpt window includes the first video excerpt card and the second video excerpt card. The second video excerpt card includes the recorded third video, and the third video includes the video segment of the second video.
[0012] The first interface can be the global collection interface 61 shown in Figure 7(k), the first video excerpt file can be video excerpt 01, and the first icon can be the icon of video excerpt 01. It should be understood that the first interface can also be the global collection interface 62 shown in Figure 7(e). In one possible case, the first interface can also be the display interface of other applications, and this embodiment does not limit this. Operation on the first icon can refer to the user clicking on the first icon, as shown in Figure 7(k). It should be understood that operation on the first icon can also be the operation of waking up the video excerpt corresponding to the first icon through a voice command. The second interface can be the display interface 64 shown in Figure 7(l), the first video excerpt card can refer to the video excerpt card 641 on the display interface 64, and the first control can refer to the append control 642. The first video is displayed in the first video excerpt card. Operation on the first control can refer to the user clicking on the first control, as shown in Figure 7(m). It should be understood that operation on the first control can also be the operation of waking up the first control through a voice command, and this embodiment does not limit this. The third interface can refer to display interface 65, as shown in Figure 7(n). The first excerpt window can refer to excerpt window 651, the recording control can refer to recording control 6512, and the first video excerpt card can refer to video excerpt card 6511. It should be understood that the second application can be the system desktop shown in Figure 7(n), or it can be other applications, and this application embodiment does not limit this. For example, the second application can also be a video playback application. The third application can refer to video application 652. The fourth interface can refer to the interface for playing video after the third application is opened, such as display interface 66 shown in Figure 7(p). It should be understood that the first excerpt window (i.e., excerpt window 651) can be a floating window. The second excerpt window can be excerpt window 671 as shown in Figure 7(r), where the recording control 6512 is switched to pause control 6516 compared to excerpt window 651 (i.e., the first excerpt window). The third excerpt window can be excerpt window 681 as shown in Figure 7(y). The first video excerpt card can be video excerpt card 6511, and the second video excerpt card can be video excerpt card 6711.
[0013] The video extraction method provided in this application includes displaying a first interface, the first interface including a first icon corresponding to a first video extraction file, the first video extraction file including a first video; responding to a user's operation on the first icon, displaying a second interface of a first application, the second interface including a first video extraction card and a first control, the first video extraction card including the first video; responding to a user's operation on the first control, displaying a first extraction window and a third interface of a second application, the first extraction window partially obscuring the content of the third interface, the first extraction window including a recording control and a first video extraction card; responding to a user's operation of opening a third application, displaying a first extraction window and a fourth interface of the third application, the first extraction window partially obscuring the content of the fourth interface, the fourth interface including a second video currently playing. In response to the operation of the recording control, recording of the video segment of the second video in the fourth interface begins, and the second excerpt window is displayed. The recording control in the second excerpt window is updated to a pause control. The second excerpt window obscures part of the content of the fourth interface. In response to the operation of the pause control, recording of the video segment of the second video in the fourth interface ends, and the third excerpt window is displayed. The third excerpt window obscures part of the content of the fourth interface. The third excerpt window includes the first video excerpt card and the second video excerpt card. The second video excerpt card includes the recorded third video, and the third video includes the video segment of the second video. This is equivalent to appending the video segment of the second video to the already saved first video excerpt file, forming a new video excerpt, enriching the form of video excerpts and improving the user experience.
[0014] In conjunction with the first aspect, in some embodiments of the first aspect, the third interface includes a second icon of the third application, and in response to a user opening the third application, displays a first summary window and a fourth interface of the third application, including: in response to a click on the second icon, displaying the first summary window and the fourth interface of the third application.
[0015] In conjunction with the first aspect, in some embodiments of the first aspect, the first video is a video segment of the second video.
[0016] In other words, the excerpted video displayed in the first video excerpt card and the excerpted video displayed in the second video excerpt card both come from the same video.
[0017] In conjunction with the first aspect, in some embodiments of the first aspect, the first video is a video segment of the fourth video in the fourth application.
[0018] The fourth and third applications can be different applications. That is to say, the excerpted video displayed in the first video excerpt card and the excerpted video displayed in the second video excerpt card are videos played in different applications.
[0019] In conjunction with the first aspect, in some embodiments of the first aspect, the length of the third extract window is greater than the length of the first extract window.
[0020] In conjunction with the first aspect, in certain embodiments of the first aspect, the first application includes global collection.
[0021] In conjunction with the first aspect, in some embodiments of the first aspect, the third extract window further includes a completion control, and the method further includes: in response to an operation on the completion control, closing the third extract window and displaying a fifth interface, the fifth interface including a third icon, the third icon being an icon corresponding to the global collection, the third icon being used to indicate that the first video and the third video are saved to the global collection.
[0022] The fifth interface can be the display interface 68 shown in Figure 7(z), and the third icon can be the global collection icon 201 shown in Figure 7(z).
[0023] In conjunction with the first aspect, in some embodiments of the first aspect, the third extract window further includes a tagging control, and the method further includes: in response to an operation on the tagging control, acquiring tagging information, and displaying a first display area in the second video extract card in the third extract card, the first display area being used to display the tagging information, the tagging information including a description of a video segment in the second video.
[0024] In conjunction with the first aspect, in some embodiments of the first aspect, the third extract window further includes a screenshot control, and the method further includes: in response to an operation on the screenshot control, acquiring a first screenshot, and displaying a second display area in the second video extract card of the third extract card, the second display area being used to display the first screenshot, the first screenshot referring to a screenshot of the second video display image when the screenshot control is operated.
[0025] In conjunction with the first aspect, in some embodiments of the first aspect, the second extraction window further includes a third display area that displays first time information, which is used to indicate the duration of the video segment for recording the second video.
[0026] In conjunction with the first aspect, in some embodiments of the first aspect, the second extract window further includes a fourth display area that displays a first prompt message indicating that a video segment of the second video is being recorded.
[0027] In conjunction with the first aspect, in some embodiments of the first aspect, the first extract window further includes a first minimize control, and the method further includes: in response to an operation on the first minimize control, the first extract window is switched to a fourth icon, the area of the fourth icon being smaller than the area of the first extract window.
[0028] The first minimize control can be the minimize control 5016 shown in Figure 6(m). In one possible case, the minimize control in the extract window is not directly displayed on the extract window, but is invoked through a wake-up operation. The fourth icon can be icon 521 shown in Figure 6(n), or icon 521 shown in Figure 6(o), or icon 521 shown in Figure 6(n) can be displayed first, followed by icon 521 shown in Figure 6(o).
[0029] In conjunction with the first aspect, in some embodiments of the first aspect, the second extract window further includes a second minimize control, and the method further includes: in response to an operation on the second minimize control, the second extract window switches to a fifth icon, the area of the fifth icon being smaller than the area of the second extract window.
[0030] The second minimize control can be minimize control 5016 as shown in Figure 6(m). In one possible case, the minimize control in the extract window is not directly displayed on the extract window, but is invoked through a wake-up operation. The fifth icon can be icon 521 as shown in Figure 6(n), or icon 521 as shown in Figure 6(o), or icon 521 as shown in Figure 6(n) can be displayed first, followed by icon 521 as shown in Figure 6(o).
[0031] In conjunction with the first aspect, in some embodiments of the first aspect, the third extract window further includes a third minimize control, and the method further includes: in response to an operation on the third minimize control, the third extract window is switched to a sixth icon, the area of the sixth icon being smaller than the area of the third extract window.
[0032] The third minimize control can be minimize control 5016 as shown in Figure 6(m). In one possible case, the minimize control in the extract window is not directly displayed on the extract window, but is invoked through a wake-up operation. The sixth icon can be icon 521 as shown in Figure 6(n), or icon 521 as shown in Figure 6(o), or icon 521 as shown in Figure 6(n) can be displayed first, followed by icon 521 as shown in Figure 6(o).
[0033] In conjunction with the first aspect, in some embodiments of the first aspect, the second interface further includes a second control, and the method further includes: in response to an operation on the second control, converting the speech in the first video into text information; displaying a sixth interface, the sixth interface including a third video excerpt card, the third video excerpt card including the first video and a fifth display area; and displaying text information in the fifth display area.
[0034] The second control can be the video-text synchronization control 643 shown in Figure 8(a), the sixth interface can be the display interface 70 shown in Figure 8(b), the third video extract card can be the video extract card 701, and the fifth display area can be the display area 7011 shown in Figure 8(b).
[0035] In conjunction with the first aspect, in some embodiments of the first aspect, the method further includes: displaying a seventh interface, the seventh interface including a seventh icon corresponding to a second video excerpt file, the second video excerpt file including a third video; in response to an operation on the seventh icon, displaying an eighth interface, the eighth interface including a fourth video excerpt card, the fourth video excerpt card including a sixth display area, the sixth display area displaying the third video; in response to an operation on the sixth display area, displaying a fourth control; in response to an operation on the fourth control, performing editing processing on the second video excerpt file, the editing processing including at least one of deleting images and adding identification information.
[0036] The seventh interface can be the display interface shown in Figure 9(b), and the second video excerpt file can be "Video Excerpt 20230516-1025" as shown in Figure 9(b). The eighth interface can be the display interface 80 shown in Figure 9(d), the fourth video excerpt card can refer to the video excerpt card 801, and the sixth display area can refer to the display area 8011. The fourth control can be the editing control 8013 shown in Figure 9(f).
[0037] In conjunction with the first aspect, in some embodiments of the first aspect, the method further includes: displaying a seventh interface, the seventh interface including a seventh icon corresponding to a second video excerpt file, the second video excerpt file including a third video; in response to an operation on the seventh icon, displaying an eighth interface, the eighth interface including a fourth video excerpt card, the fourth video excerpt card including a time stamp control; in response to an operation on the time stamp control, displaying a fourth control; in response to an operation on the fourth control, performing editing processing on the second video excerpt file, the editing processing including at least one of deleting images and adding identification information.
[0038] In conjunction with the first aspect, in some embodiments of the first aspect, the second video excerpt file further includes a first image, the second video excerpt card further displays the first image, the fourth control includes a delete sub-control, and in response to an operation on the fourth control, the second video excerpt file is edited, including: in response to an operation on the delete sub-control, deleting the first image.
[0039] Among them, deleting a child control can refer to control 80131 as shown in Figure 9(f).
[0040] In conjunction with the first aspect, in some embodiments of the first aspect, the fourth control further includes an add marker sub-control, and in response to an operation on the fourth control, the second video extract file is edited, and the control further includes: in response to an operation on the add marker sub-control, adding identification information to the third video.
[0041] Among them, adding a marker sub-control can refer to control 80132 as shown in Figure 9(f).
[0042] In conjunction with the first aspect, in some embodiments of the first aspect, when there are multiple third videos, the method further includes: when a first operation on any one of the third videos is detected on the eighth interface, adjusting the arrangement order of the videos in the third video according to the order indicated by the first operation.
[0043] In conjunction with the first aspect, in certain embodiments of the first aspect, in response to an operation on the pause control, ending the recording of a video segment of the second video in the fourth interface includes: in response to an operation on the pause control, obtaining a first video segment and displaying the recording control again; in response to an operation on the recording control, recording another video segment of the second video and displaying the pause control again; in response to an operation on the pause control, obtaining a second video segment, and based on the first video segment and the second video segment, obtaining a third video, and ending the recording of a video segment of the second video in the fourth interface.
[0044] Secondly, a video extraction apparatus is provided, including a unit for performing any of the methods of the first aspect. The apparatus may be a server, a terminal device, or a chip within a terminal device. The apparatus may include an input unit and a processing unit.
[0045] When the device is a terminal device, the processing unit may be a processor, and the input unit may be a communication interface; the terminal device may also include a memory for storing computer program code, which, when the processor executes the computer program code stored in the memory, causes the terminal device to perform any of the methods in the first aspect.
[0046] When the device is a chip within a terminal device, the processing unit can be an internal processing unit of the chip, and the input unit can be an output interface, pin, or circuit, etc.; the chip may also include a memory, which can be an internal memory of the chip (e.g., a register, cache, etc.) or an external memory (e.g., a read-only memory, random access memory, etc.); the memory is used to store computer program code, and when the processor executes the computer program code stored in the memory, the chip performs any of the methods in the first aspect.
[0047] Thirdly, a computer-readable storage medium is provided, the computer-readable storage medium storing computer program code, which, when executed by a video extraction device, causes the video extraction device to perform any of the video extraction methods in the first aspect.
[0048] Fourthly, a computer program product is provided, the computer program product comprising: computer program code, which, when executed by a video extraction device, causes the video extraction device to perform any of the apparatus methods in the first aspect.
[0049] The video extraction method and electronic device provided in this application display a first interface, which includes a first icon corresponding to a first video extraction file, the first video extraction file including a first video. In response to a user's operation on the first icon, a second interface of a first application is displayed, the second interface including a first video extraction card and a first control, the first video extraction card including the first video. In response to a user's operation on the first control, a first extraction window and a third interface of a second application are displayed, the first extraction window partially obscuring the content of the third interface. The first extraction window includes a recording control and a first video extraction card. In response to a user opening the third application, a fourth interface of the first extraction window and the third application is displayed, the first extraction window partially obscuring the content of the fourth interface, the fourth interface including the currently playing video. In response to an operation on the recording control, recording of a video segment from the second video in the fourth interface begins, and a second excerpt window is displayed. The recording control in the second excerpt window is updated to a pause control. The second excerpt window partially obscures the content of the fourth interface. In response to an operation on the pause control, recording of the video segment from the second video in the fourth interface ends, and a third excerpt window is displayed. The third excerpt window also partially obscures the content of the fourth interface. The third excerpt window includes a first video excerpt card and a second video excerpt card. The second video excerpt card includes the recorded third video, and the third video includes a video segment from the second video. This is equivalent to appending a video segment from the second video to an already saved first video excerpt file, forming a new video excerpt, enriching the form of video excerpts and improving the user experience. Attached Figure Description
[0050] Figure 1 This is a schematic diagram of a hardware system for an electronic device applicable to this application;
[0051] Figure 2 This is a schematic diagram of a software system applicable to an electronic device of this application;
[0052] Figure 3(a) is a schematic diagram of a display interface for opening video excerpts provided in an embodiment of this application;
[0053] Figure 3(b) is a schematic diagram of a display interface for opening video excerpts provided in an embodiment of this application;
[0054] Figure 3(c) is a schematic diagram of a display interface for opening video excerpts provided in an embodiment of this application;
[0055] Figure 3(d) is a schematic diagram of a display interface for opening video excerpts provided in an embodiment of this application;
[0056] Figure 4(a) is a schematic diagram of a display interface for ending video extraction provided in an embodiment of this application;
[0057] Figure 4(b) is a schematic diagram of a display interface for ending video extraction provided in an embodiment of this application;
[0058] Figure 4(c) is a schematic diagram of a display interface for ending video extraction provided in an embodiment of this application;
[0059] Figure 4(d) is a schematic diagram of a display interface for ending video extraction provided in an embodiment of this application;
[0060] Figure 4(e) is a schematic diagram of a display interface for ending video extraction provided in an embodiment of this application;
[0061] Figure 4(f) is a schematic diagram of a display interface for ending video extraction provided in an embodiment of this application;
[0062] Figure 5(a) is a schematic diagram of a display interface for saving video excerpts provided in an embodiment of this application;
[0063] Figure 5(b) is a schematic diagram of a display interface for saving video excerpts provided in an embodiment of this application;
[0064] Figure 5(c) is a schematic diagram of a display interface for saving video excerpts provided in an embodiment of this application;
[0065] Figure 5(d) is a schematic diagram of a display interface for saving video excerpts provided in an embodiment of this application;
[0066] Figure 5(e) is a schematic diagram of a display interface for saving video excerpts provided in an embodiment of this application;
[0067] Figure 5(f) is a schematic diagram of a display interface for saving video excerpts provided in an embodiment of this application;
[0068] Figure 6(a) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0069] Figure 6(b) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0070] Figure 6(c) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0071] Figure 6(d) is a schematic diagram of a video excerpt recording continuation display interface provided in an embodiment of this application;
[0072] Figure 6(e) is a schematic diagram of a video excerpt recording continuation display interface provided in an embodiment of this application;
[0073] Figure 6(f) is a schematic diagram of a video excerpt recording continuation display interface provided in an embodiment of this application;
[0074] Figure 6(g) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0075] Figure 6(h) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0076] Figure 6(i) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0077] Figure 6(j) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0078] Figure 6(k) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0079] Figure 6(l) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0080] Figure 6(m) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0081] Figure 6(n) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0082] Figure 6(o) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0083] Figure 6(p) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0084] Figure 6(q) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0085] Figure 6(r) is a schematic diagram of a video excerpt recording display interface provided in an embodiment of this application;
[0086] Figure 7(a) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0087] Figure 7(b) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0088] Figure 7(c) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0089] Figure 7(d) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0090] Figure 7(e) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0091] Figure 7(f) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0092] Figure 7(g) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0093] Figure 7(h) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0094] Figure 7(i) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0095] Figure 7(j) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0096] Figure 7(k) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0097] Figure 7(l) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0098] Figure 7(m) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0099] Figure 7(n) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0100] Figure 7(o) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0101] Figure 7(p) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0102] Figure 7(q) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0103] Figure 7(r) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0104] Figure 7(s) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0105] Figure 7(t) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0106] Figure 7(u) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0107] Figure 7(v) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0108] Figure 7(w) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0109] Figure 7(x) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0110] Figure 7(y) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0111] Figure 7(z) is a schematic diagram of a display interface for additional video extraction provided in an embodiment of this application;
[0112] Figure 8(a) is a schematic diagram of a video excerpting display interface with synchronized video and text provided in an embodiment of this application;
[0113] Figure 8(b) is a schematic diagram of a video excerpting display interface for video-text synchronization provided in an embodiment of this application;
[0114] Figure 8(c) is a schematic diagram of a video excerpting display interface with synchronized video and text provided in an embodiment of this application;
[0115] Figure 8(d) is a schematic diagram of a video excerpting display interface with synchronized video and text provided in an embodiment of this application;
[0116] Figure 8(e) is a schematic diagram of a video excerpting display interface for video-text synchronization provided in an embodiment of this application;
[0117] Figure 8(f) is a schematic diagram of a video excerpting display interface with synchronized video and text provided in an embodiment of this application;
[0118] Figure 9(a) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0119] Figure 9(b) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0120] Figure 9(c) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0121] Figure 9(d) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0122] Figure 9(e) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0123] Figure 9(f) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0124] Figure 9(g) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0125] Figure 9(h) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0126] Figure 9(i) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0127] Figure 9(j) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0128] Figure 9(k) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0129] Figure 9(l) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0130] Figure 9(m) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0131] Figure 9(n) is a schematic diagram of a display interface for secondary editing in video excerpting provided in an embodiment of this application;
[0132] Figure 10 This is a flowchart illustrating a video extraction method provided in an embodiment of this application;
[0133] Figure 11 This is a schematic diagram of an electronic device for video extraction provided in this application. Detailed Implementation
[0134] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.
[0135] In the following text, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first," "second," or "third" may explicitly or implicitly include one or more of that feature.
[0136] Currently, video, as a carrier of information, conveys information more accurately, intuitively, and easily for users to understand. For example, video conferencing and video tutorials both utilize video for information transmission, which is convenient and efficient. In today's society, content distribution and information retrieval based on video have become important channels for information transmission, and users' needs for extracting and organizing video content are increasing. For example, in video conferences, users can annotate key points to obtain video excerpts; or, during video tutorials, students can take notes on key points to obtain video excerpts. In one possible scenario, users can annotate a segment of a video conference to mark key points, obtaining video excerpts; or, users can annotate a segment of a video during a video tutorial to obtain video excerpts. However, current video excerpting methods are relatively limited, resulting in a poor user experience.
[0137] In view of this, embodiments of this application provide a video extraction method applied to an electronic device. The method involves displaying a first interface, which includes a first icon corresponding to a first video extraction file, the first video extraction file including a first video. In response to a user's operation on the first icon, a second interface of a first application is displayed. The second interface includes a first video extraction card and a first control, the first video extraction card including the first video. In response to a user's operation on the first control, a first extraction window and a third interface of a second application are displayed. The first extraction window partially obscures the content of the third interface. The first extraction window includes a recording control and a first video extraction card. In response to a user opening a third application, a fourth interface of the first extraction window and the third application is displayed. The first extraction window partially obscures the content of the fourth interface, which includes a recording function. The second video being played, in response to the operation of the recording control, begins recording a video segment of the second video in the fourth interface and displays a second excerpt window. The recording control in the second excerpt window is updated to a pause control. The second excerpt window partially obscures the content of the fourth interface. In response to the operation of the pause control, the recording of the video segment of the second video in the fourth interface ends, and a third excerpt window is displayed. The third excerpt window partially obscures the content of the fourth interface. The third excerpt window includes a first video excerpt card and a second video excerpt card. The second video excerpt card includes the recorded third video, and the third video includes a video segment of the second video. This is equivalent to appending a video segment of the second video to the already saved first video excerpt file, forming a new video excerpt, enriching the form of video excerpts and improving the user experience.
[0138] The video extraction method provided in this application can be applied to electronic devices. Optionally, the electronic device includes a terminal device, which can also be called a terminal, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. The terminal device can be a mobile phone, smart TV, wearable device, tablet computer, computer with wireless transceiver function, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal in industrial control, wireless terminal in self-driving, wireless terminal in remote medical surgery, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, wireless terminal in smart home, etc. The embodiments of this application do not limit the specific technology or device form used in the terminal device.
[0139] For example, Figure 1 A schematic diagram of the structure of electronic device 100 is shown. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0140] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0141] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0142] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0143] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0144] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0145] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0146] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0147] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0148] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0149] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0150] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0151] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0152] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0153] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0154] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0155] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0156] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.
[0157] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.
[0158] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.
[0159] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.
[0160] It should be noted that any electronic device mentioned in the embodiments of this application may include more or fewer modules in electronic device 100.
[0161] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.
[0162] Figure 2 This is a software structure block diagram of the electronic device 100 according to an embodiment of this application.
[0163] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0164] The application layer can include a series of application packages.
[0165] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, notes, SMS, global collection (also known as global collection service, etc.), and excerpt tools.
[0166] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0167] like Figure 2 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, gesture recognition service, and image processor.
[0168] The window manager is used to manage windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, record the screen, capture screenshots, and respond to note-taking actions during video recording by waking up the note-taking window.
[0169] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0170] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0171] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).
[0172] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0173] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0174] Gesture recognition services can identify corresponding gestures by detecting touch operations on a touchscreen.
[0175] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0176] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0177] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0178] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0179] The Surface Manager is used to manage the display subsystem and provides the blending of two-dimensional and three-dimensional layers for multiple applications.
[0180] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0181] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0182] A 2D graphics engine is a drawing engine for 2D drawing.
[0183] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0184] The following is combined with Figure 2 Let me introduce the implementation process of this solution:
[0185] When a user opens a video application, for example, as shown in Figure 3(a), the video plays on the display interface 10 of the mobile phone.
[0186] Users can activate the video clipping function using a wake-up gesture. This wake-up gesture can be a preset action performed by the user on the video playback interface; for example, as shown in Figure 3(b), the preset gesture can be a three-finger swipe down. It is understood that the wake-up gesture can also be other gestures. In some embodiments, users can customize the settings in the relevant options of the video clipping function.
[0187] The user performs a three-finger swipe down to wake up the video extraction function. The gesture recognition service in the application framework layer will launch the extraction tool App based on the three-finger swipe down action, that is, the extraction window 101 will be displayed floating in the video playback area, as shown in Figure 3(c).
[0188] When a user triggers an operation in the extraction window 101, the extraction window 101 identifies the video playback area and transmits the location information of the video playback area to the image processor. The image processor processes the video into a preset format based on the location information of the video playback area and transmits it to the extraction tool. The extraction tool then performs extraction operations on the video based on the preset format. In this way, video extraction can be achieved based on the content displayed on the video playback area.
[0189] The extraction tool can insert video notes generated from video extractions into the note-taking application's database. The note-taking application then displays the video notes in chronological order based on the insertion time.
[0190] The excerpting tool can also store the video excerpts generated from the video in the global collection service. The global collection service displays the video notes in chronological order based on the insertion time of the video notes in the global collection interface.
[0191] For example, the video excerpting method provided in this application embodiment can be applied to a mobile phone. When the video excerpting method is applied to a mobile phone, the excerpting window 101 can be as shown in Figure 3(c), including four controls: "Record", "Mark", "Screenshot", and "Done". The user can click the "Record" control to record the currently playing video and generate a video excerpt. The user can click the "Mark" control to add a tag, and the time node where the tag is added in the screen recording video can be displayed. For example, a text tag "This is important" can be added at 30 seconds into the screen recording. The tag is then saved below the screen recording video. When the video screen recording notes are played, the tag is grayed out before 30 seconds have elapsed, and it is highlighted when the video reaches 30 seconds. That is, when watching the video screen recording notes, the screen recording video will play the tags made during the screen recording process in order of their creation time. The maximum number of characters that a text tag can hold can be set, for example, up to 50 characters. Users can click the "Screenshot" control to take a screenshot of the current video interface. This screenshot will have a tag attribute. Since the screenshot operation is performed during screen recording, the screenshot will be saved below the screen recording video. After taking the screenshot, users can add text descriptions in the tag bar, such as "Didn't understand this part." The maximum number of characters that the text tag can hold can be set, for example, up to 50 characters. When users view the screen recording video notes, the screenshot notes are grayed out when not playing, and highlighted when the video is played. Users can click the "Done" control to end the current video excerpt and store the captured video excerpt in the global collection service.
[0192] For example, the video extraction method provided in this application embodiment can be applied to a tablet computer (Pad). When the video extraction method is applied to a Pad, since the screen width of a Pad is usually larger than that of a mobile phone, the number of controls in the Pad's extraction tool 101 can be greater than the number of controls in the mobile phone's extraction tool 101. The Pad's extraction tool 101 can include six controls, as shown in Figure 3(d): "Record," "Video Annotation," "Mark," "Screenshot," "Magic Text," and "Done." When a user clicks the "Record" control, they can record the currently playing video. When a user clicks the "Video Annotation" control, they can annotate the recorded video during the recording process, such as marking or circling key content, or writing text on the interface. These annotations are saved in the recorded video, and the annotation process is displayed in the video when the recording is reviewed. For example, if the annotation involves circling certain content, the circling process will be restored when the video notes are played back. Users can add a tag by clicking the "Tag" control, which displays the tag's position in the screen recording video. For example, a "Important" tag can be added at the 30-second mark. The tag is then saved below the screen recording video. When the video recording is played, the tag is grayed out before the 30-second mark and highlighted when the video reaches the 30-second mark. In other words, the screen recording video will play the tags added during recording in chronological order. The maximum number of characters allowed in the tag can be set, for example, up to 50 characters. Users can also take a screenshot of the current video screen by clicking the "Screenshot" control; this screenshot will include a tag attribute. Since the screenshot is taken during screen recording, it will be saved at the bottom of the recording video. After taking the screenshot, the user can add text descriptions in the screenshot's tag bar, such as "Didn't understand this part." The maximum number of characters in the tag can be set, for example, up to 50 characters. When viewing the screen recording video notes, the notes are grayed out when not playing and highlighted when played. Clicking the "Magic Text" control allows users to add text annotations to the screen recording video, such as commenting on a frame. These annotations are saved in the recording video and will appear in the video during playback. It should be understood that unlike the text entered in the "Video Annotation" control, the text generated after clicking the "Video Annotation" control is based on the user's finger swiping on the screen—in other words, the user's handwritten text. The text entered after clicking the "Magic Text" control is generated based on the preset font in the electronic device.Users can click the "Complete" control to end the current video extraction and store the extracted video excerpt in the global collection service.
[0193] The following example illustrates how to store video excerpts in a global collection.
[0194] As shown in Figure 4(a), the current display interface 10 of the mobile phone displays a recording tool 101, which includes four controls: "Record", "Mark", "Screenshot", and "Done". The user clicks the "Done" control, as shown in Figure 4(b). When ending video recording, the currently running video app can be closed or not; this embodiment does not impose any restrictions on this.
[0195] Optionally, in response to the user clicking the "Done" control, the phone ends the video recording, but the currently running video app is not closed, and the electronic device can continue playing the video. The phone's display interface switches to display interface 20, as shown in Figure 4(c). Display interface 20 includes an expanded "Global Favorites" icon 201. After a preset interval, for example, after 5 seconds, the "Global Favorites" icon 201 collapses to the right, revealing a hidden "Global Favorites" icon 202, as shown in Figure 4(d).
[0196] Optionally, in response to the user clicking the "Done" control, the phone ends video recording, exits the currently running video app, and displays the desktop, as shown in Figure 4(e). The expanded "Global Favorites" icon 201 is displayed on the desktop. After a preset interval, for example, after 5 seconds, the "Global Favorites" icon 201 collapses to the right, revealing the hidden "Global Favorites" icon 202, as shown in Figure 4(f).
[0197] In one possible scenario, the phone has two apps installed simultaneously: "Notes" and "Global Collections". The excerpting tool 101 can be either the toolbar for "Notes" or the toolbar for "Global Collections". After the user clicks the "Done" control in the excerpting tool 101, in response to the user clicking the "Done" control, option 102 is displayed on the display interface 10. Option 102 includes the options "Save to Notes" 1021 and "Save to Global Collections" 1022, as shown in Figure 5(a). The user clicks the option "Save to Global Collections" 1022, as shown in Figure 5(b). In response to the user clicking the option "Save to Global Collections" 1022, the phone displays the "Global Collections" icon 103 as shown in Figure 5(c), which can display "Video excerpts being collected". The "Global Collections" icon 103 can slide out from the right side of the display interface 10, and the phone executes a corresponding preset dynamic effect. The preset dynamic effect could be the dynamic effect of the last frame screenshot of the recorded video flying into the "Global Collections" icon 103. After the video excerpt is added to the "Global Collection" icon 103, the "Global Collection" icon 103 on the display interface 10 can display "Collection Successful," as shown in Figure 5(d). It should be understood that since the video excerpt has been stored in the Global Collection, when "Collection Successful" is displayed on the "Global Collection" icon 103, the image on the "Global Collection" icon 103 can also be changed from a preset image to an image related to the video excerpt content. For example, as shown in Figure 5(d), the image on the "Global Collection" icon 103 changes from a preset star image to a screenshot of a frame from the video excerpt, i.e., an image of the phone. Then, after a preset interval, for example, 5 seconds, the "Global Collection" icon 103 becomes the hidden Global Collection panel 104, displayed on the right side of the display interface 10, as shown in Figure 5(e).
[0198] Optionally, saving video excerpts to the global favorites can also be directly displayed on the display interface 10 via a prompt message. As shown in Figure 5(f), in response to the user clicking the option "Save to Global Favorites" 1022, the phone's display interface 10 shows a prompt message 105, which displays the text "Successfully saved" and "Go to favorites to view". It is understood that the prompt message 105 may automatically disappear after a preset duration of display on the display interface 10. The prompt message 105 may also disappear after the user clicks "Successfully saved". When the user clicks "Go to favorites to view", the phone can jump to the global favorites interface.
[0199] During video extraction, if the desired video extract is not a continuous segment from the parent video—for example, if the user wants to stitch together the video from 1 minute 20 seconds to 1 minute 35 seconds and the video from 2 minutes 15 seconds to 2 minutes 30 seconds to obtain a single video extract—this can be achieved using the video continuation recording function provided in this application's embodiments. The following describes… Figures 6(a) to 6(r) Let me explain in detail.
[0200] An electronic device (e.g., a tablet) displays a video playback app, showing a display interface 50 as shown in Figure 6(a). The user performs a three-finger swipe down gesture on display interface 50 to activate the video extraction function, as shown in Figure 6(b). In response to the user's activation, extraction window 501 is displayed, as shown in Figure 6(c). Extraction window 501 includes a recording control 5011 and a display area 5012. The display area 5012 displays a prompt message, such as the text "Video content will be extracted here." The user clicks the recording control 5011, as shown in Figure 6(d). In response to the user's click on the recording control 5011, the electronic device's display interface switches to display interface 51, as shown in Figure 6(e). Display interface 51 includes extraction window 501 and playback area 511. The playback area 512 displays the currently playing video, which is the master video from which the video excerpt is generated. The recording control 5011 in the excerpt window 501 switches to a pause control 5013, and the duration of the excerpted video is displayed below the pause control 5013. The pause control 5013 pauses the generation of the video excerpt, and the display area 5012 in the excerpt window 501 displays an indication of whether video excerpt recording is in progress, such as the text "Recording...". The user clicks the pause control 5013, as shown in Figure 6(f). In response to the user clicking the pause control 5013, the Pad pauses the extraction of content from the currently playing video. At this time, the video playing in the playback area 511 continues to play normally, and the display area 5012 displays a frame from the extracted video clip. Simultaneously, the pause control 5013 in the excerpt window 501 switches back to the recording control 5011, as shown in Figure 6(g). The area of the display area 5012 can then automatically increase. Optionally, the displayed frame may be the first frame or the last frame of the extracted video, and this application embodiment does not limit this.
[0201] When playback area 511 plays the second video segment that the user wants to extract, the user can click the recording control 5011, as shown in Figure 6(h). In response to the user clicking the recording control 5011, the Pad resumes extracting content from the playing video. At this time, the video playing in playback area 511 continues to play normally, displaying a frame from the video segment already extracted in area 5012. Simultaneously, the recording control 5011 switches to a pause control 5013, and the total duration of the extracted video is displayed below the pause control 5013, as shown in Figure 6(i).
[0202] It should be understood that users can pause the video excerpt being generated multiple times by clicking the pause control 5013, thereby achieving the function of merging multiple videos to generate a single video excerpt. For example, the user clicks the record control 5011 at 1 minute 20 seconds to start recording the video excerpt, and then clicks the pause control 5013 at 1 minute 35 seconds; then, the user clicks the record control 5011 again at 2 minutes 15 seconds to start recording the video excerpt, and then clicks the pause control 5013 again at 2 minutes 30 seconds; then, the user clicks the record control 5011 again at 3 minutes 23 seconds to start recording the video excerpt, and then clicks the pause control 5013 again at 3 minutes 27 seconds; thus, the generated video excerpt is obtained by splicing the videos from 1 minute 20 seconds to 1 minute 35 seconds, the videos from 2 minutes 15 seconds to 2 minutes 30 seconds, and the videos from 3 minutes 23 seconds to 3 minutes 27 seconds.
[0203] In one possible scenario, if the duration of the extracted video file is too long, resulting in an excessively large file size, a pop-up window will notify the user that the maximum file size limit has been reached, and recording will cease. For example, as shown in Figure 6(j), when the duration of the extracted video file is too long, pop-up window 512 will be displayed. Pop-up window 515 can display the text message "Maximum file size limit reached, screen recording file saved." Simultaneously, the pause control 5013 will switch to the recording control 5011. If recording cannot continue due to the excessively large file size, the electronic device will automatically end recording and display the generated video excerpt on the video excerpt card 517.
[0204] In one possible scenario, the extraction window 501 may also include a screenshot control 5014, as shown in Figure 6(i). During video extraction of a video file, if the user needs to extract a single frame simultaneously, they can click the screenshot control when the video reaches that frame to obtain a screenshot, which will then be displayed in the extraction window 501. For example, when extracting a playing video, if the video in the playback area 511 displays the image the user needs to mark, the user clicks the screenshot control 5014, as shown in Figure 6(k). In response to the user clicking the screenshot control 5014, the current frame image is obtained and displayed in the second area 5015 of the extraction window 501, as shown in Figure 6(l). At this time, since the second area 5015 also includes a screenshot, the area of the extraction window 501 can automatically increase.
[0205] Optionally, a time stamp is also displayed on the second area 5015. The time stamp can indicate the moment when the acquired screenshot appears in the original video, or it can indicate the moment when the acquired screenshot is in the video excerpt. This application embodiment does not limit this.
[0206] Optionally, the extraction window 501 also includes a minimize control 5016, as shown in Figure 6(i). During extraction, or when extraction is paused, the user clicks the minimize control 5016, as shown in Figure 6(m). In response to the click operation on the minimize control 5016, the display interface switches to display interface 52, on which the extraction window 501 switches to a floating ball 521 with a smaller obscuring area, as shown in Figure 6(n). If the user clicks the floating ball 521, the extraction window 501 can be brought up again; if the user does not perform any operation within a preset time, the floating ball 521 can move to the edge of the display interface 52 and be displayed as a hidden floating ball 521, as shown in Figure 6(o). This allows the extraction window 501 to be switched to a floating ball 521 with a smaller obscuring area during video extraction, reducing the impact of the extraction window 501 on the user's field of vision and improving the user experience.
[0207] Optionally, the extraction window 501 also includes a completion control 5017, as shown in Figure 6(i). The user clicks the completion control 5017, as shown in Figure 6(p). In response to the user's operation on the completion control 5017, the extracted video can be stored in the global collection. At this time, the display interface switches to display interface 53. On display interface 53, the extraction window 501 closes, and the global collection icon 531 is displayed, as shown in Figure 6(q). If the user does not perform any operation within a preset time, the global collection image 531 can move to the edge of display interface 53 and switch to a hidden global collection icon 532, as shown in Figure 6(r).
[0208] Figures 6(a) to 6(r) The illustrated embodiment describes how to obtain video excerpts based on multiple non-contiguous sub-video segments (i.e., parts of the same video) within the same video during the video excerpt acquisition process. After obtaining the video excerpts, they can be stored in a global collection or in notes; this application embodiment does not impose any limitations on this. After storing the video excerpts, they can be selected from the global collection or notes for editing. For example, the speech in the video excerpt can be converted into text and displayed in a preset area (this function can be called video-text synchronization); or, a video can be appended to an existing video excerpt to obtain a new video excerpt; or, a stored video excerpt can be edited a second time.
[0209] In one possible scenario, after a video excerpt is added to the global collection, the global collection icon is typically displayed in a hidden state on the side of the electronic device. For example, as shown in Figure 7(a), the hidden global collection icon 601 is displayed on the right side of the phone's display interface 60. The user clicks the hidden global collection icon 601, as shown in Figure 7(b). In response to the user clicking the hidden global collection icon 601, the phone's display interface 61 displays a global collection card 611 and a toolbar 612, as shown in Figure 7(c). The global collection card 611 displays items collected in the global collection; collection types include documents, images, videos, web folders, and notes. The toolbar 612 includes an expand control 6121, a minimize control 6122, and a close control 6123.
[0210] The expand control 6121 is used to convert the distributed global favorites card 611 into an expanded global favorites card 604. For example, a user clicks the expand control 6121, as shown in Figure 7(d). In response to the user's click on the expand control 6121, the phone's display interface switches to display interface 62, which includes the expanded global favorites card 621. The expanded global favorites card 621 occupies the entire display interface of the phone, as shown in Figure 7(e).
[0211] The minimize control 6122 is used to switch the distributed global favorites card 611 to the hidden global favorites icon 601. For example, the user clicks the minimize control 6122, as shown in Figure 7(f). In response to the user clicking the minimize control 6122, the phone's display interface switches to display interface 60, and the hidden global favorites icon 601 is displayed on the right side of the phone's display interface 60, as shown in Figure 7(b).
[0212] The close control 6123 is used to close the global favorites service. For example, as shown in Figure 7(g), the user clicks the close control 6123. In response to the user clicking the close control 6123, the phone's display interface switches to display interface 63, as shown in Figure 7(h). Display interface 63 does not display the hidden global favorites icon 601, the distributed global favorites card 611, or the expanded global favorites card 604.
[0213] When the distributed global collection card 611 is displayed on the display interface 61, the area occupied by the distributed global collection card 611 on the display interface can be expanded by an expand operation. The expand operation can refer to the user performing a preset gesture on the display interface 61. For example, as shown in Figure 7(i), the preset gesture can be a gesture of sliding two fingers outwards in opposite directions. After the user performs the gesture of sliding two fingers outwards in opposite directions on the display interface 61, the area of the distributed global collection card 611 increases accordingly, as shown in Figure 7(j).
[0214] After a user selects video excerpt 01 in the global collection card 602, the user can append video excerpts to video excerpt 01 to obtain new video excerpts. For example, as shown in Figure 7(k), the user clicks on video excerpt 01 in the global collection card 602 in the distributed state. In response to the user's click operation, the mobile phone's display interface switches to display interface 64, which includes video excerpt card 641 and append control 642, as shown in Figure 7(l).
[0215] The video excerpt card 641 is used to display completed video excerpts, such as "Video Excerpt 01" as shown in Figure 7(l). The append control 642 is used to append excerpts to existing video excerpts, that is, to add content to existing video excerpts. For example, when a user clicks the append control 642, as shown in Figure 7(m), in response to the user clicking the append control 642, the phone's display interface switches to display interface 65, as shown in Figure 7(n). Display interface 65 includes an excerpt window 651 and a video application 652. The excerpt window 651 includes a video excerpt card 6511, a recording control 6512, a marking control 6513, a screenshot control 6514, and a completion control 6515. The video application 652 can be the video application corresponding to the parent video of video excerpt 01, or it can be a video application that does not correspond to the parent video of video excerpt 01; this embodiment of the application does not impose any restrictions on this. Users can select the corresponding video to append video excerpts according to their needs.
[0216] For example, a user clicks on the video application 652 in the display interface, as shown in Figure 7(o). In response to the user's click on the video application 652, the display interface switches to display interface 66, as shown in Figure 7(p). Display interface 66 includes an extraction window 651 and a video frame 661 played by the video application 652, with the extraction window 651 partially obscuring the content of the video frame 661. It should be understood that the video displayed in the video frame 661 may or may not be the parent video of video extraction 01; this embodiment does not impose such limitations. If the user clicks on the recording control 6512, as shown in Figure 7(q), in response to the user's click on the recording control 6512, the display interface switches to display interface 67, as shown in Figure 7(r). Display interface 67 includes an extraction window 671 and a video frame 661 of the video application 652, with the extraction window 671 partially obscuring the content of the video frame 661. Compared to the extraction window 651, the extraction window 671 has a larger area. In addition to the video extraction card 6511, it also includes a new video extraction card 6711. The video extraction card 6711 displays a prompt indicating that video recording is in progress, such as the text "Recording..." as shown in Figure 7(r). Simultaneously, the recording control 6512 in the extraction window 671 switches to a pause control 6516. Below the pause control 6516, the duration of the recorded video extraction is displayed, increasing with the recording time. When the user completes the operation of adding video extractions to video extraction 01, the user can click the pause control 6516, as shown in Figure 7(s). In response to the user clicking the pause control 6516, the display interface switches to display interface 68, as shown in Figure 7(t). Display interface 68 includes the extraction window 671 and the video screen 661 played by the video application 652. The extraction window 671 partially obscures the content of the video screen 661. Compared to the excerpt window 671 in display interface 67, the area of the excerpt window 671 in display interface 68 is increased, and the content displayed on the video excerpt card 6711 changes from indicator information to a new video excerpt icon. It should be understood that the displayed new video excerpt icon can be a screenshot of a frame from the new video excerpt, such as a screenshot of the first frame of the new video excerpt, or a screenshot of the last frame of the new video excerpt. Simultaneously, the pause control 6516 in the excerpt window 671 is switched back to the recording control 6512.
[0217] Optionally, new markers can be added during the recording of a new video excerpt. For example, at the 17-second mark of recording a new video excerpt, the user clicks the marker control 6513 on the display interface 67, as shown in Figure 7(u). In response to the user's click on the marker control 6513, the area of the excerpt window 671 increases, and the newly added marker information is displayed on the video excerpt card 6711, as shown in Figure 7(v). In one possible case, the video excerpt card 6711 may also display the time corresponding to the newly added marker information, i.e., "00:17" as shown in Figure 7(v).
[0218] Optionally, new screenshots can be added during the recording of a new video excerpt. For example, at the 13-second mark of recording a new video excerpt, the user clicks the screenshot control 6514 in the display interface 67, as shown in Figure 7(w). In response to the click operation on the screenshot control 6514, the area of the excerpt window 671 increases, and the newly added screenshot is displayed in the video excerpt card 6711, as shown in Figure 7(x). In one possible case, the display area 6714 also displays the time corresponding to the newly added screenshot, i.e., "00:13" as shown in Figure 7(x).
[0219] After the user finishes recording the additional video excerpt, they can click the "Complete" control 6515, as shown in Figure 7(y). In response to the user clicking the "Complete" control 6515, the additional video excerpt and the initial video excerpt (i.e., video excerpt 01) are stored together in the same file group in the global collection. Simultaneously, the excerpt window 681 is closed, and the global collection icon 201 is displayed, as shown in Figure 7(z).
[0220] It should be understood that when adding to an existing video excerpt, the excerpt can be added from the parent video corresponding to the existing video excerpt, or it can be added from other videos. This application embodiment does not limit this.
[0221] For example, the existing video excerpt is obtained from video A in the video playback app. When the user clicks the recording control 6512 on the display interface 65 shown in Figure 7(n), in response to the user's click operation, the electronic device directly jumps to video A in the video playback app and appends a video excerpt based on video A to obtain a new video excerpt. This is equivalent to being able to directly jump to append a video excerpt from the original video file when appending a video excerpt, improving the convenience of appending video excerpts.
[0222] For example, the existing video excerpt is obtained from video B in a short video app, and the video the user needs to add is a segment from video C. In this case, the user needs to actively select the short video app and open video C. For instance, after clicking the short video app icon and selecting video C to open, video C begins playing at the bottom of the excerpt window 671. After the user clicks the recording control 6512, a new video excerpt is added based on video C. This is equivalent to the added video excerpt and the original video excerpt being obtained from different video files, improving the flexibility of adding video excerpts.
[0223] In one possible scenario, users can also perform video-text synchronization processing on stored video excerpts, as shown below. Figures 8(a) to 8(f) The embodiments shown will be described in detail.
[0224] As shown in Figure 7(k), the user clicks on video excerpt 01 in the global favorites card 602 in the distribution state. In response to the user's click, the phone's display interface switches to display interface 64, which includes a video excerpt card 641, an append control 642, and a video-text synchronization control 643, as shown in Figure 7(l). The user clicks on the video-text synchronization control 643, as shown in Figure 8(a). In response to the user's click on the video-text synchronization control 643, the display interface switches to display interface 70, as shown in Figure 8(b). Display interface 70 includes a video excerpt card 701, which includes a video-text synchronization card 643 and a display area 7011. The color of the video-text synchronization control 643 changes. For example, the color of the video-text synchronization control 643 in display interface 64 is black, while the color of the video-text synchronization control 643 in display interface 70 is blue. When the color of the video-text synchronization control 643 changes, it indicates that the mobile phone is performing video-text synchronization, that is, the electronic device is converting the speech in the video excerpt into text and displaying the text in the display area 7011.
[0225] Optionally, the display area 7011 may include a video-to-text synchronization icon 70111 and a conversion icon 70112. The conversion icon 70112 can be displayed according to a preset dynamic effect. When the conversion icon 70112 is displayed according to the preset dynamic effect, it indicates that a speech-to-text operation is in progress. For example, the preset dynamic effect could refer to rotation in a preset direction. The rotation of the conversion icon 70112 in the preset direction can indicate that a speech-to-text operation is in progress.
[0226] The length of the display area 7011 can be fixed. For example, as shown in Figure 8(b), the display area 7011 can display two lines of text. It should be understood that in addition to the display area 7011, other information is displayed below the video excerpt card 701. Due to the limitation of the display interface 70's length, not all other information can be fully displayed on the display interface 70. Users can slide down to display other information that is not currently displayed. During this process, the display area 7011 does not scroll with the scrolling of other information and remains fixed in the currently displayed area. Since users have a higher desire to view the converted text during video-text synchronization, meaning they are more likely to view the text in the display area 7011, keeping the display area 7011 always on the current display interface better meets user expectations.
[0227] If the converted text exceeds two lines, the excess text will be collapsed. Users can expand the collapsed area to display the full text when they need to view the collapsed text.
[0228] In one possible scenario, when the speech in the video has been converted to text and displayed in the display area 7011, if the user slides the video extraction progress bar to the left, i.e., rewinds the progress bar, as shown in Figure 8(c), the color of the text corresponding to the unplayed video indicated by the progress bar changes, for example, from black to gray, as shown in Figure 8(d). In this case, if the user clicks the video-to-text synchronization control 643 again, as shown in Figure 8(e), a pop-up window 702 can also be displayed on the display interface 70 in response to the operation of the video-to-text synchronization control 643, as shown in Figure 8(f). The pop-up window 702 prompts the user whether to re-process the speech-to-text to overwrite the old text. For example, as shown in Figure 8(f), the pop-up window 702 displays the message "There is already speech-to-text content. Continuing the conversion will overwrite the old content. Do you want to continue?" 7021, a "Don't remind me again" option 7022, a "Cancel" option 7023, and a "Confirm" option 7024.
[0229] In one possible scenario, video excerpts are stored within the Notes app. Users can select the target video excerpt from the Notes app to perform further editing. It should be understood that, unlike appending video excerpts, further editing a video excerpt does not involve creating a new excerpt; rather, it refers to re-editing a video excerpt already stored in the global collection, without needing to retrieve content from the parent video. The following will illustrate... Figures 9(a) to 9(n) The embodiments shown will be described in detail.
[0230] As shown in Figure 9(a), when a user clicks on the Notes App, the electronic device displays various notes stored in the Notes App, including video excerpts, as shown in Figure 9(b). When a user needs to process a video excerpt in a synchronized manner, the user can click on the video excerpt to be processed to open it. For example, as shown in Figure 9(c), the user clicks on "Video Excerpt 20230516-1025". In response to the user clicking on "Video Excerpt 20230516-1025", the electronic device displays the display interface 80 shown in Figure 9(d). The display interface 80 includes a video excerpt card 801, which includes a display area 8011 and a time marker control 8012. The display area 8011 displays the captured video clip, and the time marker control 8012 displays the time corresponding to the screenshot or marker information.
[0231] In one possible scenario, the user long-presses the display area 8011, as shown in Figure 9(e). In response to the user's long-press operation on the display area 8011, a secondary editing tool 8013 is displayed on the video extraction card 801, as shown in Figure 9(f). The secondary editing tool 8013 includes a delete control 80131 and an add marker control 80132.
[0232] In one possible scenario, the user clicks the time marker control 8012, as shown in Figure 9(g). In response to the user's click on the time marker control 8012, a secondary editing tool 8013 is displayed on the video clip card 801, as shown in Figure 9(f). The secondary editing tool 8013 includes a delete control 80131 and an add marker control 80132.
[0233] The display position of the secondary editing tool 8013 in response to the user's operation of clicking the display area 8011 and the display position of the secondary editing tool 8013 in response to the user's operation of clicking the time marker control 8012 can be the same or different, and this application embodiment does not limit this.
[0234] With the secondary editing tool 8013 displayed on the video excerpt card 801, the user clicks the add marker control 80132, as shown in Figure 9(h). In response to the user's click on the add marker control 80132, a flashing vertical line icon 80121 appears after the time displayed on the add marker control 80132, as shown in Figure 9(i). The user can add text after existing text markers to obtain new text markers.
[0235] Additionally, when a user clicks the add marker control 80132, if the marker time exceeds the video duration, a pop-up message indicating that the marker cannot exceed the video duration will appear on the electronic device. For example, if the total video duration is 56 seconds, and the user clicks the add marker control 80132, a flashing vertical line icon 80121 will appear after the time displayed on the add marker control 80132. The user-entered marker time is 00:59. Since 00:59 is greater than the total video duration of 00:56, a pop-up message 8014 stating "The marker cannot exceed the video duration" will appear on the electronic device, as shown in Figure 9(j).
[0236] Furthermore, when the video excerpt card 801 includes multiple video excerpts, the positions of each video excerpt can be adjusted. For example, as shown in Figure 9(k), the video excerpt card 801 includes video excerpt 01 and video excerpt 02. Video excerpt 01 is located above video excerpt 02. When the user clicks to select video excerpt 01, the background color of video excerpt 01 changes, as shown in Figure 9(l). The user drags video excerpt 01 downwards until the positions of video excerpt 01 and video excerpt 02 are swapped, as shown in Figure 9(m).
[0237] It should be understood that during the dragging of video excerpt 01, video excerpt card 801 simultaneously displays a large-sized video excerpt 01 and a small-sized video excerpt 01, as shown in Figure 9(n). The grayscale of the large-sized video excerpt 01 increases, while the small-sized video excerpt 01 moves with the user's swipe operation.
[0238] Figure 10 This is a flowchart illustrating a video extraction method provided in one embodiment of the present application, as shown below. Figure 10 As shown, the method includes:
[0239] S101. Display the first interface, which includes the first icon corresponding to the first video excerpt file, and the first video excerpt file includes the first video.
[0240] The first interface can be the global collection interface 61 shown in Figure 7(k), the first video excerpt file can refer to video excerpt 01, and the first icon can refer to the icon of video excerpt 01.
[0241] It should be understood that the first interface can also refer to the global collection interface 62 shown in Figure 7(e). In one possible case, the first interface can also be the display interface of other applications, and this embodiment of the application does not limit this.
[0242] S102. In response to the user's operation on the first icon, a second interface of the first application is displayed. The second interface includes a first video excerpt card and a first control. The first video excerpt card includes a first video.
[0243] The operation on the first icon can refer to the user clicking on the first icon, as shown in Figure 7(k). It should be understood that the operation on the first icon can also be the operation of activating the video excerpt corresponding to the first icon through voice command, and this embodiment of the application does not limit this.
[0244] The second interface can refer to the display interface 64 shown in Figure 7(l), the first application can refer to global favorites, the first video excerpt card can refer to the video excerpt card 641 on the display interface 64, and the first control can refer to the append control 642. The first video is displayed in the first video excerpt card.
[0245] S103. In response to the user's operation on the first control, a first excerpt window and a third interface of the second application are displayed. The first excerpt window obscures part of the content of the third interface. The first excerpt window includes a recording control and a first video excerpt card.
[0246] The operation of the first control can refer to the user clicking on the first control, as shown in Figure 7(m). It should be understood that the operation of the first control can also be activated by voice command; this embodiment does not limit this. The third interface can refer to display interface 65, as shown in Figure 7(n). The first excerpt window can refer to excerpt window 651, the recording control can refer to recording control 6512, and the first video excerpt card can refer to video excerpt card 6511. It should be understood that the second application can be the system desktop shown in Figure 7(n), or it can be other applications; this embodiment does not limit this. For example, the second application can also be a video playback application.
[0247] S104. In response to the user's operation of opening a third application, a first excerpt window and a fourth interface of the third application are displayed. The first excerpt window obscures part of the content of the fourth interface, which includes a second video that is currently playing.
[0248] The third application can instruct video application 652.
[0249] Optionally, when the second application is the system desktop, the third interface of the second application displays the icon of the third application, such as the video application 652 shown in Figure 7(n). The user's operation to open the third application can refer to the operation of clicking the icon of the third application.
[0250] The fourth interface can refer to the interface where the video plays after the third application is opened, such as display interface 66 shown in Figure 7(p). It should be understood that the first extraction window, i.e., extraction window 651, can be a floating window. Therefore, after the third application is opened, extraction window 651 remains floating on the fourth interface, obscuring part of the content of display interface 66. The video frame 661, i.e., the frame from the second video, is playing on display interface 66.
[0251] S105. In response to the operation of the recording control, start recording the video segment of the second video in the fourth interface, and display the second excerpt window. The recording control of the second excerpt window is updated to a pause control, and the second excerpt window obscures part of the content of the fourth interface.
[0252] The second excerpt window can be the excerpt window 671 shown in Figure 7(r). Compared with the excerpt window 651 (that is, the first excerpt window), the recording control 6512 is switched to the pause control 6516.
[0253] S106. In response to the operation of the pause control, the recording of the video segment of the second video in the fourth interface ends, and the third excerpt window is displayed. The third excerpt window obscures part of the content of the fourth interface. The third excerpt window includes a first video excerpt card and a second video excerpt card. The second video excerpt card includes the recorded third video. The third video includes the video segment of the second video.
[0254] The third extraction window can be extraction window 681 as shown in Figure 7(y). The first video extraction card can be video extraction card 6511, and the second video extraction card can be video extraction card 6711.
[0255] The video extraction method provided in this application includes displaying a first interface, the first interface including a first icon corresponding to a first video extraction file, the first video extraction file including a first video; responding to a user's operation on the first icon, displaying a second interface of a first application, the second interface including a first video extraction card and a first control, the first video extraction card including the first video; responding to a user's operation on the first control, displaying a first extraction window and a third interface of a second application, the first extraction window partially obscuring the content of the third interface, the first extraction window including a recording control and a first video extraction card; responding to a user's operation of opening a third application, displaying a first extraction window and a fourth interface of the third application, the first extraction window partially obscuring the content of the fourth interface, the fourth interface including a second video currently playing. In response to the operation of the recording control, recording of the video segment of the second video in the fourth interface begins, and the second excerpt window is displayed. The recording control in the second excerpt window is updated to a pause control. The second excerpt window obscures part of the content of the fourth interface. In response to the operation of the pause control, recording of the video segment of the second video in the fourth interface ends, and the third excerpt window is displayed. The third excerpt window obscures part of the content of the fourth interface. The third excerpt window includes the first video excerpt card and the second video excerpt card. The second video excerpt card includes the recorded third video, and the third video includes the video segment of the second video. This is equivalent to appending the video segment of the second video to the already saved first video excerpt file, forming a new video excerpt, enriching the form of video excerpts and improving the user experience.
[0256] Optionally, the third interface includes a second icon for the third application, such as the video application 652 icon shown in Figure 7(n). In response to a user opening the third application, a first excerpt window and a fourth interface of the third application are displayed, including: in response to a click on the second icon, displaying the first excerpt window and the fourth interface of the third application.
[0257] Optionally, the first video is a video segment from the second video.
[0258] In other words, the excerpted video displayed in the first video excerpt card and the excerpted video displayed in the second video excerpt card both come from the same video.
[0259] Optionally, the first video is a video segment of the fourth video in the fourth application.
[0260] The fourth and third applications can be different applications. That is to say, the excerpted video displayed in the first video excerpt card and the excerpted video displayed in the second video excerpt card are videos played in different applications.
[0261] Optionally, the length of the third extract window is greater than the length of the first extract window.
[0262] Optionally, the first application includes global favorites.
[0263] Optionally, the third excerpt window also includes a completion control, as shown in Figure 7(y) 6515. The method further includes: in response to the operation of the completion control, closing the third excerpt window and displaying a fifth interface, the fifth interface including a third icon, which is the icon corresponding to the global collection, and the third icon is used to indicate that the first video and the third video are saved to the global collection.
[0264] The fifth interface can be the display interface 68 shown in Figure 7(z), and the third icon can be the global collection icon 201 shown in Figure 7(z).
[0265] Optionally, the third extract window also includes a marker control, such as the marker control 6513 shown in FIG7(u), and the method further includes: in response to an operation on the marker control, acquiring marker information and displaying a first display area in the second video extract card in the third extract card, the first display area being used to display the marker information, the marker information including a description of a video segment in the second video.
[0266] Optionally, the third excerpt window also includes a screenshot control, such as the screenshot control 6514 shown in Figure 7(w). The method further includes: in response to an operation on the screenshot control, acquiring a first screenshot, and displaying a second display area in the second video excerpt card in the third excerpt card. The second display area is used to display the first screenshot, which refers to a screenshot of the second video display image when the screenshot control is operated.
[0267] Optionally, the second extraction window also includes a third display area, which displays first time information used to indicate the duration of the video segment recorded for the second video.
[0268] Optionally, the second extraction window also includes a fourth display area, which displays a first prompt message indicating that a video clip of the second video is being recorded.
[0269] Optionally, the first excerpt window further includes a first minimize control, and the method further includes: in response to an operation on the first minimize control, the first excerpt window is switched to a fourth icon, the area of the fourth icon being smaller than the area of the first excerpt window.
[0270] Optionally, the second excerpt window also includes a second minimize control, and the method further includes: in response to an operation on the second minimize control, the second excerpt window switches to a fifth icon, the area of which is smaller than the area of the second excerpt window.
[0271] Optionally, the third extract window also includes a third minimize control, and the method further includes: in response to an operation on the third minimize control, the third extract window switches to a sixth icon, the area of which is smaller than the area of the third extract window.
[0272] The first, second, and third minimize controls can be minimize controls 5016 as shown in Figure 6(m). In one possible scenario, the minimize controls in the extract window are not directly displayed on the extract window, but are invoked through a wake-up operation. The fourth, fifth, and sixth icons can be icons 521 as shown in Figure 6(n), or icons 521 as shown in Figure 6(o), or icons 521 as shown in Figure 6(n) can be displayed first, followed by icons 521 as shown in Figure 6(o).
[0273] The implementation methods and beneficial effects of the above embodiments are similar to those of the embodiments shown in Figure 7, and will not be repeated here.
[0274] In one embodiment, the second interface further includes a second control, and the method further includes: in response to an operation on the second control, converting the speech in the first video into text information; displaying a sixth interface, the sixth interface including a third video excerpt card, the third video excerpt card including the first video and a fifth display area; and displaying text information in the fifth display area.
[0275] The second control can be the video-text synchronization control 643 shown in Figure 8(a), the sixth interface can be the display interface 70 shown in Figure 8(b), the third video extract card can be the video extract card 701, and the fifth display area can be the display area 7011 shown in Figure 8(b).
[0276] The implementation methods and beneficial effects of the above embodiments are similar to those of the embodiment shown in Figure 8, and will not be repeated here.
[0277] Figure 11 A schematic diagram of the structure of an electronic device provided in this application is shown. Figure 11 The dashed lines in the diagram indicate that the unit or module is optional. The electronic device 700 can be used to implement the video extraction method described in the above method embodiments.
[0278] The electronic device 700 includes one or more processors 701, which support the implementation of the video extraction method in the method embodiments of the electronic device 700. The processor 701 can be a general-purpose processor or a special-purpose processor. For example, the processor 701 can be a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, such as discrete gates, transistor logic devices, or discrete hardware components.
[0279] The processor 701 can be used to control the electronic device 700, execute software programs, and process data from the software programs. The electronic device 700 may also include a communication unit 705 for inputting (receiving) and outputting (transmitting) signals.
[0280] For example, electronic device 700 may be a chip, communication unit 705 may be the input and / or output circuit of the chip, or communication unit 705 may be the communication interface of the chip, and the chip may be a component of terminal device or other electronic device.
[0281] For example, electronic device 700 can be a terminal device, communication unit 705 can be the transceiver of the terminal device, or communication unit 705 can be the transceiver circuit of the terminal device.
[0282] The electronic device 700 may include one or more memories 702, which store a program 704. The program 704 can be executed by the processor 701 to generate instructions 703, causing the processor 701 to execute the impedance matching method described in the above method embodiments according to the instructions 703.
[0283] Optionally, the memory 702 may also store data. Optionally, the processor 701 may also read the data stored in the memory 702, which may be stored at the same memory address as the program 704, or the data may be stored at a different memory address than the program 704.
[0284] The processor 701 and memory 702 can be configured separately or integrated together; for example, integrated on the system on chip (SOC) of the terminal device.
[0285] For example, the memory 702 can be used to store the relevant program 704 of the video extraction method provided in the embodiments of this application, and the processor 701 can be used to call the relevant program 704 of the video extraction method stored in the memory 702 when performing image restoration, and execute the video extraction method of the embodiments of this application.
[0286] This application also provides a computer program product that, when executed by processor 701, implements the video extraction method described in any of the method embodiments of this application.
[0287] The computer program product can be stored in memory 702, for example, program 704. Program 704 is finally converted into an executable object file that can be executed by processor 701 after processing such as preprocessing, compilation, assembly and linking.
[0288] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a computer, implements the video extraction method described in any of the method embodiments of this application. The computer program may be a high-level language program or an executable object program.
[0289] The computer-readable storage medium is, for example, memory 702. Memory 702 can be volatile memory or non-volatile memory, or memory 702 can include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).
[0290] In this application, "at least one" means one or more, and "more than one" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0291] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0292] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0293] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0294] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for example, the division of units is merely a logical functional division, and other division methods may exist in actual implementation; for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0295] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0296] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0297] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A video extraction method, characterized in that, The method includes: The first interface is displayed, which includes a first icon corresponding to the first video excerpt file, and the first video excerpt file includes the first video. In response to the user's operation on the first icon, a second interface of the first application is displayed. The second interface includes a first video excerpt card and a first control. The first video excerpt card includes the first video. In response to the user's operation on the first control, a first excerpt window and a third interface of the second application are displayed. The first excerpt window obscures part of the content of the third interface. The first excerpt window includes a recording control and the first video excerpt card. The third interface displays the icon of the third application. In response to the user opening the third application, the first excerpt window and the fourth interface of the third application are displayed, the first excerpt window obscuring part of the content of the fourth interface, the fourth interface including a second video that is being played; In response to the operation of the recording control, recording of a video segment of the second video in the fourth interface begins, and a second excerpt window is displayed. The recording control in the second excerpt window is updated to a pause control, and the second excerpt window obscures part of the content of the fourth interface. In response to the operation of the pause control, the recording of the video segment of the second video in the fourth interface ends, and a third excerpt window is displayed. The third excerpt window obscures part of the content of the fourth interface. The third excerpt window includes the first video excerpt card and the second video excerpt card. The second video excerpt card includes the recorded third video, and the third video includes the video segment of the second video.
2. The method according to claim 1, characterized in that, The third interface includes a second icon for the third application. The process of displaying the first extract window and a fourth interface of the third application in response to a user opening the third application includes: In response to a click on the second icon, the first extract window and the fourth interface of the third application are displayed.
3. The method according to claim 1 or 2, characterized in that, The first video is a video segment from the second video.
4. The method according to claim 1 or 2, characterized in that, The first video is a video clip from the fourth video in the fourth application.
5. The method according to claim 1 or 2, characterized in that, The length of the third extract window is greater than the length of the first extract window.
6. The method according to claim 1 or 2, characterized in that, The first application includes global bookmarks.
7. The method according to claim 6, characterized in that, The third extract window also includes a completion control, and the method further includes: In response to the operation of the completion control, the third excerpt window is closed and the fifth interface is displayed. The fifth interface includes a third icon, which is the icon corresponding to the global collection. The third icon is used to indicate that the first video and the third video are saved to the global collection.
8. The method according to claim 1 or 2, characterized in that, The third extract window also includes a marker control, and the method further includes: In response to an operation on the tagging control, tagging information is acquired, and a first display area is displayed in the second video clip card in the third clipping window. The first display area is used to display the tagging information, which includes a description of a video clip in the second video.
9. The method according to claim 1 or 2, characterized in that, The third extract window also includes a screenshot control, and the method further includes: In response to an operation on the screenshot control, a first screenshot is acquired, and a second display area is displayed in the second video clip card in the third clip window. The second display area is used to display the first screenshot, which refers to a screenshot of the second video display image when the screenshot control is operated.
10. The method according to claim 1 or 2, characterized in that, The second extraction window also includes a third display area, which displays first time information, which is used to indicate the duration of the video segment recorded in the second video.
11. The method according to claim 1 or 2, characterized in that, The second extraction window also includes a fourth display area, which displays a first prompt message indicating that a video clip of the second video is being recorded.
12. The method according to claim 1 or 2, characterized in that, The first extract window further includes a first minimize control, and the method further includes: In response to the operation on the first minimized control, the first extract window is switched to a fourth icon, the area of which is smaller than the area of the first extract window.
13. The method according to claim 1 or 2, characterized in that, The second extract window also includes a second minimize control, and the method further includes: In response to the operation on the second minimize control, the second extract window switches to a fifth icon, the area of which is smaller than the area of the second extract window.
14. The method according to claim 1 or 2, characterized in that, The third extract window also includes a third minimize control, and the method further includes: In response to an operation on the third minimize control, the third extract window switches to a sixth icon, the area of which is smaller than the area of the third extract window.
15. The method according to claim 1 or 2, characterized in that, The second interface also includes a second control, and the method further includes: In response to an operation on the second control, the speech in the first video is converted into text information; The sixth interface is displayed, which includes a third video extract card, which includes the first video and a fifth display area; The text information is displayed in the fifth display area.
16. The method according to claim 1 or 2, characterized in that, The method further includes: The seventh interface is displayed, which includes a seventh icon corresponding to the second video excerpt file, and the second video excerpt file includes the third video. In response to an operation on the seventh icon, an eighth interface is displayed, the eighth interface including a fourth video excerpt card, the fourth video excerpt card including a sixth display area, the sixth display area displaying the third video; In response to an operation on the sixth display area, the fourth control is displayed; In response to an operation on the fourth control, the second video extract file is edited, the editing process including at least one of deleting images and adding identification information.
17. The method according to claim 1 or 2, characterized in that, The method further includes: The seventh interface is displayed, which includes a seventh icon corresponding to the second video excerpt file, and the second video excerpt file includes the third video. In response to an operation on the seventh icon, an eighth interface is displayed, the eighth interface including a fourth video excerpt card, the fourth video excerpt card including a time stamp control; In response to an operation on the time stamp control, a fourth control is displayed; In response to an operation on the fourth control, the second video extract file is edited, the editing process including at least one of deleting images and adding identification information.
18. The method according to claim 16, characterized in that, The second video excerpt file also includes a first image, and the second video excerpt card further displays the first image. The fourth control includes a delete sub-control. The editing process of the second video excerpt file in response to an operation on the fourth control includes: In response to the operation on the delete sub-control, the first image is deleted.
19. The method according to claim 18, characterized in that, The fourth control further includes an add marker sub-control, and the step of editing the second video excerpt file in response to an operation on the fourth control further includes: In response to the operation of adding the marker sub-control, identification information is added to the third video.
20. The method according to claim 16, characterized in that, When there are multiple third videos, the method further includes: When the eighth interface detects a first operation on any one of the third videos, the order of the videos in the third video is adjusted according to the order indicated by the first operation.
21. The method according to claim 1 or 2, characterized in that, The step of ending the recording of the video segment of the second video in the fourth interface in response to the operation of the pause control includes: In response to the operation of the pause control, the first video segment is obtained, and the recording control is displayed again; In response to the operation of the recording control, another video segment of the second video is recorded again, and the pause control is displayed again; In response to the operation of the pause control, a second video segment is obtained, and based on the first video segment and the second video segment, the third video is obtained, and the recording of the video segment of the second video in the fourth interface ends.
22. An electronic device, characterized in that, The electronic device includes a module for performing the method as described in any one of claims 1 to 21.
23. An electronic device, characterized in that, include: One or more processors; Memory; And one or more computer programs, wherein the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, cause the electronic device to perform the method as described in any one of claims 1 to 21.
24. A chip system, characterized in that, The chip system includes a processor for calling and running a computer program from memory, causing an electronic device on which the chip system is installed to perform the method as described in any one of claims 1 to 21.
25. A computer-readable storage medium comprising a computer program, characterized in that, When the computer program is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1 to 21.