Video editing method and apparatus, electronic device, and storage medium
By displaying video text and editing video frames based on user input, the problem of low video editing efficiency is solved, fast and accurate positioning and editing is achieved, and the efficiency of video editing is improved.
Patent Information
- Application Number
- PCT/CN2024/091892
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-15
- Filing Date
- 2024-05-09
- Publication Date
- 2024-11-21
AI Technical Summary
Users need to determine the editing content for a long time when editing long videos, resulting in low video editing efficiency.
By displaying the video text of the video to be processed, receiving user input, and determining the target video frame in the video based on the video text for editing, improving the accuracy and efficiency of editing.
Users can edit to be processed videos through video text, which can quickly and accurately locate and generate target videos containing the required content, significantly improving video editing efficiency.
Smart Images

Figure CN2024091892_21112024_PF_FP_ABST
Abstract
Description
Video editing method, device, electronic device and storage medium
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to Chinese patent application No. 202310543118.8 filed on May 15, 2023, entitled “Video Editing Method, Device, Electronic Device and Storage Medium,” which is incorporated herein by reference in its entirety. Technical Field
[0003] The present application relates to the field of video processing, and specifically to a video editing method, device, electronic device, and storage medium. Background Art
[0004] Long videos have become an important medium for knowledge dissemination. Users often learn through long videos such as knowledge videos, tutorial videos, and online course videos.
[0005] Users often need to edit long videos. Generally, they edit the videos while previewing them. It takes a long time for users to determine the editing content and perform editing operations on the editing content, resulting in low video editing efficiency.
[0006] Summary of the Invention
[0007] The purpose of the embodiments of the present application is to provide a video editing method, device, electronic device and storage medium, which can solve the problem of low video editing efficiency.
[0008] In a first aspect, an embodiment of the present application provides a video editing method, the method comprising:
[0009] Display N video texts of the video to be processed, where N is a positive integer;
[0010] Receiving a first input of a first video text among the N video texts;
[0011] In response to the first input, a target video is determined according to a first video frame corresponding to the first video text in the video to be processed.
[0012] In a second aspect, an embodiment of the present application provides a video editing apparatus, comprising:
[0013] A display module, used to display N video texts of the video to be processed, where N is a positive integer;
[0014] A receiving module, configured to receive a first input of a first video text among the N video texts;
[0015] A determination module is configured to determine, in response to the first input, a target video according to a first video frame corresponding to the first video text in the video to be processed.
[0016] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor and programs or instructions stored on the memory and that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0017] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0018] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method described in the first aspect.
[0019] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method described in the first aspect.
[0020] In an embodiment of the present application, the video text of the video to be processed is displayed, and a first input of a first video text among N video texts is received. In response to the first input, a target video is determined based on a first video frame corresponding to the first video text in the video to be processed. Since the video text contains relatively rich information about the video to be processed, the user edits the video to be processed through the video text to obtain a target video containing the video content required by the user, thereby improving video editing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] FIG1 is a flow chart of a video editing method according to an embodiment of the present invention;
[0022] FIG2 is a schematic diagram of a video playback interface in a video editing method according to an embodiment of the present application;
[0023] FIG3 is a schematic diagram of a video text display interface in a video editing method provided in an embodiment of the present application;
[0024] FIG4 is a schematic diagram of an interface for capturing text from a video in a video editing method according to an embodiment of the present application;
[0025] FIG5 is a schematic diagram of an interface for moving text in a first video in a video editing method according to an embodiment of the present application;
[0026] FIG6 is a schematic diagram of an interface for deleting text from a first video in a video editing method according to an embodiment of the present application;
[0027] FIG7 is a schematic diagram of setting annotation information in the video editing method provided in an embodiment of the present application;
[0028] FIG8 is a schematic diagram showing one of the display diagrams of the annotation information in the video editing method provided in an embodiment of the present application;
[0029] FIG9 is a second schematic diagram of displaying annotation information in the video editing method provided in an embodiment of the present application;
[0030] FIG10 is a second schematic diagram of a video playback interface in the video editing method provided in an embodiment of the present application;
[0031] FIG11 is a schematic diagram of a video text directory display interface in a video editing method according to an embodiment of the present application;
[0032] FIG12 is a schematic diagram of one of the playback jump interfaces in the video editing method provided in an embodiment of the present application;
[0033] FIG13 is a second schematic diagram of a playback jump interface in the video editing method provided in an embodiment of the present application;
[0034] FIG14 is a third schematic diagram of a playback jump interface in the video editing method provided in an embodiment of the present application;
[0035] FIG15 is a fourth schematic diagram of a playback jump interface in the video editing method provided in an embodiment of the present application;
[0036] FIG16 is a fifth schematic diagram of a playback jump interface in the video editing method provided in an embodiment of the present application;
[0037] FIG17 is a sixth schematic diagram of a playback jump interface in the video editing method provided in an embodiment of the present application;
[0038] FIG18 is a schematic structural diagram of a video editing device provided in an embodiment of the present application;
[0039] FIG19 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0040] FIG20 is a schematic diagram of the hardware structure of the electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0041] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.
[0042] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.
[0043] The video editing method provided by the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0044] FIG1 is a flow chart of a video editing method provided by an embodiment of the present application. As shown in FIG1 , the method includes:
[0045] Step 101: display N video texts of the video to be processed, where N is a positive integer;
[0046] The execution subject of the embodiments of the present application is an electronic device, which includes but is not limited to a smartphone, a tablet computer, and a computer.
[0047] The video to be processed is a video that needs to be edited, which can be the original video or a video edited using the video editing method provided in the embodiment of the present application.
[0048] The video text of the video to be processed may be a video subtitle, or may be a text obtained by converting the speech of one or at least two video objects in the video to be processed, wherein the video subtitle may be identified from the video frames of the video to be processed.
[0049] A line or a sentence of video text in the video to be processed can be regarded as a video text. The embodiment of the present application does not limit the division of video text.
[0050] The electronic device displays N video texts of the video to be processed. The number N of video texts displayed on the electronic device can be determined according to the size of the display screen of the electronic device. When the display screen of the electronic device is larger, the number N of video texts displayed is larger.
[0051] When the number of video texts is greater than N, not all video texts can be displayed at the same time. The display area of the video text can be a sliding window, and the user can view other video texts by sliding the sliding window up and down, thereby achieving an overview of the video text of the video to be processed.
[0052] By browsing the video text in the video to be processed, users can get an overview of the content of the video to be processed, so as to quickly and accurately locate the required content and save time in searching for video content.
[0053] Before the electronic device displays N video texts of the video to be processed, the electronic device receives an input operation that triggers the display of the video text of the video to be processed.
[0054] The input operation may be a click operation on the video playback interface of the electronic device, or a click operation on a video thumbnail. The embodiment of the present application does not limit the input operation.
[0055] Figure 2 is a schematic diagram of a video playback interface in the video editing method provided in an embodiment of the present application. Figure 3 is a schematic diagram of a video text display interface in the video editing method provided in an embodiment of the present application. When a user is viewing a video to be processed, an edit button is displayed on the video playback interface of the video to be processed, as shown in the lower right corner of Figure 2. If the user needs to edit the video to be processed, they click the edit button, and the electronic device displays the video text display interface shown in Figure 3.
[0056] In Figure 3, the upper portion of the video text display interface can display the content of the video to be processed, the middle portion displays the playback progress bar of the video to be processed, and the lower portion displays the video text of the video to be processed line by line. The embodiment of the present application does not limit the layout of the video text display interface.
[0057] Each video text is associated with the progress bar area of each video frame corresponding to the video text. The playback progress bar of the video to be processed is divided into multiple segments according to the progress bar area associated with each video text. Each rectangular box in Figure 3 represents a progress bar area.
[0058] Step 102: receiving a first input of a first video text among the N video texts;
[0059] The first video text is selected by the user from the video text of the video to be processed. The first video text can be selected by clicking on the video text or by capturing the video text.
[0060] When intercepting video text, the user selects a line of video text. The selected video text is located in the selection box, and the progress bar area corresponding to the line of video text is in a selected state, with a slider displayed on the left and right of the progress bar.
[0061] FIG4 is a schematic diagram of an interface for capturing video text in a video editing method according to an embodiment of the present application. A user can adjust the selection box by dragging the left and right boundaries to capture the content of the line of video text. The captured content of the line of video text is used as the first video text.
[0062] You can also drag the left and right sliders on the progress bar area corresponding to the row of video text to intercept the corresponding first video text. At this time, the left and right boundaries of the selection box of the row of video text are also adjusted in conjunction, as shown in Figure 4.
[0063] The user selects a first video text according to the displayed video text and performs a first input on the first video text. The electronic device receives the first input on the first video text.
[0064] The first input is an editing operation on the first video text, such as deleting and moving the first video text. The embodiment of the present application does not specifically limit the first input.
[0065] Step 103 : In response to the first input, determine a target video according to a first video frame corresponding to the first video text in the video to be processed.
[0066] When the first video text is a video subtitle, the video frame corresponding to the first video text in the video to be processed refers to the video frame in which the first video text is identified from the video to be processed.
[0067] When the first video text is text obtained by voice conversion, the video frame corresponding to the first video text in the video to be processed refers to the video frame where the voice converted into the first video text is located in the video to be processed.
[0068] In response to a first input, the electronic device determines a target video based on a first video frame corresponding to a first video text. Specifically, the steps may include: performing corresponding editing operations on the video frame corresponding to the first video text based on an editing operation on the first video text to obtain the target video. The target video can be used for sharing and recording.
[0069] By editing the first video text, the video frames corresponding to the first video text are edited, thereby improving the accuracy and efficiency of video editing.
[0070] For example, when the first input is a deletion operation on the first video text, the electronic device deletes the video frame corresponding to the first video text from the video to be processed in response to the deletion operation.
[0071] The embodiment of the present application displays the video text of the video to be processed, receives a first input of the first video text among N video texts, and in response to the first input, determines the target video according to the first video frame corresponding to the first video text in the video to be processed. Since the video text contains relatively rich information about the video to be processed, the user edits the video to be processed through the video text to obtain the target video containing the video content required by the user, thereby improving the efficiency of video editing.
[0072] Optionally, before the step of displaying N video texts of the video to be processed, the method further includes:
[0073] According to the voice of the video object in the video to be processed, N video texts of the video to be processed are determined.
[0074] The video object is an object that makes speech in the video to be processed, such as a person object.
[0075] The voice of the video object contains relatively rich information about the video to be processed, which is generally the information that users focus on in the video to be processed.
[0076] The electronic device converts the speech of the video objects in the video to be processed into video text. The conversion steps may specifically include: preprocessing the speech of all video objects in the video to be processed, including removing noise, enhancing speech signals, etc.; converting the preprocessed speech into a feature vector; using a speech recognition algorithm to analyze the feature vector and identify the text content in the speech.
[0077] The speech recognition algorithm may be based on a dynamic time warping algorithm, a hidden Markov model algorithm based on a parameter model, a vector quantization algorithm based on a non-parametric model, a neural network algorithm, etc. The embodiment of the present application does not limit the speech recognition algorithm.
[0078] The embodiment of the present application obtains and displays the video text of the video to be processed based on the voice of the video object in the video to be processed. By browsing the video text of the video to be processed, the user can accurately understand the content of the video to be processed, thereby quickly and accurately locating the required content.
[0079] Optionally, before the step of determining N video texts of the video to be processed based on the voice of the video object in the video to be processed, the method further includes:
[0080] receiving a second input of a target video object among the video objects;
[0081] The determining, based on the voice of the video object in the video to be processed, N video texts of the video to be processed includes:
[0082] In response to the second input, N video texts of the to-be-processed video are determined according to the voice of the target video object.
[0083] The target video object is the video object that the user is interested in in the video to be processed.
[0084] The second input is an operation of selecting a target video object from the video to be processed, such as inputting the name of the target video object or clicking on the target video object. The embodiment of the present application does not limit the second input.
[0085] The electronic device receives a second input, and in response to the second input, extracts a voice of a target video object from the voices of the video objects, and converts the voice of the target video object into video text.
[0086] The specific steps of extracting the speech of the target video object from the speech of the video object may include: classifying the speech of the video object and classifying the speech of each video object into a category; identifying the target video object from the video frames of the video to be processed; and determining the type of speech belonging to the target video object based on the video frames corresponding to the target video object and the video frames corresponding to each type of speech.
[0087] The speech classification algorithm may be a support vector machine algorithm, a neural network algorithm, etc. The embodiment of the present application does not limit the speech classification algorithm.
[0088] The text content in the speech of the target video subject is identified using a speech recognition algorithm. The speech recognition algorithm can be based on a dynamic time warping algorithm, a vector quantization algorithm based on a non-parametric model, a neural network algorithm, etc. The embodiments of this application do not limit the speech recognition algorithm.
[0089] In the embodiment of the present application, the user selects the target video object of his or her interest from the video objects of the video to be processed, obtains and displays the video text according to the voice of the target video object, narrows the user's browsing range, and facilitates the user to quickly and accurately locate the required content.
[0090] Optionally, the first input is used to move the first video text,
[0091] The step of determining a target video in response to the first input and according to a first video frame corresponding to the first video text in the video to be processed includes:
[0092] In response to the first input, determining a second moving position of the first video frame according to the first moving position of the first video text;
[0093] moving the first video frame to the second moving position;
[0094] The target video is generated according to the moved first video frame.
[0095] The first video text may be moved by dragging the mouse or clicking the mouse.
[0096] The first moving position is the position to be moved to in the N video texts by the first video text. The second moving position is the position to be moved to in the video to be processed by the first video frame corresponding to the first video text.
[0097] The first video text may be dragged to the first moving position among the N video texts by dragging the mouse, or the first video text may be moved to the first moving position among the N video texts by clicking the mouse.
[0098] In response to the first input, the electronic device can obtain the position of the video frame corresponding to the first moving position of the first video text, i.e., the second moving position, based on the correspondence between the video text and the video frame, and move the video frame corresponding to the first video text to the second moving position.
[0099] Figure 5 is a schematic diagram of an interface for moving the first video text in the video editing method provided by an embodiment of the present application. As shown in Figure 5, after the user selects the first video text, he can long press on the first video text and drag it up and down to change the position of the first video text.
[0100] When the first video text is moved to the first moving position, the playback progress bar area corresponding to the first video text will automatically move to the corresponding position. You can also drag the playback progress bar area left or right, and the corresponding first video text will automatically move up or down to the corresponding position, thereby achieving coordinated adjustment of the first video text and the progress bar area of the video frame corresponding to the first video text.
[0101] The embodiment of the present application performs a moving operation on the first video text in the video text of the video to be processed, thereby realizing a moving operation on the first video text corresponding to the first video frame, thereby improving the accuracy and efficiency of video editing.
[0102] Optionally, the first input is used to delete the first video text;
[0103] The step of determining a target video in response to the first input and according to a first video frame corresponding to the first video text in the video to be processed includes:
[0104] In response to the first input, the first video frame is deleted from the video to be processed to generate the target video.
[0105] The operation of deleting the first video text can be a keyboard delete or mouse delete operation after selecting the first video text. The first video text is deleted by the keyboard delete or mouse delete operation.
[0106] In response to the first input, the electronic device obtains a first video frame corresponding to the first video text in the video to be processed, deletes the first video frame from the video to be processed, and obtains a target video.
[0107] Figure 6 is a schematic diagram of the interface for deleting the first video text in the video editing method provided by an embodiment of the present application. As shown in Figure 6, after the user selects the first video text, two buttons are displayed on the right side of the area where the first video text is located: a delete button on the top and an add button on the bottom. When the user clicks the delete button, the first video text is deleted from the N video texts of the video to be processed, the first video frame corresponding to the first video text is deleted from the video to be processed, and the playback progress bar area corresponding to the first video text is deleted in conjunction with the deletion.
[0108] The embodiment of the present application deletes the first video text in the video text of the video to be processed, thereby deleting the first video frame corresponding to the first video text in the first video, thereby improving the accuracy and efficiency of video editing.
[0109] Optionally, in response to the first input, determining the target video according to the first video frame corresponding to the first video text in the video to be processed includes:
[0110] In response to the first input, adding annotation information to a first video frame corresponding to the first video text in the video to be processed;
[0111] The target video is generated according to the first video frame after the annotation information is added.
[0112] The first input is an operation of adding annotation information to the first video frame, which may be an input operation on the input box or an operation of selecting the annotation information.
[0113] The annotation information includes at least one of text information, voice information, image information and color information.
[0114] Annotation information is added to the first video frame, where the annotation information is used to mark the content or position of the first video frame.
[0115] When the annotation information includes text information, voice information or image information, the text information, voice information or image information can be displayed together when playing the first video frame, so that the user can quickly understand the content of the first video frame based on the text information, voice information or image information, and thus quickly locate the required information.
[0116] When the annotation information includes color information, the progress bar area corresponding to the first video frame can be displayed according to the color information, so that the user can quickly locate the first video frame.
[0117] FIG7 is a schematic diagram of setting annotation information in the video editing method provided by an embodiment of the present application. When the user selects the first video text, the progress bar area corresponding to the first video text appears selected. At this time, the user can long-press the progress bar area. A pop-up window will pop up above the progress bar area, displaying two options: annotation and color. The user can enter text information, voice information, or image information in the annotation option, and enter color information in the color option, as shown in FIG7.
[0118] FIG8 is a schematic diagram of one of the display diagrams of annotation information in the video editing method provided in an embodiment of the present application. After the annotation information is added to the first video frame, the progress bar area corresponding to the first video frame is displayed with the input color information, and a dialog box icon is displayed above the progress bar area, indicating that the progress bar area has annotation information, as shown in FIG8.
[0119] FIG9 is a second schematic diagram of displaying annotation information in the video editing method provided by an embodiment of the present application. When a user clicks the dialog box icon, a pop-up window appears above the progress bar, as shown in FIG9 . The pop-up window displays the annotated text, voice, or image information. After the user has read the contents of the pop-up window, they can close it by clicking the close button in the upper right corner of the pop-up window.
[0120] The embodiment of the present application sets annotation information for the first video frame corresponding to the first video text, so that the user can quickly understand the content and position of the first video frame based on the annotation information, thereby quickly locating the required information.
[0121] Optionally, in response to the first input, determining the target video according to the first video frame corresponding to the first video text in the video to be processed includes:
[0122] In response to the first input, adding subtitle information to a first video frame corresponding to the first video text in the video to be processed;
[0123] The target video is generated according to the first video frame after the subtitle information is added.
[0124] When the video to be processed does not have subtitle information, the electronic device can convert the voice of the video object in the video to be processed into N video texts, receive a first input of a first video text among the N video texts, and add subtitle information to a first video frame corresponding to the first video text in response to the first input.
[0125] The first input may be a selection operation on the first video text. In response to the first input, the electronic device directly uses the first video text as subtitle information of the first video frame.
[0126] The first input may also be an editing operation on the first video text. In response to the first input, the electronic device uses the edited first video text as subtitle information of the first video frame.
[0127] The target video generated according to the first video frame after the subtitle information is added is a video with subtitle information.
[0128] In an embodiment of the present application, subtitle information is added to a first video frame corresponding to a first video text according to a first input of a user to a first video text. The user can add subtitle information to the video to be processed with reference to the video text of the video to be processed, thereby improving the efficiency of adding subtitle information.
[0129] Optionally, the method further includes:
[0130] Receiving a third input of a second video text among the N video texts;
[0131] In response to the third input, displaying a second video frame corresponding to the second video text in the video to be processed;
[0132] receiving a fourth input of a target video frame in the second video frame;
[0133] In response to the fourth input, target graphic information is generated according to the second video text and the target video frame.
[0134] The second video text is a text used to generate graphic information. The third input is a selection operation of the second video text in the N videos.
[0135] The electronic device receives a third input of the second video text, and in response to the third input, displays a second video frame corresponding to the second video text for user selection.
[0136] The target video frame is a video frame used to generate the graphic information. The fourth input is a selection operation of the target video frame from the second video frame. The user selects one or at least two frames from the second video frame for generating the graphic information.
[0137] The electronic device receives a fourth input of a target video frame, and generates target graphic and text information in response to the fourth input.
[0138] The target graphic information is mixed information of text and image, and may be a document including the second video text and the target video frame.
[0139] The embodiment of the present application generates graphic information by selecting a second video text from N video texts of the video to be processed and selecting target graphic information from the second video frame corresponding to the second video text. The graphic information is richer and better meets user needs.
[0140] Optionally, the method further includes:
[0141] On the video playback interface of the video to be processed, a video text directory is displayed.
[0142] The video text directory is a directory that displays N video texts of the video to be processed in the order in which the video texts correspond to the video frames that are played.
[0143] While the video to be processed is playing on the video playback interface, the video text directory can be displayed for users to browse.
[0144] When there are many video texts, the video text directory cannot display all of them at the same time. The video text directory can display the first N video texts of the video to be processed, or it can display the N consecutive video texts containing the video text corresponding to the video frame currently playing in the video playback interface of the video to be processed.
[0145] The video directory can be displayed in the form of a sliding window. By sliding the sliding window up and down, other video texts can be viewed, thereby achieving an overview of the video text of the video to be processed.
[0146] When the user finds that the content currently being played in the video playback interface is not what he or she needs, he or she can quickly find the required content through the video text directory and switch to the video frame corresponding to the required content for playback.
[0147] Figure 10 is a second schematic diagram of the video playback interface in the video editing method provided in an embodiment of the present application. Figure 11 is a schematic diagram of the video text directory display interface in the video editing method provided in an embodiment of the present application. When a user is watching a video to be processed, a directory button is displayed on the video playback interface, as shown in Figure 10.
[0148] When the user finds that the content currently playing in the video playback interface is not what he needs, he clicks the directory button in Figure 10. The electronic device receives the user's click operation on the directory button and pops up a pop-up window of the video text directory. The pop-up window displays the video text of the video to be processed, as shown in Figure 11.
[0149] Users can scroll up and down in the pop-up window to browse, and by reading the video text in the video text directory, they can quickly understand the content of the video to be processed and find the key content they need.
[0150] The embodiment of the present application displays a video text directory on the video playback interface of the video to be processed for the user to browse, so that when the content currently played in the video playback interface is not what the user needs, the user can quickly find the required content by browsing the video text directory.
[0151] Optionally, the method further includes:
[0152] receiving a fifth input;
[0153] In response to the fifth input, a third video text is determined from the video text directory according to search information corresponding to the fifth input.
[0154] The fifth input may be an input operation on the input box, and the search information corresponding to the fifth input may be a keyword input in the input box.
[0155] The fifth input may also be a selection operation for pre-set search information, and the search information corresponding to the fifth input is the selected search information.
[0156] Based on the search information corresponding to the fifth input, the electronic device can match each video text in the video text directory with the search information, and use the video text containing the search information as the third video text, so that the user can quickly locate the required information.
[0157] As shown in FIG11 , a search box is displayed at the top of the pop-up window, and the user can quickly obtain the third video text containing the search information by entering the search information.
[0158] The embodiment of the present application searches for matching video text from the video text of the video to be processed based on the search information corresponding to the user's input, thereby quickly finding the required content.
[0159] Optionally, the method further includes:
[0160] receiving a sixth input of a fourth video text in the video text catalog;
[0161] In response to the sixth input, the third video frame corresponding to the fourth video text in the video to be processed is played.
[0162] The sixth input is used to select a fourth video text from the video text directory. The sixth input can be a click operation on the fourth video text, or a frame selection operation on the fourth video text.
[0163] When the user is watching the video to be processed, if the content currently played in the video playback interface of the video to be processed is not what the user wants, the user can quickly find the desired content, that is, the fourth video text, by browsing the video text directory.
[0164] The fourth video text may be a single-line video text, a plurality of continuous lines of video text, or a plurality of discontinuous lines of video text.
[0165] The user performs a sixth input on the fourth video text, such as a click operation, and the electronic device receives the sixth input and plays the third video frame corresponding to the fourth video text, thereby quickly switching the video to be processed to the desired content.
[0166] Figure 12 is one of the schematic diagrams of the play jump interface in the video editing method provided in the embodiment of the present application. When the user finds the desired fourth video text in the video text directory, he can click on the fourth video text, and the fourth video text will be included in the selection box, indicating that the fourth video text in that row has been selected.
[0167] A triangular jump button is displayed on the right side of the selection box. The user clicks the jump button to jump to the video frame corresponding to the fourth video text for playback.
[0168] Jumping to the video frame corresponding to the fourth video text for playback can also be achieved through other interactive methods, such as double-clicking the fourth video text, which is not specifically limited in the embodiment of the present application.
[0169] Figure 13 is a second schematic diagram of the playback jump interface in the video editing method provided by an embodiment of the present application. When the fourth video text contains multiple lines of video text, the user can activate the selection box by long pressing. There are arrows above and below the selection box, and the user can drag the arrows to expand the selection box upward and / or downward to select multiple consecutive lines of the fourth video text.
[0170] Figure 14 is a third schematic diagram of the playback jump interface in the video editing method provided in an embodiment of the present application. Three buttons are displayed to the right of the selection box in Figure 13. After the user selects the fourth video text using the selection box, they can click the preview button to pop up a pop-up window as shown in Figure 14, in which the video frame corresponding to the fourth video text is played.
[0171] The user can also click the Save or Share button to save the video frame corresponding to the fourth video text locally or share it with others.
[0172] Figure 15 is a fourth schematic diagram of the playback jump interface in the video editing method provided by an embodiment of the present application. When the user clicks the Add button, a New button appears at the bottom of the interface. A count icon appears in the upper right corner of the button, indicating the total number of lines of fourth video text added by the user. The fourth video text can be continuous or discontinuous.
[0173] Figure 16 is a fifth schematic diagram of the playback jump interface in the video editing method provided in an embodiment of the present application. When the user clicks the New button, a new interface will be displayed. The new interface has the same structure as the original interface and is used to display the fourth video text and its corresponding video frame added by the user in the original interface. The user can click the Back button below to return to the original interface and continue adding the fourth video text.
[0174] Figure 17 is a sixth schematic diagram of the playback jump interface in the video editing method provided by an embodiment of the present application. The user can click the Done button below in the interfaces shown in Figures 15 and 16 to play the video frame corresponding to the fourth video text in the new video playback interface, as shown in Figure 17.
[0175] There are 4 buttons displayed on the right side of the new video playback interface. If the user needs to edit the content in the new video playback interface, he can click the edit button and return to the interface in Figure 15 or Figure 16 to edit the fourth video text.
[0176] If the user does not need to edit the content in the new video playback interface, he can click the Save button or the Share button to save the video frame corresponding to the fourth video text locally or share it to other applications. When the user does not need to perform subsequent operations, he can click the Close button to exit the video playback interface.
[0177] The embodiment of the present application plays the video frames corresponding to the video text in the video text directory selected by the user, thereby quickly jumping the video to the content required by the user.
[0178] Optionally, the video to be processed is a teaching video, and the N video texts of the video to be processed are determined based on the voice of the teaching subject in the teaching video.
[0179] Teaching videos are videos that contain teaching content. The teaching objects include the teacher and the learners.
[0180] The electronic device converts the voice of the teaching object in the video to be processed into video text, which can be converted through a voice recognition algorithm.
[0181] The speech recognition algorithm may be based on a dynamic time warping algorithm, a hidden Markov model algorithm based on a parameter model, a vector quantization algorithm based on a non-parametric model, a neural network algorithm, etc. The embodiment of the present application does not limit the speech recognition algorithm.
[0182] The embodiment of the present application obtains and displays the video text of the video to be processed based on the voice of the teaching object in the video to be processed. By browsing the video text of the video to be processed, the learner can accurately understand the content of the video to be processed, thereby quickly and accurately locating the teaching content that needs to be understood.
[0183] The video editing method provided in the embodiment of the present application can be executed by a video editing device. In the embodiment of the present application, the video editing device provided in the embodiment of the present application is described by taking the video editing method executed by the video editing device as an example.
[0184] FIG18 is a schematic diagram of the structure of a video editing device provided in an embodiment of the present application. As shown in FIG18 , the device includes a display module 1801, a receiving module 1802, and a determining module 1803, wherein:
[0185] The display module 1801 is used to display N video texts of the video to be processed, where N is a positive integer;
[0186] The receiving module 1802 is configured to receive a first input of a first video text among the N video texts;
[0187] The determination module 1803 is configured to determine, in response to the first input, a target video according to a first video frame corresponding to the first video text in the video to be processed.
[0188] Optionally, the determination module is further configured to:
[0189] According to the voice of the video object in the video to be processed, N video texts of the video to be processed are determined.
[0190] Optionally, the determination module is further configured to:
[0191] receiving a second input of a target video object among the video objects;
[0192] In response to the second input, N video texts of the to-be-processed video are determined according to the voice of the target video object.
[0193] Optionally, the first input is used to move the first video text;
[0194] Determine the module specifically for:
[0195] In response to the first input, determining a second moving position of the first video frame according to the first moving position of the first video text;
[0196] moving the first video frame to the second moving position;
[0197] The target video is generated according to the moved first video frame.
[0198] Optionally, the first input is used to delete the first video text;
[0199] Determine the module specifically for:
[0200] In response to the first input, the first video frame is deleted from the video to be processed to generate the target video.
[0201] Optionally, the determination module is specifically configured to:
[0202] In response to the first input, adding annotation information to a first video frame corresponding to the first video text in the video to be processed;
[0203] The target video is generated according to the first video frame after the annotation information is added.
[0204] Optionally, the determination module is specifically configured to:
[0205] In response to the first input, adding subtitle information to a first video frame corresponding to the first video text in the video to be processed;
[0206] The target video is generated according to the first video frame after the subtitle information is added.
[0207] Optionally, a generation module is further included, for:
[0208] Receiving a third input of a second video text among the N video texts;
[0209] In response to the third input, displaying a second video frame corresponding to the second video text in the video to be processed;
[0210] receiving a fourth input of a target video frame in the second video frame;
[0211] In response to the fourth input, target graphic information is generated according to the second video text and the target video frame.
[0212] Optionally, the display module is further configured to:
[0213] On the video playback interface of the video to be processed, a video text directory is displayed.
[0214] Optionally, the determination module is further configured to:
[0215] receiving a fifth input;
[0216] In response to the fifth input, a third video text is determined from the video text directory according to search information corresponding to the fifth input.
[0217] Optionally, a playback module is further included, configured to:
[0218] receiving a sixth input of a fourth video text in the video text catalog;
[0219] In response to the sixth input, the third video frame corresponding to the fourth video text in the video to be processed is played.
[0220] Optionally, the video to be processed is a teaching video, and the N video texts of the video to be processed are determined based on the voice of the teaching subject in the teaching video.
[0221] The embodiment of the present application displays the video text of the video to be processed, receives a first input of the first video text among N video texts, and in response to the first input, determines the target video according to the first video frame corresponding to the first video text in the video to be processed. Since the video text contains relatively rich information about the video to be processed, the user edits the video to be processed through the video text to obtain the target video containing the video content required by the user, thereby improving the efficiency of video editing.
[0222] The video editing device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not specifically limit it.
[0223] The video editing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0224] The video editing device provided in the embodiment of the present application can implement each process implemented by the method embodiments of Figures 1 to 17. To avoid repetition, they will not be described here.
[0225] Optionally, as shown in Figure 19, an embodiment of the present application also provides an electronic device 1900, including a processor 1901 and a memory 1902, and the memory 1902 stores a program or instruction that can be run on the processor 1901. When the program or instruction is executed by the processor 1901, the various steps of the above-mentioned video editing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0226] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0227] FIG20 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
[0228] The electronic device 2000 includes but is not limited to components such as a radio frequency unit 2001 , a network module 2002 , an audio output unit 2003 , an input unit 2004 , a sensor 2005 , a display unit 2006 , a user input unit 2007 , an interface unit 2008 , a memory 2009 , and a processor 2010 .
[0229] Those skilled in the art will appreciate that the electronic device 2000 may further include a power source (e.g., a battery) to power various components. The power source may be logically connected to the processor 2010 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The electronic device structure shown in FIG20 does not limit the electronic device. The electronic device may include more or fewer components than shown, or may combine certain components, or have different component arrangements, which will not be described in detail here.
[0230] The display unit 2006 is used to display N video texts of the video to be processed, where N is a positive integer;
[0231] A user input unit 2007 is configured to receive a first input of a first video text among the N video texts;
[0232] The processor 2010 is configured to determine, in response to the first input, a target video according to a first video frame corresponding to the first video text in the video to be processed.
[0233] The embodiment of the present application displays the video text of the video to be processed, receives a first input of the first video text among N video texts, and in response to the first input, determines the target video according to the first video frame corresponding to the first video text in the video to be processed. Since the video text contains relatively rich information about the video to be processed, the user edits the video to be processed through the video text to obtain the target video containing the video content required by the user, thereby improving the efficiency of video editing.
[0234] Optionally, the processor 2010 is further configured to determine N video texts of the video to be processed based on the voice of the video object in the video to be processed.
[0235] The embodiment of the present application obtains and displays the video text of the video to be processed based on the voice of the video object in the video to be processed. By browsing the video text of the video to be processed, the user can accurately understand the content of the video to be processed, thereby quickly and accurately locating the required content.
[0236] Optionally, the user input unit 2007 is further configured to receive a second input on a target video object in the video objects;
[0237] The processor 2010 is further configured to determine, in response to the second input, N video texts of the video to be processed according to the voice of the target video object.
[0238] In the embodiment of the present application, the user selects the target video object of his or her interest from the video objects of the video to be processed, obtains and displays the video text according to the voice of the target video object, narrows the user's browsing range, and facilitates the user to quickly and accurately locate the required content.
[0239] Optionally, the processor 2010 is used to determine the second moving position of the first video frame in response to the first input according to the first moving position of the first video text; move the first video frame to the second moving position; and generate the target video based on the moved first video frame.
[0240] The embodiment of the present application performs a moving operation on the first video text in the video text of the video to be processed, thereby realizing a moving operation on the first video text corresponding to the first video frame, thereby improving the accuracy and efficiency of video editing.
[0241] Optionally, the processor 2010 is configured to delete the first video frame from the video to be processed in response to the first input, to generate the target video.
[0242] The embodiment of the present application deletes the first video text in the video text of the video to be processed, thereby deleting the first video frame corresponding to the first video text in the first video, thereby improving the accuracy and efficiency of video editing.
[0243] Optionally, the processor 2010 is configured to, in response to the first input, add annotation information to a first video frame corresponding to the first video text in the video to be processed; and generate the target video based on the first video frame after the annotation information is added.
[0244] The embodiment of the present application sets annotation information for the first video frame corresponding to the first video text, so that the user can quickly understand the content and position of the first video frame based on the annotation information, thereby quickly locating the required information.
[0245] Optionally, the processor 2010 is configured to, in response to the first input, add subtitle information to a first video frame corresponding to the first video text in the video to be processed; and generate the target video according to the first video frame after the subtitle information is added.
[0246] In an embodiment of the present application, subtitle information is added to a first video frame corresponding to a first video text according to a first input of a user to a first video text. The user can add subtitle information to the video to be processed with reference to the video text of the video to be processed, thereby improving the efficiency of adding subtitle information.
[0247] Optionally, the user input unit 2007 is further configured to receive a third input of a second video text among the N video texts;
[0248] The display unit 2006 is further configured to display, in response to the third input, a second video frame corresponding to the second video text in the video to be processed;
[0249] The user input unit 2007 is further configured to receive a fourth input of a target video frame in the second video frame;
[0250] The processor 2010 is further configured to generate target graphic information according to the second video text and the target video frame in response to the fourth input.
[0251] The embodiment of the present application generates graphic information by selecting a second video text from N video texts of the video to be processed and selecting target graphic information from the second video frame corresponding to the second video text. The graphic information is richer and better meets user needs.
[0252] Optionally, the display unit 2006 is further configured to display a video text directory on the video playback interface of the video to be processed.
[0253] The embodiment of the present application displays a video text directory on the video playback interface of the video to be processed for the user to browse, so that when the content currently played in the video playback interface is not what the user needs, the user can quickly find the required content by browsing the video text directory.
[0254] Optionally, the user input unit 2007 is further configured to receive a fifth input;
[0255] The processor 2010 is further configured to, in response to the fifth input, determine a third video text from the video text directory according to search information corresponding to the fifth input.
[0256] The embodiment of the present application searches for matching video text from the video text of the video to be processed based on the search information corresponding to the user's input, thereby quickly finding the required content.
[0257] Optionally, the user input unit 2007 is further configured to receive a sixth input of a fourth video text in the video text directory;
[0258] The processor 2010 is further configured to, in response to the sixth input, play the third video frame corresponding to the fourth video text in the video to be processed.
[0259] The embodiment of the present application plays the video frames corresponding to the video text in the video text directory selected by the user, thereby quickly jumping the video to the content required by the user.
[0260] It should be understood that in an embodiment of the present application, the input unit 2004 may include a graphics processing unit (GPU) 20041 and a microphone 20042, and the graphics processor 20041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 2006 may include a display panel 20061, and the display panel 20061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 2007 includes a touch panel 20071 and at least one of the other input devices 20072. The touch panel 20071 is also called a touch screen. The touch panel 20071 may include two parts: a touch detection device and a touch controller. Other input devices 20072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0261] The memory 2009 can be used to store software programs and various data. The memory 2009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 2009 may include a volatile memory or a non-volatile memory, or the memory 2009 may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 2009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0262] Processor 2010 may include one or more processing units. Optionally, processor 2010 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 2010.
[0263] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned video editing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0264] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0265] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned video editing method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0266] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0267] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned video editing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0268] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0269] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
[0270] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.
Claims
1. A video editing method, wherein: include: Display N video texts of the video to be processed, where N is a positive integer; Receiving a first input of a first video text among the N video texts; In response to the first input, a target video is determined according to a first video frame corresponding to the first video text in the video to be processed.
2. The video editing method according to claim 1, before the step of displaying N video texts of the video to be processed, the method further comprises: According to the speech of the video object in the video to be processed, N video texts of the video to be processed are determined.
3. The video editing method according to claim 2, before the step of determining N video texts of the video to be processed according to the voice of the video object in the video to be processed, the method further comprises: receiving a second input of a target video object among the video objects; The step of determining N video texts of the video to be processed according to the voice of the video object in the video to be processed includes: In response to the second input, N video texts of the video to be processed are determined according to the voice of the target video object.
4. The video editing method according to claim 1, wherein the first input is used to move the first video text; In response to the first input, determining a target video according to a first video frame corresponding to the first video text in the video to be processed includes: In response to the first input, determining a second moving position of the first video frame according to a first moving position of the first video text; moving the first video frame to the second moving position; The target video is generated according to the moved first video frame.
5. The video editing method according to claim 1, wherein the first input is used to delete the first video text; In response to the first input, determining a target video according to a first video frame corresponding to the first video text in the video to be processed includes: In response to the first input, the first video frame is deleted from the video to be processed to generate the target video.
6. The video editing method according to claim 1, wherein in response to the first input, determining the target video according to the first video frame corresponding to the first video text in the video to be processed comprises: In response to the first input, adding annotation information to a first video frame corresponding to the first video text in the video to be processed; The target video is generated according to the first video frame after the annotation information is added.
7. The video editing method according to claim 1, wherein in response to the first input, determining the target video according to the first video frame corresponding to the first video text in the video to be processed comprises: In response to the first input, adding subtitle information to a first video frame corresponding to the first video text in the video to be processed; The target video is generated according to the first video frame after the subtitle information is added.
8. The video editing method according to claim 1, further comprising: Receiving a third input of a second video text among the N video texts; In response to the third input, displaying a second video frame corresponding to the second video text in the video to be processed; receiving a fourth input of a target video frame in the second video frame; In response to the fourth input, target graphic information is generated according to the second video text and the target video frame.
9. The video editing method according to claim 1, further comprising: On the video playback interface of the video to be processed, a video text directory is displayed.
10. The video editing method according to claim 9, further comprising: receiving a fifth input; In response to the fifth input, a third video text is determined from the video text directory according to search information corresponding to the fifth input.
11. The video editing method according to claim 9, further comprising: receiving a sixth input of a fourth video text in the video text catalog; In response to the sixth input, the third video frame corresponding to the fourth video text in the video to be processed is played.
12. According to the video editing method of claim 1, the video to be processed is a teaching video, and the N video texts of the video to be processed are determined based on the voice of the teaching object in the teaching video.
13. A video editing device, wherein: include: A display module, used for displaying N video texts of the video to be processed, where N is a positive integer; A receiving module, configured to receive a first input of a first video text among the N video texts; A determination module is used to determine a target video in response to the first input according to a first video frame corresponding to the first video text in the video to be processed.
14. An electronic device, wherein: The method comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the video editing method according to any one of claims 1 to 12 are implemented.
15. A readable storage medium, wherein: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the video editing method according to any one of claims 1 to 12 are implemented.
16. A chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the steps of the video editing method according to any one of claims 1 to 12.
17. A computer program product, wherein the computer program product is executed by at least one processor to implement the steps of the video editing method according to any one of claims 1 to 12.
Citation Information
Patent Citations
Video text identification method and device, storage medium and electronic equipment
CN113762038A
Video editing method and device, computer equipment and storage medium
CN115134660A
Video editing method and device
CN115883935A
Audio and video processing method and device, equipment and storage medium
CN115914734A
Video editing method and device, electronic equipment and storage medium
CN116866670A
