A video processing method, apparatus, device, and storage medium

Abstract

The present disclosure provides a video processing method, device, equipment and storage medium, the method comprises: display the subtitle editing page of the first video, the first area of the subtitle editing page is used to play the first video, the second area is used to show the subtitle content of the first video, the subtitle content is composed of the subtitle segment group with timestamp information, the subtitle segment group includes the first subtitle segment and the second subtitle segment generated based on the first subtitle segment. When receiving the editing operation on the first subtitle segment in the first subtitle segment group, the first subtitle editing result corresponding to the editing operation is obtained, and the subtitle text of the second subtitle segment in the first subtitle segment group is updated based on the first subtitle editing result. When the user edits the first subtitle segment, the present disclosure supports updating the subtitle text of the second subtitle segment in the subtitle segment group based on the first subtitle editing result, enriches the video processing related interaction mode, and improves the video processing experience of the user.

Description

Technical Field

[0001] This disclosure relates to the field of data processing, and more particularly to a video processing method, apparatus, device, and storage medium. Background Technology

[0002] With the continuous development of video editing technology, people's needs for video processing-related functions are becoming more and more diversified.

[0003] To meet people's diverse needs for video processing functions, how to further enrich video processing-related functions is a technical problem that urgently needs to be solved. Summary of the Invention

[0004] To address the aforementioned technical problems, this disclosure provides a video processing method, apparatus, device, and storage medium.

[0005] In a first aspect, this disclosure provides a video processing method, the method comprising:

[0006] The subtitle editing page corresponding to the first video is displayed; wherein, the subtitle editing page includes a first area and a second area, the first area is used to play the first video, and the second area is used to display the subtitle content of the first video, the subtitle content includes multiple subtitle segment groups with timestamp information, the subtitle segment group includes a first subtitle segment and a second subtitle segment, the second subtitle segment is generated based on the first subtitle segment;

[0007] In response to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, the system obtains a first subtitle editing result corresponding to the editing operation, and updates the subtitle text of a second subtitle segment in the first subtitle segment group within the second region based on the first subtitle editing result.

[0008] In one alternative implementation,

[0009] The step of responding to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, obtaining a first subtitle editing result corresponding to the editing operation, and updating the subtitle text of a second subtitle segment in the first subtitle segment group within the second region based on the first subtitle editing result includes:

[0010] In response to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, the first subtitle editing result corresponding to the editing operation is obtained, and an update control is displayed in the display area of ​​the first subtitle segment group;

[0011] In response to a trigger operation on the update control, the subtitle text of the second subtitle segment in the first subtitle segment group within the second area is updated based on the first subtitle editing result.

[0012] In one optional implementation, the method further includes:

[0013] In response to a deletion operation on a second subtitle segment in a second subtitle segment group within the second region, the second subtitle segment is deleted from the second region, and a subtitle translation control is displayed in the display area of ​​the second subtitle segment group; wherein the subtitle translation control is used to trigger a translation operation on a first subtitle segment in the second subtitle segment group.

[0014] In one optional implementation, the method further includes:

[0015] In response to a first trigger operation targeting a third subtitle segment group in the second area, the third subtitle segment group is positioned and displayed in the second area, and a video segment in the first video corresponding to the third subtitle segment group is played in conjunction with it in the first area.

[0016] In one optional implementation, a playback control is provided for the third subtitle segment group in the second area. The step of responsively positioning and displaying the third subtitle segment group in the second area and simultaneously playing the video segment corresponding to the third subtitle segment group in the first video within the first area, in response to a first trigger operation on the third subtitle segment group in the second area, includes:

[0017] In response to the triggering operation of the playback control for the third subtitle segment group, the third subtitle segment group is positioned and displayed in the second area, and the video segment in the first video corresponding to the third subtitle segment group is played in conjunction with it in the first area.

[0018] In one optional implementation, the method further includes:

[0019] In response to a second triggering operation acting on the second region, control the scrolling display of the plurality of subtitle segments with timestamp information within the second region;

[0020] Additionally, displaying paused frames of the first video within the first area, or playing the first video according to the timeline.

[0021] In one optional implementation, the subtitle editing page corresponding to the first video includes:

[0022] In response to a third trigger operation on a first video on a video editing page, a subtitle editing page corresponding to the first video is displayed, and the video frame of the first video is displayed in a first area of ​​the subtitle editing page, and the subtitle content of the first video is displayed in a second area of ​​the subtitle editing page; wherein, the third trigger operation includes a subtitle generation operation or a subtitle editing operation.

[0023] In one optional implementation, the method further includes:

[0024] The video editing page is displayed; wherein, a first subtitle track and a second subtitle track are displayed in the third area of ​​the video editing page, the first subtitle track is used to display a first subtitle segment, and the second subtitle track is used to display a second subtitle segment corresponding to the first subtitle segment;

[0025] In response to a subtitle timing adjustment operation for a third subtitle segment within the third region, the system obtains the timing information of the adjustment result corresponding to the subtitle timing adjustment operation, and adjusts the timing of a fourth subtitle segment corresponding to the third subtitle segment based on the timing information of the adjustment result; wherein the third subtitle segment is displayed on the first subtitle track or the second subtitle track, and the fourth subtitle segment includes a first subtitle segment and / or a second subtitle segment belonging to the same subtitle segment group as the third subtitle segment.

[0026] In one optional implementation, the method further includes:

[0027] In response to a first subtitle hiding operation for the first video, the first subtitle track and the first subtitle segment on the first subtitle track are hidden on the video editing page.

[0028] Secondly, this disclosure provides a video processing apparatus, the apparatus comprising:

[0029] The first display module is used to display the subtitle editing page corresponding to the first video; wherein, the subtitle editing page includes a first area and a second area, the first area is used to play the first video, the second area is used to display the subtitle content of the first video, the subtitle content includes multiple subtitle segment groups with timestamp information, the subtitle segment group includes a first subtitle segment and a second subtitle segment, the second subtitle segment is generated based on the first subtitle segment;

[0030] The editing and updating module is used to respond to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, obtain a first subtitle editing result corresponding to the editing operation, and update the subtitle text of a second subtitle segment in the first subtitle segment group within the second region based on the first subtitle editing result.

[0031] Thirdly, this disclosure provides a computer-readable storage medium storing instructions that, when executed on a terminal device, cause the terminal device to implement the above-described method.

[0032] Fourthly, this disclosure provides a video processing device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the above-described method.

[0033] Fifthly, this disclosure provides a computer program product comprising a computer program / instruction that, when executed by a processor, implements the method described above.

[0034] The technical solution provided in this disclosure has at least the following advantages compared with the prior art:

[0035] This disclosure provides a video processing method. First, a subtitle editing page corresponding to a first video is displayed. This subtitle editing page includes a first area and a second area. The first area is used to play the first video, and the second area is used to display the subtitle content of the first video. The subtitle content includes multiple subtitle segment groups with timestamp information. Each subtitle segment group includes a first subtitle segment and a second subtitle segment, where the second subtitle segment is generated based on the first subtitle segment. Then, in response to an editing operation on the first subtitle segment in the first subtitle segment group within the second area, a first subtitle editing result corresponding to the editing operation is obtained. Based on the first subtitle editing result, the subtitle text of the second subtitle segment in the first subtitle segment group within the second area is updated.

[0036] This embodiment of the disclosure displays a subtitle segment group consisting of a first subtitle segment and a second subtitle segment on the subtitle editing page. When the user performs an editing operation on the first subtitle segment, it supports updating the subtitle text of the second subtitle segment in the subtitle segment group based on the editing result of the first subtitle, which enriches the video subtitle editing method, thereby enriching the interactive methods related to video processing and improving the user's video processing experience. Attached Figure Description

[0037] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0038] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0039] Figure 1 A flowchart illustrating a video processing method provided in an embodiment of this disclosure;

[0040] Figure 2 A schematic diagram of a subtitle editing page provided in an embodiment of this disclosure;

[0041] Figure 3 A schematic diagram of another subtitle editing page provided in an embodiment of this disclosure;

[0042] Figure 4 A schematic diagram of another subtitle editing page provided in an embodiment of this disclosure;

[0043] Figure 5 A schematic diagram of a video editing page provided in an embodiment of this disclosure;

[0044] Figure 6 A schematic diagram of another video editing page provided in an embodiment of this disclosure;

[0045] Figure 7 This is a schematic diagram of the structure of a video processing apparatus provided in an embodiment of the present disclosure;

[0046] Figure 8 This is a schematic diagram of the structure of a video processing device provided in an embodiment of the present disclosure. Detailed Implementation

[0047] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0048] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0049] With the continuous development of video editing technology, people's needs for video processing-related functions are becoming more and more diversified.

[0050] To meet people's diverse needs for video processing functions, how to further enrich video processing-related functions is a technical problem that urgently needs to be solved.

[0051] To address this, this disclosure provides a video processing method. First, a subtitle editing page corresponding to a first video is displayed. This subtitle editing page includes a first area and a second area. The first area is used to play the first video, and the second area is used to display the subtitle content of the first video. The subtitle content includes multiple subtitle segment groups with timestamp information. Each subtitle segment group includes a first subtitle segment and a second subtitle segment, where the second subtitle segment is generated based on the first subtitle segment. Then, in response to an editing operation on the first subtitle segment in the first subtitle segment group within the second area, a first subtitle editing result corresponding to the editing operation is obtained. Based on the first subtitle editing result, the subtitle text of the second subtitle segment in the first subtitle segment group within the second area is updated.

[0052] This embodiment of the disclosure displays a subtitle segment group consisting of a first subtitle segment and a second subtitle segment on the subtitle editing page. When the user performs an editing operation on the first subtitle segment, it supports updating the subtitle text of the second subtitle segment in the subtitle segment group based on the editing result of the first subtitle, which enriches the video subtitle editing method, thereby enriching the interactive methods related to video processing and improving the user's video processing experience.

[0053] Based on this, the present disclosure provides a video processing method, referring to... Figure 1 The flowchart below illustrates a video processing method provided in this embodiment of the present disclosure. The method specifically includes:

[0054] S101: Displays the subtitle editing page corresponding to the first video.

[0055] The subtitle editing page includes a first area and a second area. The first area is used to play the first video, and the second area is used to display the subtitle content of the first video. The subtitle content includes multiple subtitle segment groups with timestamp information. Each subtitle segment group includes a first subtitle segment and a second subtitle segment. The second subtitle segment is generated based on the first subtitle segment.

[0056] The video processing method provided in this disclosure can be applied to a client, such as a client deployed on a smartphone, a client deployed on a tablet, etc.

[0057] The first video can be any video. By importing the first video and triggering the subtitle editing / generation operation for it, the first video can be displayed on the subtitle editing page. The first video is a video with subtitle content. The subtitle editing page includes a first area and a second area. The first area displays the video frame of the first video; specifically, this first area can be a video display window, and its display location can include the top area of ​​the subtitle editing page, etc. The second area displays the subtitle content of the first video; specifically, this second area can be displayed in the form of a panel, and its display location can include the bottom area of ​​the subtitle editing page, etc.

[0058] In one optional implementation, when the subtitle editing page corresponding to the first video is triggered, the video content of the first video is played in the video display window on the subtitle editing page, and an editing panel is displayed on the subtitle editing page, which displays the subtitle content of the first video.

[0059] like Figure 2 The diagram shown is a schematic of a subtitle editing page provided in an embodiment of this disclosure. The subtitle editing page displays a video display window 201, in which the video content of the first video is played. The subtitle editing page also displays an editing panel 202, on which the subtitle content of the first video is displayed.

[0060] The subtitle content in this embodiment consists of multiple subtitle segment groups with timestamp information. The timestamp information of each subtitle segment group can represent the start time of the subtitle in the corresponding subtitle segment group. Each subtitle segment group includes a first subtitle segment and at least one second subtitle segment. The first subtitle segment and the second subtitle segment in the same subtitle segment group have a corresponding relationship. The subtitle text of the first subtitle segment is generated based on the corresponding video segment in the first video. Specifically, the subtitle text of the first subtitle segment can be obtained by speech recognition of the corresponding video segment in the first video, that is, the recognition language of the first subtitle segment is the source language of the first video. The second subtitle segment is obtained by translating the subtitle text of the corresponding first subtitle segment. The translation language of the second subtitle segment can be determined by user selection. A subtitle segment group can include multiple second subtitle segments, that is, second subtitle segments with different translation language types can be generated based on the first subtitle segment.

[0061] In one optional implementation, the first subtitle segment included in the same subtitle segment group can be a main subtitle segment, and the second subtitle segment can be a subtitle segment corresponding to the main subtitle segment. A main subtitle segment can include multiple subtitle segments. Specifically, the main subtitle segment can be a subtitle segment obtained by performing speech recognition on any video segment in the first video, while the corresponding subtitle segment can be a subtitle segment obtained by translating the main subtitle segment. For example, a bilingual subtitle segment group can include a main subtitle segment (such as a Chinese subtitle segment) and subtitle segments (such as an English subtitle segment).

[0062] As mentioned above Figure 2 The editing panel 202 on the subtitle editing page shows subtitle content composed of multiple subtitle fragment groups with timestamp information, including subtitle fragment group 203, which includes a first subtitle fragment 204 and a second subtitle fragment 205, wherein the first subtitle fragment 204 and the second subtitle fragment 205 have a corresponding relationship.

[0063] S102: In response to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, obtain a first subtitle editing result corresponding to the editing operation, and update the subtitle text of a second subtitle segment in the first subtitle segment group within the second region based on the first subtitle editing result.

[0064] In this embodiment of the disclosure, during the display of the subtitle editing page corresponding to the first video, the user can trigger an editing operation on the first subtitle segment in the first subtitle segment group within the second area of ​​the subtitle editing page. The first subtitle segment group can be any subtitle segment group within the second area of ​​the subtitle editing page. Editing operations on the first subtitle segment of the first subtitle segment group can include clicking, double-clicking, long-pressing, etc., and displaying a cursor within the display area of ​​the first subtitle segment to receive the user's editing operations. These editing operations can include modification and clearing operations on the first subtitle segment. Modification operations include adding, deleting, or modifying the subtitle text of the first subtitle segment; clearing operations can delete the entire first subtitle segment.

[0065] In one application scenario, when an editing operation is received on a first subtitle segment within a first subtitle segment group in a second area of ​​the subtitle editing page, a cursor is displayed in the display area of ​​the first subtitle segment. The editing operation on the first subtitle segment is received, and the first subtitle editing result corresponding to the editing operation is obtained. Based on the first subtitle editing result, the subtitle text of the second subtitle segment in the first subtitle segment group is updated, and the updated second subtitle segment is displayed. The first subtitle editing result can refer to the result obtained after editing the first subtitle segment; specifically, the first subtitle editing result can be the edited first subtitle segment.

[0066] As mentioned above Figure 2 In the subtitle editing page shown, when a click operation is received on the first subtitle segment 204 in the subtitle segment group 203, a cursor is displayed in the display area of ​​the first subtitle segment. The modification operation on the first subtitle segment is received, the edited first subtitle segment 206 is displayed, and then the first subtitle editing result corresponding to the modification operation is obtained. Based on the first subtitle editing result, the subtitle text of the second subtitle segment 205 is updated to obtain the updated second subtitle segment 207.

[0067] As can be seen, this disclosure supports actively triggering a linked update operation of the second subtitle segment corresponding to the first subtitle segment based on the first subtitle editing result by obtaining the first subtitle editing result. That is, the subtitle text of the second subtitle segment corresponding to the first subtitle segment is edited based on the first subtitle editing result, so that the first subtitle segment and the second subtitle segment maintain semantic consistency.

[0068] In practical applications, after receiving a user's editing operation on the first subtitle segment in the first subtitle segment group, an update control can be set to prompt the user whether to trigger a linked update operation on the second subtitle segment group in the same subtitle segment group based on the editing result of the first subtitle segment. This update control is used to trigger the update of the subtitle text of the second subtitle segment. That is, before the user triggers the update control, the editing operation of the first subtitle segment does not affect the second subtitle segment; after the update control is triggered, the second subtitle segment is updated based on the editing result of the first subtitle segment.

[0069] In one optional implementation, when an editing operation is received on the first subtitle segment in the first subtitle segment group within the second area of ​​the subtitle editing page, a cursor is displayed in the display area of ​​the first subtitle segment, the editing operation on the first subtitle segment is received, the edited first subtitle segment is displayed, the first subtitle editing result corresponding to the editing operation is obtained, and an update control is displayed in the display area of ​​the first subtitle segment group. The update control is used to trigger a linkage update operation on the second subtitle segment in the first subtitle segment group based on the first subtitle editing result.

[0070] Specifically, after the update control is displayed in the display area of ​​the first subtitle segment group, when a trigger operation is received for the update control, the subtitle text of the second subtitle segment in the first subtitle segment group is updated based on the obtained first subtitle editing result.

[0071] like Figure 3 The diagram shows another subtitle editing page provided in this embodiment of the present disclosure. The subtitle editing page displays subtitle content composed of multiple subtitle segment groups, including a subtitle segment group 301. The subtitle segment group 301 includes a first subtitle segment 302 and a second subtitle segment 303. When a click operation is received on the first subtitle segment 302 in the subtitle segment group 301, a modification operation is received on the first subtitle segment 302, the edited first subtitle segment 304 is displayed, the first subtitle editing result corresponding to the modification operation is obtained, and an update control 305 is displayed in the display area of ​​the subtitle segment group. When a trigger operation is received on the update control 305, the subtitle text of the second subtitle segment 303 is updated based on the first subtitle editing result, and the updated second subtitle segment 306 is displayed.

[0072] By displaying an update control, problems caused by accidental operations can be effectively reduced. At the same time, users can also set the trigger for update operations based on their own needs to meet personalized editing requirements.

[0073] In one optional implementation, to enhance the user's subtitle editing experience, a deletion operation can also be triggered on the second subtitle segment within the second subtitle segment group in the second area of ​​the subtitle editing page. Here, the second subtitle segment group refers to any subtitle segment group within the second area, and the second subtitle segment is any one of the second subtitle segments within that group.

[0074] Specifically, when a deletion operation is received for the second subtitle segment in the second subtitle segment group within the second area of ​​the subtitle editing area, the second subtitle segment is deleted from the second area. That is, the second subtitle segment is not displayed in the second subtitle segment group within the second area at this time.

[0075] Based on the aforementioned removal of the second subtitle segment, to meet the user's subtitle translation needs, a subtitle translation control can be displayed within the display area of ​​the second subtitle segment group. This subtitle translation control is used by the user to trigger a translation operation on the first subtitle segment in the second subtitle segment group. Specifically, when a trigger operation is received for the subtitle translation control, the subtitle text of the first subtitle segment in the second subtitle segment group is translated to generate a new second subtitle segment. Specifically, the subtitle text of the first subtitle segment in the second subtitle segment group can be translated using a translation tool; this disclosure does not limit the scope of the invention. The new second subtitle segment generated based on the translation of the first subtitle segment can use the same language as the translated second subtitle segment before deletion, but with a different expression.

[0076] like Figure 4 The diagram shows a subtitle editing page provided in an embodiment of this disclosure. The subtitle editing page displays a subtitle segment group 401, which includes a first subtitle segment and a second subtitle segment 402. When a deletion operation is received for the second subtitle segment 402, the second subtitle segment is cleared, and a subtitle translation control 403 is displayed in the display area of ​​the subtitle segment group 401. When a trigger operation is received for the subtitle translation control, a translation operation is performed based on the first subtitle segment included in the subtitle segment group 401 to generate a new second subtitle segment 404.

[0077] As can be seen, deleting the second subtitle segment does not affect the first subtitle segment. In addition, by displaying the subtitle translation control, users can directly trigger the translation operation in the subtitle editing interface without switching between multiple tools or interfaces, which greatly simplifies the operation process and improves editing efficiency.

[0078] In the video processing method provided in this embodiment, firstly, a subtitle editing page corresponding to a first video is displayed. This subtitle editing page includes a first area and a second area. The first area is used to play the first video, and the second area is used to display the subtitle content of the first video. The subtitle content includes multiple subtitle segment groups with timestamp information. Each subtitle segment group includes a first subtitle segment and a second subtitle segment, where the second subtitle segment is generated based on the first subtitle segment. Then, in response to an editing operation on the first subtitle segment in the first subtitle segment group within the second area, a first subtitle editing result corresponding to the editing operation is obtained, and the subtitle text of the second subtitle segment in the first subtitle segment group within the second area is updated based on the first subtitle editing result.

[0079] This embodiment of the disclosure displays a subtitle segment group consisting of a first subtitle segment and a second subtitle segment on the subtitle editing page. When the user performs an editing operation on the first subtitle segment, it supports updating the subtitle text of the second subtitle segment in the subtitle segment group based on the editing result of the first subtitle, which enriches the video subtitle editing method, thereby enriching the interactive methods related to video processing and improving the user's video processing experience.

[0080] In one optional implementation, to enhance the user's interactive experience in subtitle editing, a first trigger operation can be set for a third subtitle segment group within the second area of ​​the subtitle editing page. The third subtitle segment group can be any subtitle segment group within the second area of ​​the subtitle editing page, and the first trigger operation for this third subtitle segment group can include clicks, double-clicks, or other trigger operations on the third subtitle segment. Specifically, when a first trigger operation is received for a third subtitle segment group within the second area of ​​the subtitle editing page, the second area is controlled to display the third subtitle segment group, and simultaneously, the video segment corresponding to the third subtitle segment group in the first video is played in conjunction with the first area of ​​the subtitle editing page.

[0081] Among them, the video segment in the first video that corresponds to the third subtitle segment group can be determined based on the timestamp information in the third subtitle segment group.

[0082] By receiving the first trigger operation for the third subtitle segment group, it supports the linked playback of the video segment in the first video that corresponds to the third subtitle segment group. This allows users to quickly view the video segment that corresponds to the third subtitle segment group. In addition, by listening to the subtitle text of the third subtitle segment group, users can intuitively see the correspondence between the subtitles and the video content, promptly identify problems between the subtitles and the video, and improve the accuracy of subtitle editing.

[0083] Based on the above embodiments, a corresponding playback control can be set for the third subtitle segment group. This playback control is used to control whether to play the video segment in the first video corresponding to the third subtitle segment group. Specifically, when a trigger operation is received for the playback control of the third subtitle segment group, the third subtitle segment group is positioned and displayed in the second area of ​​the subtitle editing page, and the video segment in the first video corresponding to the third subtitle segment group is played in the first area. During the playback of the corresponding video segment, when a trigger operation is received for the playback control, the playback of the video content of that video segment is paused.

[0084] In one optional implementation, after the video segment corresponding to the third subtitle segment group in the first video is played in the first area of ​​the subtitle editing page, the video segment can be paused to facilitate subsequent operations on the third subtitle segment group by the user.

[0085] In another optional implementation, after the video segment corresponding to the third subtitle segment group in the first video is played in the first area of ​​the subtitle editing page, the video segment can continue to be played in a loop to allow users to listen to it multiple times and check the degree of matching between the video content of the video segment and the subtitle content of the subtitle segment group.

[0086] In another optional implementation, after the video segment corresponding to the third subtitle segment group in the first video finishes playing in the first area of ​​the aforementioned subtitle editing page, the next video can be determined from the first video based on the current position of the video segment, so as to realize the function of continuing playback in the first area. That is, playback is based on the video segment corresponding to the third subtitle segment.

[0087] In one optional implementation, during the display of the subtitle editing page corresponding to the first video, to facilitate user browsing of the subtitle segment groups included in the subtitle content of the first video, a second trigger operation can be set for the second area. This second trigger operation applies to the entire second area and can be a sliding operation targeting the second area.

[0088] Specifically, when a second trigger operation is received that acts on the second area of ​​the subtitle editing page, the system controls the scrolling display of multiple subtitle segments with timestamp information within that second area.

[0089] When the subtitle clips are scrolling, it is also necessary to determine the playback status of the first area of ​​the current subtitle editing page. Specifically, when a second trigger operation is received on the second area of ​​the subtitle editing page, the playback status of the first area of ​​the current subtitle editing page is determined. If the first video in the first area is paused, the multiple subtitle clips with timestamp information in the second area are scrolled, and the paused frame of the first video is displayed in the first area. That is, at this time, the image frames in the corresponding video clips are displayed in the first area without following the scrolling of the subtitle clips.

[0090] If the first video in the first area is in playback mode, while controlling the scrolling display of multiple subtitle segments with timestamp information in the second area, the first video continues to play in the first area based on the timeline information.

[0091] To display the subtitle editing page corresponding to the first video, this embodiment of the disclosure can receive a third trigger operation on the first video on the video editing page. This third trigger operation may include a subtitle generation operation or a subtitle editing operation. Specifically, a subtitle generation control or a subtitle editing control may be displayed on the video editing page to trigger the display of the subtitle editing page corresponding to the first video. The subtitle generation operation generates subtitles based on the first video and displays the generated subtitles on the subtitle editing page to demonstrate the subtitle display effect of the first video to the user. The subtitle editing operation triggers the display of the subtitle editing page to perform editing operations on the subtitle content of the first video on the subtitle editing page. Before triggering the subtitle editing operation, the first video has already generated corresponding subtitles. The video editing page is a display page used for performing various editing operations on the video.

[0092] In one optional implementation, when a subtitle generation operation is received for a first video on the video editing page, speech recognition is performed on the first video to generate subtitles, and the subtitle editing page corresponding to the first video is displayed. The video content of the first video is played in a first area of ​​the subtitle editing page, and the subtitle content of the first video is displayed in a second area of ​​the subtitle editing page. The subtitle content includes multiple subtitle segment groups with timestamp information, and each subtitle segment group includes a first subtitle segment and a second subtitle segment. The video editing page displays the video track of the first video.

[0093] Specifically, the first video frame is displayed in the first area of ​​the subtitle editing page. The video content of the first video can be automatically played in the first area of ​​the subtitle editing page based on the start playback time of the first video, and the first frame of the first video can also be displayed in the first area of ​​the subtitle editing page.

[0094] like Figure 5 The image shown is a schematic diagram of a video editing page provided in an embodiment of this disclosure. Figure 5 As can be seen in (a), the video editing page displays a first video and a subtitle generation control 501. When a trigger operation is received for the subtitle generation control 501, speech recognition is performed on the first video to generate a first subtitle segment and a second subtitle segment is generated based on the first subtitle segment. The subtitle editing page corresponding to the first video is displayed. The video frame 502 of the first video is displayed in the first area of ​​the subtitle editing page, and the subtitle content of the first video is displayed in the second area. The subtitle content includes multiple subtitle segment groups with timestamp information, including subtitle segment group 503, which includes the first subtitle segment and the second subtitle segment.

[0095] As can be seen, by triggering the subtitle generation operation on the video editing page, the subtitle editing page of the first video can be displayed directly after the subtitle of the first video is generated, which can show the user the overall effect of the subtitle and quickly realize the subtitle editing operation.

[0096] In another optional implementation, when a subtitle editing operation is received for the first video on the video editing page, the subtitle editing page corresponding to the first video is displayed. The video frame of the first video is displayed in a first area of ​​the subtitle editing page, and the subtitle content of the first video is displayed in a second area of ​​the subtitle editing page. The subtitle content includes multiple subtitle segment groups with timestamp information, and each subtitle segment group includes a first subtitle segment and a second subtitle segment. The video editing page displays the subtitle track and video track of the first video.

[0097] As mentioned above Figure 5 As shown in (b), the video editing page displays a first video. The third area of ​​the first video displays a first subtitle track and a second subtitle track, as well as a subtitle editing control 504. When a trigger operation is received for the subtitle editing control 504, the subtitle editing page corresponding to the first video is displayed based on the first subtitle segment on the first subtitle track and the second subtitle segment on the second subtitle track on the video editing page. The video frame 502 of the first video is displayed in the first area of ​​the subtitle editing page, and the subtitle content of the first video is displayed in the second area. The subtitle content includes multiple subtitle segment groups with timestamp information, including subtitle segment group 503, which includes the first subtitle segment and the second subtitle segment.

[0098] In one optional implementation, while the first subtitle track and the second subtitle track of the first video are displayed in the third area of ​​the video editing page, subtitle timing adjustments can also be performed based on a third subtitle segment within the third area of ​​the video editing page. The third subtitle segment is displayed on either the first or second subtitle track; that is, the third subtitle segment can be any one of the first or second subtitle segments. The third area is a pre-defined area on the video editing page. The subtitle timing adjustment operation for the third subtitle segment can include dragging, sliding, or other triggering operations on the corresponding track.

[0099] Specifically, when a subtitle timing adjustment operation is received for the third subtitle segment within the third area of ​​the video editing page, the subtitle timing of the third subtitle segment is adjusted based on the operation. After the timing adjustment of the third subtitle segment is completed, the adjusted third subtitle segment is displayed, and the adjustment result timing information corresponding to the subtitle timing adjustment is obtained. Based on the adjustment result timing information, the subtitle timing of the fourth subtitle segment corresponding to the third subtitle segment is adjusted, and the adjusted fourth subtitle segment is displayed. The fourth subtitle segment has a corresponding relationship with the third subtitle segment. Specifically, the fourth subtitle segment includes the first subtitle segment and / or the second subtitle segment belonging to the same subtitle segment group as the third subtitle segment. That is, if the third subtitle segment is the first subtitle segment, then the fourth subtitle segment is the second subtitle segment belonging to the same subtitle segment group as the first subtitle segment; if the third subtitle segment is the second subtitle segment, then the fourth subtitle segment is the first subtitle segment belonging to the same subtitle segment group as the second subtitle segment. The adjustment result timing information can be the display time range of the adjusted third subtitle segment.

[0100] like Figure 6 The diagram illustrates a video editing page according to an embodiment of this disclosure. The third area 601 of the video editing page displays a first subtitle track 602 and a second subtitle track 603. The first subtitle track 602 displays multiple first subtitle segments, including a first subtitle segment 604. The second subtitle track displays second subtitle segments corresponding to the first subtitle segments, including a second subtitle segment 605 corresponding to the first subtitle segment 604. When a subtitle timing adjustment operation is received for the first subtitle segment 604, the subtitle timing of the first subtitle segment is adjusted, and the adjusted first subtitle segment 606 is displayed. The adjustment result timing information corresponding to the subtitle timing adjustment is obtained, and based on the adjustment result timing information, the subtitle timing of the second subtitle segment 605 is adjusted, and the adjusted second subtitle segment 607 is displayed.

[0101] As can be seen, by obtaining the timing information of the subtitle timing adjustment and then adjusting the timing of the corresponding subtitle segments in a coordinated manner, manual adjustment of subtitle timing can be avoided, saving time, simplifying interactive operations, and improving editing efficiency. Furthermore, it can align subtitle segments within the same subtitle segment group on the timeline, enhancing the viewing experience.

[0102] Based on the above embodiments, while displaying the first subtitle track and the corresponding second subtitle track on the video editing page, a first subtitle hiding operation can also be set, which can hide the first subtitle track and the first subtitle segment on the first subtitle track on the video editing page, that is, the second subtitle segment is displayed separately in the video frame of the first video displayed on the video editing page.

[0103] Specifically, when a first subtitle hiding operation is received for the first video, the first subtitle track of the first video and the first subtitle segment on the first subtitle track are hidden on the video editing page. The hiding operation for the first video may include setting a first subtitle hiding control on a page; in one optional implementation, the first subtitle hiding control may be displayed on the video editing page.

[0104] As can be seen, by setting a first subtitle hiding operation for the first subtitle in this embodiment, the first video can be applied to different language scenarios, thereby improving the user's viewing experience.

[0105] Based on the above method embodiments, this disclosure also provides a video processing apparatus, with reference to... Figure 7 This is a schematic diagram of the structure of a video processing apparatus provided in an embodiment of the present disclosure. The apparatus includes:

[0106] The first display module 701 is used to display a subtitle editing page corresponding to the first video; wherein, the subtitle editing page includes a first area and a second area, the first area is used to play the first video, the second area is used to display the subtitle content of the first video, the subtitle content includes multiple subtitle segment groups with timestamp information, the subtitle segment group includes a first subtitle segment and a second subtitle segment, the second subtitle segment is generated based on the first subtitle segment;

[0107] The editing and updating module 702 is used to respond to an editing operation on a first subtitle segment in a first subtitle segment group in the second region, obtain a first subtitle editing result corresponding to the editing operation, and update the subtitle text of a second subtitle segment in the first subtitle segment group in the second region based on the first subtitle editing result.

[0108] In one optional implementation, the editing and updating module includes:

[0109] The first display submodule is configured to respond to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, obtain the first subtitle editing result corresponding to the editing operation, and display an update control within the display area of ​​the first subtitle segment group;

[0110] The subtitle update submodule is used to update the subtitle text of the second subtitle segment in the first subtitle segment group in the second area based on the first subtitle editing result in response to the trigger operation of the update control.

[0111] In one optional embodiment, the apparatus further includes:

[0112] The second display module is configured to, in response to a deletion operation on a second subtitle segment in a second subtitle segment group within the second area, delete the second subtitle segment from the second area and display a subtitle translation control within the display area of ​​the second subtitle segment group; wherein the subtitle translation control is configured to trigger a translation operation on a first subtitle segment in the second subtitle segment group.

[0113] In one optional embodiment, the apparatus further includes:

[0114] The linkage module is used to respond to a first trigger operation on the third subtitle segment group in the second area, to locate and display the third subtitle segment group in the second area, and to play the video segment in the first video corresponding to the third subtitle segment group in the first area.

[0115] In one optional implementation, a playback control is provided for the third subtitle segment group within the second area, and the linkage module is specifically used for:

[0116] In response to the triggering operation of the playback control for the third subtitle segment group, the third subtitle segment group is positioned and displayed in the second area, and the video segment in the first video corresponding to the third subtitle segment group is played in conjunction with it in the first area.

[0117] In one optional embodiment, the apparatus further includes:

[0118] A scrolling control module is used to control the scrolling display of the plurality of subtitle segments with timestamp information within the second area in response to a second trigger operation acting on the second area.

[0119] The display module is used to display paused frames of the first video in the first area, or to play the first video according to the timeline.

[0120] In one optional implementation, the first display module is specifically used for:

[0121] In response to a third trigger operation on a first video on a video editing page, a subtitle editing page corresponding to the first video is displayed, and the video frame of the first video is displayed in a first area of ​​the subtitle editing page, and the subtitle content of the first video is displayed in a second area of ​​the subtitle editing page; wherein, the third trigger operation includes a subtitle generation operation or a subtitle editing operation.

[0122] In one optional embodiment, the apparatus further includes:

[0123] The third display module is used to display the video editing page; wherein, the third area on the video editing page displays a first subtitle track and a second subtitle track, the first subtitle track is used to display a first subtitle segment, and the second subtitle track is used to display a second subtitle segment corresponding to the first subtitle segment;

[0124] The timing adjustment module is used to respond to a timing adjustment operation for a third subtitle segment in the third region, obtain timing information of the adjustment result corresponding to the timing adjustment operation, and adjust the timing of a fourth subtitle segment corresponding to the third subtitle segment based on the timing information of the adjustment result; wherein the third subtitle segment is displayed on the first subtitle track or the second subtitle track, and the fourth subtitle segment includes a first subtitle segment and / or a second subtitle segment belonging to the same subtitle segment group as the third subtitle segment.

[0125] In one optional embodiment, the apparatus further includes:

[0126] A subtitle hiding module is used to hide the first subtitle track and the first subtitle segment on the first subtitle track on the video editing page in response to a first subtitle hiding operation for the first video.

[0127] In the video processing apparatus provided in this embodiment, firstly, a subtitle editing page corresponding to a first video is displayed. This subtitle editing page includes a first area and a second area. The first area is used to play the first video, and the second area is used to display the subtitle content of the first video. The subtitle content includes multiple subtitle segment groups with timestamp information. Each subtitle segment group includes a first subtitle segment and a second subtitle segment, where the second subtitle segment is generated based on the first subtitle segment. Then, in response to an editing operation on the first subtitle segment in the first subtitle segment group within the second area, a first subtitle editing result corresponding to the editing operation is obtained, and the subtitle text of the second subtitle segment in the first subtitle segment group within the second area is updated based on the first subtitle editing result.

[0128] This embodiment of the disclosure displays a subtitle segment group consisting of a first subtitle segment and a second subtitle segment on the subtitle editing page. When the user performs an editing operation on the first subtitle segment, it supports updating the subtitle text of the second subtitle segment in the subtitle segment group based on the editing result of the first subtitle, which enriches the video subtitle editing method, thereby enriching the interactive methods related to video processing and improving the user's video processing experience.

[0129] In addition to the methods and apparatus described above, this disclosure also provides a computer-readable storage medium storing instructions that, when executed on a terminal device, cause the terminal device to implement the video processing method described in this disclosure.

[0130] This disclosure also provides a computer program product, which includes a computer program / instructions that, when executed by a processor, implement the video processing method described in this disclosure.

[0131] In addition, this disclosure also provides a video processing device, see [link to relevant documentation]. Figure 8 As shown, it may include:

[0132] The video processing device includes a processor 801, a memory 802, an input device 803, and an output device 804. The number of processors 801 in the video processing device can be one or more. Figure 8 Taking a processor as an example. In some embodiments of this disclosure, the processor 801, memory 802, input device 803, and output device 804 can be connected via a bus or other means, wherein, Figure 8 Taking the example of a connection between China and Israel via a bus.

[0133] The memory 802 can be used to store software programs and modules. The processor 801 executes various functional applications and data processing of the video processing device by running the software programs and modules stored in the memory 802. The memory 802 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function, etc. In addition, the memory 802 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. The input device 803 can be used to receive input digital or character information, and to generate signal inputs related to user settings and function control of the video processing device.

[0134] Specifically in this embodiment, the processor 801 will load the executable files corresponding to the processes of one or more applications into the memory 802 according to the following instructions, and the processor 801 will run the applications stored in the memory 802 to realize the various functions of the video processing device described above.

[0135] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0136] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A video processing method, characterized in that, The method includes: The subtitle editing page corresponding to the first video is displayed; wherein, the subtitle editing page includes a first area and a second area, the first area is used to play the first video, and the second area is used to display the subtitle content of the first video, the subtitle content includes multiple subtitle segment groups with timestamp information, the subtitle segment group includes a first subtitle segment and a second subtitle segment, the second subtitle segment is generated based on the first subtitle segment; In response to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, the system obtains a first subtitle editing result corresponding to the editing operation, and updates the subtitle text of a second subtitle segment in the first subtitle segment group within the second region based on the first subtitle editing result.

2. The method according to claim 1, characterized in that, The step of responding to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, obtaining a first subtitle editing result corresponding to the editing operation, and updating the subtitle text of a second subtitle segment in the first subtitle segment group within the second region based on the first subtitle editing result includes: In response to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, the first subtitle editing result corresponding to the editing operation is obtained, and an update control is displayed in the display area of ​​the first subtitle segment group; In response to a trigger operation on the update control, the subtitle text of the second subtitle segment in the first subtitle segment group within the second area is updated based on the first subtitle editing result.

3. The method according to claim 1, characterized in that, The method further includes: In response to a deletion operation on a second subtitle segment in a second subtitle segment group within the second region, the second subtitle segment is deleted from the second region, and a subtitle translation control is displayed in the display area of ​​the second subtitle segment group; wherein the subtitle translation control is used to trigger a translation operation on a first subtitle segment in the second subtitle segment group.

4. The method according to claim 1, characterized in that, The method further includes: In response to a first trigger operation targeting a third subtitle segment group in the second area, the third subtitle segment group is positioned and displayed in the second area, and a video segment in the first video corresponding to the third subtitle segment group is played in conjunction with it in the first area.

5. The method according to claim 4, characterized in that, The third subtitle segment group in the second area is provided with a playback control. The step of responding to a first trigger operation on the third subtitle segment group in the second area, positioning and displaying the third subtitle segment group in the second area, and simultaneously playing the video segment in the first video corresponding to the third subtitle segment group in the first area, includes: In response to the triggering operation of the playback control for the third subtitle segment group, the third subtitle segment group is positioned and displayed in the second area, and the video segment in the first video corresponding to the third subtitle segment group is played in conjunction with it in the first area.

6. The method according to claim 1, characterized in that, The method further includes: In response to a second triggering operation acting on the second region, control the scrolling display of the plurality of subtitle segments with timestamp information within the second region; In addition, displaying paused frames of the first video within the first area, or playing the first video according to timeline information.

7. The method according to claim 1, characterized in that, The subtitle editing page corresponding to the first video includes: In response to a third trigger operation on a first video on a video editing page, a subtitle editing page corresponding to the first video is displayed, and the video frame of the first video is displayed in a first area of ​​the subtitle editing page, and the subtitle content of the first video is displayed in a second area of ​​the subtitle editing page; wherein, the third trigger operation includes a subtitle generation operation or a subtitle editing operation.

8. The method according to claim 7, characterized in that, The method further includes: The video editing page is displayed; wherein, a first subtitle track and a second subtitle track are displayed in the third area of ​​the video editing page, the first subtitle track is used to display a first subtitle segment, and the second subtitle track is used to display a second subtitle segment corresponding to the first subtitle segment; In response to a subtitle timing adjustment operation for a third subtitle segment within the third region, the system obtains the timing information of the adjustment result corresponding to the subtitle timing adjustment operation, and adjusts the timing of a fourth subtitle segment corresponding to the third subtitle segment based on the timing information of the adjustment result; wherein the third subtitle segment is displayed on the first subtitle track or the second subtitle track, and the fourth subtitle segment includes a first subtitle segment and / or a second subtitle segment belonging to the same subtitle segment group as the third subtitle segment.

9. The method according to claim 8, characterized in that, The method further includes: In response to a first subtitle hiding operation for the first video, the first subtitle track and the first subtitle segment on the first subtitle track are hidden on the video editing page.

10. A video processing apparatus, characterized in that, The device includes: The first display module is used to display the subtitle editing page corresponding to the first video; wherein, the subtitle editing page includes a first area and a second area, the first area is used to play the first video, the second area is used to display the subtitle content of the first video, the subtitle content includes multiple subtitle segment groups with timestamp information, the subtitle segment group includes a first subtitle segment and a second subtitle segment, the second subtitle segment is generated based on the first subtitle segment; The editing and updating module is used to respond to an editing operation on a first subtitle segment in a first subtitle segment group within the second region, obtain a first subtitle editing result corresponding to the editing operation, and update the subtitle text of a second subtitle segment in the first subtitle segment group within the second region based on the first subtitle editing result.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a terminal device, cause the terminal device to perform the method as described in any one of claims 1-9.

12. A video processing device, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the method as claimed in any one of claims 1-9.

13. A computer program product, characterized in that, The computer program product includes a computer program / instruction that, when executed by a processor, implements the method as described in any one of claims 1-9.

Images