Cooperative video processing method and apparatus, electronic device, and storage medium

CN113099130BActive Publication Date: 2026-10-09DOUYIN VISION CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202110407804.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-04-15
Publication Date
2026-10-09
Estimated Expiration
2041-04-15

AI Technical Summary

Technical Problem

[0005]本公开实施例提供一种协同视频处理方法、装置、电子设备及存储介质,以克服无法及时对视频处理过程中出现的问题进行协调,影响视频导播的效率和视频导播质量的问题

Benefits of technology

[0023]本实施例提供的协同视频处理方法、装置、电子设备及存储介质,通过响应于第一编辑指令,将显示于所述第一终端设备上的待处理视频进行编辑,得到第一编辑日志,其中,所述第一编辑日志用于指示基于所述第一编辑指令对所述待处理视频进行编辑的编辑内容和/或编辑过程;将所述第一编辑日志发送至第二终端设备,其中,所述第一编辑日志用于所述第二终端设备在所述待处理视频上显示所述第一编辑日志对应的编辑内容的问题。由于第一终端设备在响应第一编辑指令对待处理视频进行编辑的同时,将对应生成的第一编辑日志发送给了第二终端设备,使第二终端设备能够通过该第一编辑日志,在第二终端设备上的待处理视频上,复现第一编辑指令对应的编辑内容,使第二终端设备一侧的用户能够实时的了解第一终端设备一侧的用户对待处理视频的所做的编辑,从而对待处理视频进行相应的编辑,实现对待处理视频的协同处理,提高导播视频的制作效率,提高导播视频质量。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113099130B_ABST
    Figure CN113099130B_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure provide a collaborative video processing method and device, electronic equipment and storage medium. The method comprises: editing a to-be-processed video displayed on a first terminal device in response to a first editing instruction to obtain a first editing log, wherein the first editing log is used to indicate editing content and / or an editing process of the to-be-processed video based on the first editing instruction; and sending the first editing log to a second terminal device, wherein the first editing log is used by the second terminal device to display a question of the editing content corresponding to the first editing log on the to-be-processed video. Since the first terminal device sends the first editing log corresponding to the editing content of the first editing instruction to the second terminal device while editing the to-be-processed video in response to the first editing instruction, the second terminal device can reproduce the editing content corresponding to the first editing instruction, implement collaborative processing of the to-be-processed video, improve the production efficiency of the director video, and improve the quality of the director video.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of computer and network communication technology, and in particular to a collaborative video processing method, apparatus, electronic device, and storage medium. Background Technology

[0002] For large-scale live broadcast programs, program directors and other staff need to use the broadcasting platform to arrange the program content and effects in order to achieve better program effects and meet the viewing needs of the audience.

[0003] Currently, cloud-based video production platforms can perform audio and video processing on recorded video content, such as adding video effects and arranging video content. After processing, the processed video can be distributed and pushed to video platforms for playback, thereby improving the video's performance.

[0004] However, in actual broadcasting, different stages of video processing are usually carried out by multiple staff members. Due to the mutual influence between different stages, they can only be carried out in a fixed order, making it impossible to coordinate problems that arise during video processing in a timely manner, which affects the efficiency and quality of video broadcasting. Summary of the Invention

[0005] This disclosure provides a collaborative video processing method, apparatus, electronic device, and storage medium to overcome the problem of being unable to coordinate problems that arise during video processing in a timely manner, thus affecting the efficiency and quality of video broadcasting.

[0006] In a first aspect, embodiments of this disclosure provide a collaborative video processing method applied to a first terminal device, wherein both the first terminal device and a second terminal device display a video to be processed, the method comprising:

[0007] In response to a first editing instruction, the video to be processed displayed on the first terminal device is edited to obtain a first editing log, wherein the first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction; the first editing log is sent to a second terminal device, wherein the first editing log is used by the second terminal device to display the editing content corresponding to the first editing log on the video to be processed.

[0008] Secondly, embodiments of this disclosure provide a collaborative video processing method applied to a second terminal device, wherein both the first terminal device and the second terminal device display videos to be processed, the method comprising:

[0009] The system receives a first editing log, which indicates the editing content and / or editing process of editing the video to be processed based on the first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to. The system displays the editing content corresponding to the first editing log on the video to be processed according to the first editing log.

[0010] Thirdly, embodiments of this disclosure provide a collaborative video processing method applied to a server. The method includes: receiving a first editing log sent by a first terminal device, the first editing log being used to indicate editing content and / or editing process of editing the video to be processed based on a first editing instruction, wherein the first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to; and sending the first editing log to a second terminal device so that the second terminal device displays the editing content corresponding to the first editing log on the video to be processed.

[0011] Fourthly, embodiments of this disclosure provide a collaborative video processing apparatus applied to a first terminal device, wherein both the first terminal device and a second terminal device display video to be processed, the apparatus comprising:

[0012] The display module is configured to, in response to a first editing instruction, edit the video to be processed displayed on the first terminal device to obtain a first editing log, wherein the first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction;

[0013] The transceiver module is used to send the first editing log to the second terminal device, wherein the first editing log is used by the second terminal device to display the editing content corresponding to the first editing log on the video to be processed.

[0014] Fifthly, embodiments of this disclosure provide a collaborative video processing apparatus applied to a second terminal device, wherein both the first terminal device and the second terminal device display video to be processed, and the apparatus includes:

[0015] The transceiver module is used to receive a first editing log, which is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to.

[0016] The display module is used to display the edited content corresponding to the first edit log on the video to be processed, based on the first edit log.

[0017] Sixthly, embodiments of this disclosure provide a collaborative video processing apparatus applied to a server, the apparatus comprising:

[0018] The receiving module is configured to receive a first editing log sent by a first terminal device. The first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to.

[0019] The sending module is used to send the first editing log to the second terminal device, so that the second terminal device displays the editing content corresponding to the first editing log on the video to be processed.

[0020] In a seventh aspect, embodiments of this disclosure provide an electronic device, comprising: at least one processor and a memory; the memory storing computer-executable instructions; the at least one processor executing the computer-executable instructions stored in the memory, causing the at least one processor to perform the collaborative video processing method as described in the first aspect and various possible designs of the first aspect, or causing the at least one processor to perform the collaborative video processing method as described in the second aspect and various possible designs of the second aspect, or causing the at least one processor to perform the collaborative video processing method as described in the third aspect and various possible designs of the third aspect.

[0021] Eighthly, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions. When a processor executes the computer-executable instructions, it implements the collaborative video processing method described in the first aspect and various possible designs of the first aspect, or implements the collaborative video processing method described in the second aspect and various possible designs of the second aspect, or implements the collaborative video processing method described in the third aspect and various possible designs of the third aspect.

[0022] Ninthly, embodiments of this disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the collaborative video processing method described in the first aspect and various possible designs of the first aspect, or implements the collaborative video processing method described in the second aspect and various possible designs of the second aspect, or implements the collaborative video processing method described in the third aspect and various possible designs of the third aspect.

[0023] The collaborative video processing method, apparatus, electronic device, and storage medium provided in this embodiment, in response to a first editing instruction, edit the video to be processed displayed on the first terminal device to obtain a first editing log. The first editing log indicates the editing content and / or editing process of editing the video to be processed based on the first editing instruction. The first editing log is then sent to a second terminal device, whereby the second terminal device displays the corresponding editing content on the video to be processed. Because the first terminal device sends the corresponding first editing log to the second terminal device while editing the video to be processed in response to the first editing instruction, the second terminal device can reproduce the editing content corresponding to the first editing instruction on the video to be processed on its own screen using the first editing log. This allows users on the second terminal device to understand in real time the edits made by users on the first terminal device, enabling them to edit the video to be processed accordingly, achieving collaborative processing of the video to be processed, improving the production efficiency and quality of the broadcast video. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 This is a schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0026] Figure 2 This is a schematic diagram of a process for processing broadcast video in the prior art;

[0027] Figure 3 Flowchart of the collaborative video processing method provided in the embodiments of this disclosure Figure 1 ;

[0028] Figure 4 A schematic diagram illustrating the interaction process between a first terminal device and a second terminal device provided in an embodiment of this disclosure;

[0029] Figure 5 Flowchart of the collaborative video processing method provided in the embodiments of this disclosure Figure 2 ;

[0030] Figure 6 Flowchart of the collaborative video processing method provided in the embodiments of this disclosure Figure 3 ;

[0031] Figure 7 A schematic diagram illustrating the interaction process between a first terminal device and a second terminal device, provided in an embodiment of this disclosure;

[0032] Figure 8 for Figure 6 A flowchart illustrating step S305 in the illustrated embodiment;

[0033] Figure 9 Signaling diagram of a collaborative video processing method provided in this embodiment of the present disclosure;

[0034] Figure 10 Flowchart of the collaborative video processing method provided in the embodiments of this disclosure Figure 4 ;

[0035] Figure 11 Signaling diagram of another collaborative video processing method provided in this disclosure embodiment;

[0036] Figure 12 A structural block diagram of a collaborative video processing device provided in this disclosure embodiment;

[0037] Figure 13 A structural block diagram of another collaborative video processing apparatus provided in this disclosure embodiment;

[0038] Figure 14 A structural block diagram of another collaborative video processing apparatus provided in the embodiments of this disclosure;

[0039] Figure 15 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure;

[0040] Figure 16 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0041] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0042] Figure 1 This is a schematic diagram of an application scenario provided by an embodiment of the present disclosure, with reference to... Figure 1 The collaborative video processing method provided in this disclosure can be applied in video directing application scenarios, specifically, such as... Figure 1As shown, in this application scenario, the camera unit is used to collect video data and send it to the cloud server. The director user communicates with the cloud server through a terminal device with the cloud director platform client installed, obtains the video data, and edits and processes the video data, such as adjusting video combination editing, adding video effects, etc. Finally, the edited output video is distributed to the live streaming platform for live streaming, so that users of the live streaming platform can watch the output video by accessing the live streaming platform.

[0043] Figure 2 This is a schematic diagram of a process for processing broadcast video in existing technology. In actual broadcast production, different stages of video processing are usually performed by multiple staff members. Due to the mutual influence between different stages, they can only be carried out in a fixed order, such as... Figure 2 As shown, after the video to be processed enters the video processing stage, it is edited sequentially by director user A, director user B, and director user C before the final output video is generated. However, if the modifications made by director user C require the cooperation of director user A and need to be rolled back for modification, the video can only be returned to director user A and processed and confirmed again sequentially by director user A, director user B, and director user C. Because the problems that occur during the video processing cannot be handled collaboratively in a timely manner, it leads to problems affecting the efficiency and quality of video directing.

[0044] Figure 3 Flowchart of the collaborative video processing method provided in the embodiments of this disclosure Figure 1 For example, the method of this embodiment can be applied to a first terminal device, where the first terminal device and a second terminal device are communicatively connected. Both the first terminal device and the second terminal device display a video to be processed. The first terminal device and the second terminal device are, for example, personal computers. The collaborative video processing method includes:

[0045] S101: In response to the first editing instruction, the video to be processed displayed on the first terminal device is edited to obtain a first editing log, wherein the first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction.

[0046] For example, the first editing instruction is an instruction from the director user on the first terminal device side to edit the video to be processed. More specifically, for example, adding special effects to the video to be processed. After receiving the first editing instruction, the first terminal device responds to it, performs corresponding edits on the video to be processed, and displays the content through the interactive interface. This process is a conventional process of the terminal device responding to user operations, editing and displaying the video to be processed, and will not be described in detail here. At the same time, a first editing log is generated for the editing content and / or editing process of the video to be processed by the first editing instruction. For example, the first editing log includes the trigger time of the first editing instruction, the identifier of the first terminal device, and specific information related to the editing content such as the editing location and editing type, and / or the operation information for editing the video to be processed, which will not be described in detail here. Based on the first editing log, the editing process and editing result of the video to be processed by the first editing instruction can be reproduced.

[0047] S102: Send the first editing log to the second terminal device, wherein the first editing log is used by the second terminal device to display the editing content corresponding to the first editing log on the video to be processed.

[0048] For example, there are several ways to send the first editing log to the second terminal device. For instance, the first and second terminal devices can be directly connected via a local area network (LAN). The first and second terminal devices exchange data within the same LAN using their respective internally installed software clients, thus sending the first editing log to the second terminal device. Another example is that the first and second terminal devices can connect to a server within a cloud server using their respective internally installed software clients. The first terminal device sends the first editing log to the cloud server, which then forwards it to the second terminal device. This process will not be elaborated upon here.

[0049] Furthermore, since the first editing log sent by the first terminal device indicates the editing content of the video to be processed based on the first editing instruction, the second terminal device, upon receiving the first editing log, can reproduce the editing process and results of the video to be processed according to the first editing instruction. More specifically, for example, the first editing log may include specific operation information and parameters corresponding to the first editing instruction, such as the location and type of effects to be added to the video to be processed. Thus, after receiving the first editing log, the second terminal device can display the editing results corresponding to the first editing log on the video to be processed on the second terminal device. Alternatively, the first editing log may include the editing content after editing the video to be processed based on the first editing instruction, descriptions of newly added or modified video elements, etc. Thus, after receiving the first editing log, the second terminal device can display the editing results corresponding to the first editing log on the video to be processed on the second terminal device, thereby achieving the goal of synchronizing the video processing process on the first terminal device to the second terminal device in real time.

[0050] Figure 4 This is a schematic diagram illustrating the interaction process between a first terminal device and a second terminal device, as provided in an embodiment of this disclosure. Figure 4 As shown, after the first terminal device responds to the first editing command, it displays the edited content of the video to be processed on the first terminal device through the first interactive interface, such as adding an "advertisement" to the video to be processed. At the same time, the corresponding first editing log is sent to the second terminal device. After receiving the first editing log, the second terminal device displays the edited content corresponding to the first editing log on the second terminal device through the second interactive interface. This allows the director user on the second terminal device to observe the director user on the first terminal device editing the video to be processed while simultaneously editing the video to be processed, realizing the collaborative processing of the video to be processed by the first and second terminal devices and improving the efficiency of video generation.

[0051] Figure 5 Flowchart of the collaborative video processing method provided in the embodiments of this disclosure Figure 2 For example, the method of this embodiment can be applied to a second terminal device. The first terminal device and the second terminal device are communicatively connected, and both the first terminal device and the second terminal device display a video to be processed. The first terminal device and the second terminal device are, for example, personal computers. The collaborative video processing method includes:

[0052] S201: Receive a first editing log, the first editing log being used to indicate the editing content of the video to be processed based on a first editing instruction, the first editing instruction being used to edit the video to be processed displayed on the first terminal device when responded to.

[0053] S202: Based on the first editing log, display the editing content corresponding to the first editing log on the video to be processed.

[0054] For example, the first editing log sent by the first terminal device indicates the editing content of the video to be processed based on the first editing instruction. After receiving the first editing log, the second terminal device can reproduce the editing process and editing result of the video to be processed by the first editing instruction according to the first editing log. More specifically, the first editing log can enable the second terminal device to display the editing process and editing result corresponding to the first editing log on the video to be processed on the second terminal device, thereby achieving the purpose of synchronizing the video processing process on the first terminal device to the second terminal device in real time.

[0055] The specific implementation method of the second terminal device side in this embodiment is as follows: Figure 3 The embodiments shown have already been described and will not be repeated here.

[0056] In this embodiment, while the first terminal device is editing the video to be processed in response to the first editing instruction, it sends the corresponding first editing log to the second terminal device. This allows the second terminal device to reproduce the editing content corresponding to the first editing instruction on the video to be processed on the second terminal device through the first editing log. This enables the user on the second terminal device to understand in real time the editing made by the user on the first terminal device on the video to be processed, thereby enabling the user to edit the video to be processed accordingly. This achieves collaborative processing of the video to be processed, improves the production efficiency of the broadcast video, and enhances the quality of the broadcast video.

[0057] Figure 6 Flowchart of the collaborative video processing method provided in the embodiments of this disclosure Figure 3 The method provided in this embodiment is Figure 3 Based on the illustrated embodiment, the steps of receiving a second editing instruction and sending a lock request and conflict detection are added, such as... Figure 6 As shown, the collaborative video processing method provided in this embodiment includes:

[0058] S301: In response to the first editing instruction, the video to be processed displayed on the first terminal device is edited to obtain a first editing log, wherein the first editing log is used to indicate the editing content of the video to be processed based on the first editing instruction.

[0059] In one possible implementation, the first editing instruction includes annotation information, which is used to instruct the addition of annotation information to the video to be processed, wherein the annotation information includes annotation text and / or annotation identifier.

[0060] Specifically, for example, through the first editing instruction, a certain video element in the video to be processed is indicated by an annotation mark and explained by the annotation text. Figure 7 This is a schematic diagram of annotation information provided in an embodiment of the present disclosure, such as... Figure 7 As shown, the annotation information includes annotation text and annotation identifiers. Using the annotation information in the first editing instruction, the director on the first terminal device marks the "billboard" in the video to be processed and annotates it with "billboard blurred". By sending the first editing log generated by the first editing instruction containing this annotation information to the second terminal device, the annotation information can also be reproduced in the video to be processed displayed on the second terminal device. This allows the director on the second terminal device to receive the modification intentions of the director on the first terminal device, thereby achieving real-time collaborative processing of the video to be processed, improving the efficiency of video processing, and reducing repeated modifications.

[0061] In one possible implementation, the annotation information also includes a cursor. By moving the cursor, more real-time communication between different terminal devices can be achieved. The implementation method is similar to that of annotation labels and annotation text, and will not be elaborated here.

[0062] S302: Send a collaboration request message to the server to establish a collaboration connection with at least one second terminal device, wherein the collaboration request message is used by the first terminal device to establish a collaboration connection with at least one second terminal device through the server.

[0063] S303: Send the first edit log to the second terminal device with the established collaborative connection via the server.

[0064] For example, before the collaborative processing begins, the first terminal device needs to initiate a request to the server, informing the server which terminal devices it needs to establish collaborative processing with, i.e., establishing a collaborative connection with at least one second terminal device.

[0065] The collaboration request information includes identification information for a first terminal device and identification information for a second terminal device. The identification information of the first terminal device is used by the server to determine whether to respond to the collaboration request. More specifically, the server stores permission identification information, which is used to determine the permission of each terminal device to establish a collaborative connection, i.e., whether it is qualified to initiate a collaborative connection request, based on the identification information of each terminal device. After receiving the collaboration request information, the server determines whether the first terminal device has permission to initiate a collaborative connection based on its identification information. If it determines that the first terminal device has permission, then based on the identification of at least one second terminal device in the collaboration request information, the server enables the first terminal device to establish a collaborative connection with at least one second terminal device, thereby proceeding with subsequent collaborative processing. In this embodiment, authenticating the first terminal device based on the collaboration request information improves the security of subsequent collaborative processing.

[0066] S304: Receive the second editing log, which indicates the editing content of the video to be processed based on the second editing instruction. The second editing instruction is used to edit the video to be processed displayed on the second terminal device when responded to.

[0067] S305: Based on the second editing log, display the editing content corresponding to the second editing log on the video to be processed.

[0068] For example, the second editing log is similar in content to the first editing log, both being information used to characterize the edited content of the video to be processed. Specifically, the second editing log characterizes the edited content of the video to be processed when the second editing command is responded to on the second terminal device. Based on the second editing log, the first terminal device can reproduce and display the edited content corresponding to the second editing command. This allows the director on the first terminal device to know in real time the edits made to the video to be processed by the director on the second terminal device, thereby achieving collaborative processing between multiple devices.

[0069] Figure 7 This is a schematic diagram illustrating the interaction process between another first terminal device and a second terminal device provided in an embodiment of this disclosure, such as... Figure 7As shown, after the first terminal device responds to the first editing command, it displays the edited content of the video to be processed on the first terminal device through the first interactive interface, such as adding an "advertisement" to the video to be processed; and sends the corresponding first editing log to the second terminal device. At the same time, the first terminal device also receives the second editing log sent by the second terminal device, and displays the edited content of the video to be processed corresponding to the second editing log on the interactive interface of the first terminal device, such as adding an "effect" to the video to be processed. This allows the first terminal user to observe the director's editing of the video to be processed on the second terminal device while simultaneously editing the video to be processed, realizing bidirectional collaborative processing of the video to be processed by the first and second terminal devices and improving the efficiency of video generation.

[0070] Optionally, such as Figure 8 As shown, step S305 includes two specific implementation steps: S3051 and S3052.

[0071] S3051: Based on the second editing log, edit the video to be processed to generate an edited video, wherein the video parameters of the edited video are changed compared to the video to be processed, and / or, at least one video element is added to the edited video compared to the video to be processed.

[0072] S3052: Displays the edited video.

[0073] For example, the process of editing the video to be processed according to the second editing log includes changing the video parameters of the video to be processed, such as changing the size and dimensions of the video to be processed. If there are multiple videos to be processed, the video parameters of the videos to be processed also include information such as the positional relationship and playback order of the videos to be processed. In addition, the process of editing the video to be processed according to the second editing log also includes adding video elements to the video to be processed. Video elements are such as text, special effects, videos, and images. Here, the edited video can be a video obtained by editing the video to be processed in any way involved in the prior art. The specific content of the edited video is not limited here, nor are examples provided.

[0074] It should be noted that since the content involved in the first editing log and the second editing log is similar, both being the process and result of editing the video to be processed, the process by which the second terminal device edits the video to be processed according to the first editing log and generates the edited video is similar to the process in the above embodiment, and will not be repeated here.

[0075] Optionally, after or before step S305, the method further includes:

[0076] S306: Send a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and the first editing log and / or the second editing log corresponding to the edited video are determined as input logs, and the input logs are used to generate the output video.

[0077] Further, optionally, after the first terminal device sends a collaboration request to the server, and the server authenticates the first terminal device based on its identifier, the first terminal device can also send a video lock request to ultimately determine the editing content of the video to be processed. This video lock request can be sent by the first terminal device to the server, which then locks the edited video, preventing either the first or second terminal device from modifying it via synchronized editing logs. The last received second editing log and / or first editing log are used as input logs to generate the final output video. More specifically, for example, if only the first terminal device edits the video, the first editing log sent by the first terminal device is used as input logs to generate the output video, which includes only the editing content corresponding to the first editing log. If both the first terminal device and at least one second terminal device edit the video, the first editing log sent by the first terminal device and the corresponding second editing log sent by at least one second terminal device are used as input logs to generate the output video, which includes the editing content corresponding to the first editing log and the editing content corresponding to at least one second editing log.

[0078] In this embodiment, the first terminal device acts as the decision-maker in the entire video collaborative processing process, determining the final edited content of the video to be processed. Once the first terminal device determines that the editing process of the video to be processed by each terminal device has ended, it generates the final output video by sending a video lock request, which is then distributed by the server to the live streaming platform for playback. This improves management efficiency in the collaborative processing process. The identity and permissions of the first terminal device as the decision-maker are determined by the server based on the identification information of the first terminal device.

[0079] Optionally, it also includes:

[0080] S307: Based on the second editing log, perform conflict detection on the first editing instruction. If the editing content corresponding to the first editing instruction conflicts with the editing content corresponding to the second editing log, output a prompt message.

[0081] For example, after the first terminal device obtains the second editing log, it will display the corresponding editing content on the video to be processed. Subsequently, if the first terminal device needs to continue responding to the first editing instruction input by the director user and continue editing the video to be processed, the first terminal device will first check the first editing instruction received later according to the second editing log to confirm whether there is an editing content conflict. For example, the editing content represented by the second editing log includes deleting video element A in the video to be processed. If the first terminal device includes modifying the attributes of video element A in the subsequent first editing instruction, there is an editing content conflict since video element A has been deleted. Similarly, editing content conflicts also include: positional conflicts and size conflicts between the video element added by the first terminal device and the video element added by the second terminal device, etc., which will not be elaborated here.

[0082] In this embodiment, by using the second editing log to perform conflict detection on the first editing command, real-time conflict detection can be achieved for collaborative processing between multiple terminal devices, avoiding editing conflicts from affecting the editing quality and effect of the broadcast video, and improving the efficiency of collaborative video editing.

[0083] Figure 9 A signaling diagram for a collaborative video processing method provided in this disclosure embodiment, such as... Figure 9 As shown, the collaborative video processing method provided in this embodiment includes:

[0084] S401: In response to the first editing instruction, the first terminal device edits the video to be processed displayed on the first terminal device to obtain a first editing log, wherein the first editing log is used to indicate the editing content of the video to be processed based on the first editing instruction.

[0085] Optionally, the first editing instruction includes annotation information, which is used to instruct the addition of annotation information to the video to be processed, wherein the annotation information includes annotation text and / or annotation identifier.

[0086] S402: The first terminal device sends the first edit log to the second terminal device.

[0087] S403: The second terminal device receives the first edit log.

[0088] S404: The second terminal device displays the edited content corresponding to the first edit log on the video to be processed, based on the first edit log.

[0089] Optionally, based on the first editing log, the edited content corresponding to the first editing log is displayed on the video to be processed, including:

[0090] Based on the first editing log, the video to be processed is edited to generate an edited video, wherein the video parameters of the edited video are changed compared to the video to be processed, and / or at least one video element is added to the edited video compared to the video to be processed; the edited video is then displayed.

[0091] S405: In response to the second editing instruction, the second terminal device edits the video to be processed displayed on the second terminal device to obtain a second editing log, wherein the second editing log is used to indicate the editing content of the video to be processed based on the second editing instruction.

[0092] Optionally, after step S405, the following may also be included:

[0093] S406: The second terminal device sends a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and the first editing log and / or the second editing log corresponding to the edited video are determined as input logs, and the input logs are used to generate the output video.

[0094] Optionally, after step S405, the following may also be included:

[0095] S407: The second terminal device performs conflict detection on the second editing instruction based on the first editing log. If the editing content corresponding to the second editing instruction conflicts with the editing content corresponding to the first editing log, a prompt message is output.

[0096] Steps S406 and S407 can be executed sequentially or individually, and there is no restriction on the execution order of steps S406 and S407.

[0097] S408: The second terminal device sends the second edit log to the first terminal device.

[0098] S409: The first terminal device receives the second edit log.

[0099] S410: The first terminal device displays the edited content corresponding to the second editing log on the video to be processed, based on the second editing log.

[0100] In this embodiment, the process of the second terminal device receiving the first editing log, displaying the edited content of the first editing log, triggering the second editing instruction, and sending the second editing log is similar to the process and effect of the first terminal device receiving the second editing log, displaying the edited content of the second editing log, triggering the first editing instruction, and sending the first editing log. It can be referred to the description in the above embodiment, and will not be repeated here.

[0101] In this embodiment, the first terminal device and the second terminal device generate corresponding first and second editing logs by responding to the corresponding first and second editing instructions, and send these first and second editing logs to each other. This allows both the first and second terminal devices to receive the editing logs sent by the other, thereby displaying the edits made to the video to be processed by the other on their respective interactive interfaces, thus achieving the purpose of collaborative processing. It should be noted that the first terminal device and / or the second terminal device can each include one or more terminal devices, and their implementation principles and processes are consistent with those described in the above embodiments, and will not be repeated here.

[0102] Figure 10 Flowchart of the collaborative video processing method provided in the embodiments of this disclosure Figure 4 For example, the method of this embodiment can be applied to a server, which is communicatively connected to a first terminal device and a second terminal device, such as... Figure 10 As shown, the collaborative video processing method provided in this embodiment includes:

[0103] S501: Receive a first editing log sent by the first terminal device. The first editing log is used to indicate the editing content of the video to be processed based on the first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to.

[0104] S502: Send the first editing log to the second terminal device so that the second terminal device displays the editing content corresponding to the first editing log on the video to be processed.

[0105] For example, the server is communicatively connected to the first terminal device and the second terminal device respectively. After receiving the first editing log sent by the first terminal device, the server forwards the first editing log to the second terminal device in real time. At the same time, after receiving the second editing log sent by the second terminal device, the server forwards the second editing log to the first terminal device in real time, thereby realizing real-time synchronization of editing content among multiple terminal devices. Data exchange between the server and the client can be achieved through a client-server mode, and this process will not be described in detail here.

[0106] Optionally, the method provided in this embodiment further includes:

[0107] Save the first edit log sent by the first terminal device and / or the second edit log sent by the second terminal device as historical data; receive a historical data request instruction sent by the first terminal device or the second terminal device; respond to the historical data request instruction sent by the first terminal device and send the historical data to the first terminal device, or respond to the historical data request instruction sent by the second terminal device and send the historical data to the second terminal device.

[0108] In this embodiment, after receiving the first editing log sent by the first terminal device and / or the second editing log sent by the second terminal device, the server saves the first editing log and / or the second editing log as historical data in real time. Since the first editing log and the second editing log are time-sensitive, when the information editing instruction is responded to, the terminal device will generate an information editing log to overwrite the previous editing log. Therefore, the server saves the first editing log and the second editing log received each time, which can realize the recording of the entire process of editing the video to be processed. Then, when the first terminal device or the second terminal device needs to retrieve the editing log at a certain time point, it can obtain the corresponding historical data by sending a historical data request instruction to the server, thereby realizing fine management of the editing process of the video to be processed and improving the efficiency of collaborative processing.

[0109] Figure 11 A signaling diagram for another collaborative video processing method provided in this disclosure embodiment, such as... Figure 11 As shown, the collaborative video processing method provided in this embodiment includes:

[0110] S601: The first terminal device sends a collaboration request message to the server.

[0111] S602A: The server sends a coordination processing identifier to the first terminal device.

[0112] S602B: The server sends a coordination processing identifier to at least one second terminal device.

[0113] S603: The first terminal device sends a response message to the server.

[0114] S604: The second terminal device sends a response message to the server.

[0115] S605: The server receives response information from the first terminal device and at least one second terminal device, and determines that the first terminal device and the second terminal device are in a collaborative state.

[0116] S606: The server receives the first edit log sent by the first terminal device in a collaborative state.

[0117] S607: The server sends the first edit log to the second terminal device in the coordination state.

[0118] S608: The server receives the second edit log sent by the second terminal device in a collaborative state.

[0119] S609: The server sends the second edit log to the first terminal device in the coordination state.

[0120] In this embodiment, the first terminal device and the second terminal device are connected to a server, enabling collaborative video processing when editing the video to be processed. This allows the first and second terminal devices to adjust their editing methods in real time based on the content being edited by the other, improving the collaborative efficiency of video editing and enhancing the overall efficiency and quality of the video directing process. The specific implementation methods of the first terminal device, the second terminal device, and the server in their respective execution steps are detailed below. Figures 3-10 The embodiments shown have been described in detail and will not be repeated here.

[0121] Corresponding to the collaborative video processing method in the above embodiments, Figure 12 This is a structural block diagram of a collaborative video processing apparatus provided in an embodiment of the present disclosure, applied to a first terminal device. For ease of explanation, only the parts relevant to the embodiments of the present disclosure are shown. (Refer to...) Figure 12 The collaborative video processing device 6 includes:

[0122] Display module 61 is used to respond to a first editing instruction to edit the video to be processed displayed on the first terminal device and obtain a first editing log, wherein the first editing log is used to indicate the editing content of the video to be processed based on the first editing instruction;

[0123] The transceiver module 62 is used to send the first editing log to the second terminal device, wherein the first editing log is used by the second terminal device to display the editing content corresponding to the first editing log on the video to be processed.

[0124] In one possible implementation, the transceiver module 62 is specifically used to: send a collaboration request message to the server to establish a collaboration connection with at least one second terminal device, wherein the collaboration request message is used by the first terminal device to establish a collaboration connection with at least one second terminal device through the server; and send the first edit log through the server to the second terminal device with which the collaboration connection has been established.

[0125] In one possible implementation, the collaboration request information includes identification information of a first terminal device and identification information of a second terminal device, wherein the identification information of the first terminal device is used to enable the server to determine whether to respond to the collaboration request information.

[0126] In one possible implementation, the first editing instruction includes annotation information, which is used to instruct the addition of annotation information to the video to be processed, wherein the annotation information includes annotation text and / or annotation identifier.

[0127] In one possible implementation, the transceiver module 62 is further configured to: receive a second editing log, the second editing log being used to indicate the editing content of the video to be processed based on a second editing instruction, the second editing instruction being used to edit the video to be processed displayed on the second terminal device when responded to; the display module 61 is further configured to: display the editing content corresponding to the second editing log on the video to be processed according to the second editing log.

[0128] In one possible implementation, when the display module 61 displays the edited content corresponding to the second editing log on the video to be processed according to the second editing log, it is specifically used to: edit the video to be processed according to the second editing log to generate an edited video, wherein the video parameters of the edited video are changed compared to the video to be processed, and / or, at least one video element is added to the edited video compared to the video to be processed; and display the edited video.

[0129] In one possible implementation, the transceiver module 62 is further configured to: send a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and to determine the first editing log and / or the second editing log corresponding to the edited video as the input log, the input log being used to generate the output video.

[0130] In one possible implementation, the display module 61 is further configured to: perform conflict detection on the first editing instruction according to the second editing log; and output a prompt message if the editing content corresponding to the first editing instruction conflicts with the editing content corresponding to the second editing log.

[0131] The device provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effect are similar, and will not be described again here.

[0132] Figure 13 This diagram illustrates a structural block diagram of another collaborative video processing apparatus provided in an embodiment of this disclosure, applied to a second terminal device. For ease of explanation, only the parts relevant to the embodiments of this disclosure are shown. (Refer to...) Figure 13 The collaborative video processing device 7 includes:

[0133] The transceiver module 71 is used to receive a first editing log, which is used to indicate the editing content of the video to be processed based on a first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when a response is received.

[0134] Display module 72 is used to display the edited content corresponding to the first edit log on the video to be processed, based on the first edit log.

[0135] In one possible implementation, the display module 72 is specifically used to: edit the video to be processed according to the first editing log to generate an edited video, wherein the video parameters of the edited video are changed compared to the video to be processed, and / or, at least one video element is added to the edited video compared to the video to be processed; and display the edited video.

[0136] In one possible implementation, the display module 72 is further configured to: in response to a second editing instruction, edit the video to be processed displayed on the first terminal device; and, based on a first editing log, perform conflict detection on the second editing instruction, and if the editing content corresponding to the second editing instruction conflicts with the editing content corresponding to the first editing log, output a prompt message.

[0137] In one possible implementation, the transceiver module 71 is further configured to: send a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and to determine the first editing log corresponding to the edited video as the input log, the input log being used to generate the output video.

[0138] Figure 14 This is a structural block diagram of another collaborative video processing apparatus provided in an embodiment of the present disclosure, applied to a server. For ease of explanation, only the parts relevant to the embodiments of the present disclosure are shown. (Refer to...) Figure 14 The collaborative video processing device 8 includes:

[0139] The receiving module 81 is used to receive a first editing log sent by the first terminal device. The first editing log is used to indicate the editing content of the video to be processed based on the first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to.

[0140] The sending module 82 is used to send the first editing log to the second terminal device so that the second terminal device can display the editing content corresponding to the first editing log on the video to be processed.

[0141] In one possible implementation, the sending module 82 is further configured to: send a coordination processing identifier to the first terminal device and at least one second terminal device; the receiving module 81 is further configured to: receive response information sent by the first terminal device and at least one second terminal device, and determine that the first terminal device and the second terminal device are in a coordinated state.

[0142] In one possible implementation, the receiving module 81, when receiving the first edit log sent by the first terminal device, is specifically used to: receive the first edit log sent by the first terminal device in a collaborative state; and the sending module 82, when sending the first edit log to the second terminal device, is specifically used to: send the first edit log to the second terminal device in a collaborative state.

[0143] In one possible implementation, the collaborative video processing device 8 further includes:

[0144] Control module 83 is used to save the first edit log sent by the first terminal device and / or the second edit log sent by the second terminal device as historical data;

[0145] The receiving module 81 is also configured to: receive a historical data request instruction sent by the first terminal device or the second terminal device;

[0146] The sending module 82 is further configured to: respond to a historical data request instruction sent by the first terminal device and send historical data to the first terminal device, or respond to a historical data request instruction sent by the second terminal device and send historical data to the second terminal device.

[0147] Figure 15 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure, such as... Figure 15 As shown, the electronic device 9 includes at least one processor 91 and a memory 92;

[0148] Memory 92 stores instructions executed by the computer;

[0149] At least one processor 91 executes computer execution instructions stored in memory 92, causing at least one processor 91 to perform, for example, Figures 3-10 Screen sharing method in the illustrated embodiment.

[0150] The processor 91 and the memory 92 are connected via a bus 93.

[0151] For relevant instructions, please refer to the corresponding text. Figures 3-11 The relevant descriptions and effects of the steps in the corresponding embodiments are understood, and will not be elaborated on here.

[0152] refer to Figure 16The diagram illustrates a structural schematic of an electronic device 900 suitable for implementing embodiments of the present disclosure. The electronic device 900 can be a terminal device or a server. The terminal device can include, but is not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, personal digital assistants (PDAs), portable Android devices (PADs), portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 16 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0153] like Figure 16 As shown, the electronic device 900 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. The RAM 903 also stores various programs and data required for the operation of the electronic device 900. The processing unit 901, ROM 902, and RAM 903 are interconnected via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0154] Typically, the following devices can be connected to I / O interface 905: input devices 906 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 907 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 908 including, for example, magnetic tapes, hard disks, etc.; and communication devices 909. Communication device 909 allows electronic device 900 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 16 An electronic device 900 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0155] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by a processing device 901, it performs the functions defined in the methods of embodiments of this disclosure.

[0156] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0157] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0158] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above embodiments.

[0159] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0160] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0161] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0162] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0163] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0164] In a first aspect, according to one or more embodiments of this disclosure, a collaborative video processing method is provided, applied to a first terminal device, wherein both the first terminal device and a second terminal device display video to be processed, the method comprising:

[0165] In response to a first editing instruction, the video to be processed displayed on the first terminal device is edited to obtain a first editing log, wherein the first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction; the first editing log is sent to a second terminal device, wherein the first editing log is used by the second terminal device to display the editing content corresponding to the first editing log on the video to be processed.

[0166] According to one or more embodiments of this disclosure, sending the first edit log to a second terminal device includes: sending a collaboration request message to a server to establish a collaboration connection with at least one second terminal device, wherein the collaboration request message is used by the first terminal device to establish a collaboration connection with the at least one second terminal device through the server; and sending the first edit log to the second terminal device with which the collaboration connection has been established.

[0167] According to one or more embodiments of this disclosure, the collaboration request information includes identification information of the first terminal device and identification information of the second terminal device, wherein the identification information of the first terminal device is used to enable the server to determine whether to respond to the collaboration request information.

[0168] According to one or more embodiments of this disclosure, the first editing instruction includes annotation information, the first editing instruction being used to instruct the addition of the annotation information to the video to be processed, wherein the annotation information includes annotation text and / or annotation identifier.

[0169] According to one or more embodiments of this disclosure, the method further includes: receiving a second editing log, the second editing log being used to indicate editing content and / or editing process of editing the video to be processed based on a second editing instruction, the second editing instruction being used to edit the video to be processed displayed on the second terminal device when responded to; and displaying the editing content corresponding to the second editing log on the video to be processed according to the second editing log.

[0170] According to one or more embodiments of this disclosure, displaying the edited content corresponding to the second editing log on the video to be processed according to the second editing log includes: editing the video to be processed according to the second editing log to generate an edited video, wherein the video parameters of the edited video are changed relative to the video to be processed, and / or, at least one video element is added to the edited video relative to the video to be processed; and displaying the edited video.

[0171] According to one or more embodiments of this disclosure, the method further includes: sending a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and determining a first editing log and / or a second editing log corresponding to the edited video as input logs, the input logs being used to generate an output video.

[0172] According to one or more embodiments of this disclosure, the method further includes: performing conflict detection on the first editing instruction based on the second editing log; if the editing content corresponding to the first editing instruction conflicts with the editing content corresponding to the second editing log, then outputting a prompt message.

[0173] Secondly, according to one or more embodiments of this disclosure, a collaborative video processing method is provided, applied to a second terminal device, wherein both the first terminal device and the second terminal device display video to be processed, the method comprising:

[0174] The system receives a first editing log, which indicates the editing content and / or editing process of editing the video to be processed based on the first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to. The system displays the editing content corresponding to the first editing log on the video to be processed according to the first editing log.

[0175] According to one or more embodiments of this disclosure, displaying the edited content corresponding to the first editing log on the video to be processed according to the first editing log includes: editing the video to be processed according to the first editing log to generate an edited video, wherein the video parameters of the edited video are changed relative to the video to be processed, and / or, at least one video element is added to the edited video relative to the video to be processed; and displaying the edited video.

[0176] According to one or more embodiments of this disclosure, the method further includes: in response to a second editing instruction, editing the video to be processed displayed on the first terminal device; and according to the first editing log, performing conflict detection on the second editing instruction, and if the editing content corresponding to the second editing instruction conflicts with the editing content corresponding to the first editing log, outputting a prompt message.

[0177] According to one or more embodiments of this disclosure, the method further includes: sending a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and determining a first editing log corresponding to the edited video as an input log, the input log being used to generate an output video.

[0178] Thirdly, according to one or more embodiments of this disclosure, a collaborative video processing method is provided, applied to a server, the method comprising:

[0179] The system receives a first editing log sent by a first terminal device, the first editing log being used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction, wherein the first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to; the system sends the first editing log to a second terminal device so that the second terminal device displays the editing content corresponding to the first editing log on the video to be processed.

[0180] According to one or more embodiments of this disclosure, the method further includes: sending a coordination processing identifier to the first terminal device and at least one second terminal device; receiving response information sent by the first terminal device and at least one second terminal device to determine that the first terminal device and the second terminal device are in a coordinated state; the receiving of the first edit log sent by the first terminal device includes: receiving the first edit log sent by the first terminal device in the coordinated state; sending the first edit log to the second terminal device includes: sending the first edit log to the second terminal device in the coordinated state.

[0181] According to one or more embodiments of this disclosure, the method further includes: saving a first edit log sent by the first terminal device and / or a second edit log sent by the second terminal device as historical data; receiving a historical data request instruction sent by the first terminal device or the second terminal device; and, in response to the historical data request instruction sent by the first terminal device, sending the historical data to the first terminal device, or, in response to the historical data request instruction sent by the second terminal device, sending the historical data to the second terminal device.

[0182] Fourthly, embodiments of this disclosure provide a collaborative video processing apparatus applied to a first terminal device, wherein both the first terminal device and a second terminal device display video to be processed, the apparatus comprising:

[0183] The display module is configured to, in response to a first editing instruction, edit the video to be processed displayed on the first terminal device to obtain a first editing log, wherein the first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction;

[0184] The transceiver module is used to send the first editing log to the second terminal device, wherein the first editing log is used by the second terminal device to display the editing content corresponding to the first editing log on the video to be processed.

[0185] According to one or more embodiments of this disclosure, the transceiver module is specifically configured to: send a collaboration request message to a server to establish a collaboration connection with at least one second terminal device, wherein the collaboration request message is used by the first terminal device to establish a collaboration connection with the at least one second terminal device through the server; and send the first edit log to the second terminal device with which the collaboration connection has been established.

[0186] According to one or more embodiments of this disclosure, the collaboration request information includes identification information of the first terminal device and identification information of the second terminal device, wherein the identification information of the first terminal device is used to enable the server to determine whether to respond to the collaboration request information.

[0187] According to one or more embodiments of this disclosure, the first editing instruction includes annotation information, the first editing instruction being used to instruct the addition of the annotation information to the video to be processed, wherein the annotation information includes annotation text and / or annotation identifier.

[0188] According to one or more embodiments of this disclosure, the transceiver module is further configured to: receive a second editing log, the second editing log being used to indicate editing content and / or editing process of editing the video to be processed based on a second editing instruction, the second editing instruction being used to edit the video to be processed displayed on the second terminal device when responded to; the display module is further configured to: display the editing content corresponding to the second editing log on the video to be processed according to the second editing log.

[0189] According to one or more embodiments of this disclosure, when the display module displays the edited content corresponding to the second editing log on the video to be processed according to the second editing log, it is specifically used to: edit the video to be processed according to the second editing log to generate an edited video, wherein the video parameters of the edited video are changed relative to the video to be processed, and / or, at least one video element is added to the edited video relative to the video to be processed; and display the edited video.

[0190] According to one or more embodiments of this disclosure, the transceiver module is further configured to: send a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and to determine the first editing log and / or the second editing log corresponding to the edited video as input logs, wherein the input logs are used to generate an output video.

[0191] According to one or more embodiments of this disclosure, the display module is further configured to: perform conflict detection on the first editing instruction based on the second editing log; and if the editing content corresponding to the first editing instruction conflicts with the editing content corresponding to the second editing log, output a prompt message.

[0192] Fifthly, embodiments of this disclosure provide a collaborative video processing apparatus applied to a second terminal device, wherein both the first terminal device and the second terminal device display video to be processed, and the apparatus includes:

[0193] The transceiver module is used to receive a first editing log, which is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to.

[0194] The display module is used to display the edited content corresponding to the first edit log on the video to be processed, based on the first edit log.

[0195] According to one or more embodiments of this disclosure, the display module is specifically configured to: edit the video to be processed according to the first editing log to generate an edited video, wherein the video parameters of the edited video are changed relative to the video to be processed, and / or, at least one video element is added to the edited video relative to the video to be processed; and display the edited video.

[0196] According to one or more embodiments of this disclosure, the display module is further configured to: in response to a second editing instruction, edit the video to be processed displayed on the first terminal device; and perform conflict detection on the second editing instruction according to the first editing log, and if the editing content corresponding to the second editing instruction conflicts with the editing content corresponding to the first editing log, output a prompt message.

[0197] According to one or more embodiments of this disclosure, the transceiver module is further configured to: send a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and to determine a first editing log corresponding to the edited video as an input log, wherein the input log is used to generate an output video.

[0198] Sixthly, embodiments of this disclosure provide a collaborative video processing apparatus applied to a server, the apparatus comprising:

[0199] The receiving module is configured to receive a first editing log sent by a first terminal device. The first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to.

[0200] The sending module is used to send the first editing log to the second terminal device, so that the second terminal device displays the editing content corresponding to the first editing log on the video to be processed.

[0201] According to one or more embodiments of this disclosure, the sending module is further configured to: send a coordination processing identifier to the first terminal device and at least one second terminal device; the receiving module is further configured to: receive response information sent by the first terminal device and at least one second terminal device, and determine that the first terminal device and the second terminal device are in a cooperative state.

[0202] According to one or more embodiments of this disclosure, when receiving the first edit log sent by the first terminal device, the receiving module is specifically configured to: receive the first edit log sent by the first terminal device in a collaborative state; when sending the first edit log to the second terminal device, the sending module is specifically configured to: send the first edit log to the second terminal device in a collaborative state.

[0203] According to one or more embodiments of this disclosure, the same video processing apparatus 8 further includes:

[0204] The control module is used to save the first edit log sent by the first terminal device and / or the second edit log sent by the second terminal device as historical data;

[0205] The receiving module is further configured to: receive a historical data request instruction sent by the first terminal device or the second terminal device;

[0206] The sending module is further configured to: respond to a historical data request instruction sent by the first terminal device and send the historical data to the first terminal device, or respond to a historical data request instruction sent by the second terminal device and send the historical data to the second terminal device.

[0207] In a seventh aspect, embodiments of this disclosure provide an electronic device, comprising: at least one processor and a memory; the memory storing computer-executable instructions; the at least one processor executing the computer-executable instructions stored in the memory, causing the at least one processor to perform the collaborative video processing method as described in the first aspect and various possible designs of the first aspect, or causing the at least one processor to perform the collaborative video processing method as described in the second aspect and various possible designs of the second aspect, or causing the at least one processor to perform the collaborative video processing method as described in the third aspect and various possible designs of the third aspect.

[0208] Eighthly, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions. When a processor executes the computer-executable instructions, it implements the collaborative video processing method described in the first aspect and various possible designs of the first aspect, or implements the collaborative video processing method described in the second aspect and various possible designs of the second aspect, or implements the collaborative video processing method described in the third aspect and various possible designs of the third aspect.

[0209] Ninthly, embodiments of this disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the collaborative video processing method described in the first aspect and various possible designs of the first aspect, or implements the collaborative video processing method described in the second aspect and various possible designs of the second aspect, or implements the collaborative video processing method described in the third aspect and various possible designs of the third aspect.

[0210] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0211] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0212] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A collaborative video processing method, characterized in that, Applied to a first terminal device, the method includes: In response to a first editing instruction, the video to be processed displayed on the first terminal device is edited to obtain a first editing log, wherein the first editing log is used to indicate the editing content and / or editing process of the video to be processed based on the first editing instruction; The first editing log is sent to the second terminal device, wherein the first editing log is used by the second terminal device to display the editing content corresponding to the first editing log on the video to be processed; The first editing instruction includes annotation information, which is used to instruct the addition of the annotation information to the video to be processed. The annotation information is used to characterize the modification method of the video elements in the video to be processed by the second terminal device. The first edit log is also used to reproduce the annotation information on the second terminal device.

2. The method according to claim 1, characterized in that, Sending the first edit log to the second terminal device includes: Sending a collaboration request message to the server to establish a collaboration connection with at least one second terminal device, wherein the collaboration request message is used by the first terminal device to establish a collaboration connection with the at least one second terminal device through the server; The first edit log is sent to the second terminal device with which a collaborative connection has been established.

3. The method according to claim 2, characterized in that, The collaboration request information includes the identification information of the first terminal device and the identification information of the second terminal device, wherein the identification information of the first terminal device is used to enable the server to determine whether to respond to the collaboration request information.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: Receive a second editing log, the second editing log being used to indicate the editing content and / or editing process of editing the video to be processed based on a second editing instruction, the second editing instruction being used to edit the video to be processed displayed on the second terminal device when responded to; Based on the second editing log, the edited content corresponding to the second editing log is displayed on the video to be processed.

5. The method according to claim 4, characterized in that, According to the second editing log, the editing content corresponding to the second editing log is displayed on the video to be processed, including: Based on the second editing log, the video to be processed is edited to generate an edited video; The edited video is displayed.

6. The method according to claim 5, characterized in that, The method further includes: Send a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and the first editing log and / or the second editing log corresponding to the edited video are determined as input logs, and the input logs are used to generate the output video.

7. The method according to claim 4, characterized in that, The method further includes: Based on the second editing log, a conflict detection is performed on the first editing instruction. If the editing content corresponding to the first editing instruction conflicts with the editing content corresponding to the second editing log, a prompt message is output.

8. A collaborative video processing method, characterized in that, Applied to a second terminal device, the method includes: Receive a first editing log, the first editing log being used to indicate the editing content and / or editing process of editing the video to be processed based on a first editing instruction, the first editing instruction being used to edit the video to be processed displayed on the first terminal device when responded to; Based on the first editing log, display the editing content corresponding to the first editing log on the video to be processed; The first editing instruction includes annotation information, which is used to instruct the addition of the annotation information to the video to be processed. The annotation information is used to characterize the modification method of the video elements in the video to be processed by the second terminal device. The first edit log is also used to reproduce the annotation information on the second terminal device.

9. The method according to claim 8, characterized in that, The method further includes: In response to the second editing command, the video to be processed displayed on the first terminal device will be edited; Based on the first editing log, a conflict detection is performed on the second editing instruction. If the editing content corresponding to the second editing instruction conflicts with the editing content corresponding to the first editing log, a prompt message is output.

10. The method according to claim 8 or 9, characterized in that, The method further includes: Send a video lock request, wherein the video lock request is used to indicate that editing of the edited video is prohibited, and the first editing log corresponding to the edited video is determined as the input log, the input log being used to generate the output video.

11. A collaborative video processing method, characterized in that, Applied to a server, the method includes: The system receives a first editing log sent by a first terminal device. The first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on a first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to. The first editing log is sent to the second terminal device so that the second terminal device displays the editing content corresponding to the first editing log on the video to be processed. The first editing instruction includes annotation information, which is used to instruct the addition of the annotation information to the video to be processed. The annotation information is used to characterize the modification method of the video elements in the video to be processed by the second terminal device. The first edit log is also used to reproduce the annotation information on the second terminal device.

12. The method according to claim 11, characterized in that, The method further includes: Send a coordination processing identifier to the first terminal device and at least one second terminal device; Receive response information from the first terminal device and at least one second terminal device to determine that the first terminal device and the second terminal device are in a collaborative state; The step of receiving the first edit log sent by the first terminal device includes: receiving the first edit log sent by the first terminal device in a collaborative state; Sending the first edit log to the second terminal device includes: The first edit log is sent to the second terminal device in a coordinated state.

13. The method according to claim 11 or 12, characterized in that, The method further includes: The first edit log sent by the first terminal device and / or the second edit log sent by the second terminal device are saved as historical data. Receive a historical data request instruction sent by the first terminal device or the second terminal device; In response to a historical data request instruction sent by the first terminal device, the historical data is sent to the first terminal device; or, in response to a historical data request instruction sent by the second terminal device, the historical data is sent to the second terminal device.

14. A collaborative video processing device, characterized in that, Applied to a first terminal device, the device includes: The display module is configured to, in response to a first editing instruction, edit the video to be processed displayed on the first terminal device to obtain a first editing log, wherein the first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on the first editing instruction; The transceiver module is used to send the first editing log to the second terminal device, wherein the first editing log is used by the second terminal device to display the editing content corresponding to the first editing log on the video to be processed; The first editing instruction includes annotation information, which is used to instruct the addition of the annotation information to the video to be processed. The annotation information is used to characterize the modification method of the video elements in the video to be processed by the second terminal device. The first edit log is also used to reproduce the annotation information on the second terminal device.

15. A collaborative video processing device, characterized in that, Applied to a second terminal device, the device includes: The transceiver module is used to receive a first editing log, which is used to indicate the editing content and / or editing process of the video to be processed based on a first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to. The display module is used to display the edited content corresponding to the first edit log on the video to be processed, according to the first edit log. The first editing instruction includes annotation information, which is used to instruct the addition of the annotation information to the video to be processed. The annotation information is used to characterize the modification method of the video elements in the video to be processed by the second terminal device. The first edit log is also used to reproduce the annotation information on the second terminal device.

16. A collaborative video processing device, characterized in that, Applied to a server, the device includes: The receiving module is configured to receive a first editing log sent by a first terminal device. The first editing log is used to indicate the editing content and / or editing process of editing the video to be processed based on a first editing instruction. The first editing instruction is used to edit the video to be processed displayed on the first terminal device when responded to. The sending module is used to send the first editing log to the second terminal device, so that the second terminal device displays the editing content corresponding to the first editing log on the video to be processed; The first editing instruction includes annotation information, which is used to instruct the addition of the annotation information to the video to be processed. The annotation information is used to characterize the modification method of the video elements in the video to be processed by the second terminal device. The first edit log is also used to reproduce the annotation information on the second terminal device.

17. An electronic device, characterized in that, include: At least one processor and memory; The memory stores computer-executed instructions; The at least one processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the collaborative video processing method as described in any one of claims 1 to 13.

18. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the collaborative video processing method as described in any one of claims 1 to 13.

Citation Information

Patent Citations

  • Method, device and system for generating videos capable of showing video notations

    CN103517158A

  • Paper reviewing method and system with strong interaction

    CN106817617A

  • Cloud-based video processing method and device, storage medium and electronic equipment

    CN112261416A

  • Image editing system and image editing method

    JP2010278656A