A video processing method and related device

By independently storing the interactive information of live content in the database and automatically importing video files with corresponding relationships, the problem of low efficiency in interactive information filtering and synchronization in video live content editing is solved, improving the efficiency and accuracy of video editing is achieved, saving Human resources.

CN114077686BActive Publication Date: 2024-12-06TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010837987.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-08-19
Publication Date
2024-12-06
Estimated Expiration
2040-08-19

AI Technical Summary

Technical Problem

In the prior art, when editing live video content, the screening and synchronization of interactive information is low, resulting in low video editing efficiency and accuracy, requiring manual cumbersome operations and wasting human resources.

Method used

By independently storing the interactive information of live broadcast content in the database, using the correspondence between live broadcast identifiers and interactive information, it automatically reads and imports the video to be generated from the database, and generates synchronized video files based on the timeline mapping relationship to avoid manual filtering and synchronous operations.

Benefits of technology

It improves the efficiency and accuracy of video editing, saves human resources, realizes convenient and accurate import of interactive information, and enhances the degree of automation of video editing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114077686B_ABST
    Figure CN114077686B_ABST
Patent Text Reader

Abstract

This application discloses a video processing method and related apparatus. The method includes: determining a first video to be generated and a first time interval of the first video to be generated in a first timeline according to a first video editing task corresponding to live content; the first timeline is the live timeline of the live content; reading target information corresponding to the first time interval from interaction information stored in a database according to the live identifier of the live content; the interaction information is interaction information obtained during the live broadcast of the live content; the interaction information is stored in the database according to a first correspondence between the live identifier and the first information identifier; and importing the target information into the first video to be generated based on the mapping relationship between the first timeline and the second timeline to generate a first video file corresponding to the first video editing task. This method eliminates the need for manual filtering and synchronization, improves the efficiency of video editing, and saves human resources.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing, and in particular to a video processing method and related devices. Background Art

[0002] Live video is a common form of content dissemination, such as live events and anchor live broadcasts. When users watch live videos on live broadcast platforms, they can interact with the live content through interactive information, such as viewing and user interaction. In live video, interactive information is currently mainly expressed in the form of bullet screens.

[0003] Since live video is a live broadcast of content, it is time-sensitive. If a user misses the live broadcast period, he or she will not be able to watch the live broadcast content at that time through live broadcast. To this end, the live broadcast content in the live broadcast platform can be converted into a video file and provided to the video platform, so that users can view the missed live broadcast content at any time through the video platform.

[0004] In order to allow users to experience the interactive atmosphere of the live broadcast when watching the video file and achieve a sense of presence when watching the live broadcast, the interactive information during the live broadcast needs to be reflected when the video file is played. In the related technology, the interactive information will be synchronized to the video file identifier corresponding to the live broadcast during the live broadcast, and then fully imported into the video file. If the live broadcast content needs to be edited or adjusted, such as making a highlight collection, in order to determine the interactive information associated with the adjusted video file, it can only be manually screened, edited, and synchronized, which is very inefficient and prone to errors. Summary of the invention

[0005] In order to solve the above technical problems, the present application provides a video processing method that does not require manual screening and synchronization, thereby improving the efficiency of video editing and saving human resources.

[0006] The embodiments of the present application disclose the following technical solutions:

[0007] In a first aspect, the present application provides a video processing method, the method comprising:

[0008] Determine, according to a first video editing task corresponding to the live content, a first video to be generated and a first time interval of the first video to be generated in a first timeline, where the first timeline is a live timeline of the live content;

[0009] According to the live broadcast identifier of the live broadcast content, target information corresponding to the first time interval is read from the interaction information stored in the database, wherein the interaction information is interaction information for the live broadcast content acquired during the live broadcast of the live broadcast content, and the interaction information is stored in the database according to a first corresponding relationship between the live broadcast identifier and the first information identifier;

[0010] Based on the mapping relationship between the first timeline and the second timeline, the target information is imported into the first video to be generated to generate a first video file corresponding to the first video editing task, and the second timeline is the video timeline of the first video file.

[0011] In a second aspect, the present application provides a video processing device, the device comprising a first determining unit, a first reading unit and a first importing unit:

[0012] The first determining unit is used to determine, according to a first video editing task corresponding to the live content, a first video to be generated and a first time interval of the first video to be generated in a first timeline, where the first timeline is a live timeline of the live content;

[0013] The first reading unit is used to read the target information corresponding to the first time interval from the interactive information stored in the database according to the live broadcast identifier of the live broadcast content, wherein the interactive information is interactive information for the live broadcast content acquired during the live broadcast process of the live broadcast content, and the interactive information is stored in the database according to a first corresponding relationship between the live broadcast identifier and the first information identifier;

[0014] The first import unit is used to import the target information into the first video to be generated based on the mapping relationship between the first timeline and the second timeline to generate a first video file corresponding to the first video editing task, and the second timeline is the video timeline of the first video file.

[0015] In a third aspect, the present application provides a device for video processing, the device comprising a processor and a memory:

[0016] The memory is used to store program code and transmit the program code to the processor;

[0017] The processor is used to execute the video processing method described in the first aspect according to the instructions in the program code.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and the computer program is used to execute the video processing method described in the first aspect.

[0019] It can be seen from the above technical solution that during the live broadcast process, the interactive information for the live broadcast content will be saved in the database through the first corresponding relationship, and the first corresponding relationship identifies the relationship between the live broadcast identifier of the live broadcast content and the first information identifier of the interactive information, so that the interactive information corresponding to the live broadcast content can be accurately identified from the database through the first corresponding relationship. When the processing device obtains the first video editing task corresponding to the live broadcast content, the first video to be generated can be determined based on the live broadcast content and the editing requirements, and the first time interval in which the content included in the first video to be generated is determined based on the first time line of the live broadcast content. According to the live broadcast identifier of the live broadcast content, the target information corresponding to the first time interval is read from the database, and the target information is the interactive information that appears in the first time interval of the live broadcast content. When generating the first video file, since the first video to be generated and the target information are both determined based on the first time line, in order to synchronize the video content and the target information, the target information can be imported into the first video to be generated based on the first time line to obtain the first video file corresponding to the first video editing task. Since the interactive information corresponding to each live broadcast content is saved in the database independently of the live broadcast content, it is in a state that can be edited and read at any time. When determining video files from live content based on video editing tasks, the required target information can be conveniently and accurately selected from the database based on the corresponding relationship without the need for manual screening and synchronization, which improves the efficiency of video editing and saves human resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 A schematic diagram of a video processing method in an actual application scenario provided by an embodiment of the present application;

[0022] Figure 2 A flowchart of a video processing method provided in an embodiment of the present application;

[0023] Figure 3 A schematic diagram of a video processing method provided in an embodiment of the present application;

[0024] Figure 4 A schematic diagram of a video processing method provided in an embodiment of the present application;

[0025] Figure 5A schematic diagram of a video processing method in an actual application scenario provided by an embodiment of the present application;

[0026] Figure 6 A schematic diagram of a video processing method in an actual application scenario provided by an embodiment of the present application;

[0027] Figure 7 A flowchart of a video processing method in an actual application scenario provided by an embodiment of the present application;

[0028] Figure 8 A schematic diagram of a video processing method in an actual application scenario provided by an embodiment of the present application;

[0029] Fig. 9 A structural block diagram of a video processing device provided in an embodiment of the present application;

[0030] Fig.10 A structural diagram of a device for video processing provided in an embodiment of the present application;

[0031] Fig.11 A structural diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] The embodiments of the present application are described below in conjunction with the accompanying drawings.

[0033] Watching live broadcasts is one of the most popular ways of leisure nowadays. In order to allow users who are too busy to watch live broadcasts to watch the wonderful live content, relevant personnel often edit the wonderful parts of the live content into video highlights to promote the live content, or record all the live content during the live broadcast for users to watch. In order to restore the interactive atmosphere during the live broadcast, relevant personnel often add interactive information sent by users who watch this part of the live content when editing the video.

[0034] In the related art, if relevant personnel want to obtain interactive information corresponding to the edited live content, they need to manually filter and synchronize the video files, and the efficiency and accuracy of video processing are low.

[0035] In order to solve the above technical problems, the present application provides a video processing method that does not require manual screening and synchronization, thereby improving the efficiency of video editing and saving human resources.

[0036] It is understandable that the method can be applied to a processing device, which is a processing device capable of performing video processing, for example, a terminal device or a server with a video processing function. The method can be executed independently by a terminal device or a server, or it can be applied to a network scenario in which a terminal device and a server communicate, and is executed in cooperation with a terminal device and a server. Among them, the terminal device can be a computer, a personal digital assistant (PDA for short), a tablet computer and other devices. The server can be understood as an application server or a Web server. In actual deployment, the server can be an independent server or a cluster server. At the same time, in terms of hardware environment, the environment in which this technology has been implemented includes: ARM architecture processors, X86 architecture processors; in terms of software environment, the environment in which this technology has been implemented includes: Android platform, Windows XP and above operating systems or Linux operating systems.

[0037] In order to facilitate understanding of the technical solution provided by the present application, a video processing method provided by an embodiment of the present application will be introduced below in combination with an actual application scenario.

[0038] See also Figure 1 , Figure 1 A schematic diagram of a video processing method in an actual application scenario provided by an embodiment of the present application. In the actual application scenario, the processing device is a terminal device 101, and the user can edit the live content through the terminal device 101. As shown in the figure, in this scenario, the live content is a basketball game broadcast live to users by a live broadcast platform. When watching the live broadcast of the basketball game, in order to improve the viewing experience, the user can send interactive information through the live broadcast platform to discuss with other users watching the game. The interactive information can be barrage information. As shown in the figure, the user watching the game sent three barrage information, barrage information A, barrage information B, and barrage information C. These barrage information will pass through the live content in the manner shown in barrage information A.

[0039] During the live broadcast process, the live broadcast platform will store the barrage information for the basketball game in the database with the first information identifier as a mark according to the correspondence between the live broadcast identifier of the live broadcast of the basketball game and the first information identifier. Among them, since the barrage information is stored in the database independently of the live broadcast content, this part of the barrage information has the ability to be freely read, that is, the terminal device 101 can read any part of the barrage information from the database for use. Based on this, when the user wants to edit the live broadcast content through the terminal device 101, if the barrage needs to be added to the edited video file, the terminal device 101 can directly extract the required part from the database and add it to the video file according to the demand, without manually screening and importing the barrage information, which reduces the user's operating burden to a certain extent and improves the editing efficiency.

[0040] For example, in this actual application scenario, in order to recommend a player who played in the basketball game to others, the user can edit the live video of the game to create a collection of the player's highlight moments. The user can issue a first video editing task to the terminal device 101 based on the player's highlight moments. The terminal device 101 can first determine the first video to be generated based on the task. The first video to be generated is a collection of the player's highlight moments that lacks barrage information. In order to add corresponding barrage information to the video to be generated, the terminal device 101 can first determine the first time interval corresponding to the first video to be generated in the first timeline. The first timeline refers to the timeline of the live broadcast of the basketball game. The first time interval is the time interval in which the player's highlight moments appear in the timeline of the live broadcast of the game.

[0041] As mentioned above, the barrage information of this game is stored according to the correspondence between the live broadcast identifier and the first information identifier. Therefore, the terminal device 101 can read the target barrage information corresponding to the first time interval from the database according to the live broadcast identifier of the live broadcast content corresponding to the first video editing task and the first time interval. For example, the terminal device 101 can determine all the information related to the live broadcast of this game from the database according to the live broadcast identifier, and then determine all the barrage information for the game according to the first information identifier corresponding to the live broadcast identifier, and finally determine the target barrage information in the first time interval from the barrage information according to the time corresponding to these barrage information.

[0042] After reading the target barrage information, since the video clips in the first video to be generated are extracted from the live broadcast content of the first timeline, and the target barrage information is also determined based on the first time interval in the first timeline, the determined target barrage information and the first video to be generated have a synchronization relationship. The terminal device can import the target barrage information into the first video to be generated based on the first timeline to generate a first video file, which is a player highlight collection video with the corresponding live barrage information.

[0043] It can be seen from the above content that in the process of generating the first video file, the terminal device 101 can automatically extract the corresponding target barrage information from the database and import it into the video according to the first video editing task, thereby eliminating the need for manual screening and importing of the barrage information, thereby improving the efficiency and accuracy of video processing.

[0044] Next, a video processing method provided in an embodiment of the present application will be introduced in conjunction with the accompanying drawings. The above video processing method is applied to the above terminal device.

[0045] See also Figure 2 , Figure 2 A flowchart of a video processing method provided in an embodiment of the present application, the method comprising:

[0046] S201: Determine, according to a first video editing task corresponding to live content, a first video to be generated and a first time interval of the first video to be generated in a first timeline.

[0047] In order to enable users who cannot watch live broadcasts to watch the wonderful live broadcast content, and to record and promote the live broadcast content, live broadcast platforms or users often record or edit the live broadcast content. Among them, strong interactivity is one of the advantages of live broadcasting. When watching live broadcasts, users can interact with the anchor or other users watching the same live broadcast content by sending interactive messages, and express their feelings when watching the live broadcast.

[0048] Among them, interactive information refers to the information sent by users in response to the live broadcast content when watching the live broadcast, such as information about gifts that can be given to users, barrage information sent by users, etc. The interactive information will be displayed to users watching the live broadcast content through the live broadcast platform, thereby enhancing the interactive atmosphere during the live broadcast. Based on this, in order to enable users who watch the video edited from the live broadcast content to also feel the interactive atmosphere during the live broadcast, the interactive information for the live broadcast content corresponding to the video can be added to the video when editing the video.

[0049] First, the processing device can obtain the first video editing task corresponding to the live broadcast content, and the first video editing task is used to instruct the processing device to perform video editing on the live broadcast content. The publisher of the task can be the user of the processing device, or it can be generated according to a pre-set program. For example, in order to record the live broadcast content, relevant personnel can turn on the automatic recording function in the live broadcast platform. After a live broadcast ends, the live broadcast platform will automatically generate a first video editing task to instruct the processing device to edit the live broadcast content of the live broadcast.

[0050] In order to enable the processing device to determine the live content corresponding to the first video editing task, the first video editing task may include a live identification of the live content, and the live identification can identify the specified live content and has a one-to-one correspondence with the live content. According to the live identification, the processing device can determine the live content that needs to be edited this time.

[0051] The processing device can extract part or all of the live content from the live content based on the editing requirements according to the first video editing task to determine the first video to be generated. For example, when the purpose of the first video editing task is to edit the wonderful operation of a member from a game, the processing device can determine the first time interval of this part of the wonderful operation in the first timeline from the first video editing task, and then edit the first video to be generated corresponding to the wonderful operation from the live content according to the first time interval. Among them, the first timeline is the live timeline of the live content, and the first timeline can be expressed in a variety of ways. For example, since the live content is broadcast in real time, the first timeline can be the natural time corresponding to the live content; in addition, the first timeline can be a relative timeline based on the live content, for example, it can be a relative timeline with the start time of the live broadcast as the time zero. The first time interval is the time interval of the first video to be generated in the first timeline, for example, it can be expressed by "8:30-8:35"; the first video to be generated includes live content that meets the editing requirements, but at this time, it does not include interactive information for the live content during the live broadcast.

[0052] In addition, if the purpose of the first video editing task is to completely record a game, the first video to be generated can be a recording of all live content so that other viewers who have not watched the live broadcast of the game can watch it.

[0053] S202: Reading target information corresponding to the first time interval from the interaction information stored in the database according to the live broadcast identifier of the live broadcast content.

[0054] After editing the live broadcast content to determine the first video to be generated, in order to restore the interactive atmosphere during the live broadcast, the processing device can choose to add the interactive information corresponding to the live broadcast content in the first video to be generated to the first video to be generated. When watching the video, the user can choose to display the interactive information and feel the audience's discussion and feedback on the live broadcast content during the live broadcast.

[0055] When adding interactive information, if the interactive information does not match the video content, it will seriously affect the user's viewing experience. For example, when the video content is a recording of a basketball game, a player makes a wonderful dribbling pass, but because the interactive information does not match, the video shows the user a critical message about the player's operation at another time point, which will confuse and puzzle the user. In order to avoid this situation, the processing device needs to determine the corresponding interactive information for the video content of the first video to be generated.

[0056] In order to achieve the above purpose, the processing device needs to have the ability to freely extract interactive information. In related technologies, interactive information will be synchronized to the video file corresponding to the live broadcast during the live broadcast, and will be fully imported into the video file of the live broadcast after the live broadcast ends. Since the interactive information is stored in conjunction with the video file, there is no ability to freely read the interactive information from the outside world during this process. If the interactive information needs to be obtained in a targeted manner, the user can only filter out the interactive information from the video file and import it into the corresponding position of his own video, which will consume a lot of user time and energy, and the efficiency of video editing is also low.

[0057] In an embodiment of the present application, in order to enable the processing device to have this capability, the present application provides a unique storage idea, that is, to store the interactive information independently of the live content, so that the interactive information can be freely read. During the live broadcast of the live content corresponding to the first video editing task, the live broadcast platform or related equipment can obtain the interactive information for the live content, and then save the interactive information in the database according to the first correspondence between the live broadcast identifier corresponding to the live content and the first information identifier. Among them, since the interactive information is stored in the database independently of the video file, it can be freely read by the processing device, for example, all the information therein or any specified information fragment can be read.

[0058] The first information identifier is used to identify the interactive information related to the live content. Through the first corresponding relationship, the first information identifier corresponding to the live identifier of the live content can be found during storage, and then the interactive information is stored in the database based on the first information identifier. Therefore, in the embodiment of the present application, in order to determine the interactive information corresponding to the first video to be generated, after the processing device determines the first time interval, it can read the target information corresponding to the first time interval from the interactive information stored in the database according to the live identifier of the live content.

[0059] It can be understood that since the live broadcast content in the first video to be generated is also determined by the processing device from the corresponding live broadcast content according to the first time interval, the live broadcast content targeted by the target information is the same as the corresponding live broadcast content in the first video to be generated, and the target information is the interactive information for the live broadcast content in the first video to be generated during the live broadcast.

[0060] S203: Based on the mapping relationship between the first timeline and the second timeline, the target information is imported into the first video to be generated to generate a first video file corresponding to the first video editing task.

[0061] As mentioned above, the first video to be generated does not include interactive information for the live content during the live broadcast, so the processing device can import the target information into the first video to be generated to generate the video required for the first video editing task. Since the first video to be generated and the target information are both determined based on the first time interval, and the first time interval is the time interval in the first timeline, the target information and the first video to be generated are in a synchronous relationship in the first timeline. Based on this, the processing device can import the target information into the first video to be generated based on the first timeline to generate the first video file corresponding to the first video editing task.

[0062] Among them, when importing the target information, since the first timeline is the timeline of the live content, and in the first video to be generated, the timeline is the second timeline, and the second timeline is the video timeline of the first video file corresponding to the first video editing task, the timelines of the first video to be generated and the live content are different, and the target information corresponding to the time information of the first timeline cannot be directly imported into the first video to be generated with the second timeline. For example, when a segment of a live content is played during the live broadcast, the time information is recorded according to the time point of playing the segment in natural time, and after the live content segment is edited into the first video to be generated, it is recorded according to the time point of its appearance in the video, that is, the "minutes and seconds" at which it appears in the video.

[0063] When importing the target information into the first video to be generated, in order to make the target information fit the second timeline in the first video to be generated, the processing device may convert the time point of the first timeline corresponding to the target information into the time point in the second timeline, that is, import the target information according to the mapping relationship between the first timeline and the second timeline. Figure 3 As shown, Figure 3 The first timeline in is the natural timeline. In the natural timeline, the time when the live content segment A starts playing during the live broadcast is tbegin1, and the time when the playing ends is tend1. The time when the interactive information A appears during the live broadcast is td1. After being placed in the first video to be generated, the live content segment A becomes the video segment A to be generated in the first video to be generated. The video segment A to be generated is at the beginning position of the first video to be generated, that is, in the second timeline corresponding to the first video to be generated, the time tbegin2 when the video segment A to be generated starts is 0. Therefore, the calculation formula for the time td2 when the interactive information A appears in the first video to be generated is as follows:

[0064] td2 = td1 - tbegin1

[0065] The time when the live content segment B starts playing in the natural timeline is tbegin3. After being put into the first video to be generated, it becomes the video segment B to be generated. The time when the interactive information B appears in the live broadcast is td3. Therefore, the calculation formula for the appearance time td4 of the interactive information B in the first video to be generated is as follows:

[0066] td4=td3-tbegin3+tend1-tbegin1

[0067] The above-mentioned importing method can make the live broadcast content targeted by the target information in the first video to be generated the same as the live broadcast content targeted during the live broadcast.

[0068] It can be seen from the above technical solution that during the live broadcast process, the interactive information for the live broadcast content will be saved in the database through the first corresponding relationship, and the first corresponding relationship identifies the relationship between the live broadcast identifier of the live broadcast content and the first information identifier of the interactive information, so that the interactive information corresponding to the live broadcast content can be accurately identified from the database through the first corresponding relationship. When the processing device obtains the first video editing task corresponding to the live broadcast content, the first video to be generated can be determined based on the live broadcast content and the editing requirements, and the first time interval in which the content included in the first video to be generated is determined based on the first time line of the live broadcast content. According to the live broadcast identifier of the live broadcast content, the target information corresponding to the first time interval is read from the database, and the target information is the interactive information that appears in the first time interval of the live broadcast content. When generating the first video file, since the first video to be generated and the target information are both determined based on the first time line, in order to synchronize the video content and the target information, the target information can be imported into the first video to be generated based on the first time line to obtain the first video file corresponding to the first video editing task. Since the interactive information corresponding to each live broadcast content is saved in the database independently of the live broadcast content, it is in a state that can be edited and read at any time. When determining video files from live content based on video editing tasks, the required target information can be conveniently and accurately selected from the database based on the corresponding relationship without the need for manual screening and synchronization, which improves the efficiency of video editing and saves human resources.

[0069] Among them, for different live broadcast situations, the amount of interactive information sent by users when watching live broadcasts may vary. For example, when a popular anchor is broadcasting live, users may send thousands of barrage messages within a few minutes. When a less popular anchor is broadcasting live, there may be only a few hundred barrage messages in the same period of time; or, during the daytime on weekdays, there are fewer users watching live broadcasts, and the amount of interactive information that needs to be stored in the entire live broadcast platform is relatively small. In the evening when people are resting, the number of people watching live broadcasts increases, and the amount of interactive information that needs to be stored in the entire live broadcast platform is relatively large. Therefore, in different live broadcast situations, the data flow of the database when storing interactive information is also different.

[0070] If the relevant device and the database directly transmit data, there is a coupling relationship between the relevant device and the database. That is, when the relevant device has the need to store interactive information, it will transmit the interactive information to the database for storage. When storing interactive information during the live broadcast, due to certain limitations on the transmission capacity of the database, if there is an excessively high information transmission peak, that is, a large amount of interactive information is transmitted to the database in a short period of time, it may cause the database to malfunction and fail to perform the storage function normally.

[0071] Therefore, in order to more reasonably control and manage the database, so that the database can store data in a relatively healthy state and avoid damage to the database due to excessively high information transmission peaks, the relevant devices and the database can be decoupled. In one possible implementation, the relevant devices can temporarily store the interactive information through the message middleware. Therefore, when the interactive information that needs to be stored appears in the live broadcast platform, the relevant devices can first send the interactive information to the message middleware, and then store the interactive information from the message middleware to the database, thereby achieving the decoupling effect between the live broadcast platform and the database.

[0072] Since the message middleware may temporarily store interactive information in a sequential manner, that is, the interactive information is stored and sent according to the first-in-first-out principle through message queues, etc., it may not be able to directly support arbitrary reading of interactive information. In order to realize the free reading function, the interactive information needs to be further stored in the database.

[0073] Based on this, when writing the interaction information into the database, the relevant device can save the interaction information in the message middleware into the database according to the corresponding relationship between the live broadcast identifier of the live broadcast content and the first information identifier of the interaction information.

[0074] Among them, the relevant equipment refers to the equipment for storing interactive information, such as the live broadcast platform mentioned in the above content. Message middleware refers to a device that can cache messages. Depending on the transmission performance of the database, the number of message middleware serving the database may also be different. When the database transmission performance is low and the possibility of encountering a high transmission peak is high, more message middleware can be configured for the database; when the database transmission performance is high and the possibility of encountering a high transmission peak is low, less message middleware can be configured for high-concurrency reception of interactive information. Temporary storage through message middleware can cache the message in the message middleware when a large peak occurs in the transmission of interactive information, and then send it to the database for storage at a more reasonable sending speed, so that the database does not need to directly contact the excessively high information transmission peak, which to a certain extent avoids damage to the database due to excessively high peaks in the transmission of interactive information.

[0075] At the same time, in order to further maintain the security of the database, the processing device can also manage the interaction information that has been stored in the database. Since the capacity of the database is limited, in order to prevent the amount of data stored in the database from being too large, resulting in too little free space in the database and the inability to use the functions in the database normally, the processing device can clean up the interaction information stored in the database.

[0076] In the interactive information stored in the database, the longer the interactive information is stored, the farther the corresponding live broadcast time is from the current time. It can be understood that the closer the live broadcast content is to the current time, the higher the possibility of being edited. Therefore, in a possible implementation, in order to make the database have sufficient free space and reasonably clean up the interactive information in the database, the processing device can clean up the data based on the storage time of the interactive information in the database.

[0077] If the capacity of the interaction information stored in the database exceeds the threshold, the processing device may determine that the capacity occupancy of the database at this time may affect the normal performance of the database. At this time, the processing device may clear the interaction information in the database according to the storage time of the interaction information. For example, when the capacity exceeds the threshold, the processing device may clear the interaction information with a longer storage time and retain the interaction information with a shorter storage time.

[0078] It is understandable that in order for the processing device to automatically generate the required first video file according to the live broadcast content, the first video editing task needs to include relevant information that enables the processing device to obtain the various contents of the first video file. First, the relevant user who needs to edit the video can initiate an editing request for the live broadcast content to be edited to the processing device. In the editing request, the relevant user can set the live broadcast identifier of the live broadcast content for the required first video file and the first time interval corresponding to the live broadcast content in the first video file.

[0079] The processing device can obtain the editing request for the live content, and then generate a video identifier corresponding to the first video file according to the editing request, and the video identifier is used to identify the first video file. Subsequently, the processing device can determine the live broadcast identifier for the live content from the editing request, and establish a second correspondence between the video identifier and the live broadcast identifier, so that the video and file to be generated edited by the live content can be marked in the subsequent process. At the same time, the processing device can determine the first information identifier corresponding to the live broadcast identifier according to the first correspondence relationship, and in order to facilitate the recording and management of the target information after the target information is imported into the first video file, the processing device can determine the second information identifier of the target information in the first video file, and the second information identifier is used to identify the target information imported into the first video file.

[0080] The processing device can generate a first video editing task based on the first corresponding relationship, the second corresponding relationship and the acquired first time interval, and the first video editing task may include a live broadcast identifier, a video identifier, a first information identifier, a second information identifier of the target information in the first video file, and a first time interval. Through the video identifier, the live broadcast identifier and the first time interval, the processing device can first determine the first video to be generated corresponding to the video identifier according to the targeted live broadcast content, and then, based on the first information identifier and the first time interval, the processing device can determine the corresponding target information from the database according to the technical solution mentioned above, and based on the first timeline corresponding to the first time interval and the second information identifier, import the target information into the second information identifier in the first video to be generated, thereby obtaining the desired first video file.

[0081] Of course, the above-mentioned information is only the information content necessary for generating the first video file. In addition to the above-mentioned information, in order to further enrich the information content that the first video file can display to the user, the first video editing task may also include other task information.

[0082] For example, when a user is watching a video, in addition to the above-mentioned bullet screen information and the video content itself, the user can also obtain other users' viewing experience of the video content by browsing the comment information on the video. Based on this, in order to enrich the user's experience when watching the first video file, when the processing device imports the target information into the first video file to be generated, it can further set the expression type of the target information in the first video file. The expression type refers to the way the target information is presented to the user in the first video file, which may include, for example, bullet screen type, comment type, etc.

[0083] In one possible implementation, after acquiring the target information, the processing device can determine the expression type of the target information in the first video file, which expression type includes any one or more of a barrage type or a comment type. When importing the target information, since target information of different expression types is presented differently in the first video file, the processing device needs to first determine the information import interface corresponding to the expression type, and based on the mapping relationship between the first timeline and the second timeline, import the target information into the first video to be generated through the information import interface to generate a first video file corresponding to the first video editing task.

[0084] For example, in Figure 1In the actual application scenario shown, a user sent a bullet screen message with the content "This game is really exciting" while watching the live broadcast of the basketball game. The bullet screen message is determined as part of the target information. When importing the target information, the processing device can determine the expression type of the bullet screen message as a comment type, and then import it into the first video to be generated through the information import interface corresponding to the comment type. When the user watches the first video file of the basketball game, he will not see this bullet screen message in the bullet screen, but will see a video comment with the same content as the bullet screen message in the video comment area.

[0085] It is understandable that during the live broadcast, since multiple users are sending interactive information at the same time and these users are watching the same live broadcast content, there is a certain probability that interactive information with the same content will be sent. For example, in a basketball game, if player A scores a key three-pointer, multiple users may send interactive information with the content "Player A is awesome". Therefore, the interactive information for the same live broadcast content may include repeated interactive information.

[0086] Since the meanings expressed by these repeated interactive information are basically the same, when storing the interactive information through the database, in order to save the storage space of the database so that the database can store more interactive information of the live content, the processing device can deduplicate the interactive information stored in the database, that is, delete some of the repeated interactive information.

[0087] In addition to the possibility of duplication of the interactive information itself, when the target information is imported into the first video to be generated, due to other error factors, there is a certain probability that the target information imported into the first video to be generated will be repeated. For example, when importing the target information, if the processing device has a restart, freeze, or other failures, it may cause the processing device to repeatedly import the same target information, which will cause multiple duplicate information to appear in the generated first video file, such as two identical comments, two identical bullet comments, etc., which may cause some confusion to users watching the video.

[0088] Based on this, in addition to deduplication processing of the interactive information in the database, in order to improve the reliability of the information in the first video file, the processing device can also perform corresponding deduplication processing when importing the target information. In a possible implementation, the target information acquired by the processing device includes first information, and the first information can be any information in the target information. When the first information is imported into the first video to be generated based on the first timeline, the processing device can determine whether the first information exists in the deduplication table.

[0089] Among them, the deduplication table is an information table set by the processing device for determining whether to import information repeatedly. When importing target information, the processing device can record the imported information in the deduplication table. If the processing device determines that the first information exists in the deduplication table, it means that the first information has been imported into the first video to be generated before. In order to prevent repeated import of interactive information, the processing device may not import the first information into the first video to be generated at this time; if it does not exist, it means that the first information has not been imported before. At this time, the processing device can import the first information into the first video to be generated. At the same time, in order to avoid repeated import of the first information in the subsequent import process, the processing device can write the first information into the deduplication table to complete the update of the deduplication table.

[0090] In addition, after obtaining the target information, in addition to deduplication of the target information during import, the processing device can also further check the target information itself to improve the security of the target information. It is understandable that during the live broadcast process, in order to maintain a good live broadcast environment, the relevant equipment usually reviews the interactive information sent by the user when watching the live broadcast. Among them, according to different review requirements, the way of reviewing the interactive information can be different.

[0091] For example, when there are many users sending interactive information during the live broadcast, in order to reduce the review pressure on the review equipment, you can choose to send first and then review, that is, first display the interactive information sent by the user in the live broadcast content, and then review the interactive information, thereby reducing the processing pressure on the system and equipment; when there are fewer users sending interactive information during the live broadcast, the review pressure is smaller. At this time, in order to improve the review accuracy, the review equipment can first review the interactive information sent by the user, and then display it to the audience through the live broadcast content.

[0092] When the review type of interactive information is "publish first, review later", since it has been added to the live content before the review, the relevant device will also store the interactive information in the database. When the processing device reads the interactive information from the database, there is a certain probability that this part of the unreviewed interactive information will be read. Based on this, in order to improve the security of the interactive information in the first video file, in a possible implementation method, after reading the target information, the processing device can first determine whether there is unreviewed interactive information in the target information. If so, the unreviewed interactive information is subject to content review, and the interactive information that does not meet the review criteria is removed from the target information.

[0093] like Figure 4 As shown, Figure 4The figure is a schematic diagram of a video processing method in an actual application scenario. After determining whether the target information contains unreviewed interactive information, the processing device can import the target information into different interfaces according to the determination result. If the target information contains interactive information that is released first and reviewed later, the target information is imported into the first video to be generated through the review-free interface; if there is interactive information that is released first and reviewed later, the interactive information is imported through the review interface, thereby completing the review of the target information content.

[0094] In order to facilitate the processing device to determine whether the target information contains unreviewed interactive information, the relevant device can add corresponding review type identification to the interactive information when storing the interactive information, including the first issue and then review identification and the first review and then issue identification. As shown in the following table, this table is the relevant information table when storing interactive information.

[0095]

[0096]

[0097] Among them, the live broadcast id is the live broadcast id of the live broadcast content targeted by the interactive information, the information id is the first information identifier corresponding to the live broadcast identifier, the information number id is the number identifier unique to each interactive information, and the information type is the information type corresponding to the interactive information, including text, video, picture, audio and other types. The information text is the specific information content of the interactive information, and the publishing source refers to the software used by the user when sending the interactive information. The table includes two softwares, software 1 and software 2. If published through software 1, it will carry the publishing software 1 account, and if published through software 2, it will carry the publishing software 2 account, so as to record and analyze user information. The publishing time is the time when the user sends the interactive information, and the information review result is the review result of the review device on the interactive information of the review-before-post type.

[0098] The play time point refers to the time node of playing the interactive information in the first timeline corresponding to the live broadcast. Whether there is a parent comment is used to identify whether the interactive information has a superior interactive information, that is, whether the interactive information is sent for a certain interactive information. The parent comment id is the information identifier corresponding to the parent comment, which is used to enable the processing device to find the parent comment. The message status is used to identify whether the interactive information is valid. The validity can be judged in a variety of ways, such as the storage time of the interactive information, the message content of the interactive information, etc.

[0099] In addition to carrying multiple types of information when storing interactive information, multiple types of information can also be carried in the first video editing task.

[0100] As shown in the following table, this table is an information table of the first video editing task in an actual application scenario:

[0101]

[0102] Among them, the relocation target type refers to the type of the first video file to be generated, which can include the video album type cid and the single video type vid. The relocation target id refers to the video identifier corresponding to the first video file, that is, the specific value of cid or vid. The target id refers to the second information identifier corresponding to the first video file. The live broadcast start time and the live broadcast end time can identify the first time interval corresponding to the first video editing task. The relocation range type is used to identify whether the live broadcast content corresponding to the first time interval is all live broadcast content or live broadcast content in a specified time period. Whether to exempt from review represents whether the acquired target information needs to be reviewed in this editing task. In some scenarios, if the live broadcast content to be edited is relatively safe, you can choose not to review the interactive information of the live broadcast content. The task status refers to the processing status of the first video editing task, which is divided into four types: not started, in progress, ended, and task processing failed, so that the processing device can know the current task processing status and avoid problems such as repeated execution of the same task.

[0103] In the above technical solutions, the described solutions are all processes of editing live content to generate a first video file. In daily video processing, secondary editing of the first video file is often involved. For example, if the first video file is a complete video recording of a basketball game, relevant personnel can edit the wonderful moves of a player based on the first video file.

[0104] In order to facilitate the user to perform secondary editing on the first video file, in a possible implementation, the processing device can also obtain a second video editing task for the first video file, and the second video editing task is used to instruct the processing device to edit the first video file to obtain the second video file.

[0105] Similar to the first video editing task, the processing device can determine the second video to be generated and the second time interval of the second video to be generated in the second timeline according to the second video editing task. The second video to be generated can be edited by the processing device from the live content included in the first video file according to the second time interval, and the second timeline is the video timeline of the first video file, that is, the relative timeline mentioned in the above content.

[0106] In order to determine the interactive information corresponding to the live content included in the second video file to be generated, the processing device can read the target information corresponding to the second time interval from the interactive information stored in the database according to the mapping relationship between the second timeline and the first timeline and the first information identifier. It can be understood that since the live content in the second video to be generated is extracted from the first video file, this part of the live content has a corresponding second time interval, and the live content in the first video file is extracted from the live content during the live broadcast and has a corresponding first time interval. Therefore, the time interval corresponding to the live content in the second video file to be generated can be determined through the mapping relationship between the first timeline and the second timeline, that is, the time interval corresponding to this part of the live content in the first timeline.

[0107] Based on the first information identifier, the processing device can find the corresponding interaction information in the database, and then based on the time interval, the processing device can determine the interaction information corresponding to the live content in the second video file to be generated, that is, the interaction information corresponding to the second time interval. This part of the interaction information is the target information corresponding to the second video to be generated.

[0108] The processing device can import the target information corresponding to the second time interval into the second video to be generated based on the second timeline to generate a second video file corresponding to the second video editing task. Wherein, as with the generation of the first video file, there can also be multiple importing methods when importing the target information according to different timeline references. For example, the processing device can first convert the time of appearance of the target information into the time in the second timeline through the mapping relationship between the first timeline and the second timeline, and then, according to the mapping relationship between the second timeline and the timeline of the second video to be generated, the time of appearance of the target information can be converted into the time in the timeline of the second video to be generated, thereby importing the target information into the corresponding position in the second video to be generated.

[0109] Next, a video processing method according to an embodiment of the present application will be introduced in combination with an actual application scenario.

[0110] See also Figure 5 , Figure 5 A schematic diagram of a video processing method provided in an embodiment of the present application. In this actual application scenario, the processing device is an intelligent terminal that can provide a timed video processing service. When watching a live broadcast, the audience can discuss or post bullet screens through the chat room or bullet screen function provided by the live broadcast platform, where the information discussed in the chat room can also be posted as bullet screen information in the live broadcast content.

[0111] If the live broadcast requires the barrage information to be reviewed before it is released, the information entered by the audience through the chat room or the barrage publishing function will be pushed to the review background for review. After the review background, the information will be sent to the barrage background, and the barrage background will reflect this information in the form of barrage in the live broadcast content.

[0112] like Figure 6 As shown, Figure 6 This is a schematic diagram of barrage information storage. After the audience enters the barrage, the terminal device can transmit the barrage and send the barrage information to the barrage posting cluster. After the barrage posting cluster reviews it, it can send the barrage information to the message queue. The messages in the message queue will be sent to the message middleware. The messages in the message middleware will be extracted and stored in the database SystemStructured Query Language, referred to as mysql).

[0113] In order to promote the live broadcast content, the operator of the live broadcast platform can configure a video editing task, which includes configuration task information, and the configuration task information can include a live broadcast identifier corresponding to the live broadcast content, a first information identifier, a first time interval, etc. The operator can send the video editing task to the smart terminal, and the smart terminal can perform video processing according to the editing task.

[0114] After receiving the video editing task, the smart terminal can use the scheduled video processing service to first read the live content corresponding to the live identification from the video data service library, and perform video editing according to the video editing task through the editing platform to obtain the video to be generated. Subsequently, the smart terminal can obtain the time node of the clip in the video to be generated, determine the interactive information configuration task based on the time node, live identification and other information, and import the corresponding interactive information into the video to be generated based on the interactive information configuration task.

[0115] like Figure 7 As shown, Figure 7 A flowchart of a video processing method in an actual application scenario provided by the present application, the method comprising:

[0116] S701: Read the task configuration table to query unfinished interaction information configuration tasks.

[0117] The intelligent terminal can query the interaction information configuration tasks that are currently in an unfinished state by reading the task configuration table.

[0118] S702: Query the audit type of the interactive information of pid. If it is the type of first release and then review, and the method of importing information in the configuration task is the review-free method, notify the user to perform a second confirmation.

[0119] The intelligent terminal can determine the review type for the interactive information of the live broadcast based on the live broadcast identifier pid in the interactive information configuration task. If it is a publish-first-review-later type, it means that the interactive information stored in the database has not been reviewed. If the user chooses to import information without review, information security issues may arise. Therefore, a second confirmation message can be sent to the user.

[0120] In addition, if the method of importing information is not exempt from review, and the review type is first issue then review, the target information can be reviewed when importing the target information through the write interface.

[0121] S703: Determine the information identifier of the video to be generated.

[0122] In order to import the interactive information into the corresponding video to be generated, the intelligent terminal may first determine the information identifier corresponding to the video to be generated, that is, the information identifier corresponding to the interactive information to be written in the video to be generated.

[0123] S704: Determine the time interval provided by the editing platform.

[0124] According to the time nodes included in the interactive information configuration task, the intelligent terminal can determine the time interval corresponding to the video to be generated edited by the editing platform in the live broadcast timeline.

[0125] S705: Read the interaction information storage table according to the information identifier corresponding to the live broadcast identifier.

[0126] The interactive information storage table is used to record the interactive information stored in MySQL. By reading the storage table, the intelligent terminal can determine the target information to be imported.

[0127] S706: Determine whether there is any target information that has not been imported.

[0128] During the import process, the intelligent terminal can determine in real time whether there is target information of the video to be generated that has not been imported. If yes, jump to S707; if no, jump to S710.

[0129] S707: During the import, deduplication processing is performed according to the redis deduplication table.

[0130] The intelligent terminal can detect whether the target information has been imported repeatedly according to the Remote Dictionary Server (redis) deduplication table. If it has been imported, the target information will not be imported again; if it does not exist, jump to S708.

[0131] S708: If the target information does not have duplication, call the on-demand comment writing interface or the on-demand bullet screen writing interface to import the target information.

[0132] The intelligent terminal can determine the expression type of the target information in the video file required for the video editing task. If it is a comment type, the target information is imported through the on-demand comment writing interface; if it is a barrage type, the target information is imported through the on-demand barrage writing interface.

[0133] S709: Update the redis deduplication table.

[0134] After successfully writing the new target information, the smart terminal can update the redis deduplication table used for deduplication.

[0135] S710: Update the status of the interaction information configuration task to a completed status.

[0136] After determining that all target information has been imported into the video to be generated, the intelligent terminal may update the interactive information configuration task to a completed state, thereby avoiding repeated execution of the task.

[0137] The execution process of the above interactive information configuration task can be achieved through Figure 8 The operation personnel can input the video editing task to the server, and the server can obtain the relevant information for generating the required video file according to the task information, such as obtaining the time interval corresponding to the video to be generated and the target information in the database. Then, the server can import the target information into the video to be generated in a corresponding manner according to different target information types.

[0138] Based on the video processing method provided in the above embodiment, the present application also provides a video processing device, see Fig. 9 , Fig. 9 The structure block diagram of a video processing device 900 provided in the present application includes a first determining unit 901, a first reading unit 902 and a first importing unit 903:

[0139] A first determining unit 901 is configured to determine, according to a first video editing task corresponding to the live content, a first video to be generated and a first time interval of the first video to be generated in a first timeline, where the first timeline is a live timeline of the live content;

[0140] A first reading unit 902 is configured to read target information corresponding to the first time interval from interaction information stored in a database according to a live broadcast identifier of the live broadcast content, wherein the interaction information is interaction information for the live broadcast content acquired during the live broadcast of the live broadcast content, and the interaction information is stored in the database according to a first corresponding relationship between the live broadcast identifier and the first information identifier;

[0141] The first import unit 903 is used to import the target information into the first video to be generated based on the mapping relationship between the first timeline and the second timeline to generate a first video file corresponding to the first video editing task, and the second timeline is the video timeline of the first video file.

[0142] In a possible implementation, the apparatus 900 further includes a first storage unit and a second storage unit:

[0143] A first storage unit, used for temporarily storing the interaction information through a message middleware;

[0144] The second storage unit is used to save the interaction information in the message middleware into the database according to the corresponding relationship between the live broadcast identifier of the live broadcast content and the first information identifier of the interaction information.

[0145] In a possible implementation, the apparatus 900 further includes a first acquisition unit, a first generation unit, and a second generation unit:

[0146] A first obtaining unit, configured to obtain an editing request for the live broadcast content;

[0147] A first generating unit, configured to generate a video identifier corresponding to the first video file according to the editing request, and establish a second corresponding relationship between the video identifier and the live broadcast identifier;

[0148] The second generating unit is used to generate a first video editing task according to the first corresponding relationship, the second corresponding relationship, and the first time interval obtained; the first video editing task includes the live broadcast identifier, the video identifier, the first information identifier, the second information identifier of the target information in the first video file, and the first time interval.

[0149] In a possible implementation, the first importing unit 903 is specifically configured to:

[0150] Determine an expression type of the target information in the first video file; the expression type includes any one or more of a bullet screen type or a comment type;

[0151] Determine the information import interface corresponding to the expression type;

[0152] Based on the mapping relationship between the first timeline and the second timeline, the target information is imported into the first video to be generated through the information import interface to generate a first video file corresponding to the first video editing task.

[0153] In a possible implementation manner, the target information includes first information, and the apparatus 900 further includes a second determining unit:

[0154] A second determining unit, configured to determine whether the first information exists in the deduplication table when importing the first information into the first video to be generated based on the mapping relationship between the first timeline and the second timeline;

[0155] If the information exists, the first information is not imported into the first video to be generated;

[0156] If not present, the first information is imported into the first video to be generated, and the first information is written into the deduplication table.

[0157] In a possible implementation, the method further includes a second acquiring unit, a third determining unit, a second reading unit, and a second importing unit:

[0158] A second obtaining unit, configured to obtain a second video editing task for the first video file;

[0159] A third determining unit, configured to determine, according to the second video editing task, a second video to be generated and a second time interval of the second video to be generated in the second timeline;

[0160] a second reading unit, configured to read target information corresponding to the second time interval from the interaction information stored in the database according to a mapping relationship between the second time line and the first time line and the first information identifier;

[0161] The second importing unit is used to import the target information corresponding to the second time interval into the second video to be generated based on the second timeline, so as to generate a second video file corresponding to the second video editing task.

[0162] In a possible implementation, the apparatus 900 further includes a fourth determining unit and a reviewing unit:

[0163] a fourth determining unit, configured to determine whether the target information contains any unreviewed interaction information;

[0164] The review unit is used to, if available, perform content review on the unreviewed interactive information and remove the interactive information that does not meet the review criteria from the target information.

[0165] In a possible implementation, the apparatus 900 further includes a clearing unit:

[0166] The clearing unit is configured to clear the interaction information in the database according to the storage time of the interaction information if the capacity of the interaction information stored in the database exceeds a threshold.

[0167] In a possible implementation, the apparatus 900 further includes a deduplication unit:

[0168] The deduplication unit is used to perform deduplication processing on the interactive information in the database.

[0169] The present application also provides a device for video processing, which is described below in conjunction with the accompanying drawings. Fig.10 As shown, the embodiment of the present application provides a device, which may also be a terminal device. The terminal device may be any intelligent terminal including a mobile phone, a tablet computer, a personal digital assistant (PDA), a point of sales (POS), a vehicle-mounted computer, etc., and the terminal device is a mobile phone as an example:

[0170] Fig.10 FIG. 1 is a block diagram showing a partial structure of a mobile phone related to a terminal device provided in an embodiment of the present application. Fig.10 The mobile phone includes: a radio frequency (RF) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity (WiFi) module 1070, a processor 1080, and a power supply 1090. Those skilled in the art can understand that Fig.10 The mobile phone structure shown in the figure does not constitute a limitation on the mobile phone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0171] Combine the following Fig.10 A detailed introduction to the various components of the mobile phone:

[0172] The RF circuit 1010 can be used for receiving and sending signals during the process of sending and receiving information or making calls. In particular, after receiving the downlink information of the base station, it is sent to the processor 1080 for processing; in addition, the designed uplink data is sent to the base station. Usually, the RF circuit 810 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, referred to as LNA), a duplexer, etc. In addition, the RF circuit 1010 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to the Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.

[0173] The memory 1020 can be used to store software programs and modules. The processor 1080 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 1020. The memory 1020 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 1020 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0174] The input unit 1030 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile phone. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1031 or near the touch panel 1031 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 1031 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the processor 1080, and can receive and execute commands sent by the processor 1080. In addition, the touch panel 1031 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1031, the input unit 1030 may further include other input devices 1032. Specifically, the other input devices 1032 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

[0175] The display unit 1040 can be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 1040 may include a display panel 1041. Optionally, the display panel 1041 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch panel 1031 may cover the display panel 1041. When the touch panel 1031 detects a touch operation on or near it, it is transmitted to the processor 1080 to determine the type of touch event. Subsequently, the processor 1080 provides a corresponding visual output on the display panel 1041 according to the type of touch event. Although in Fig.10 In the embodiment, the touch panel 1031 and the display panel 1041 are used as two independent components to realize the input and output functions of the mobile phone, but in some embodiments, the touch panel 1031 and the display panel 1041 can be integrated to realize the input and output functions of the mobile phone.

[0176] The mobile phone may also include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 1041 and / or the backlight when the mobile phone is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the mobile phone, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0177] The audio circuit 1060, the speaker 1061, and the microphone 1062 can provide an audio interface between the user and the mobile phone. The audio circuit 1060 can transmit the received audio data to the speaker 1061 after converting the received audio data into an electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1060 and converted into audio data, and then the audio data is output to the processor 1080 for processing, and then sent to another mobile phone through the RF circuit 1010, or the audio data is output to the memory 1020 for further processing.

[0178] WiFi is a short-range wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages and access streaming media through the WiFi module 1070. It provides users with wireless broadband Internet access. Fig.10 A WiFi module 1070 is shown, but it is understandable that it is not an essential component of the mobile phone and can be omitted as needed without changing the essence of the invention.

[0179] The processor 1080 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. It executes various functions of the mobile phone and processes data by running or executing software programs and / or modules stored in the memory 1020 and calling data stored in the memory 1020. Optionally, the processor 1080 may include one or more processing units; preferably, the processor 1080 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 1080.

[0180] The mobile phone also includes a power supply 1090 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 1080 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption.

[0181] Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0182] In this embodiment, the processor 1080 included in the terminal device also has the following functions:

[0183] Determine, according to a first video editing task corresponding to the live content, a first video to be generated and a first time interval of the first video to be generated in a first timeline, where the first timeline is a live timeline of the live content;

[0184] According to the live broadcast identifier of the live broadcast content, target information corresponding to the first time interval is read from the interaction information stored in the database, wherein the interaction information is interaction information for the live broadcast content acquired during the live broadcast of the live broadcast content, and the interaction information is stored in the database according to a first corresponding relationship between the live broadcast identifier and the first information identifier;

[0185] Based on the mapping relationship between the first timeline and the second timeline, the target information is imported into the first video to be generated to generate a first video file corresponding to the first video editing task, and the second timeline is the video timeline of the first video file.

[0186] The present application also provides a server. Fig.11 As shown, Fig.11 The structural diagram of the server 1100 provided in the embodiment of the present application, the server 1100 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPUs) 1122 (for example, one or more processors) and memories 1132, and one or more storage media 1130 (for example, one or more mass storage devices) storing application programs 1142 or data 1144. Among them, the memory 1132 and the storage medium 1130 can be short-term storage or permanent storage. The program stored in the storage medium 1130 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processing unit 1122 can be configured to communicate with the storage medium 1130 and execute a series of instruction operations in the storage medium 1130 on the server 1100.

[0187] The server 1100 may also include one or more power supplies 1126, one or more wired or wireless network interfaces 1150, one or more input and output interfaces 1158, and / or one or more operating systems 1141, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

[0188] The steps performed by the server in the above embodiment can be based on Fig.11 The server structure shown.

[0189] The embodiment of the present application also provides a computer-readable storage medium for storing a computer program, wherein the computer program is used to execute any one of the implementation methods of the video downloading methods described in the aforementioned embodiments.

[0190] A person of ordinary skill in the art can understand that all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the above-mentioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the above-mentioned storage medium can be at least one of the following media: read-only memory (English: read-only memory, abbreviated: ROM), RAM, magnetic disk or optical disk, etc. Various media that can store program codes.

[0191] It should be noted that each embodiment in this specification is described in a progressive manner, and the same and similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiments. The device and system embodiments described above are merely schematic, in which the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative work.

[0192] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A video processing method, characterized in that: The method comprises: Determine, according to a first video editing task corresponding to the live content, a first video to be generated and a first time interval of the first video to be generated in a first timeline, where the first timeline is a live timeline of the live content; According to the live broadcast identifier of the live broadcast content, target information corresponding to the first time interval is read from the interaction information stored in the database, the interaction information is interaction information for the live broadcast content acquired during the live broadcast of the live broadcast content, the interaction information is stored in the database according to a first corresponding relationship between the live broadcast identifier and a first information identifier, and the first information identifier is used to identify interaction information related to the live broadcast content; Based on the mapping relationship between the first timeline and the second timeline, the target information is imported into the first video to be generated to generate a first video file corresponding to the first video editing task, which includes: determining the expression type of the target information in the first video file, the expression type includes any one or more of the barrage type and the comment type, and the expression type refers to the way in which the target information is presented to the user in the first video file; determining the information import interface corresponding to the expression type; based on the mapping relationship between the first timeline and the second timeline, importing the target information into the first video to be generated through the information import interface to generate the first video file corresponding to the first video editing task, and the second timeline is the video timeline of the first video file; The method of creating the first video editing task includes: Obtaining an editing request for the live broadcast content; Generate a video identifier corresponding to the first video file according to the editing request, and establish a second corresponding relationship between the video identifier and the live broadcast identifier; A first video editing task is generated according to the first corresponding relationship, the second corresponding relationship, and the first time interval obtained, wherein the first video editing task includes a live broadcast identifier, a video identifier, a first information identifier, a second information identifier of the target information in the first video file, and the first time interval.

2. The method according to claim 1, characterized in that Before determining the first video to be generated and the first time interval of the first video to be generated in the first timeline according to the first video editing task corresponding to the live content, the method further includes: Temporarily storing the interaction information through the message middleware; The interactive information in the message middleware is saved in the database according to the corresponding relationship between the live broadcast identifier of the live broadcast content and the first information identifier of the interactive information.

3. The method according to claim 1 or 2, characterized in that: The target information includes first information. In the process of importing the target information into the first video to be generated based on the mapping relationship between the first timeline and the second timeline, the method further includes: When first information is imported into the first video to be generated based on the mapping relationship between the first timeline and the second timeline, determining whether the first information exists in the deduplication table; If the information exists, the first information is not imported into the first video to be generated; If not present, the first information is imported into the first video to be generated, and the first information is written into the deduplication table.

4. The method according to claim 1, characterized in that: The method further comprises: Acquire a second video editing task for the first video file; Determine, according to the second video editing task, a second video to be generated and a second time interval of the second video to be generated in the second timeline; Reading target information corresponding to the second time interval from the interaction information stored in the database according to a mapping relationship between the second timeline and the first timeline and the first information identifier; Based on the second timeline, the target information corresponding to the second time interval is imported into the second video to be generated to generate a second video file corresponding to the second video editing task.

5. The method according to claim 1, characterized in that Before generating the first video file corresponding to the first video editing task, the method further includes: Determining whether the target information contains unreviewed interactive information; If available, content review is performed on the unreviewed interactive information, and interactive information that does not meet the review criteria is removed from the target information.

6. The method according to claim 1, characterized in that The method further comprises: If the capacity of the interaction information stored in the database exceeds a threshold, the interaction information in the database is cleared according to the storage time of the interaction information.

7. The method according to claim 1, characterized in that The method further comprises: Deduplication processing is performed on the interactive information in the database.

8. A video processing device, characterized in that: The device comprises a first determining unit, a first reading unit and a first importing unit: The first determining unit is used to determine, according to a first video editing task corresponding to the live content, a first video to be generated and a first time interval of the first video to be generated in a first timeline, where the first timeline is a live timeline of the live content; The first reading unit is used to read the target information corresponding to the first time interval from the interactive information stored in the database according to the live broadcast identifier of the live broadcast content, wherein the interactive information is interactive information for the live broadcast content acquired during the live broadcast process of the live broadcast content, and the interactive information is stored in the database according to a first corresponding relationship between the live broadcast identifier and a first information identifier, and the first information identifier is used to identify the interactive information related to the live broadcast content; The first import unit is used to import the target information into the first video to be generated based on the mapping relationship between the first timeline and the second timeline to generate a first video file corresponding to the first video editing task, which includes: determining the expression type of the target information in the first video file, the expression type includes any one or more of the barrage type and the comment type, and the expression type refers to the way in which the target information is presented to the user in the first video file; determining the information import interface corresponding to the expression type; based on the mapping relationship between the first timeline and the second timeline, importing the target information into the first video to be generated through the information import interface to generate the first video file corresponding to the first video editing task, and the second timeline is the video timeline of the first video file; The method of creating the first video editing task includes: Obtaining an editing request for the live broadcast content; Generate a video identifier corresponding to the first video file according to the editing request, and establish a second corresponding relationship between the video identifier and the live broadcast identifier; A first video editing task is generated according to the first corresponding relationship, the second corresponding relationship, and the first time interval obtained, wherein the first video editing task includes a live broadcast identifier, a video identifier, a first information identifier, a second information identifier of the target information in the first video file, and the first time interval.

9. The device according to claim 8, characterized in that The device also includes a first storage unit and a second storage unit: The first storage unit is used to temporarily store the interaction information through the message middleware; The second storage unit is used to save the interaction information in the message middleware into the database according to the corresponding relationship between the live broadcast identifier of the live broadcast content and the first information identifier of the interaction information.

10. The device according to claim 8 or 9, characterized in that The target information includes first information, and the device further includes: A second determination unit is configured to determine whether the first information exists in the deduplication table when the first information is imported into the first video to be generated based on the mapping relationship between the first timeline and the second timeline; if so, not importing the first information into the first video to be generated; if not, importing the first information into the first video to be generated and writing the first information into the deduplication table.

11. The device according to claim 8, characterized in that The device further comprises a second acquiring unit, a third determining unit, a second reading unit and a second importing unit: The second acquisition unit is used to acquire a second video editing task for the first video file; The third determining unit is used to determine the second video to be generated and a second time interval of the second video to be generated in the second timeline according to the second video editing task; The second reading unit is configured to read the target information corresponding to the second time interval from the interaction information stored in the database according to the mapping relationship between the second time line and the first time line and the first information identifier; The second importing unit is used to import the target information corresponding to the second time interval into the second video to be generated based on the second timeline, so as to generate a second video file corresponding to the second video editing task.

12. The device according to claim 8, characterized in that The device also includes a fourth determination unit and a review unit; The fourth determining unit is used to determine whether the target information contains unreviewed interaction information; The review unit is used to, if available, perform content review on the unreviewed interactive information and remove interactive information that does not meet the review criteria from the target information.

13. The device according to claim 8, characterized in that The device also includes a clearing unit; The clearing unit is configured to clear the interaction information in the database according to the storage time of the interaction information if the capacity of the interaction information stored in the database exceeds a threshold.

14. A device for video processing, characterized in that: The device comprises a processor and a memory: The memory is used to store program code and transmit the program code to the processor; The processor is used to execute the video processing method described in any one of claims 1 to 7 according to the instructions in the program code.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and the computer program is used to execute the video processing method according to any one of claims 1 to 7.