Video processing method, device, electronic device and computer readable storage medium

Abstract

The present disclosure relates to a video processing method, device, electronic device and computer-readable storage medium, wherein the method comprises: obtaining a video to be published in a video interactive application; when the video includes news material, obtaining the element content of the news corresponding to the news material, and adding the element content to the video. Through the present disclosure, the problem of incomplete video content caused by processing the video to be published in the related art is solved, thereby achieving the effect of effectively improving the integrity of the video content.

Description

Technical Field

[0001] The present disclosure relates to the field of computers, and in particular to a video processing method, device, electronic device, and computer-readable storage medium. Background Art

[0002] When playing videos on interactive application software, the video is edited by the publisher according to his / her own needs. For example, the publisher may cut or render the video. However, when the video is processed in the above way, some important information may be missing, resulting in incomplete content. Summary of the invention

[0003] The present disclosure provides a video processing method, device, electronic device and computer-readable storage medium to at least solve the problem in the related art that the video content is incomplete after the video to be published is processed. The technical solution of the present disclosure is as follows:

[0004] According to a first aspect of an embodiment of the present disclosure, a video processing method is provided, comprising: obtaining a video to be published in a video interaction application; when the video includes news material, obtaining element content of news corresponding to the news material; and adding the element content to the video.

[0005] Optionally, obtaining the essential content of the news corresponding to the news material includes: obtaining audio data from the video; capturing news keywords from the audio data; and searching for the news corresponding to the news material based on the news keywords to obtain the essential content of the news.

[0006] Optionally, the method also includes: obtaining image data from the video; obtaining news image data from the news corresponding to the news material; verifying the image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to the upload terminal of the video.

[0007] Optionally, adding the element content to the video includes: determining a predetermined frame video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame video image; and adding the element content to the predetermined frame video image.

[0008] Optionally, adding the element content to the predetermined frame video image includes: determining a position of the target object in the predetermined frame video image; and displaying the element content for the target object based on the determined position.

[0009] A second aspect of an embodiment of the present disclosure provides a video processing method, including: receiving a video playback request on a display interface; responding to the video playback request and playing a video on the display interface, wherein the video is a video in a video interaction application, and news elements are added to the played video, and the news is news corresponding to the news material included in the video.

[0010] A third aspect of the disclosed embodiments provides a video processing method, comprising: receiving a sliding operation; and playing a video in response to the sliding operation, wherein the video is a video in a video interaction application, and news elements are added to the played video, and the news is news corresponding to the news material included in the video.

[0011] According to a fourth aspect of the embodiments of the present disclosure, a video processing device is provided, comprising: a first acquisition module, used to acquire a video to be published in a video interaction application; a second acquisition module, used to acquire the element content of news corresponding to the news material when the video includes news material; and a first adding module, used to add the element content to the video.

[0012] Optionally, the second acquisition module includes: a first acquisition unit, used to acquire audio data from the video; a second acquisition unit, used to acquire news keywords from the audio data; and a first search unit, used to search for news corresponding to the news material based on the news keywords to obtain element content of the news.

[0013] Optionally, the device also includes: a third acquisition module, used to acquire image data from the video; a fourth acquisition module, used to acquire news image data from the news corresponding to the news material; a verification module, used to verify the image data in the video according to the news image data to obtain a verification result; and a feedback module, used to feed back the verification result to the upload terminal of the video.

[0014] Optionally, the first adding module includes: a determining unit, used to determine a predetermined frame video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame video image; and an adding unit, used to add the element content to the predetermined frame video image.

[0015] Optionally, the adding unit includes: a determining subunit, used to determine the position of the target object in the predetermined frame video image; and a display subunit, used to display the element content for the target object based on the determined position.

[0016] According to a fifth aspect of an embodiment of the present disclosure, a video processing device is provided, including: a first receiving module, used to receive a video playback request on a display interface; a first playback module, used to respond to the video playback request and play the video on the display interface, wherein the video is a video in a video interaction application, and news elements are added to the played video, and the news is news corresponding to the news material included in the video.

[0017] A sixth aspect of an embodiment of the present disclosure provides a video processing device, including: a second receiving module, used to receive a sliding operation; a second playing module, used to respond to the sliding operation and play a video, wherein the video is a video in a video interaction application, and news elements are added to the played video, and the news is news corresponding to the news material included in the video.

[0018] According to a seventh aspect of an embodiment of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement a video processing method as described in any one of the above items.

[0019] According to an eighth aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute any one of the video processing methods described above.

[0020] According to a ninth aspect of an embodiment of the present disclosure, a computer program product is provided. When a computer program in the computer program product is executed by a processor of an electronic device, the electronic device is enabled to execute any one of the video processing methods described above.

[0021] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects:

[0022] By adding news elements to the news materials included in the video, the missing information in the video can be supplemented, effectively allowing video viewers to view the complete information of the video, thereby improving the user's video viewing experience. The problem of incomplete video content caused by processing the video to be published in the related art is solved, thereby achieving the effect of effectively improving the integrity of the video content.

[0023] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0025] Figure 1 The present invention is a hardware structure block diagram of a computer terminal for implementing a video processing method according to an exemplary embodiment.

[0026] Figure 2 The figure is a flowchart of a video processing method 1 according to an exemplary embodiment.

[0027] Figure 3 It is a schematic diagram of an interface for adding element content to a video frame according to an embodiment of the present invention.

[0028] Figure 4 The figure is a flowchart of a second video processing method according to an exemplary embodiment.

[0029] Figure 5 is a flowchart of a third video processing method according to an exemplary embodiment.

[0030] Figure 6 is a flowchart of a fourth video processing method according to an exemplary embodiment.

[0031] Figure 7 is a device block diagram of a video processing device 1 according to an exemplary embodiment.

[0032] Figure 8 is a device block diagram of a second video processing device according to an exemplary embodiment.

[0033] Fig. 9 is a device block diagram of a video processing device 3 according to an exemplary embodiment.

[0034] Fig.10 It is a device block diagram of a terminal according to an exemplary embodiment.

[0035] Fig.11 The figure is a structural block diagram of a server according to an exemplary embodiment. DETAILED DESCRIPTION

[0036] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0037] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0038] Example 1

[0039] According to an embodiment of the present disclosure, a method embodiment of a video processing method is proposed. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that here.

[0040] The method embodiment provided in Embodiment 1 of the present disclosure may be executed in a mobile terminal, a computer terminal or a similar computing device. Figure 1 FIG. 1 is a hardware structure block diagram of a computer terminal (or mobile device) for implementing a video processing method according to an exemplary embodiment. Figure 1 As shown, the computer terminal 10 (or mobile device) may include one or more (shown as 102a, 102b, ..., 102n in the figure) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission device for communication functions. In addition, it may also include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the BUS bus), a network interface, a power supply and / or a camera. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0041] It should be noted that the one or more processors 102 and / or other data processing circuits described above may generally be referred to herein as "data processing circuits". The data processing circuits may be embodied in whole or in part as software, hardware, firmware, or any other combination thereof. In addition, the data processing circuit may be a single independent processing module, or may be incorporated in whole or in part into any of the other components in the computer terminal 10 (or mobile device). As involved in the embodiments of the present disclosure, the data processing circuit acts as a processor control (e.g., selection of a variable resistor terminal path connected to an interface).

[0042] The memory 104 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the video processing method in the embodiment of the present disclosure. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, that is, to implement the vulnerability detection method of the above-mentioned application. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the computer terminal 10 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0043] The transmission device is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device can be a radio frequency (Radio Frequency, RF) module, which is used to communicate with the Internet wirelessly.

[0044] The display may be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the computer terminal 10 (or mobile device).

[0045] It should be noted that, in some optional embodiments, the above Figure 1 The computer device (or mobile device) shown may include hardware elements (including circuits), software elements (including computer code stored on a computer-readable medium), or a combination of hardware elements and software elements. It should be noted that Figure 1This is merely one example of a particular embodiment and is intended to illustrate the types of components that may be present in the above-described computer device (or mobile device).

[0046] The data involved in the present disclosure (such as data used for analysis, data for presentation, etc.) may be data authorized by the user or fully authorized by all parties.

[0047] Under the above operating environment, the present disclosure provides Figure 2 The video processing method shown. Figure 2 is a flowchart of a video processing method 1 according to an exemplary embodiment. Figure 2 As shown, the method is used in the above-mentioned computer terminal and includes the following steps.

[0048] In step S21, a video to be published in a video interaction application is obtained.

[0049] In step S22, when the video includes news material, the essential content of the news corresponding to the news material is obtained.

[0050] It should be noted that the above-mentioned elements may include: the time when the news occurred, the place where the news occurred, the people involved in the news and other information.

[0051] In step S23, the element content is added to the video.

[0052] By adopting the above processing, by adding news elements to the video for the news materials included in the video, the missing information in the video can be supplemented, so that the video viewers can effectively watch the complete information of the video, thereby improving the user's video viewing experience. The problem of incomplete video content caused by processing the video to be released in the related art is solved, thereby achieving the effect of effectively improving the integrity of the video content.

[0053] In one or more optional embodiments, the video processing method 1 can be applied to a variety of video processing scenarios, which can be a scenario of processing a video to be published in a video interactive application. The execution subject of the video processing method 1 can be various, for example, it can be a server that reviews or edits the video to be published, or it can be a terminal, for example, a computer cluster with parallel processing capabilities, etc.

[0054] In one or more optional embodiments, a video to be published in a video interactive application is obtained, that is, a user who publishes a video uploads the video to a server, and the server receives the uploaded video. It should be noted that when a user uploads a video to be published, an option to select a type may be provided to the user, and the user selects the type of the uploaded video to be published based on the provided options, for example, news, entertainment, selfie, life, etc. Of course, the user's selection of the provided options may not be a necessary operation, that is, the user may choose whether to identify the type.

[0055] In one or more optional embodiments, when determining whether a video includes news material, multiple methods can be used. For example, when a user uploads a video to be published, if the type of the video to be published has been selected, it can be directly determined whether the video includes news material based on the type selected by the user. For example, when the user uploads the video, it has been identified that the video belongs to the news category, then the video can be confirmed to include news material to a large extent. For another example, when determining whether a video includes news material, the specific content of the video can also be analyzed to accurately determine whether it belongs to news material. For example, voice and image data can be obtained from the video (that is, the video is split to obtain audio data and image data respectively), and keywords in the video content can be captured from the voice. For example, the keyword can be compared with a predetermined news word library. When the keyword matches the news word in the news word library, it is determined that the video includes news material. By matching with a predetermined news word library, it can be more accurately determined whether the video includes news material.

[0056] In one or more optional embodiments, when obtaining the element content of the news corresponding to the news material, the news corresponding to the news material can be determined first, and then the element content of the news can be obtained. For example, the following processing method can be used: obtain audio data from the video; obtain news keywords from the audio data; search the news corresponding to the news material according to the news keywords to obtain the element content of the news. In one or more optional embodiments, when obtaining news keywords from audio data, that is, splitting the audio data from the video, some video editing software can be used to separate the audio data in the video through the software, so as to store it as an audio data file. When capturing news keywords from audio data, natural language processing (NLP) can be used to implement it. For example, the audio data can be converted into text first, and the text can be preprocessed (segmenting the text, removing stop words, etc.) to obtain segmented words, and then each segmented word is matched with the words in the news word library to obtain the news keywords included in the audio data. When searching for news corresponding to the news material according to the news keyword and obtaining the essential content of the news, the news keyword can be processed first. For example, the context of the news keyword in the audio data can be semantically processed to obtain the news entry. Then, the news corresponding to the news material can be searched in the news database (for example, it can be an authorized news website) according to the news entry, and the information of the searched news is refined to obtain the essential content of the news. For example, the following method can be adopted: firstly, the context of the news keyword in the audio data is semantically processed to obtain a complete information segment; the complete information segment is refined to obtain a news entry. Among them, the complete information segment is used to fully express the content of the news material in the video. After the complete information segment is refined, the obtained news entry is convenient for subsequent search. After the context of the news keyword is semantically processed, the complete information segment is obtained, which can more comprehensively and accurately express the content of the news, so that the subsequent search is more accurate; and the complete information segment is refined to obtain the news entry, which can be more conducive to the subsequent search. When searching for news corresponding to news materials based on news keywords and obtaining the essential content of the news, you can search in the news database, extract the information of the news corresponding to the news materials, and obtain the essential content of the news. When searching for news based on news keywords, you can select the news database to be searched, so that the integrity of the news obtained by the search is high.

[0057] In one or more optional embodiments, image data can also be obtained from the video; news image data can be obtained from the news corresponding to the news material; the image data in the video can be verified according to the news image data to obtain the verification result; and the verification result can be fed back to the video upload terminal. Among them, the news image data obtained from the news corresponding to the news material is the complete image data of the news. When the image data in the video is verified, the image data in the video can be compared with the key information in the news image data in the news, so as to obtain the verification result of whether the image data in the video is complete, and the verification result can be fed back to the video uploading user. When the verification result indicates that the image data in the video is incomplete, the user prompt information is fed back to prompt that the video needs to be modified so that the uploaded video is complete and accurate. For example, the video uploading user can be prompted to supplement some information of the uploaded video, such as supplementing some key elements of the uploaded video: time, place, characters, etc. The above processing can prompt the video uploading user to upload the complete video content and improve the satisfaction of the video viewing user.

[0058] In one or more optional embodiments, after acquiring the element content, when adding the element content to the video, a predetermined frame video image in the video can be determined, wherein the predetermined frame video image has a target object corresponding to the element content; and the element content is added to the predetermined frame video image. Since the target object corresponding to the element content appears in the predetermined frame video image, when the element content is added to the predetermined frame video image, the integrity of the video can be more clearly displayed. For example, when the element content is a person in the news, the person in the news is added to the predetermined frame video image in which the person appears in the video, while the video frame in which the person does not appear in the video is not added. In this way, when the video is played, the video viewer can more directly confirm the integrity of the video content, thereby improving the user's viewing experience.

[0059] In one or more optional embodiments, when adding element content to a predetermined frame video image, the position of the target object in the predetermined frame video image can be determined; based on the determined position, the element content is displayed for the target object. The element content is displayed for the target object at the position where the target object is located, so that when playing the video, not only can the video viewer more directly confirm the integrity of the video content, but also can more clearly know the position of the target object corresponding to the element content in the video image, which further facilitates the user to know the element information and further improves the user's video viewing experience. Figure 3 is a schematic diagram of an interface for adding element content to a video frame according to an embodiment of the present invention, such as Figure 3As shown, when a target object (e.g., a handbag in a car) appears in the predetermined frame of video image, an arrow may be drawn at the location of the object, and an image frame may be displayed not far from the arrow (e.g., where the video image is not blocked), in which the target object in the news is displayed (clearer than the image in the video), so that the audience can identify the object in the video, thereby facilitating the video viewers to understand more details of the target object.

[0060] In one or more optional embodiments, after acquiring the element content, when adding the element content to the video, various methods may be used depending on different adding methods and adding locations.

[0061] When adding in different ways, the element content can be added to the video in at least one of the following ways: adding the element content to the video in the form of a watermark; adding the element content to the video in the form of an animation; adding the element content to the video in the form of a bullet screen; adding the element content to the video in the form of a moving window. Among them, adding the element content to the video in the form of a watermark will not block the user from watching the video, and thus will not affect the user's viewing of the video. Adding the element content to the video in the form of an animation can show the integrity of the video content to the user in a more friendly picture. Adding the element content to the video in the form of a bullet screen can flexibly express the element content. When the element content is added to the video in the form of a moving window, when the user pays attention to the element content, the mobile window can be easily closed, thereby achieving effective control of the user over the element content.

[0062] When the adding position is different, the element content can be added to the video in at least one of the following ways: adding the element content to the first frame of the video; adding the element content to each frame of the video; adding the element content to the predetermined frame of the video. Among them, adding the element content to the first frame of the video can make the user pay attention to the element content at the first time. Adding the element content to each frame of the video can enable the video viewer to obtain the element content of the news material for a long time. For example, if the video viewer does not see the element content in the first frame of the video, the element content can be seen in other frames of the video, so as to avoid the video viewer from missing the element content. Adding the element content to the predetermined frame of the video can, on the one hand, avoid the user from missing the element content as much as possible, and on the other hand, since it is not necessary to add each frame of the video, the operation of adding the element content can be effectively reduced. It should be noted that the predetermined frame images referred to above can be some special frame images, for example, the frame images corresponding to the news key information display screen, etc.

[0063] It should be noted that the above-mentioned addition of element content to the video is to display the element content when playing the video, so that the video and the element content are displayed together. Therefore, when adding element content to the video, the above-mentioned element content can be played as a part of the video, or the element content and the video can be regarded as separate individuals and the element content is displayed when the video is played. When displaying the element content independent of the video when playing the video, a variety of methods can also be used, for example, the element content can be displayed in the form of a control, the element content can be displayed in a jump window, etc.

[0064] In one or more optional embodiments, when adding element content to a video, in order to show the user the complete news material included in the video as much as possible, in addition to the element content of the news material, the integrity of the video itself can also be displayed. For example, it is possible to determine whether the news image included in the video is complete, and then add the determination result to the video to display it to the user. For example, it can be implemented in the following ways: obtaining image data split from the video; obtaining news image data searched from the news database; comparing the image data split from the video with the news image data searched from the news database to obtain comparison result information; adding the element content to the video in combination with the comparison result information. It should be noted that when determining the integrity of the video itself, in order to obtain a higher accuracy, the computational complexity involved may also be higher. For example, when the specific details of each frame of the video image of the news material in the video are determined in detail, the required amount of calculation or analysis is large, resulting in a large cost.

[0065] In one or more optional embodiments, when determining the integrity of the video itself, the integrity of the news image included in the video can be determined. For example, the image data separated from the video is compared with the news image data corresponding to the news material. If the difference between the two is within a certain range, it can be confirmed that the news image included in the video is complete. When determining the integrity of the video itself, it can be selective, for example, it can be determined for some news images corresponding to news materials of high concern and high importance. Therefore, before verifying the image data separated from the video with the news image data corresponding to the news material, it is also possible to: determine the attention and / or importance value of the news corresponding to the news material; detect that the attention is greater than a predetermined attention threshold, and / or, detect that the importance value is greater than a predetermined importance threshold; when the detection result is that the attention is greater than the predetermined attention threshold, and / or, the importance value is greater than the predetermined importance threshold, determine to verify the image data separated from the video with the news image data corresponding to the news material. The predetermined attention threshold mentioned above can be determined based on the impact of the news, for example, it can be represented by an impact factor, where the impact factor can be a value less than 1. When the impact of the news material is large and the time is long, the corresponding attention is greater; otherwise, it is smaller. The above-mentioned predetermined importance threshold can also be determined in accordance with the above-mentioned predetermined attention threshold method, which will not be repeated here.

[0066] In one or more optional embodiments, after adding the element content to the video, the video with the added element content can also be published. That is, the video with the added element content is published to realize the review and publication of the video, so that the published video content is more complete.

[0067] Figure 4 is a flowchart of a second video processing method according to an exemplary embodiment. Figure 4 As shown, the method includes the following steps.

[0068] In step S41, a video playback request is received on the display interface;

[0069] In step S42, in response to the video play request, a video is played on the display interface, wherein the video is a video in a video interaction application, and news elements are added to the played video, and the news is news corresponding to the news material included in the video.

[0070] By adopting the above processing, by playing the video with the news elements added on the display interface, the video viewers can accurately know the news elements, thereby improving the user's video viewing experience. The problem of incomplete video content caused by processing the video to be released in the related art is solved, thereby achieving the effect of effectively improving the integrity of the video content.

[0071] Figure 5 is a flowchart of a video processing method 3 according to an exemplary embodiment. Figure 5 As shown, the method includes the following steps.

[0072] In step S51, a slide operation is received.

[0073] In step S52, in response to the sliding operation, a video is played, wherein the video is a video in a video interaction application, and news elements are added to the played video, and the news is news corresponding to the news material included in the video.

[0074] By adopting the above processing, a video is played in response to a specific application operation (for example, a video playback is triggered by a sliding operation in a video interactive application), and the elements of the news are added to the played video, so that the video viewers can accurately know the elements of the news in the process of sliding the video, thereby improving the user's video viewing experience. The problem of incomplete video content caused by processing the video to be released in the related art is solved, thereby achieving the effect of effectively improving the integrity of the video content.

[0075] The following takes a scenario as an example to illustrate an optional implementation mode of the present invention. In this scenario, a user uploads a video to be published in a video interaction application. The type of the user is not specifically limited here.

[0076] In video playback applications (for example, the video interaction applications mentioned above), when browsing videos, there will be a lot of news materials in the video. News materials generally need to focus on the event itself, and should describe in detail the place, time, and task of the event, which are the so-called three elements of news. However, some video uploaders will perform operations such as editing on news materials, but some element information (such as time) will be lost in the editing process. Once news materials lose these element information, they may not be able to accurately express the information. Therefore, when video upload users upload videos that include news materials, there may be missing information and incomplete content.

[0077] In view of this, in this optional implementation, an optional implementation of a video processing method is provided. Figure 6 is a flowchart of a fourth video processing method according to an exemplary embodiment. Figure 6 As shown, the method includes the following steps.

[0078] S1, starting from the user posting a video. The user uploads the material of the video to be posted, and can add the category selection of the material included in the posted video (for example, news, entertainment, selfie, life, etc.), where the user can choose not to select and use the default value; or can choose according to the actual situation;

[0079] S2, conduct qualification review on the materials uploaded by the user. That is, the materials included in the video can be multiple, for example, it can contain image information and audio information. After the user uploads the video material, it will be reviewed. If it passes the review and meets the publishing qualifications, it will continue with the subsequent process, otherwise it will be rejected;

[0080] S3, split the material uploaded by the user to obtain audio data and image data. That is, when the user passes the preliminary review and is qualified to publish, the server will split the uploaded original video into audio and video to obtain audio and image data for subsequent processing;

[0081] S4, based on the obtained audio data, determine whether the material uploaded by the user belongs to news material. If it is determined to be news material, obtain the three elements of news: the server performs voice analysis on the audio data, and determines whether it includes news material by comparing the voice with the news vocabulary. If it includes news material, extract news keywords. After capturing the news keywords, perform semantic analysis on the context before and after the news keywords, and confirm again the information to be captured (news keywords trigger contextual semantic analysis, and a complete piece of information is obtained through semantic analysis). After multiple sampling captures and voice semantic analysis, the final news keywords are obtained (news keywords are obtained after streamlining a complete piece of information);

[0082] After obtaining the news keywords, the server will search the news keywords through various news databases to obtain information related to the news, and then refine the "three elements (time, place, and person)" of this information to obtain a brief three-element content;

[0083] S5, based on the obtained image data, determine whether the material uploaded by the user is accurate: After processing the audio data, it can be decided whether to screen the image data based on the attention and importance of the news to ensure the accuracy of the relevant content. If image identification is required, image comparison is required, and the two sides of the comparison are: ① the image in the material; ② the image obtained through news keywords or news keywords in the news database to ensure the accuracy of the image information;

[0084] S6, if the material uploaded by the user is accurate, add the three elements of news to the material uploaded by the user: After the above processing, the following information can be obtained: determine whether the material included in the video is news material, obtain the relevant three elements through auxiliary means, confirm whether the published image is accurate through image comparison, etc., so it has the ability to assist in adding the three elements. Therefore, based on the above steps, the server can also choose to process the first frame of the video, add the above information, and then integrate the audio and video data, and then put it into the publishing system for subsequent publishing.

[0085] In this optional implementation, on the basis of the existing platform services, by helping users to complete the necessary information of the "news" materials they upload, the information dissemination is made more accurate. In this optional implementation, when users upload materials, the option of selecting the type can be provided to preliminarily determine the category to which the material belongs to correspond to the subsequent different processes. When the material is qualified for publication after passing the initial screening, content analysis can be added to confirm whether it is news material again through speech semantic analysis. If it is confirmed to be news material, the key words are captured for key keyword splitting, and then the news database is searched for key keywords to obtain the complete information of the news, such as time, people, location and other information. After obtaining the above-mentioned important information of the news, the three elements are refined, and then the information is added to the first frame of the video material in the form of watermarks, which is convenient for video viewers to watch. In this optional implementation, the publisher's publishing process remains basically unchanged, and the publishing cost will not be increased, and the video viewers can obtain complete news information.

[0086] Therefore, through the above-mentioned optional implementation methods, the following beneficial effects can be achieved: without changing the existing process, the three elements of news can be added to more accurately deliver news information while reducing investment costs; secondly, the accuracy of the system is greatly improved through machine learning and language processing; thirdly, the automatic verification and recognition of image content further improves the efficiency of video review.

[0087] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present disclosure is not limited by the order of the actions described, because according to the present disclosure, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

[0088] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present disclosure, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present disclosure.

[0089] Example 2

[0090] According to an embodiment of the present disclosure, a device for implementing the above-mentioned video processing method 1 is also provided. Figure 7 FIG. 1 is a device block diagram of a video processing device according to an exemplary embodiment. Figure 7 The device includes a first acquisition module 71, a second acquisition module 72 and a first adding module 73. The device is described below.

[0091] The first acquisition module 71 is used to acquire the video to be released in the video interaction application; the second acquisition module 72 is connected to the above-mentioned first acquisition module 71, and is used to acquire the essential content of the news corresponding to the news material when the video includes news material; the first adding module 73 is connected to the above-mentioned second acquisition module 72, and is used to add the essential content to the video.

[0092] It should be noted that the first acquisition module 71, the second acquisition module 72 and the first adding module 73 correspond to steps S21 to S23 in Example 1, and the examples and application scenarios implemented by the modules and the corresponding steps are the same, but are not limited to the contents disclosed in Example 1. It should be noted that the modules as part of the device can be run in the computer terminal 10 provided in Example 1.

[0093] In one or more optional embodiments, the second acquisition module includes: a first acquisition unit, used to acquire audio data from the video; a second acquisition unit, used to acquire news keywords from the audio data; and a first search unit, used to search for news corresponding to the news material based on the news keywords to obtain the essential content of the news.

[0094] In one or more optional embodiments, the device also includes: a third acquisition module, used to acquire image data from the video; a fourth acquisition module, used to acquire news image data from the news corresponding to the news material; a verification module, used to verify the image data in the video according to the news image data to obtain a verification result; and a feedback module, used to feed back the verification result to the upload terminal of the video.

[0095] In one or more optional embodiments, the first adding module includes: a determination unit, used to determine a predetermined frame video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame video image; and an adding unit, used to add the element content to the predetermined frame video image.

[0096] In one or more optional embodiments, the adding unit includes: a determining subunit for determining the position of the target object in the predetermined frame video image; and a displaying subunit for displaying the element content for the target object based on the determined position.

[0097] According to an embodiment of the present disclosure, a device for implementing the second video processing method is also provided. Figure 8 FIG. 1 is a device block diagram of a second video processing device according to an exemplary embodiment. Figure 8 The device includes a first receiving module 81 and a first playing module 82. The device is described below.

[0098] The first receiving module 81 is used to receive a video playback request on the display interface; the first playback module 82 is connected to the first receiving module 81, and is used to respond to the video playback request and play the video on the display interface, wherein the video is a video in a video interactive application, and the played video has news elements added thereto, and the news is news corresponding to the news material included in the video.

[0099] It should be noted that the first receiving module 81 and the first playing module 82 correspond to steps S41 to S42 in Example 1, and the examples and application scenarios implemented by the modules and the corresponding steps are the same, but are not limited to the contents disclosed in Example 1. It should be noted that the modules as part of the device can be run in the computer terminal 10 provided in Example 1.

[0100] According to an embodiment of the present disclosure, a device for implementing the above-mentioned video processing method 3 is also provided. Fig. 9 FIG. 1 is a device block diagram of a video processing device 3 according to an exemplary embodiment. Fig. 9 The device includes a second receiving module 91 and a second playing module 92. The device is described below.

[0101] The second receiving module 91 is used to receive a sliding operation; the second playing module 92 is connected to the above-mentioned second receiving module 91, and is used to respond to the sliding operation and play the video, wherein the video is a video in a video interactive application, and the played video has news elements added to it, and the news is news corresponding to the news material included in the video.

[0102] It should be noted that the second receiving module 91 and the second playing module 92 correspond to steps S51 to S52 in Example 1, and the examples and application scenarios implemented by the modules and the corresponding steps are the same, but are not limited to the contents disclosed in Example 1. It should be noted that the modules as part of the device can be run in the computer terminal 10 provided in Example 1.

[0103] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0104] Example 3

[0105] The embodiments of the present disclosure may provide an electronic device, which may be a terminal or a server. For example, when the electronic device is a terminal, the terminal may be any computer terminal device in a computer terminal group. Optionally, in the present embodiment, the terminal may also be a terminal device such as a mobile terminal.

[0106] Optionally, in this embodiment, the terminal may be located in at least one network device among a plurality of network devices of the computer network.

[0107] Optionally, Fig.10 FIG. 1 is a block diagram of a terminal according to an exemplary embodiment. Fig.10 As shown, the terminal may include: one or more (only one is shown in the figure) processors 101, and a memory 102 for storing processor executable instructions; wherein the processor is configured to execute instructions to implement any of the above-mentioned video processing methods.

[0108] Among them, the memory can be used to store software programs and modules, such as program instructions / modules corresponding to the video processing method and device in the embodiment of the present disclosure. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, realizing the above-mentioned video processing method. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the computer terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0109] The processor can call the information and application programs stored in the memory through the transmission device to perform the following steps:.

[0110] Optionally, the processor may also execute program codes of the following steps: obtaining a video to be released in a video interaction application; when the video includes news material, obtaining news element content corresponding to the news material; and adding the element content to the video.

[0111] Optionally, the processor may also execute program code for the following steps: obtaining essential content of news corresponding to the news material, including: obtaining audio data from the video; capturing news keywords from the audio data; searching for news corresponding to the news material based on the news keywords to obtain essential content of the news.

[0112] Optionally, the processor may also execute the program code of the following steps: obtaining image data from the video; obtaining news image data from the news corresponding to the news material; verifying the image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to the video upload terminal.

[0113] Optionally, the processor may also execute program code for the following steps: adding element content to a video, including: determining a predetermined frame video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame video image; and adding the element content to the predetermined frame video image.

[0114] Optionally, the processor may also execute program code of the following steps: adding element content to a predetermined frame video image, including: determining a position of a target object in the predetermined frame video image; and displaying the element content for the target object based on the determined position.

[0115] The processor can call the information and application stored in the memory through the transmission device to execute the following steps: receiving a video playback request on the display interface; responding to the video playback request, playing the video on the display interface, wherein the video is a video in the video interaction application, and the played video has news elements added to it, and the news is news corresponding to the news material included in the video.

[0116] The processor can call the information and application stored in the memory through the transmission device to execute the following steps: receiving a sliding operation; responding to the sliding operation and playing a video, wherein the video is a video in a video interactive application, and the played video has news elements added to it, and the news is news corresponding to the news material included in the video.

[0117] In the case where the electronic device is a server, in an embodiment of the present disclosure, a server is provided. Fig.11 FIG. 1 is a structural block diagram of a server according to an exemplary embodiment. Fig.11 As shown, the server 110 may include: one or more (only one is shown in the figure) processing components 111, a memory 112 for storing executable instructions of the processing component 111, a power supply component 113 for providing power, a network interface 114 for communicating with an external network, and an I / O input and output interface 115 for data transmission with the outside; wherein the processing component 111 is configured to execute instructions to implement any of the above-mentioned video processing methods.

[0118] Among them, the memory can be used to store software programs and modules, such as program instructions / modules corresponding to the video processing method and device in the embodiment of the present disclosure. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, realizing the above-mentioned video processing method. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the computer terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0119] The processing component can call the information and application programs stored in the memory through the transmission device to perform the following steps: obtain the video to be released in the video interaction application; when the video includes news materials, obtain the element content of the news corresponding to the news materials; and add the element content to the video.

[0120] Optionally, the processing component may also execute the following steps of program code: obtaining audio data from the video; capturing news keywords from the audio data; searching for news corresponding to news materials based on the news keywords to obtain the essential content of the news.

[0121] Optionally, the above-mentioned processing component can also execute the program code of the following steps: obtain image data from the video; obtain news image data from the news corresponding to the news material; verify the image data in the video according to the news image data to obtain the verification result; and feed back the verification result to the video upload terminal.

[0122] Optionally, the above-mentioned processing component can also execute the program code of the following steps: adding element content to the video, including: determining a predetermined frame video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame video image; adding the element content to the predetermined frame video image.

[0123] Optionally, the processing component may also execute program code of the following steps: adding element content to a predetermined frame video image, including: determining a position of a target object in the predetermined frame video image; and displaying element content for the target object based on the determined position.

[0124] The processing component can call the information and application programs stored in the memory through the transmission device to execute the following steps: receiving a video playback request on the display interface; responding to the video playback request, playing the video on the display interface, wherein the video is a video in a video interactive application, and the played video has news elements added thereto, and the news is news corresponding to the news material included in the video.

[0125] The processing component can call the information and application stored in the memory through the transmission device to execute the following steps: receiving a sliding operation; responding to the sliding operation and playing a video, wherein the video is a video in a video interactive application, and the played video has news elements added to it, and the news is news corresponding to the news material included in the video.

[0126] It can be understood by those skilled in the art that Fig.10 , Fig.11 The structure shown is for illustration only. For example, the terminal may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a handheld computer, a mobile Internet device (MID), a PAD, or other terminal devices. Fig.10 , Fig.11 It does not limit the structure of the above electronic device. For example, it may also include Fig.10 , Fig.11More or fewer components (such as network interfaces, display devices, etc.) shown in, or having Fig.10 , Fig.11 Different configurations are shown.

[0127] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing the hardware related to the terminal device through a program, and the program can be stored in a computer-readable storage medium, and the storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0128] Example 4

[0129] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, and when the instructions in the computer-readable storage medium are executed by a processor of a terminal, the terminal is enabled to perform any of the above-mentioned video processing methods. Optionally, the computer-readable storage medium may be a non-temporary computer-readable storage medium, for example, the non-temporary computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0130] Optionally, in this embodiment, the computer-readable storage medium may be used to store program codes executed by the video processing method provided in the first embodiment.

[0131] Optionally, in this embodiment, the computer-readable storage medium may be located in any one of the computer terminals in a computer terminal group in a computer network, or in any one of the mobile terminals in a mobile terminal group.

[0132] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for executing the following steps: obtaining a video to be published in a video interaction application; when the video includes news material, obtaining element content of news corresponding to the news material; and adding the element content to the video.

[0133] Optionally, in this embodiment, the computer-readable storage medium is also configured to store program codes for executing the following steps: obtaining essential content of news corresponding to the news material, including: obtaining audio data from the video; capturing news keywords from the audio data; searching for news corresponding to the news material based on the news keywords to obtain essential content of the news.

[0134] Optionally, in this embodiment, the computer-readable storage medium is also configured to store program codes for executing the following steps: obtaining image data from the video; obtaining news image data from news corresponding to the news material; verifying the image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to the video upload terminal.

[0135] Optionally, in this embodiment, the computer-readable storage medium is also configured to store program code for performing the following steps: adding element content to a video, including: determining a predetermined frame video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame video image; adding the element content to the predetermined frame video image.

[0136] Optionally, in this embodiment, the computer-readable storage medium is also configured to store program code for performing the following steps: adding element content to a predetermined frame video image, including: determining a position of a target object in the predetermined frame video image; and displaying the element content for the target object based on the determined position.

[0137] Optionally, in this embodiment, the computer-readable storage medium is configured to store program codes for executing the following steps: receiving a video playback request on a display interface; responding to the video playback request, playing a video on the display interface, wherein the video is a video in a video interactive application, and the played video has news elements added to it, and the news is news corresponding to the news material included in the video.

[0138] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for executing the following steps: receiving a sliding operation; in response to the sliding operation, playing a video, wherein the video is a video in a video interaction application, and news elements are added to the played video, and the news is news corresponding to the news material included in the video.

[0139] In an exemplary embodiment, a computer program product is further provided. When a computer program in the computer program product is executed by a processor of an electronic device, the electronic device is enabled to perform any of the above-mentioned video processing methods.

[0140] The serial numbers of the above-mentioned embodiments of the present disclosure are only for description and do not represent the advantages or disadvantages of the embodiments.

[0141] In the above embodiments of the present disclosure, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0142] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0143] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0144] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0145] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a computer-readable storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the various embodiments of the present disclosure. The aforementioned computer-readable storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0146] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0147] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A video processing method, characterized in that: include: Get the video to be published in the video interaction application; In the case where the video includes news material, obtaining news element content corresponding to the news material; Adding the element content to the video; The method further includes: obtaining image data from the video; obtaining news image data from the news corresponding to the news material; verifying the image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to the video uploading terminal; Acquiring the essential content of the news corresponding to the news material, including: acquiring audio data from the video; acquiring news keywords from the audio data; searching for the news corresponding to the news material according to the news keywords to obtain the essential content of the news; Adding the element content to the video includes: determining a predetermined frame video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame video image; and adding the element content to the predetermined frame video image.

2. The method according to claim 1, characterized in that Adding the element content to the predetermined frame video image includes: Determine the position of the target object in the predetermined frame of video image; Based on the determined position, the element content is displayed for the target object.

3. A video processing method, characterized in that: include: Receiving a video playback request on the display interface; In response to the video play request, play a video on the display interface, wherein the video is a video in a video interaction application, and news elements are added to the played video, and the news is news corresponding to the news material included in the video; The method for obtaining the essential content of the news corresponding to the news material includes: obtaining audio data from the video; obtaining news keywords from the audio data; searching for the news corresponding to the news material according to the news keywords to obtain the essential content of the news; The processing method of adding the element content to the video includes: determining a predetermined frame video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame video image; adding the element content to the predetermined frame video image; The method includes: obtaining image data from the video; obtaining news image data from the news corresponding to the news material; verifying the image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to the upload terminal of the video.

4. A video processing device, characterized in that: include: A first acquisition module, used to acquire a video to be published in a video interaction application; A second acquisition module is used to acquire the news element content corresponding to the news material when the video includes news material; A first adding module, used for adding the element content to the video; The device further comprises: a third acquisition module for acquiring image data from the video; a fourth acquisition module for acquiring news image data from the news corresponding to the news material; a verification module for verifying the image data in the video according to the news image data to obtain a verification result; and a feedback module for feeding back the verification result to the video upload terminal; The second acquisition module is further used to acquire audio data from the video; acquire news keywords from the audio data; search for news corresponding to the news material according to the news keywords to obtain the essential content of the news; The first adding module is further configured to determine a predetermined frame of video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame of video image; and add the element content to the predetermined frame of video image; The second acquisition module includes: a first acquisition unit, used to acquire audio data from the video; a second acquisition unit, used to acquire news keywords from the audio data; a first search unit, used to search for news corresponding to the news material according to the news keywords to obtain the element content of the news; and a feedback module, used to feed back the verification result to the video uploading terminal; The first adding module includes: a determining unit, used to determine a predetermined frame video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame video image; and an adding unit, used to add the element content to the predetermined frame video image.

5. The device according to claim 4, characterized in that The adding unit comprises: A determination subunit, used to determine the position of the target object in the predetermined frame of video image; The display subunit is used to display the element content for the target object based on the determined position.

6. A video processing device, characterized in that: include: A first receiving module, used to receive a video playback request on a display interface; A first playback module, configured to respond to the video playback request and play the video on the display interface, wherein the video is a video in a video interaction application, and the played video is added with news elements, and the news is news corresponding to the news material included in the video; The method for obtaining the essential content of the news corresponding to the news material is to obtain audio data from the video; obtain news keywords from the audio data; search for the news corresponding to the news material according to the news keywords to obtain the essential content of the news; The processing method of adding the element content to the video is to determine a predetermined frame of video image in the video, wherein a target object corresponding to the element content appears in the predetermined frame of video image; and add the element content to the predetermined frame of video image; Among them, the device is also used to obtain image data from the video; obtain news image data from the news corresponding to the news material; verify the image data in the video according to the news image data to obtain a verification result; and feed back the verification result to the upload terminal of the video.

7. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the video processing method according to any one of claims 1 to 3.

8. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the video processing method according to any one of claims 1 to 3.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the video processing method according to any one of claims 1 to 3 is implemented.

Images