An information publishing method, an identification method, an electronic device, and a medium

Abstract

Embodiments of the present disclosure provide an information publishing method, an identification method, an electronic device and a medium. The method comprises: displaying target media content on a display page; in response to determining that the target media content is identified media content with a preset effect, displaying a preset template effect control on the display page, the preset effect being identified based on audio information and / or image information of the target media content; in response to the preset template effect control in the display page being triggered, displaying a media content generation page, the media content generation page comprising a target template determined based on the preset effect; and in response to a media content generation operation on the media content generation page, generating media content based on the target template. The method enriches the creation mode of media content and improves the user experience.

Description

Technical Field

[0001] This disclosure relates to computer technology, and more particularly to an information publishing method, an identification method, an electronic device, and a medium. Background Technology

[0002] Currently, video applications frequently feature videos with specific template types, such as beat-sync videos. Beat-sync videos are videos where the generated visuals match the rhythm of the music, allowing the visuals to smoothly transition at the beat points. Users can achieve their desired beat-sync effects by using beat-sync video templates when creating their own content. Summary of the Invention

[0003] This disclosure provides an information publishing method, an identification method, an electronic device, and a medium, which enrich the ways of creating media content and improve the user experience.

[0004] In a first aspect, embodiments of this disclosure provide an information publishing method, including:

[0005] Display the target media content on the display page;

[0006] In response to determining that the target media content is identified as media content with a preset effect, a preset template effect control is displayed on the display page, wherein the preset effect is obtained based on the audio information and / or image information of the target media content;

[0007] In response to the triggering of the preset template effect control in the display page, a media content generation page is displayed, the media content generation page including a target template determined based on the preset effect;

[0008] In response to the media content generation operation on the media content generation page, media content is generated based on the target template.

[0009] Secondly, embodiments of this disclosure also provide a method for identifying media content with preset effects, including:

[0010] Obtain audio and image information of the media content to be identified;

[0011] The audio information and the image information are identified to obtain the identification result;

[0012] Based on the recognition results, it is determined whether the media content to be recognized has a preset effect, so that the media content to be recognized can display a preset template effect control on the display page.

[0013] Thirdly, embodiments of this disclosure also provide an electronic device, the electronic device comprising:

[0014] One or more processing devices;

[0015] Storage device for storing one or more programs.

[0016] When the one or more programs are executed by the one or more processing devices, the one or more processing devices perform the methods provided in the embodiments of this disclosure.

[0017] Fourthly, embodiments of this disclosure also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the methods provided in embodiments of this disclosure.

[0018] This disclosure provides an information publishing method, an identification method, an electronic device, and a medium. First, target media content is displayed on a display page. Then, in response to determining that the target media content is identified as media content with a preset effect, a preset template effect control is displayed on the display page. The preset effect is obtained based on the audio and / or image information of the target media content. Next, in response to the triggering of the preset template effect control on the display page, a media content generation page is displayed. The media content generation page includes the target template determined based on the preset effect. Finally, in response to a media content generation operation on the media content generation page, media content is generated based on the target template. This method enriches the creation methods of media content and improves the user experience by displaying a preset template effect control within a display page containing media content with preset effects, triggering the display of the media content generation page through this control, and then generating media content for publication using the target template included in the media content generation page. Attached Figure Description

[0019] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0020] Figure 1 This is a flowchart illustrating an information publishing method provided in an embodiment of the present disclosure;

[0021] Figure 2 This is a flowchart illustrating another information publishing method provided in an embodiment of this disclosure;

[0022] Figure 3 This disclosure provides a method for implementing page display.

[0023] Figure 4 A flowchart illustrating a method for identifying media content with a preset effect, provided in an embodiment of this disclosure;

[0024] Figure 5 A flowchart illustrating another method for identifying media content with a preset effect provided in this embodiment of the present disclosure;

[0025] Figure 6 A schematic diagram illustrating the implementation of a method for determining checkpoint probability according to an embodiment of this disclosure;

[0026] Figure 7 This is a schematic diagram illustrating the implementation of a video recognition method provided in an embodiment of this disclosure;

[0027] Figure 8 A schematic diagram illustrating the implementation of a checkpoint template generation method provided in this embodiment of the disclosure;

[0028] Figure 9 This is a schematic diagram illustrating the implementation of a checkpoint according to an embodiment of the present disclosure;

[0029] Figure 10 This is a schematic diagram of the structure of an information publishing device provided in an embodiment of the present disclosure;

[0030] Figure 11 A schematic diagram of the structure of a media content recognition device with preset effects provided in an embodiment of this disclosure;

[0031] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0032] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0033] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0034] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0035] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0036] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0037] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0038] It is understood that before using the technical solutions disclosed in the embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and their authorization should be obtained. For example, the identification of the media content to be identified requires the consent of the user who publishes the media content to be identified, and the use of content applied in the media content by the target template, such as music and images, requires the authorization of the producer.

[0039] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0040] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0041] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0042] Currently, video applications frequently feature videos with specific template types, such as beat-sync videos. Beat-sync videos are videos where the generated visuals match the rhythm of the music, allowing for smooth transitions between musical beats. Users can achieve the desired beat-sync effect by using beat-sync video templates. However, currently, beat-sync video templates are generally created actively by template creators. For example, template creators need to publish videos with template information (this template information needs to be actively edited by the creator and uploaded along with the video). Upon publication, the platform determines the template associated with the video based on the user-edited template information, thus displaying the template on the playback page for other users to use. For pre-recorded videos uploaded by users, even if the video's rhythm is beat-sync, because the video itself does not contain template information, the relevant template shooting entry will not be displayed after publication.

[0043] Figure 1 This is a flowchart illustrating an information publishing method provided in an embodiment of the present disclosure. This embodiment is applicable to situations where media content is generated to enrich the way media content is created and improve the user experience. The method can be executed by an information publishing device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a terminal-side device.

[0044] like Figure 1 As shown, the method includes:

[0045] S110. Display the target media content on the display page.

[0046] In this embodiment, the display page can be understood as a page within the application used for displaying and browsing media content. The target media content can be understood as the media content displayed on the display page. Media content can be understood as content based on media data. Media data can refer to an important medium used for storing and transmitting information, such as audio data, video data, image data, data combining any two, or data combining all three.

[0047] Once an electronic device is accessed by the application, the target media content can be displayed on the application's showcase page.

[0048] S120. In response to determining that the target media content is identified media content with preset effects, a preset template effect control is displayed on the display page.

[0049] In this embodiment, the preset effect can be understood as a pre-set display effect; the preset effect is not specifically limited here, but may be an effect associated with video beat display. The preset effect can be obtained based on the audio information and / or image information of the target media content. Audio information can be understood as information associated with audio; the audio information is not specifically limited here, but may include information such as the beat, melody, or lyrics of the audio. Image information can be understood as information associated with an image; the image information is not specifically limited here, but may include information such as the cut scene corresponding to the image; a cut scene can be understood as a visual switching of the scene.

[0050] This section does not specify how to obtain the preset effect based on the audio and / or image information of the target media content. For example, based on the audio and / or image information of the target media content, corresponding audio beat recognition algorithms and cut-scene recognition algorithms can be used to identify the information associated with the audio beats corresponding to the audio information and / or the information associated with the cut-scenes corresponding to the image information. Based on this, it can be determined whether the target media content has the preset effect based on the identified information.

[0051] In one embodiment, the identification of whether the target media content has a preset effect can be performed by a server-side device or by a terminal-side device. For example, the identification of whether the target media content has a preset effect can be performed by either the server-side device or the terminal-side device when the target media content is published. The identification of the media content requires the consent of the user who published the media content, and the use of content applied in the media content by the target template, such as music and images, requires authorization from the producer.

[0052] Preset template effect controls can be understood as pre-defined controls used to trigger the display of media content generation pages. In response to determining that the target media content is identified as media content with preset effects, the electronic device can display the preset template effect controls on the display page. The display position of the preset template effect controls on the display page is not specifically limited here and can be flexibly set according to actual needs.

[0053] Understandably, when the server-side device identifies whether the target media content is media content with a preset effect, the server-side device can send information indicating whether the target media content is media content with a preset effect. The electronic device (i.e., the terminal-side device) can determine whether the target media content is media content with a preset effect by receiving this information.

[0054] S130. In response to the triggering of the preset template effect control in the display page, the media content generation page is displayed.

[0055] In this embodiment, the media content generation page can be understood as a page used to generate media content; the media content generation page may include a target template determined based on preset effects. The target template can be understood as a template used to generate media content with preset effects.

[0056] This section does not specify how to determine the target template based on preset effects; for example, a template can be created based on the effect settings for audio, image, video and other information in the media content in the preset effects, which can be used to set any uploaded media content according to these effects, i.e., the target template.

[0057] When a preset template effect control on the display page is triggered, the electronic device can display a media content generation page. There are no specific limitations on how the media content generation page is displayed; for example, it can display an interface containing multiple resources to be selected (such as an interface for selecting resources from an album), or it can display an interface for acquiring resources (such as a shooting page for acquiring resources by taking a picture). Furthermore, the displayed media content generation page can also include indication information such as the number of resources required for the target template and / or the display duration of the resources. Here, resources can be understood as images and / or videos used to generate media content.

[0058] S140. In response to the media content generation operation on the media content generation page, generate media content based on the target template.

[0059] In this embodiment, the media content generation operation can be understood as an operation used to trigger the generation of media content. In response to the media content generation operation on the media content generation page, the electronic device can generate media content based on the target template.

[0060] This section does not specify how media content should be generated based on the target template. For example, the selected or captured resources (such as images and / or videos) can be configured according to the effects of the cuts, transitions, beats, and text settings in the target template to obtain the corresponding media content.

[0061] This disclosure provides an information publishing method. First, target media content is displayed on a display page. Then, in response to determining that the target media content is identified as media content with a preset effect, a preset template effect control is displayed on the display page. The preset effect is obtained based on the audio and / or image information of the target media content. Next, in response to the triggering of the preset template effect control on the display page, a media content generation page is displayed. The media content generation page includes a target template determined based on the preset effect. Finally, in response to a media content generation operation on the media content generation page, media content is generated based on the target template. This method, by displaying a preset template effect control within a display page containing media content with preset effects, triggering the display of the media content generation page through this control, and then generating media content for publication using the target template included on the media content generation page, achieves automatic media content generation, enriches the creation methods of media content, and improves the user experience.

[0062] Optional preset effects include one or more of the following: text information, beat information, transition information, and visual cut information.

[0063] Textual information can be understood as information associated with text; here, textual information is not specifically limited, but may include text content, text font, text size, etc.

[0064] Checkpoint information can be understood as information associated with a checkpoint; there are no specific limitations on checkpoint information here, such as the number of segments at the checkpoint and the duration of each segment. Each segment at a checkpoint can be used to carry a selected resource.

[0065] Transition information can be understood as information associated with a transition point; however, there are no specific limitations on transition information here, such as transition ranges and transition categories. A transition can be understood as the visual transition or change between two resources located within two adjacent cutscenes. A transition range can be understood as the display area of ​​a transition. A transition category can be understood as the display format of a transition effect.

[0066] Visual cut information can be understood as information associated with visual cuts; here, visual cut information is not specifically limited, and may include information such as visual cut position. A visual cut can be understood as a visual transition between shots. The visual cut position can be understood as the temporal location at which the visual shot transitions.

[0067] Optionally, the target media content may include one or more of the following:

[0068] Category 1 content and Category 2 content;

[0069] The first category of content includes identified content with preset effects, while the second category includes content published after modifying the corresponding target template.

[0070] In this embodiment, there is no specific limitation on how to modify the target template; for example, it may be to change the audio configured in the target template to another audio, and / or modify the duration of the audio configured in the target template, etc.

[0071] In this embodiment, the first type of content can be content with a preset effect that is automatically identified by an algorithm.

[0072] In one embodiment, the target media content may also include user-created content with preset effects.

[0073] Figure 2 This is a flowchart illustrating another information publishing method provided in this embodiment, which is a refinement of the above embodiments. In this embodiment, the process of displaying the media content generation page and the process following the fulfillment of the termination condition are described in detail. It should be noted that technical details not described in detail in this embodiment can be found in any of the above embodiments. Figure 2 As shown, the method includes:

[0074] S210. Display the target media content on the display page.

[0075] S220. In response to determining that the target media content is media content with preset effects, display preset template effect controls on the display page.

[0076] S230. In response to the triggering of the preset template effect control on the display page, display indicator information on the resource selection interface.

[0077] In this embodiment, the media content generation page may include a resource selection interface. After a preset template effect control on the display page is triggered, the electronic device can display instruction information on the resource selection interface.

[0078] The resource selection interface can be understood as an interface used for resource selection. That is, the resource selection interface may include multiple resources for the user to choose from. The indication information can indicate the number of resources to be selected for the target template and / or the display duration of the resources. Display duration can be understood as the length of time the resources are displayed.

[0079] The number can be determined based on the preset attributes of the preset effects in the identified media content with preset effects. Preset attributes can be understood as attributes that are set in advance; for example, the preset attributes of text information can be considered as attributes such as text size and font size; the preset attributes of timing information can be considered as attributes such as the number of timing segments and the duration of timing segments.

[0080] The number can include both the minimum required number and the maximum selectable number. There is no specific limitation on how the required number of resources to be selected is determined based on the preset attributes of the preset effects in the identified media content with preset effects. For example, the number of segments with preset effects in the timing information can be used to determine the required number of resources. Specifically, the number of segments with preset effects can be directly determined as the number, with the minimum required number and the maximum selectable number being the same; alternatively, the number of segments with preset effects can be determined as the maximum selectable number, and the number determined based on the number of segments with preset effects or a pre-set number can be determined as the minimum required number. It is understood that the minimum required number can be less than or equal to the maximum selectable number.

[0081] S240. In response to the media content generation operation on the media content generation page, generate media content based on the target template.

[0082] S250. In response to the fulfillment of the termination condition, display the selection completion control on the resource selection interface.

[0083] In this embodiment, the termination condition may include the number of selected resources being a second number, or the number of selected resources being greater than or equal to the first number when the value of the second number is greater than a first preset threshold. The selected resources can be understood as the resources selected by the user. The first preset threshold can be understood as a pre-set first threshold, which can be flexibly set according to actual needs. The selection completion control can be understood as a control used to trigger the display of the editing page.

[0084] When the termination condition is met, the electronic device can display a selection completion control on the resource selection interface.

[0085] S260. In response to the selection completion control being triggered, the editing page is displayed.

[0086] In this embodiment, the electronic device can display an editing page in response to the selection completion control being triggered. The editing page can be understood as a page used for editing media content, such as adding text or animated stickers and effects to the media content within the editing page; however, this is not specifically limited here.

[0087] This disclosure provides a second embodiment of an information publishing method, which specifies the process of displaying a media content generation page and the process after a termination condition is met. Using this method, the number of resources to be selected for the target template within the instruction information is determined by the preset attributes of preset effects in the media content, improving the flexibility of number determination. Furthermore, by determining the termination condition based on a first number and / or a second number to trigger the display of a selection completion control, the flexibility of control display is improved, thereby enhancing the richness of page-to-page interaction.

[0088] Optionally, the preset effect includes timing information, the number of which is determined based on the preset attributes of the preset effect in the identified media content with preset effect, including: the number is determined based on the number of segments with timing in the identified media content with preset effect.

[0089] In this embodiment, the preset effect may include timing information. The number can be determined based on the number of segments with timing in the identified media content that have the preset effect. Here, there is no specific limitation on how the number is determined based on the number of segments with timing in the identified media content that have the preset effect. For example, the number of segments with timing can be directly determined as the number; or the number can be determined based on the comparison between the number of segments with timing and a set threshold. Specifically, if the number of segments with timing is less than the set threshold, the number can be determined as the number of segments with timing or a preset number less than the number of segments; otherwise, the number can be a number calculated based on the number of segments with timing, such as one-third of the number of segments with timing.

[0090] Optionally, the number includes a first number and a second number. The first number is a number determined or set based on the number of segments with preset effects in the identified media content. The second number is the number of segments with preset effects in the identified media content. The first number is less than the second number.

[0091] In this embodiment, the number may include a first number and a second number. The first number can be understood as a number determined based on the number of segments with pre-defined effects in the identified media content; the first number can be considered as at least the required number to be selected. The set number can be understood as a pre-set number, and there is no specific limitation on the set number here; it can be flexibly set according to actual needs.

[0092] The second number is the number of media content segments with preset effects identified; the second number can be considered the maximum number that can be selected. The first number can be less than the second number.

[0093] In one embodiment, after resource selection is completed, the playback duration of the selected resource and the playback duration of the target template can be determined first. The resource playback duration can be understood as the total playback duration of the resource. The template playback duration can be understood as the total playback duration of the target template. Based on this, the playback duration of the selected resource and the playback duration of the target template are compared.

[0094] When the playback duration of a resource is shorter than the playback duration of the template, the playback speed adjustment information for the selected resource can be determined based on the difference between the two durations. No specific limitations are made here on how to determine the playback speed information based on the difference; for example, the playback speed information can be obtained from the difference and a corresponding algorithm, instructing the playback duration of the resource to be slowed down uniformly until it matches the playback duration of the template.

[0095] If the playback duration of a resource is longer than the playback duration of the template, the selected resource can be trimmed based on the difference between the two. There are no specific limitations on how to trim; for example, resources whose playback duration equals the difference can be trimmed. The trimming position is also not limited and can be flexibly set according to actual needs, such as the beginning, highlight, or end of the selected resource.

[0096] In one embodiment, the resources retained after cropping may include the highlight positions of the resources. The highlight positions can be considered as the locations corresponding to exciting moments in the video, such as the locations of keyframes.

[0097] If the playback duration of the resource is equal to the playback duration of the template, there is no need to adjust the selected resource.

[0098] The following provides an exemplary description of this disclosure.

[0099] Figure 3 This disclosure provides a method for implementing page display in an embodiment. For example... Figure 3 As shown, 1 represents the display page; 2 represents the preset template effect control; 3 represents the media content generation page; 4 represents the resource selection interface; 5 represents the resource to be selected; 6 represents the second location within the target template for uploading resources; 7 represents the selection completion control; 8 represents the display duration of the resource in the prompt message; and 9 represents the number of resources to be selected as indicated by the prompt message. After determining that the target media content in the current display page 1 is media content with preset effects, the electronic device displays the preset template effect control 2 on the display page 1. In response to the triggering of the preset template effect control 2, the media content generation page 3 can be displayed. The media content generation page 3 includes a resource selection interface 4, which displays the resource to be selected 5, the location for uploading resources 6, and prompt messages 8 and 9. In response to the fulfillment of the termination condition, the selection completion control 7 is displayed on the resource selection interface 4. The editing page can be displayed by responding to the triggering of the selection completion control 7.

[0100] This disclosure achieves the preset effects of the target template by displaying a template shooting entry (i.e., a preset template effect control) in the lower left corner of the beat-sync video (i.e., media content with preset effects) on the consumption page (i.e., the display page). Triggering this entry leads to the corresponding media content generation page, where media content is generated based on the target template, thus shortening the information dissemination path of the media content. The beat-sync video can be composed of two videos, or a mixture of videos and images, etc.

[0101] In one embodiment, before displaying the media content generation page, it can be determined whether the interface for displaying the resources to be selected (such as the interface of the local photo album of an electronic device) has permission to open. If no permission is granted, an authorization pop-up window needs to be triggered, and the media content generation page will be entered after the user agrees. If permission is granted, the media content generation page can be entered directly.

[0102] In one embodiment, the resource selection interface can display the locations for uploading resources (the number of which is the same as the number of segments in the target template) and prompts, where each location can correspond to uploading one selected resource. Assume the number of resources to be selected is X, and the number of segments in the template is Y; there are several ways to determine X. One is that X can be a pre-set value, such as 2, 3, or 4. Another is to determine X based on Y. Specifically, if Y is less than or equal to the first set threshold (e.g., 2), then X can be the same as Y; if Y is greater than the first set threshold, then X can be the same as the first set threshold, such as the user uploading 2 resources; if Y is greater than the first set threshold (e.g., 2) and less than the second set threshold (greater than the first set threshold, such as 10), then X can be a pre-set value less than or equal to Y, such as the user uploading 2-10 resources; if Y is greater than or equal to the second set threshold (e.g., 10), then X can be a value determined based on Y, such as the calculation formula X = Y / 3, where X is rounded to the nearest integer, such as the user uploading 3-10 resources.

[0103] In one embodiment, when the number of uploaded resources reaches X, the selection completion control can be triggered to display.

[0104] Figure 4 This is a flowchart illustrating a method for identifying media content with preset effects according to an embodiment of the present disclosure. This embodiment is applicable to the situation of identifying media content with preset effects. The method can be executed by a device for identifying media content with preset effects. The device can be implemented in the form of software and / or hardware, or optionally, by an electronic device, which can be a terminal-side device or a server-side device.

[0105] like Figure 4 As shown, the method includes:

[0106] S310. Obtain the audio and image information of the media content to be identified.

[0107] In this embodiment, the media content to be identified can be understood as the media content to be identified. The electronic device acquires the audio and image information of the media content to be identified. The method for acquiring the audio and image information of the media content to be identified is not specifically limited here; for example, it can be acquired by processing the media content to be identified using appropriate audio and image information recognition algorithms.

[0108] S320: Recognize audio and image information and obtain recognition results.

[0109] In this embodiment, the recognition result can be understood as the result obtained by recognizing audio information and image information. The recognition result is not specifically limited here; it may include audio timing information corresponding to the audio information, visual cropping information corresponding to the image information in the media content to be recognized, and text information in the media content to be recognized, etc. Audio timing information can be understood as the timing information of the audio.

[0110] Optionally, the recognition results include audio timing information of the audio information and visual cropping information of the media content to be recognized.

[0111] This section does not specify how to identify audio and image information or obtain the identification results. For example, audio information can be processed using appropriate audio track separation algorithms to obtain the corresponding identification results, such as audio beat information. Similarly, image information of the media content to be identified can be processed using appropriate cut-off detection algorithms to obtain the corresponding identification results, such as visual cut-off information of the media content to be identified.

[0112] S330. Based on the recognition results, determine whether the media content to be recognized has a preset effect, so that the media content to be recognized can display the preset template effect control on the display page.

[0113] In this embodiment, the electronic device can determine whether the media content to be identified has a preset effect based on the recognition result; if it has a preset effect, the media content to be identified can display the preset template effect control on the display page; if it does not have a preset effect, the media content to be identified cannot display the preset template effect control on the display page.

[0114] This section does not specify how to determine whether the media content to be identified has a preset effect based on the recognition results. For example, based on the audio timing information and visual cut-off information in the recognition results, the degree of matching between the audio timing information and the visual timing information can be determined. If the degree of matching is higher than a set threshold, it indicates that the media content to be identified has a preset effect; otherwise, it does not. Here, the degree of matching can be understood as the proportion of overlapping timing points between audio and visual timing points within a certain range. Visual timing points can be understood as visual timing points in the media content.

[0115] Optional preset effects include one or more of the following: text information, beat information, transition information, and visual cut information.

[0116] This disclosure provides a method for identifying media content with preset effects. First, audio and image information of the media content to be identified is acquired. Then, the audio and image information are identified to obtain a recognition result. Finally, based on the recognition result, it is determined whether the media content to be identified has a preset effect, so that the media content to be identified displays a preset template effect control on the display page. This method improves the automation and efficiency of media content identification by processing the audio and image information of the media content to be identified to obtain a recognition result, and then using the recognition result to determine whether the media content to be identified has a preset effect.

[0117] Figure 5 This is a flowchart illustrating another method for identifying media content with a preset effect provided by an embodiment of this disclosure. This embodiment refines the above embodiments. In this embodiment, the process of identifying audio and image information and obtaining identification results, the process of determining whether the media content to be identified has a preset effect based on the identification results, and the process after the media content to be identified is determined to have a preset effect are described in detail. It should be noted that technical details not described in detail in this embodiment can be found in any of the above embodiments. Figure 5 As shown, the method includes:

[0118] S410. Obtain the audio and image information of the media content to be identified.

[0119] S420. Recognize the audio information to obtain the audio timing information.

[0120] In this embodiment, no specific limitation is made on how the audio information is identified to obtain the audio timing information. For example, the audio information can be identified and processed using a set algorithm for audio timing recognition (such as the onset algorithm) to obtain the audio timing information.

[0121] S430. Recognize the image information to obtain the visual cut-off information of the media content to be recognized.

[0122] In this embodiment, the recognition result can be the audio timing information of the audio information and the visual cut-out information of the media content to be recognized.

[0123] This section does not specify how to identify image information to obtain the visual cut-off information of the media content to be identified. For example, multiple image information of the media content to be identified can be processed by a corresponding algorithm to determine the cut-off probability corresponding to each image information, where the cut-off probability can be understood as the probability of the corresponding image information being cut off; then the cut-off probability of each image information is compared with a pre-set probability threshold to filter out the image information corresponding to the cut-off probability greater than the set probability threshold; finally, the time position corresponding to the filtered image information is determined as the visual cut-off information of the media content to be identified.

[0124] S440. Based on visual cut-off information and audio timing information, determine the probability of timing that the media content to be identified has a preset effect.

[0125] In this embodiment, the jamming probability can be understood as the probability of jamming between visual cut-off information and audio jamming information in the media content to be identified.

[0126] This section does not specify how to determine the probability of the media content to be recognized having a preset effect based on visual cut-off information and audio timing information. For example, one could first determine the number of visual timing points corresponding to the visual cut-off information and the number of audio timing points corresponding to the audio timing information. Then, identify the points where the visual and audio timing points overlap. These overlapping points can be understood as points where the distance between the two points is within a set range; they are considered to be nearly identical. Finally, based on the identified overlapping points, visual timing points, and audio timing points, the probability of the timing point is determined using a corresponding timing probability algorithm.

[0127] S450: Determine whether the media content to be identified has a preset effect based on the probability of the checkpoint; if so, proceed to S460.

[0128] In this embodiment, there is no specific limitation on how to determine whether the media content to be identified has a preset effect based on the probability of the checkpoint. For example, a probability threshold can be preset to measure whether the preset effect is achieved. The checkpoint probability and the probability threshold are compared. If the checkpoint probability is greater than the probability threshold, it indicates that the media content to be identified has a preset effect, and S460 can continue to be executed. Otherwise, it indicates that the media content to be identified does not have a preset effect.

[0129] S460. After determining that the media content to be identified has a preset effect, determine the transition range based on the visual cut-off information and the second set threshold.

[0130] In this embodiment, the second set threshold can be understood as a second pre-set threshold. The transition interval can be understood as the time interval corresponding to the transition location.

[0131] This section does not specify how to determine the transition interval based on visual cut-off information and a second set threshold. For example, the change rate of the cut-off probability of the visual cut-off information can be determined first through a corresponding change rate algorithm, where the change rate can be understood as the slope between the cut-off probabilities corresponding to two adjacent image information. Then, the change rate of the cut-off probability is compared with the second set threshold, and the change rate less than the second set threshold is selected. Finally, for each selected change rate, the two image information corresponding to the change rate are determined, so as to determine the transition interval corresponding to the two image information based on the time position of the two image information.

[0132] S470. Input the video within the transition interval into the category recognition model to obtain the transition category corresponding to the transition interval.

[0133] In this embodiment, the category recognition model can be understood as a model used to identify the transition category corresponding to the transition interval; the category recognition model is not specifically limited here, but can be a Temporal Shift Module (TSM) model. Transition information can include transition intervals and transition categories. Transition category can be understood as the category of the transition's display effect; the transition category is not specifically limited here, but can include dissolves, fade-in / fade-out, etc. The electronic device inputs the video within the transition interval into the category recognition model, and through the corresponding model processing, the transition category corresponding to the transition interval can be obtained.

[0134] In one embodiment, before inputting the video within the transition interval into the category recognition model, the video within the transition interval can be processed by a temporal difference algorithm. Based on this, the processed video is then input as input data into the category recognition model for corresponding processing to obtain the transition classification corresponding to the transition interval.

[0135] This disclosure specifies the process of recognizing audio and image information and obtaining recognition results, the process of determining whether the media content to be recognized has a preset effect based on the recognition results, and the process after the media content to be recognized is determined to have a preset effect. This method, by recognizing audio and image information separately, can obtain audio timing information and visual cut-off information to determine timing probabilities, and then uses these timing probabilities to identify whether the media content to be recognized has a preset effect, effectively recognizing whether the media content to be recognized has a preset effect. Furthermore, by determining transition intervals and transition categories after determining that a preset effect exists, the content corresponding to the preset effects of the media content to be recognized is enriched, thus enriching the creation methods of media content.

[0136] Optionally, the image information is recognized to obtain visual cropping information of the media content to be recognized, including:

[0137] The image information is input into the cut-off recognition model to obtain the cut-off probability of the image information;

[0138] The cut probability of each image information is compared with a set probability value, and the cut probability is selected from each cut probability based on the comparison result.

[0139] Based on the image information corresponding to the selected cut probability, the visual cut information of the media content to be identified is determined.

[0140] In this embodiment, the cut-scene recognition model can be understood as a model used to identify the cut-scene probability of image information; the cut-scene recognition model is not specifically limited here, and can be, for example, a TransNetV2 model or a clipper model. The set probability value can be understood as a pre-set probability value, which is not limited here and can be flexibly set according to actual needs. The comparison result can be understood as the result of comparing each cut-scene probability with the set probability value.

[0141] In this embodiment, the process of recognizing image information to obtain the visual cut-off information of the media content to be recognized can be as follows: First, the image information is input into the cut-off recognition model for corresponding processing to obtain the cut-off probability of the image information; then, the cut-off probability of each image information is compared with a set probability value, and the cut-off probability is selected from each cut-off probability based on the comparison result; finally, the visual cut-off information of the media content to be recognized can be determined based on the image information corresponding to the selected cut-off probability.

[0142] This embodiment does not specifically limit how to select the cut probability from each cut probability based on the comparison results; for example, the cut probability greater than a set probability value can be used as the selected cut probability. Correspondingly, this embodiment also does not specifically limit how to determine the visual cut information of the media content to be identified based on the image information corresponding to the selected cut probability; for example, the time position of the image information corresponding to the selected cut probability can be determined as the cut position corresponding to the image information, and the determined cut position can be considered as the visual cut information of the media content to be identified.

[0143] Optionally, based on visual cut-off information and a second set threshold, the transition range is determined, including:

[0144] Determine the rate of change of the cutting probability of the visual cutting lens information;

[0145] Candidate transition positions are selected from visual cut-off information based on the rate of change and a second set threshold.

[0146] The transition range is determined based on the candidate transition locations.

[0147] In this embodiment, the candidate transition position can be understood as the candidate time position used to determine the transition interval.

[0148] This section does not specify how to determine the rate of change of the cut probability in the visual cut information. For example, the slope between the cut probabilities corresponding to two adjacent image information can be used as the rate of change of the cut probability. Correspondingly, this section also does not specify how to select candidate transition positions from the visual cut information based on the rate of change and the second set threshold. For example, the rate of change and the second set threshold can be compared first, and the rate of change less than the second set threshold can be selected. Then, for each selected rate of change, the time position of the two image information corresponding to that rate of change can be determined as the candidate transition position.

[0149] Based on this, no specific limitations are made on how to determine the transition interval based on the candidate transition positions; for example, for each selected rate of change, the interval between the two candidate transition positions corresponding to the rate of change can be determined as the transition interval; or, the candidate transition position earlier in time can be used as the benchmark, and the time position within a certain time range before the candidate transition position can be determined as the left endpoint of the transition interval, and the candidate transition position later in time can be used as the benchmark, and the time position within a certain time range after the candidate transition position can be determined as the right endpoint of the transition interval, thereby determining the transition interval corresponding to the rate of change based on the left endpoint and the right endpoint.

[0150] In one embodiment, two adjacent transition intervals with a distance less than a set distance threshold can be merged into one transition interval. Transition intervals with a size smaller than a set interval threshold can also be filtered out.

[0151] Optionally, based on visual cut-off information and audio timing information, determine the probability of the timing of the media content to be identified having a preset effect, including:

[0152] The number of visual checkpoints is determined based on visual slicing information;

[0153] The number of audio punctuation points is determined based on the audio punctuation information;

[0154] Based on visual cut-out information and audio timing information, the number of overlaps is determined. The number of overlaps is the number of points where the distance between the position indicated by the visual cut-out information and the position indicated by the audio timing information is less than a first preset value.

[0155] Based on the number of visual checkpoints, the number of audio checkpoints, and the number of overlaps, the probability of checkpoints that the media content to be identified has a preset effect is determined.

[0156] In this embodiment, the number of visual checkpoints can be understood as the number of visual checkpoints. The number of audio checkpoints can be understood as the number of audio checkpoints. No specific limitation is made here on how to determine the number of visual checkpoints and audio checkpoints. For example, the corresponding number of visual checkpoints and audio checkpoints can be obtained by recognizing and processing the audio checkpoint information and visual cut-off information using appropriate algorithms.

[0157] The number of overlapping points can be understood as the number of points where the distance between the position indicated by the visual cut-off information and the position indicated by the audio caliper information is less than a first preset value. The first preset value can be understood as a pre-set value used to measure the distance between point positions; this is not specifically limited here and can be flexibly set according to actual needs.

[0158] This embodiment does not specifically limit how to determine the number of overlaps based on visual cut-off information and audio sync information. For example, for each visual sync point corresponding to the visual cut-off information, the distance between the position of the visual sync point (which can be considered as the time position) and the position of each audio sync point (which can be considered as the time position) in the audio sync information can be determined. Based on this, the visual sync points and audio sync points corresponding to distances less than a first preset value can be determined as overlap points. Overlap points can be understood as points where the distance between the position indicated by the visual cut-off information and the position indicated by the audio sync information is less than the first preset value. Then, the number of overlap points determined is the number of overlaps.

[0159] This embodiment does not specifically limit how to determine the probability of the media content to be identified having a preset effect based on the number of visual checkpoints, the number of audio checkpoints, and the number of overlaps. For example, the ratio between the number of overlaps and the number of visual checkpoints can be determined as the matching rate corresponding to the visual checkpoints, and the ratio between the number of overlaps and the number of audio checkpoints can be determined as the matching rate corresponding to the audio checkpoints. Based on this, the probability of checkpoints can be determined based on the two missing matching rates. For example, the probability of checkpoints can be the average of the two matching rates, or the weighted average of the two matching rates, etc.

[0160] Optionally, based on the number of visual checkpoints, the number of audio checkpoints, and the number of overlaps, the probability of the media content to be identified having a preset effect is determined, including:

[0161] Determine the checkpoint matching rate, which is the ratio of the number of overlapping visual checkpoints to the number of visual checkpoints;

[0162] Select an audio point position from among the various audio point positions where the audio amplitude is the set amplitude;

[0163] The percentage of positions indicated by the selected audio timing information that are less than the position indicated by the visual timing information is determined as the timing hit rate of the set amplitude.

[0164] Determine the hit rate of each audio amplitude in the audio amplitude corresponding to each audio amplitude, and determine the average hit rate of each audio amplitude as the average hit rate.

[0165] The probability of a checkpoint is determined based on the checkpoint matching rate, the checkpoint hit rate within a set range, and the average checkpoint rate.

[0166] In this embodiment, the point matching rate can be understood as the probability of a match between a visual point and an overlapping point. In this embodiment, the ratio between the number of overlapping points and the number of visual points can be determined as the point matching rate.

[0167] The set amplitude can be understood as a preset amplitude value. The audio amplitude can be understood as the amplitude corresponding to the audio cadence. The audio cadence position can be understood as the location (i.e., time position) of the audio cadence. In this embodiment, the audio amplitude of the audio cadence corresponding to each audio cadence position can be determined, and based on this, the audio cadence position with the set amplitude can be selected from each audio cadence position.

[0168] The second preset value can be understood as a pre-set second value used to measure the distance between point positions. This is not specifically limited here and can be flexibly set according to actual needs. The proportion value can be understood as the percentage of audio point information positions indicated by audio point information whose distance from the position indicated by the visual point information is less than the second preset value, within the selected audio point information positions. The point hit rate can be understood as the probability value representing the overlap between the positions of audio point information and video point information. In this embodiment, the proportion of positions indicated by selected audio point information whose distance from the position indicated by visual point information is less than the second preset value can be determined as the point hit rate of a set amplitude. Based on this, using the above point hit rate method, the point hit rate corresponding to each audio amplitude can be determined, and the average point hit rate corresponding to each audio amplitude can be determined as the average point hit rate.

[0169] This embodiment does not specifically limit how to determine the checkpoint probability based on the checkpoint matching rate, the checkpoint hit rate of the set range, and the average checkpoint rate. For example, the sum of the checkpoint matching rate, the checkpoint hit rate of the set range, and the average checkpoint rate can be determined as the checkpoint probability; or the weighted sum of the checkpoint matching rate, the checkpoint hit rate of the set range, and the average checkpoint rate can be determined as the checkpoint probability, etc.

[0170] The following provides an exemplary description of this disclosure.

[0171] Figure 6 This is a schematic diagram illustrating the implementation of a method for determining checkpoint probability according to an embodiment of this disclosure. Figure 6 As shown, the implementation process of this method is as follows:

[0172] S10. Receive the video to be identified;

[0173] The video to be identified can be considered as the media content to be identified.

[0174] S11. Perform video cropping on the video to be recognized to obtain visual cropping information;

[0175] S12. The audio timing information is obtained by processing the video to be recognized through a set algorithm.

[0176] The algorithm can be a beat tracking algorithm or an onset algorithm, etc.

[0177] S13. Is the video to be identified a single image? If yes, proceed to S14; otherwise, proceed to S15.

[0178] In this context, "single image" can be understood as the video to be identified being composed of a single image.

[0179] S14, the probability of getting stuck is 0 points;

[0180] A score of 0 indicates that the corresponding video to be identified is a video without the preset effect.

[0181] S15. Determine the timing match rate, timing hit rate, and average timing hit rate based on the visual cut-off information and audio timing information.

[0182] The specific determination method can be found in the above embodiments, and will not be repeated here.

[0183] S16. Determine the checkpoint probability based on the checkpoint matching rate, checkpoint hit rate, and average checkpoint hit rate.

[0184] The specific determination method can be found in the above embodiments, and will not be repeated here.

[0185] Figure 7 This is a schematic diagram illustrating the implementation of a video recognition method provided in an embodiment of this disclosure. Figure 7 As shown, the implementation process of this method includes:

[0186] Video frame extraction: The video to be identified is processed by extracting frames to obtain each frame of the video (i.e., image information).

[0187] Scene cut detection: The extracted frames are input into TransNetV2 to obtain the scene cut probability value (scene_pred) for each frame. The smoothed prediction value (scene_pred_avg) is a pre-set value based on human experience. Scene cut position determination (i.e., determination of visual scene cut information): A scene cut probability value greater than the smoothed prediction value is selected, and the time position of each frame corresponding to the selected scene cut probability value is determined as the corresponding scene cut position.

[0188] Transition interval calculation: 1) Distinguish between hard cuts and transitions based on the change rate of scene_pred: Hard cuts and transitions are distinguished based on the change rate of the cut position (i.e., the change rate of the cut probability of the visual cut information), where the change rate is equivalent to the slope between two adjacent cut positions; 2) Determine the transition interval with a low threshold (i.e., the second set threshold): If the slope is greater than the low threshold, the corresponding interval attribute is a hard cut. A hard cut can be understood as two frames of images being joined together without any special effects, simply switching from one frame to another; If the slope is less than the low threshold, the corresponding interval attribute is a transition (i.e., a transition interval); The low threshold is preset; The time position of the two frames corresponding to the transition position can be considered as a candidate transition position, and the transition interval can be determined based on the candidate transition position; 3) Transition interval filtering and merging: Adjacent transition intervals are merged, and transition intervals that are too small are filtered out.

[0189] Transition Classification: 1) TSM + Temporal Differentiation to Predict Transition Category: The frame images corresponding to the transition interval are first processed by temporal difference. The processed frame images corresponding to the transition interval are then input into the TSM model to obtain the transition category corresponding to that transition interval. 2) Obtaining Transition Details: Based on the determined transition category and the pre-defined mapping relationship between the indicated transition category and transition details, the transition details corresponding to the transition category are determined. The transition details can be understood as information associated with the transition category, but this is not limited here.

[0190] Transition field generation: Each frame of the video to be identified is processed using a corresponding algorithm to obtain information such as transition fields (i.e., text information).

[0191] Figure 8 This is a schematic diagram illustrating the implementation of a checkpoint template generation method provided in an embodiment of this disclosure. Figure 8 As shown, the implementation process of this method includes: for the video to be recognized, performing audio track separation processing to obtain audio segments (i.e., audio timing information); performing video cut processing to obtain slot duration (i.e., the display duration of the resource, where a slot can be understood as the position corresponding to a timing segment); and performing transition detection to obtain transition animations (including transition categories). Performing Optical Character Recognition (OCR) processing on the video to be recognized can obtain the text content and position within the text detection box (i.e., text information), and can also obtain the text font and font size (i.e., text information) through font recognition and font size calibration methods in OCR. Performing transition detection processing on the video to be recognized can obtain information such as the transition intervals of the video to be recognized. Performing sticker detection processing on the video to be recognized can obtain information such as the stickers and sticker positions in the video to be recognized; stickers can be considered a type of video effect setting.

[0192] Based on this, by using the audio segments, slot durations, transition animations, text content, text positions, text font sizes, transition intervals, stickers, and other information obtained from the video to be identified, a new template can be obtained, namely, a beat template.

[0193] Figure 9 This is a schematic diagram illustrating the implementation of a checkpoint according to an embodiment of this disclosure. Figure 9 As shown, the vertical axis represents the audio amplitude (i.e., energy); the horizontal axis (time) represents time (i.e., time position); the broken line represents the broken line formed by the audio of the video to be identified, and the inflection point of the broken line can be regarded as the rhythm point of the music; the vertical straight line represents the straight line where the video is stopped; the dot represents the point where the curve and the straight line coincide (i.e., the point where the stop coincides).

[0194] Figure 10 This is a schematic diagram of the structure of an information publishing device provided in an embodiment of this disclosure, as shown below. Figure 10 As shown, the device includes: a display module 510, a first response module 520, a third response module 530, and a fourth response module 540;

[0195] Among them, the display module 510 is used to display the target media content on the display page;

[0196] The first response module 520 is used to respond to determining that the target media content is identified media content with a preset effect, and to display a preset template effect control on the display page, wherein the preset effect is obtained based on the audio information and / or image information of the target media content;

[0197] The third response module 530 is used to display a media content generation page in response to the triggering of the preset template effect control in the display page. The media content generation page includes a target template determined based on the preset effect.

[0198] The fourth response module 540 is used to generate media content based on the target template in response to a media content generation operation on the media content generation page.

[0199] The technical solution provided in this disclosure first displays target media content on a display page through a display module; then, in response to determining that the target media content is media content with a preset effect, a preset template effect control is displayed on the display page through a first response module. The preset effect is obtained based on the audio and / or image information of the target media content; subsequently, in response to the triggering of the preset template effect control on the display page, a media content generation page is displayed through a third response module. The media content generation page includes a target template determined based on the preset effect; finally, in response to a media content generation operation on the media content generation page, media content is generated based on the target template. This device, by displaying a preset template effect control within a display page containing media content with preset effects, triggering the display of the media content generation page through this control, and then generating media content for publication using the target template included on the media content generation page, achieves automatic media content generation, enriches the methods of media content creation, and improves the user experience.

[0200] Optionally, the media content generation page includes a resource selection interface and a third response module 530, including:

[0201] The display unit is used to display instruction information on the resource selection interface. The instruction information indicates the number of resources to be selected for the target template and / or the display duration of the resources. The number is determined based on the preset attributes of the preset effects in the identified media content with preset effects.

[0202] Optionally, the preset effect includes timing information, and the number is determined based on the preset attributes of the preset effect in the identified media content with preset effect, including: the number is determined based on the number of segments with timing in the identified media content with preset effect.

[0203] Optionally, the number includes a first number and a second number, wherein the first number is a number determined or set based on the number of segments with preset effects in the identified media content, and the second number is the number of segments with preset effects in the identified media content, wherein the first number is less than the second number.

[0204] Optionally, the device may also include:

[0205] The first response unit is used to display a selection completion control on the resource selection interface in response to the fulfillment of the termination condition.

[0206] The second response unit is used to display the edit page in response to the selection completion control being triggered.

[0207] The termination condition includes the number of selected resources being a second number, or the number of selected resources being greater than or equal to a first number when the value of the second number is greater than a first set threshold.

[0208] Optionally, the target media content includes one or more of the following:

[0209] Category 1 content and Category 2 content;

[0210] The first type of content includes identified content with preset effects, and the second type of content includes content published after modifying the corresponding target template.

[0211] The information publishing device provided in this disclosure can execute the information publishing method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects of executing the method.

[0212] Figure 11 A schematic diagram of the structure of a media content recognition device with preset effects provided in an embodiment of this disclosure is shown below. Figure 11 As shown, the device includes: an acquisition module 610, an identification module 620, and a determination module 630;

[0213] The acquisition module 610 is used to acquire audio and image information of the media content to be identified.

[0214] The recognition module 620 is used to recognize the audio information and the image information and obtain the recognition result;

[0215] The determining module 630 is used to determine, based on the recognition result, whether the media content to be recognized has a preset effect, so that the media content to be recognized can display a preset template effect control on the display page.

[0216] In this embodiment, the acquisition module first acquires the audio and image information of the media content to be identified; then, the recognition module identifies the audio and image information to obtain the recognition result; finally, the determination module determines, based on the recognition result, whether the media content to be identified has a preset effect, so that the media content to be identified displays the preset template effect control on the display page. This device improves the automation and efficiency of media content identification by processing the audio and image information of the media content to be identified, and then using the recognition result to determine whether the media content to be identified has a preset effect.

[0217] Optionally, the preset effects include one or more of the following: text information, timing information, transition information, and visual cut-off information.

[0218] Optionally, the recognition result includes the audio timing information of the audio information and the visual cut-out information of the media content to be recognized.

[0219] Optionally, the recognition module 620 includes:

[0220] The first identification unit is used to identify the audio information and obtain the audio timing information of the audio information;

[0221] The second recognition unit is used to recognize the image information to obtain the visual cut-off information of the media content to be recognized.

[0222] Optionally, the second identification unit includes:

[0223] The input subunit is used to input the image information into the cut-off recognition model to obtain the cut-off probability of the image information;

[0224] A sub-unit is selected to compare the cutting probability of each image information with a set probability value, and select a cutting probability from each cutting probability based on the comparison result.

[0225] The information determination subunit is used to determine the visual cut information of the media content to be identified based on the image information corresponding to the selected cut probability.

[0226] Optionally, the device may also include:

[0227] The interval determination module is used to determine the transition interval based on the visual cut-out information and the second set threshold after the media content to be identified is determined to have a preset effect;

[0228] The classification determination module is used to input the video within the transition interval into the category recognition model to obtain the transition classification corresponding to the transition interval;

[0229] The transition information includes the transition range and the transition category.

[0230] Optional, the interval determination module includes:

[0231] A rate of change determination unit is used to determine the rate of change of the cutting probability of the visual cutting information;

[0232] A position selection unit is used to select candidate transition positions from the visual cut-out information based on the rate of change and a second set threshold.

[0233] An interval determination unit is used to determine a transition interval based on the candidate transition positions.

[0234] Optionally, module 630 is defined, including:

[0235] The probability determination unit is used to determine the probability that the media content to be identified has a preset effect based on the visual cut-out information and the audio timing information.

[0236] An effect recognition unit is used to determine whether the media content to be recognized has a preset effect based on the probability of the checkpoint.

[0237] Optional, probability determination unit, including:

[0238] The first number determination subunit is used to determine the number of visual checkpoints based on the visual slicing information;

[0239] The second number determination subunit is used to determine the number of audio punctuation points based on the audio punctuation information;

[0240] The third number determination subunit is used to determine the number of overlaps based on the visual cut-out information and the audio timing information. The number of overlaps is the number of points where the distance between the position indicated by the visual cut-out information and the position indicated by the audio timing information is less than a first preset value.

[0241] The probability determination subunit is used to determine the probability that the media content to be identified has a preset effect based on the number of visual checkpoints, the number of audio checkpoints, and the number of overlaps.

[0242] Optional, probabilistic deterministic subunit, specifically used for:

[0243] Determine the checkpoint matching rate, wherein the checkpoint matching rate is the ratio of the number of overlapping points to the number of visual checkpoints;

[0244] Select an audio point position from the various audio point positions where the audio amplitude is the set amplitude;

[0245] The percentage of positions indicated by the selected audio timing information that are less than a second preset value from the positions indicated by the visual timing information is determined as the timing hit rate of the set amplitude.

[0246] Determine the hit rate of each audio amplitude in the audio amplitude corresponding to each audio amplitude, and determine the average hit rate of each audio amplitude as the average hit rate.

[0247] The checkpoint probability is determined based on the checkpoint matching rate, the checkpoint hit rate of the set range, and the average checkpoint rate.

[0248] The media content recognition device with preset effects provided in this disclosure can execute the media content recognition method with preset effects provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects of the method execution.

[0249] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.

[0250] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Reference is made below. Figure 12 The diagram illustrates a structural schematic of an electronic device 700 suitable for implementing embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 12 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0251] like Figure 12As shown, the electronic device 700 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. The RAM 703 also stores various programs and data required for the operation of the electronic device 700. The processing unit 701, ROM 702, and RAM 703 are interconnected via a bus 704. An edit / output (I / O) interface 705 is also connected to the bus 704.

[0252] Typically, the following devices can be connected to I / O interface 705: input devices 706 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 707 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 708 including, for example, magnetic tapes, hard disks, etc.; and communication devices 709. Communication device 709 allows electronic device 700 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 12 An electronic device 700 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0253] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 709, or installed from storage device 708, or installed from ROM 702. When the computer program is executed by processing device 701, it performs the functions defined in the methods of embodiments of this disclosure.

[0254] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0255] The electronic device provided in this embodiment belongs to the same inventive concept as the information publishing method or the media content identification method with preset effect provided in the above embodiments. Technical details not described in detail in this embodiment can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.

[0256] This disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the information publishing method or the media content identification method with preset effects provided in the above embodiments.

[0257] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to, an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0258] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0259] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0260] Optionally, the aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: display target media content on a display page; in response to determining that the target media content is identified as media content with a preset effect, display a preset template effect control on the display page, the preset effect being identified based on audio and / or image information of the target media content; in response to the preset template effect control on the display page being triggered, display a media content generation page, the media content generation page including a target template determined based on the preset effect; and in response to a media content generation operation on the media content generation page, generate media content based on the target template.

[0261] Optionally, the aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to: acquire audio and image information of the media content to be identified; identify the audio and image information to obtain an identification result; and, based on the identification result, determine whether the media content to be identified has a preset effect, so that the media content to be identified displays a preset template effect control on the display page.

[0262] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0263] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0264] The modules or units described in the embodiments of this disclosure can be implemented in software or hardware. The names of modules or units do not necessarily limit the unit itself; for example, a first response unit can also be described as "a unit that displays a selection completion control on the resource selection interface in response to the fulfillment of a termination condition."

[0265] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0266] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0267] According to one or more embodiments of this disclosure, Example 1 provides an information publishing method, including:

[0268] Display the target media content on the display page;

[0269] In response to determining that the target media content is identified as media content with a preset effect, a preset template effect control is displayed on the display page, wherein the preset effect is obtained based on the audio information and / or image information of the target media content;

[0270] In response to the triggering of the preset template effect control in the display page, a media content generation page is displayed, the media content generation page including a target template determined based on the preset effect;

[0271] In response to the media content generation operation on the media content generation page, media content is generated based on the target template.

[0272] According to one or more embodiments of this disclosure, Example 2 describes the method described in Example 1, wherein the media content generation page includes a resource selection interface, and the display of the media content generation page includes:

[0273] The resource selection interface displays instruction information indicating the number of resources to be selected for the target template and / or the display duration of the resources. The number is determined based on the preset attributes of the preset effects in the identified media content with preset effects.

[0274] According to one or more embodiments of this disclosure, Example 3 describes the preset effect according to Example 2, which includes one or more of the following: text information, timing information, transition information, and visual cut-off information.

[0275] According to one or more embodiments of this disclosure, Example 4 describes the method according to Example 2, wherein the preset effect includes timing information, and the number is determined based on the preset attributes of the preset effect in the identified media content with the preset effect, including: the number is determined based on the number of segments with timing in the identified media content with the preset effect.

[0276] According to one or more embodiments of this disclosure, Example 5 describes the method according to Example 3, wherein the number includes a first number and a second number, the first number being a number determined or set based on the number of segments with pre-defined effects in the target media content, and the second number being the number of segments with pre-defined effects in the target media content, wherein the first number is less than the second number.

[0277] According to one or more embodiments of this disclosure, Example 6, based on the method described in Example 3, further includes:

[0278] In response to the fulfillment of the termination condition, a selection completion control is displayed on the resource selection interface;

[0279] In response to the selection completion control being triggered, the editing page is displayed;

[0280] The termination condition includes the number of selected resources being a second number, or the number of selected resources being greater than or equal to a first number when the value of the second number is greater than a first set threshold.

[0281] According to one or more embodiments of this disclosure, Example 7 describes the method described in Example 1, wherein the target media content includes one or more of the following:

[0282] Category 1 content and Category 2 content;

[0283] The first type of content includes identified content with preset effects, and the second type of content includes content published after modifying the corresponding target template.

[0284] According to one or more embodiments of this disclosure, Example 8 provides a method for identifying media content with a preset effect, including:

[0285] Obtain audio and image information of the media content to be identified;

[0286] The audio information and the image information are identified to obtain the identification result;

[0287] Based on the recognition results, it is determined whether the media content to be recognized has a preset effect, so that the media content to be recognized can display a preset template effect control on the display page.

[0288] According to one or more embodiments of this disclosure, Example 9 describes the preset effect according to Example 8, which includes one or more of the following: text information, timing information, transition information, and visual cut-off information.

[0289] According to one or more embodiments of this disclosure, Example 10 describes the method described in Example 8, wherein the recognition result includes audio timing information of the audio information and visual cut-off information of the media content to be recognized.

[0290] According to one or more embodiments of this disclosure, Example 11, based on the method described in Example 8, includes identifying the audio information and the image information to obtain an identification result, comprising:

[0291] The audio information is identified to obtain the audio timing information of the audio information;

[0292] The image information is identified to obtain the visual cut-off information of the media content to be identified.

[0293] According to one or more embodiments of this disclosure, Example 12, based on the method described in Example 11, the step of identifying the image information to obtain visual cut-off information of the media content to be identified includes:

[0294] The image information is input into the cut-off recognition model to obtain the cut-off probability of the image information;

[0295] The cut probability of each image information is compared with a set probability value, and a cut probability is selected from the cut probabilities based on the comparison result.

[0296] Based on the image information corresponding to the selected cut probability, the visual cut information of the media content to be identified is determined.

[0297] According to one or more embodiments of this disclosure, Example 13, based on the method described in Example 8, further includes:

[0298] After the media content to be identified is determined to have a preset effect, the transition range is determined based on the visual cut-out information and the second set threshold.

[0299] The video within the transition interval is input into a category recognition model to obtain the transition category corresponding to the transition interval;

[0300] The transition information includes the transition range and the transition category.

[0301] According to one or more embodiments of this disclosure, Example 14, based on the method of Example 3, the step of determining the transition interval based on the visual cut-off information and a second set threshold includes:

[0302] Determine the rate of change of the cutting probability of the visual cutting information;

[0303] Based on the rate of change and the second set threshold, candidate transition positions are selected from the visual cut-out information;

[0304] The transition range is determined based on the candidate transition locations.

[0305] According to one or more embodiments of this disclosure, Example 15 describes the method described in Example 10, wherein determining whether the media content to be identified has a preset effect based on the identification result includes:

[0306] Based on the visual cut-out information and the audio timing information, determine the probability that the media content to be identified has a preset effect at a certain timing point.

[0307] Based on the probability of the checkpoint, it is determined whether the media content to be identified has a preset effect.

[0308] According to one or more embodiments of this disclosure, Example 16 describes the method described in Example 15, wherein determining the probability that the media content to be identified has a preset effect based on the visual cut-out information and the audio timing information includes:

[0309] The number of visual checkpoints is determined based on the visual slicing information;

[0310] The number of audio punctuation points is determined based on the audio punctuation information;

[0311] Based on the visual cut-out information and the audio timing information, the number of overlaps is determined. The number of overlaps is the number of points where the distance between the position indicated by the visual cut-out information and the position indicated by the audio timing information is less than a first preset value.

[0312] Based on the number of visual checkpoints, the number of audio checkpoints, and the number of overlaps, the probability of the checkpoints that the media content to be identified has a preset effect is determined.

[0313] According to one or more embodiments of this disclosure, Example 17, based on the method described in Example 16, determines the probability that the media content to be identified has a preset effect based on the number of visual timing points, the number of audio timing points, and the number of overlaps, including:

[0314] Determine the checkpoint matching rate, wherein the checkpoint matching rate is the ratio of the number of overlapping points to the number of visual checkpoints;

[0315] Select an audio point position from the various audio point positions where the audio amplitude is the set amplitude;

[0316] The percentage of positions indicated by the selected audio timing information that are less than a second preset value from the positions indicated by the visual timing information is determined as the timing hit rate of the set amplitude.

[0317] Determine the hit rate of each audio amplitude in the audio amplitude corresponding to each audio amplitude, and determine the average hit rate of each audio amplitude as the average hit rate.

[0318] The checkpoint probability is determined based on the checkpoint matching rate, the checkpoint hit rate of the set range, and the average checkpoint rate.

[0319] According to one or more embodiments of this disclosure, Example 18 provides an electronic device, including:

[0320] One or more processing devices;

[0321] Storage device for storing one or more programs.

[0322] When the one or more programs are executed by the one or more processing devices, the one or more processing devices perform the method as described in any of Examples 1-17.

[0323] According to one or more embodiments of the present disclosure, Example 19 provides a storage medium containing computer-executable instructions that, when executed by a computer processing device, are used to perform a session page display method as described in any of Examples 1-17.

[0324] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0325] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0326] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. An information dissemination method, characterized in that, include: Display the target media content on the display page; In response to determining that the target media content is identified as media content with a preset effect, a preset template effect control is displayed on the display page, wherein the preset effect is determined based on information obtained from the identification of the audio information and / or image information of the target media content; In response to the triggering of the preset template effect control in the display page, a media content generation page is displayed, the media content generation page including a target template determined based on the preset effect; In response to the media content generation operation on the media content generation page, media content is generated based on the target template; The media content generation page includes a resource selection interface. The display of the media content generation page includes: displaying instruction information on the resource selection interface, wherein the instruction information indicates the number of resources to be selected for the target template and the display duration of the resources, and the number is determined based on the preset attributes of the preset effects in the identified media content with preset effects.

2. The method according to claim 1, characterized in that, The preset effect includes timing information, and the number is determined based on the preset attributes of the preset effect in the identified media content with preset effect, including: the number is determined based on the number of segments with timing in the identified media content with preset effect.

3. The method according to claim 1, characterized in that, The number includes a first number and a second number. The first number is a number determined or set based on the number of segments with preset effects in the target media content. The second number is the number of segments with preset effects in the target media content. The first number is less than the second number.

4. The method according to claim 1, characterized in that, Also includes: In response to the fulfillment of the termination condition, a selection completion control is displayed on the resource selection interface; In response to the selection completion control being triggered, the editing page is displayed; The termination condition includes the number of selected resources being a second number, or the number of selected resources being greater than or equal to a first number when the value of the second number is greater than a first set threshold.

5. The method according to claim 1, characterized in that, The target media content includes one or more of the following: Category 1 content and Category 2 content; The first type of content includes identified content with preset effects, and the second type of content includes content published after modifying the corresponding target template.

6. A method for identifying media content with preset effects, characterized in that, include: Obtain audio and image information of the media content to be identified; The audio information and the image information are identified to obtain the identification result; The recognition result includes the audio timing information of the audio information and the visual cut-out information of the media content to be recognized; Based on the recognition result, it is determined whether the media content to be recognized has a preset effect, so that the media content to be recognized displays a preset template effect control on the display page; the preset effect includes one or more of the following: text information, timing information, transition information and visual cut information; The step of identifying audio information and image information and obtaining identification results includes: identifying the audio information to obtain audio timing information of the audio information; and identifying the image information to obtain visual cut-out information of the media content to be identified. The step of determining whether the media content to be identified has a preset effect based on the recognition result includes: determining the number of visual checkpoints based on the visual cut-out information; determining the number of audio checkpoints based on the audio checkpoint information; and determining the number of overlaps based on the visual cut-out information and the audio checkpoint information, wherein the number of overlaps is the number of points where the distance between the position indicated by the visual cut-out information and the position indicated by the audio checkpoint information is less than a first preset value. Determine the matching rate of the audio points, which is the ratio of the number of overlapping points to the number of visual points; select the positions indicated by audio points with an audio amplitude of a set amplitude from the positions indicated by each audio point information; determine the percentage of the selected audio point information positions whose distance from the position indicated by the visual cut-off information is less than a second preset value as the hit rate of the set amplitude. Determine the hit rate of each audio amplitude corresponding to each audio amplitude, and determine the average hit rate of each audio amplitude as the average hit rate; determine the hit probability based on the hit rate, the hit rate of the set amplitude, and the average hit rate; determine whether the media content to be identified has a preset effect based on the hit probability.

7. The method according to claim 6, characterized in that, The step of recognizing the image information to obtain the visual cut-off information of the media content to be recognized includes: The image information is input into the cut-off recognition model to obtain the cut-off probability of the image information; The cut probability of each image information is compared with a set probability value, and a cut probability is selected from the cut probabilities based on the comparison result. Based on the image information corresponding to the selected cut probability, the visual cut information of the media content to be identified is determined.

8. The method according to claim 6, characterized in that, Also includes: After the media content to be identified is determined to have a preset effect, the transition range is determined based on the visual cut-out information and the second set threshold. The video within the transition interval is input into a category recognition model to obtain the transition category corresponding to the transition interval; The transition information includes the transition range and the transition category.

9. The method according to claim 8, characterized in that, The step of determining the transition range based on the visual cut-off information and the second set threshold includes: Determine the rate of change of the cutting probability of the visual cutting information; Based on the rate of change and the second set threshold, candidate transition positions are selected from the visual cut-out information; The transition range is determined based on the candidate transition locations.

10. An electronic device, characterized in that, The electronic device includes: One or more processing devices; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processing devices, the one or more processing devices perform the method as described in any one of claims 1-9.

11. A storage medium comprising computer-executable instructions, which, when executed by a computer processor, are used to perform the method as described in any one of claims 1-9.

Images