Information posting methods, identification methods, electronic devices and media
The method enhances media content creation by identifying and utilizing preset effects in media content, automating the generation process to improve interactive experiences in animation and video production.
Patent Information
- Application Number
- JP2025546137
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-02-21
- Filing Date
- 2024-02-08
- Publication Date
- 2026-02-25
AI Technical Summary
Current animation and video creation tools lack the ability to automatically identify and utilize preset effects in media content, such as audio-sync animations, leading to inefficient and limited interactive experiences.
An information posting method that identifies preset effects in media content based on audio and image information, presents a template effect control, and generates media content using a target template, enhancing interactive effects.
Enriches media content creation by automatically generating content with preset effects, improving user interaction and efficiency in animation and video production.
Smart Images

Figure 2026506596000001_ABST
Abstract
Description
[Technical Field]
[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This application is based on and claims priority from Chinese Patent Application No. 202310145814.3, filed on February 21, 2023, the disclosure of which is incorporated herein in its entirety.
[0002] [Technical field] TECHNICAL FIELD The present disclosure relates to computer technology, and more particularly to an information posting method, an identification method, an electronic device, and a medium. [Background technology]
[0003] Currently, animation applications often feature animations with specific templates, such as audio-sync animations. Audio-sync animations refer to animations in which the generated images are matched to the rhythm of the music, so that the images change smoothly at the rhythmic points of the music. Users can achieve the desired audio-sync effect by using audio-sync animation templates when creating their animations. Summary of the Invention [Problem to be solved by the invention]
[0004] The present disclosure provides an information posting method, an identification method, an electronic device, and a medium. [Means for solving the problem]
[0005] According to a first aspect, an embodiment of the present disclosure provides an information posting method, the method comprising: presenting the target media content in a presentation interface; presenting a preset template effect control in the presentation interface in response to determining that the target media content is media content having an identified preset effect, the preset effect being identified based on audio information and / or image information of the target media content; displaying a media content generation interface including a target template determined based on the preset effect in response to the preset template effect control in the presentation interface being triggered; and generating media content based on the target template in response to a media content generation operation on the media content generation interface.
[0006] According to a second aspect, an embodiment of the present disclosure further provides a method for identifying media content having a preset effect, the method comprising: obtaining audio and image information for media content to be identified; distinguishing between the audio information and the image information and obtaining a distinguishing result; Based on the identification result, determining whether the identified media content has a preset effect, so that the identified media content presents a preset template effect control in a presentation interface.
[0007] According to a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising: one or more processing devices; a storage device for storing one or more programs; The one or more programs, when executed by the one or more processing devices, cause the one or more processing devices to implement a method according to an embodiment of the present disclosure.
[0008] According to a fourth aspect, an embodiment of the present disclosure further provides a storage medium including computer-executable instructions, which, when executed by a computer processor, are used to perform a method according to an embodiment of the present disclosure.
[0009] The above and other features, advantages, and aspects of each embodiment of the present disclosure will become more apparent by reference to the following specific embodiments in conjunction with the drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are illustrative only, and that original components and elements are not necessarily drawn to scale. [Brief explanation of the drawings]
[0010] [Figure 1] 1 is a schematic flow chart of an information posting method according to an embodiment of the present disclosure. [Figure 2] 1 is a schematic flow chart of another information posting method according to an embodiment of the present disclosure. [Figure 3] 1 is a diagram illustrating a method for implementing an interface display according to an embodiment of the present disclosure. [Figure 4] 1 is a schematic flow chart of a method for identifying media content with preset effects according to an embodiment of the present disclosure; [Figure 5] 10 is a schematic flow chart diagram of another method for identifying media content with preset effects according to an embodiment of the present disclosure. [Figure 6] 1 is a schematic diagram of an implementation of a sound-hame probability determination method according to an embodiment of the present disclosure; [Figure 7] 1 is a schematic diagram illustrating an implementation of a moving image identification method according to an embodiment of the present disclosure; [Figure 8] FIG. 1 is a schematic diagram of an implementation of a sound-Hame template generation method according to an embodiment of the present disclosure. [Figure 9] FIG. 1 is a schematic diagram of a sound-hame implementation according to an embodiment of the present disclosure. [Figure 10] 1 is a structural schematic diagram of an information posting device according to an embodiment of the present disclosure; [Figure 11]1 is a structural schematic diagram of a media content identification device with preset effects according to an embodiment of the present disclosure; [Figure 12] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0011] The following describes in more detail the embodiments of the present disclosure with reference to the drawings. Although the drawings show some embodiments of the present disclosure, it should be understood that the present disclosure can be realized in various forms and should not be construed as being limited to the embodiments described herein, but rather these embodiments are provided for a better understanding and complete comprehension of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are merely illustrative and are not intended to limit the protection scope of the present disclosure.
[0012] It should be understood that the steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel, and that method embodiments may include additional steps and / or omit performing steps as shown, and the scope of the present disclosure is not limited in this respect.
[0013] As used herein, the term "comprises" and variations thereof are open-ended "includes," i.e., "including, but not limited to." The term "based on" means "based at least in part on." The term "in one embodiment" means "at least one embodiment," the term "in another embodiment" means "at least one other embodiment," and the term "in some embodiments" means "at least some embodiments." Relevant definitions of other terms are provided below in the description.
[0014] It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are merely intended to distinguish different devices, modules or units, and are not intended to limit the order or interdependence of functions performed by these devices, modules or units.
[0015] It should be noted that the limitations "one" and "plurality" referred to in this disclosure are illustrative and not limiting, and should be understood as "one or more" unless the context clearly indicates otherwise, as would be understood by one of ordinary skill in the art.
[0016] The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.
[0017] As can be understood, before using the technical solutions disclosed in each embodiment of the present disclosure, users must be informed of the type, scope of use, and use scenario of personal information involved in the present disclosure in an appropriate manner in accordance with laws and regulations, and permission from the users must be obtained. For example, identification of media content to be identified requires consent from the user who posted the media content to be identified, and the target template must obtain permission from the creator to use content applied in the media content, such as music, images, etc.
[0018] For example, in response to receiving a spontaneous request from a user, prompt information may be sent to the user to clearly prompt the user that the requested operation requires the acquisition and use of the user's personal information, so that the user can autonomously choose whether to provide personal information to software or hardware, such as an electronic device, an application program, a server, or a storage medium, that performs the operation of the technical solution of the present disclosure, based on the prompt information.
[0019] As an optional but non-limiting implementation, the method of sending prompt information to the user in response to receiving a voluntary request from the user may be, for example, a pop-up window in which the prompt information is displayed in text form, and the pop-up window may further include a selection control for the user to select "agree" or "disagree" to providing personal information to the electronic device.
[0020] As can be appreciated, the above notification and user permission acquisition process is merely exemplary and does not constitute a limitation on the implementation of the present disclosure, and other methods that comply with relevant laws and regulations may also be used in the implementation of the present disclosure.
[0021] Currently, videos with specific templates, such as music-matched videos, are common in video application programs. Music-matched videos refer to videos in which the generated images are matched to the rhythm of the music, so that the images change smoothly at the rhythmic points of the music. Users can achieve the desired music-matched effect by using music-matched video templates when creating their videos. However, currently, music-matched video templates are generally created voluntarily by template creators. For example, the template creator must post a video containing template information (the template information must be voluntarily edited by the template creator and uploaded along with the video). Upon posting, the platform determines the template of the video based on the template information edited by the user, and displays the template on the playback interface for other users to use. For example, even if a filmed video uploaded by a user has a video rhythm that belongs to a music-matched video, the video itself does not contain template information, so the filmed entry for the related template is not displayed after posting.
[0022] A method according to an embodiment of the present disclosure presents a preset template effect control in a presentation interface including media content with preset effects, and triggers the display of a media content generation interface through the control, and further generates media content for posting through a target template included in the media content generation interface, thereby enriching the media content creation method and enhancing the interactive effect.
[0023] FIG. 1 is a schematic flowchart of an information posting method according to an embodiment of the present disclosure, which is applied to generating media content to enrich the creation of media content and enhance the interactive effect. The method may be performed by an information posting device, which may be implemented in the form of software and / or hardware, or alternatively, by an electronic device, which may be a terminal device.
[0024] As shown in FIG. 1, the method includes:
[0025] S110, presenting the target media content in a presentation interface.
[0026] In this embodiment, the presentation interface may be understood as an interface for presenting and viewing media content in an application program. The target media content may be understood as media content presented in the presentation interface. The media content may be understood as content based on media data. Media data may refer to an important medium for storing and transmitting information, and may include, for example, audio data, video data, picture data, any combination of the two, or a combination of the three.
[0027] After executing the application program, the electronic device can present the target media content in the presentation interface of the application program.
[0028] S120, in response to determining that the target media content is media content having the identified preset effect, present a preset template effect control in the presentation interface.
[0029] In this embodiment, the term "preset effect" may be understood as a pre-defined presentation effect, and is not limited to a specific preset effect. For example, the term may be an effect related to the presentation of a video audio. The preset effect may be identified and obtained based on audio information and / or image information of the target media content. The term "audio information" may be understood as information related to audio, and is not limited to a specific audio information, and may include, for example, information such as the beat, melody, or lyrics of the audio. The term "image information" may be understood as information related to an image, and is not limited to a specific image information, and may include, for example, information such as a cut situation corresponding to the image. A cut may be understood as a visual screen transition.
[0030] Here, there is no specific limitation on how to obtain a preset effect by identifying based on the audio information and / or image information of the target media content. For example, based on the audio information and / or image information of the target media content, identification can be performed using a corresponding audio sound break identification algorithm and cut identification algorithm to obtain information related to the audio sound break corresponding to the audio information and / or information related to the cut corresponding to the image information, and then, based on the identified information, it can be determined whether the target media content has a preset effect.
[0031] In one embodiment, a service-side device may identify whether the target media content has a preset effect, or a terminal-side device may identify whether the target media content has a preset effect. For example, when posting the target media content, the service-side device or the terminal-side device may identify whether the target media content has a preset effect. The identification of the media content to be identified requires consent from the user who posts the media content to be identified. The target template requires permission from the creator to use content applied in the media content, such as music or images.
[0032] The preset template effect control may be understood as a preset control for triggering the display of a media content generation interface. In response to determining that the target media content is media content having the identified preset effect, the electronic device may present the preset template effect control in the presentation interface. Here, the presentation position of the preset template effect control in the presentation interface is not specifically limited and may be flexibly set according to actual needs.
[0033] As can be understood, when the service side device identifies whether the target media content is media content with preset effects, the service side device can send information indicating whether the target media content is media content with preset effects, and the electronic device (i.e., the terminal side device) can determine whether the target media content is media content with preset effects by receiving this information.
[0034] S130, displaying a media content generation interface in response to a preset template effect control in the presentation interface being triggered.
[0035] In this embodiment, the media content generation interface may be understood as an interface for generating media content, and the media content generation interface may include a target template determined based on the preset effect. The target template may be understood as a template for generating media content with the preset effect.
[0036] Here, there is no specific limitation on how to determine a target template based on a preset effect. For example, based on the setting of an effect on information such as audio, image, and video in media content among the preset effects, a template, i.e., a target template, for setting any uploaded media content according to this effect can be created.
[0037] The electronic device may display a media content generation interface in response to triggering a preset template effect control in the presentation interface. Here, there is no specific limitation on how the media content generation interface is displayed. For example, the media content generation interface may display an interface including multiple resources to be selected (e.g., an interface for selecting resources from an album), or may display an interface available for acquiring resources (e.g., a photography interface for acquiring resources by photography). The displayed media content generation interface may further include instruction information for indicating information such as the number of resources to be selected by the target template and / or the presentation time duration of the resources. Here, the resources may be understood to be pictures and / or videos for generating media content.
[0038] S140, in response to a media content generation operation on the media content generation interface, generating media content based on the target template.
[0039] In this embodiment, the media content generation operation may be understood as an operation for triggering the generation of media content, and the electronic device can generate media content based on the target template in response to the media content generation operation on the media content generation interface.
[0040] Here, there is no specific limitation on how to generate media content based on the target template. For example, selected or captured resources (e.g., pictures and / or videos) can be configured according to the effect configuration of the target template, such as resource cuts, transitions, sound effects, and arranged text, to obtain corresponding media content.
[0041] An embodiment of the present disclosure provides a method for posting information, comprising: first presenting target media content in a presentation interface; and, in response to determining that the target media content is media content with an identified preset effect, presenting a preset template effect control in the presentation interface, the preset effect being identified and obtained based on audio information and / or image information of the target media content; then, in response to triggering the preset template effect control in the presentation interface, displaying a media content generation interface including a target template determined based on the preset effect; and finally, in response to a media content generation operation in the media content generation interface, generating the media content based on the target template. This method presents the preset template effect control in the presentation interface including the media content with the preset effect, triggers the display of the media content generation interface using the control, and further generates the media content for posting using the target template included in the media content generation interface, thereby automatically generating the media content, enriching the media content creation method and enhancing the interactive effects.
[0042] Optionally, the preset effect includes one or more of text information, sound-insertion information, transition information, and visual cut information.
[0043] The character information may be understood as information related to characters, and is not specifically limited to the character information, and may include, for example, information such as character content, character font, and character font size.
[0044] The audio information may be understood as information related to audio insertion, and is not specifically limited to audio insertion information, and may include, for example, information such as the number of inserted clips, the duration of each inserted clip, etc., which can be used to load one selected resource onto each inserted clip.
[0045] The transition information may be understood as information related to a transition, and is not limited to the transition information, and may include, for example, information such as a transition section and a transition type. A transition may be understood as a transition or change in display between two resources located in two adjacent audio clips. A transition section may be understood as a display range of a transition. A transition type may be understood as a display format of a transition effect.
[0046] The visual cut information may be understood as information related to the visual cut information, and is not specifically limited to the visual cut information, and may include, for example, information such as the visual cut position. The visual cut may be understood as a visual transition between scenes. The visual cut position may be understood as a time position at which a scene is visually switched.
[0047] Optionally, the target media content is: including one or more of a first type of content and a second type of content; Here, the first type of content includes the content with the identified preset effect, and the second type of content includes the content posted after making the corresponding target template changes.
[0048] In this embodiment, there is no specific limitation on how the target template is changed, and for example, the audio composed by the target template may be corrected to another audio, and / or the time length of the audio composed by the target template may be corrected.
[0049] In this embodiment, the first type of content may be content with preset effects that are automatically identified by an algorithm.
[0050] In one embodiment, the targeted media content may further include content with preset effects that are autonomously created by the user.
[0051] 2 is a schematic flowchart of another information posting method according to an embodiment of the present disclosure, which is a further detailed description of the above embodiments. This embodiment specifically describes the display process of a media content generation interface and the process after responding to meeting the termination condition. It should be noted that technical details not described in this embodiment may refer to any of the above embodiments. As shown in FIG. 2, the method includes:
[0052] S210, presenting the target media content in a presentation interface.
[0053] S220, in response to determining that the target media content is media content having the identified preset effect, present a preset template effect control in the presentation interface.
[0054] S230, in response to the preset template effect control in the presentation interface being triggered, displaying instruction information in the resource selection interface.
[0055] In this embodiment, the media content generation interface may include a resource selection interface, and the electronic device may display instructional information in the resource selection interface in response to a preset template effect control in the presentation interface being triggered.
[0056] The resource selection interface may be understood as an interface for selecting resources, i.e., the resource selection interface may include multiple resources to be selected by the user. The instruction information may indicate the number of resources that need to be selected by the target template and / or the presentation duration of the resources. The presentation duration may be understood as the duration for which the resources are presented.
[0057] The quantity may be determined based on preset attributes of the identified preset effects in the media content having the preset effects, where the preset attributes may be understood as pre-defined attributes, such as the size of characters, font size, etc., and the preset attributes of the audio information may be understood as the number of audio clips inserted, the duration of audio clips, etc.
[0058] The quantity may include a quantity that must be selected and a maximum selectable quantity. Here, there is no specific limitation on how the quantity of resources that must be selected is determined based on the preset attributes of the preset effect in the identified media content having the preset effect. For example, the quantity of resources that must be selected may be determined based on the number of audio-inserted clips in the audio-insertion information. Specifically, for example, the number of audio-inserted clips may be directly determined as the quantity. Alternatively, the quantity that must be selected and the maximum selectable quantity may be the same, and the number of audio-inserted clips may be determined as the maximum selectable quantity. Alternatively, a quantity determined based on the number of audio-inserted clips or a preset quantity may be determined as the quantity that must be selected. As can be understood, the quantity that must be selected may be equal to or less than the maximum selectable quantity.
[0059] S240, in response to a media content generation operation on the media content generation interface, generating media content based on the target template.
[0060] S250, in response to the completion of the selection, displays a selection completion control in the resource selection interface.
[0061] In this embodiment, the termination condition may include that the quantity of the selected resource is a second quantity, or that the quantity of the selected resource is equal to or greater than the first quantity when the value of the second quantity is greater than a first predetermined threshold. The selected resource may be understood as a resource selected by a user. The first predetermined threshold may be understood as a preset first threshold, and the first predetermined threshold may be flexibly set according to actual needs. The selection completion control may be understood as a control for triggering the display of an editing interface.
[0062] In response to satisfying the exit condition, the electronic device may display a selection completion control in the resource selection interface.
[0063] S260, in response to the selection completion control being triggered, displays an editing interface.
[0064] In this embodiment, the electronic device may display an editing interface in response to the selection completion control being triggered. The editing interface may be understood as an interface for editing media content, for example, in the editing interface, content such as text or animated sticker effects may be added to the media content, although this is not specifically limited thereto.
[0065] The information posting method according to the second embodiment of the present disclosure embodies a display process of a media content generation interface and a process after responding to the satisfaction of an end condition. By using this method, the quantity of resources that need to be selected by the target template in the instruction information can be determined according to the preset attributes of the preset effect in the media content, thereby improving the flexibility of quantity determination, and further determining the end condition based on the first quantity and / or the second quantity to trigger the display of a selection completion control, thereby improving the flexibility of control display, thereby improving the richness of interaction between the interface.
[0066] Optionally, the preset effect includes fit information, and determining the quantity based on preset attributes of the preset effect in the identified media content having the preset effect includes determining the quantity based on the number of fit clips in the identified media content having the preset effect.
[0067] In this embodiment, the preset effect may include audio-insertion information. The quantity may be determined based on the number of audio-inserted clips in the identified media content having the preset effect. Here, the method for determining the quantity based on the number of audio-inserted clips in the identified media content having the preset effect is not specifically limited. For example, the quantity may be determined directly as the number of audio-inserted clips in the identified media content having the preset effect, or the quantity may be determined based on the result of comparing the number of audio-inserted clips with a predetermined threshold. Specifically, for example, if the number of audio-inserted clips is less than the predetermined threshold, the quantity may be determined as the number of audio-inserted clips or a predetermined number less than the number of audio-inserted clips. Otherwise, the quantity may be calculated based on the number of audio-inserted clips, such as one-third of the number of audio-inserted clips.
[0068] Optionally, the quantity includes a first quantity and a second quantity, the first quantity being a quantity or predetermined quantity determined based on the number of sound-fitted clips in the identified media content having the preset effect, and the second quantity being the number of sound-fitted clips in the identified media content having the preset effect, and the first quantity being less than the second quantity.
[0069] In this embodiment, the quantity may include a first quantity and a second quantity. The first quantity may be understood as a quantity determined based on the number of embedded clips in the identified media content having the preset effect, or a predetermined quantity, and the first quantity may be recognized as at least a quantity that needs to be selected. The predetermined quantity may be understood as a preset quantity, where the predetermined quantity is not specifically limited and may be flexibly set according to actual needs.
[0070] The second quantity may be the number of clips in the identified media content that have the preset effect, and the second quantity may be recognized as the maximum quantity that can be selected. The first quantity may be less than the second quantity.
[0071] In one embodiment, after resource selection is completed, the resource playback duration of the selected resource and the template playback duration of the target template may be determined first. Here, the resource playback duration may be understood as the total playback duration of the resource. The template playback duration may be understood as the total playback duration of the target template. Then, the resource playback duration of the selected resource and the template playback duration of the target template are compared.
[0072] When the resource playback time length is shorter than the template playback time length, speed information for adjusting the playback speed of the selected resource can be determined based on the difference between the resource playback time length and the template playback time length. Here, there is no specific limitation on how the speed information is determined based on the difference between the resource playback time length and the template playback time length. For example, the speed information can be obtained based on the difference and a corresponding algorithm, and the speed information can indicate that the resource playback time length is to be slowed down at a constant speed until the resource playback time length and the template playback time length become the same.
[0073] If the playback duration of a resource is longer than the template playback duration, the selected resource may be clipped based on the difference between the playback duration of the resource and the template playback duration. The clipping method is not specifically limited, and for example, a resource whose playback duration is the difference may be clipped and removed from the selected resource. The clipped position is also not specifically limited, and may be flexibly set according to actual needs, and may be, for example, the first clip position, highlight position, or end clip position of the selected resource.
[0074] In one embodiment, the resource reserved after clipping may include a highlight position of the resource, where a highlight position may be considered to be a position corresponding to a specific time in the video, for example, a position where a key frame of the video exists.
[0075] If the resource duration is equal to the template duration, there is no need to adjust the selected resource.
[0076] The following provides an exemplary explanation of the present disclosure.
[0077] 3 illustrates an implementation method for interface display according to an embodiment of the present disclosure. As shown in FIG. 3, 1 represents the presentation interface, 2 represents a preset template effect control, 3 represents a media content generation interface, 4 represents a resource selection interface, 5 represents a resource to be selected, 6 represents a location for uploading a second quantity of resources in the target template, 7 represents a selection completion control, 8 represents the presentation time length of the resource in the prompt information, and 9 represents the quantity of resources to be selected indicated by the prompt information. After determining that the target media content in the current presentation interface 1 is media content with a preset effect, the electronic device can display a preset template effect control 2 in the presentation interface 1, and in response to the triggering of the preset template effect control 2, display a media content generation interface 3, which includes a resource selection interface 4, in which a resource 5 to be selected, a location 6 for uploading resources, and prompt information 8 and 9 are displayed. In response to meeting an end condition, the electronic device can display a selection completion control 7 in the resource selection interface 4, and in response to the triggering of the selection completion control 7, display an editing interface.
[0078] The present disclosure presents a template capture entry (i.e., preset template effect control) in the lower left corner of an audio-infused video (i.e., media content with preset effects) on a billing page (i.e., presentation interface), and triggers the template capture entry to enter a corresponding media content generation interface, which generates corresponding media content based on a target template to achieve the preset effect of the target template and shorten the information submission path of the media content. The audio-infused video may be composed of two videos, or may be composed of a mixture of videos and pictures, etc.
[0079] In one embodiment, before displaying the media content generation interface, it can first determine whether the user has access permission to the interface in the resource selection interface for displaying the resource to be selected (e.g., the interface of the local album of the electronic device). If there is no permission, a permission pop-up window needs to be triggered, and the user can enter the media content generation interface after consenting from the user. If there is permission, the user can directly enter the media content generation interface.
[0080] In one embodiment, the resource selection interface can display resource upload locations (the number of which is the same as the number of embedded clips in the target template) and prompt information, where one selected resource can be uploaded to each location. If the number of resources to be selected is X and the number of embedded clips is Y, there are several ways to determine X. Method 1 is that X can be a preset number, such as 2, 3, or 4. Method 2 is to determine X based on Y. Specifically, when Y is less than or equal to a first predetermined threshold (e.g., 2), X may be equal to Y. When Y is greater than the first predetermined threshold, X may be equal to the first predetermined threshold. For example, if a user can upload two resources, and Y is greater than a first predetermined threshold (e.g., 2) and less than a second predetermined threshold (greater than the first predetermined threshold, e.g., 10), X may be a predetermined value less than or equal to Y. For example, if a user can upload 2 to 10 resources, and Y is greater than or equal to a second predetermined threshold (e.g., 10), X may be a value determined based on Y. For example, the calculation formula may be X=Y / 3, where X is rounded to an integer. For example, in this case, the user can upload 3 to 10 resources.
[0081] In one embodiment, when the number of uploaded resources reaches X, the display of a selection complete control can be triggered.
[0082] FIG. 4 is a schematic flowchart of a method for identifying media content with preset effects according to an embodiment of the present disclosure, which is applied to identifying media content with preset effects. The method may be performed by an apparatus for identifying media content with preset effects, which may be implemented in the form of software and / or hardware, or alternatively, by an electronic device, which may be a terminal device or a service device.
[0083] As shown in FIG. 4, the method includes:
[0084] S310, audio information and image information of the media content to be identified are obtained.
[0085] In this embodiment, the media content to be identified may be understood as the media content to be identified. The electronic device acquires audio information and image information of the media content to be identified. Here, the method for acquiring the audio information and image information of the media content to be identified is not specifically limited. For example, the media content to be identified may be acquired by processing the media content to be identified using a corresponding audio and image information identification algorithm.
[0086] S320, distinguishing between audio information and image information, and obtaining a distinguishing result.
[0087] In this embodiment, the identification result may be understood as a result obtained by distinguishing between audio information and image information. Here, the identification result is not specifically limited and may include, for example, audio cut information corresponding to the audio information, visual cut information corresponding to the image information in the media content to be identified, and text information in the media content to be identified. The audio cut information may be understood as audio cut information.
[0088] Optionally, the identification result includes audio cut information of the audio information and visual cut information of the media content to be identified.
[0089] Here, there is no specific limitation on how to distinguish between audio information and image information and obtain the distinguishing result. For example, by performing a distinguishing process on audio information using a corresponding track separation algorithm, a distinguishing result corresponding to the audio information, such as audio sound-in information, can be obtained. Furthermore, by performing a distinguishing process on image information of the media content to be distinguished using a corresponding cut detection algorithm, a distinguishing result corresponding to the image information, such as visual cut information of the media content to be distinguished, can be obtained.
[0090] S330, based on the identification result, determining whether the identified media content has a preset effect, so that the identified media content presents a preset template effect control in a presentation interface.
[0091] In this embodiment, the electronic device can determine whether the media content to be identified has a preset effect based on the identification result. If the media content to be identified has a preset effect, the electronic device will present a preset template effect control in the presentation interface for the media content to be identified; if the media content to be identified does not have a preset effect, the electronic device will not present a preset template effect control in the presentation interface for the media content to be identified.
[0092] Here, there is no specific limitation on how to determine whether the media content to be identified has a preset effect based on the identification result. For example, based on the audio sound insert information and visual cut information as the identification result, the degree of matching between the audio sound insert corresponding to the audio sound insert information and the visual sound insert corresponding to the visual cut information can be determined. If the degree of matching is higher than a predetermined threshold, it can be determined that the media content to be identified has a preset effect. Otherwise, it cannot have the preset effect. Here, the degree of matching can be understood as the proportion of sound inserts that match and overlap within a certain range between the audio sound insert and the visual sound insert. The visual sound insert can be understood as the visual sound insert in the media content.
[0093] Optionally, the preset effect includes one or more of text information, sound-insertion information, transition information, and visual cut information.
[0094] An embodiment of the present disclosure provides a method for identifying media content with preset effects, which first obtains audio information and image information of the media content to be identified, then identifies the audio information and image information to obtain an identification result, and finally determines whether the media content to be identified has a preset effect based on the identification result, so that the media content to be identified presents a preset template effect control in a presentation interface. The method obtains an identification result by performing an identification process on the audio information and image information of the media content to be identified, and determines whether the media content to be identified has a preset effect based on the identification result, thereby improving the automation and efficiency of identifying the media content to be identified.
[0095] 5 is a schematic flowchart of another method for identifying media content with preset effects according to an embodiment of the present disclosure, which is a further detailed description of the above-mentioned embodiments. This embodiment specifically describes the process of identifying audio information and image information and obtaining an identification result, the process of determining whether the identified media content has a preset effect based on the identification result, and the process after determining that the identified media content has a preset effect. It should be noted that technical details not described in this embodiment may refer to any of the above-mentioned embodiments. As shown in FIG. 5, this method includes:
[0096] S410, obtain audio information and image information of the media content to be identified.
[0097] S420, identifying the audio information and obtaining audio sound-in information of the audio information;
[0098] In this embodiment, there is no specific limitation on how to identify the audio information and obtain the audio sound-in information of the audio information. For example, the audio information can be identified by a set audio sound-in identification algorithm (e.g., an onset algorithm) to obtain the audio sound-in information.
[0099] S430, identifying the image information and obtaining visual cut information of the media content to be identified;
[0100] In this embodiment, the identification result may be audio sound-in information of the audio information and visual cut information of the media content to be identified.
[0101] Here, there are no specific limitations on how to identify image information and obtain visual cut information of the media content to be identified. For example, first, a plurality of image information of the media content to be identified can be processed using a corresponding algorithm to determine the cut probability corresponding to each image information, where the cut probability can be understood as the probability of the corresponding image information being cut. Then, the cut probability of each image information is compared with a predetermined probability threshold, and image information corresponding to a cut probability greater than the set probability threshold is screened out, and finally the time position corresponding to the screened image information is determined as the visual cut information of the media content to be identified.
[0102] S440, determining a probability that the media content to be identified has a preset effect based on the visual cut information and the audio cut information.
[0103] In this embodiment, the fit probability may be understood as a probability representing a fit situation between visual cut information and audio fit information in the media content to be identified.
[0104] Here, the method for determining the sound-insertion probability that the media content to be identified has a preset effect based on the visual cut information and the audio sound-insertion information is not specifically limited. For example, the number of visual sound intrusions corresponding to the visual cut information and the number of audio sound intrusions corresponding to the audio sound-insertion information may be first determined. Then, the overlapping positions of the visual sound intrusions and the audio sound intrusions may be determined. Here, the overlapping positions may be understood as positions where the distance between the two sound intrusions is within a predetermined range, i.e., the two intrusion positions are deemed to be approximately overlapping. Finally, the sound intrusion probability is determined using a corresponding sound intrusion probability algorithm based on the determined overlapping positions, the visual sound intrusions, and the audio sound intrusions.
[0105] S450: Determine whether the media content to be identified has a preset effect based on the sound jam probability; if yes, execute S460.
[0106] In this embodiment, there is no specific limitation on how to determine whether the media content to be identified has a preset effect based on the sound-in probability. For example, a probability threshold is pre-set to evaluate whether the media content to be identified has a preset effect, and the sound-in probability is compared with the probability threshold. If the sound-in probability is greater than the probability threshold, it can be indicated that the media content to be identified has a preset effect, and S460 can be continued to be executed; otherwise, it can be indicated that the media content to be identified does not have a preset effect.
[0107] S460, after determining that the media content to be identified has a preset effect, determines a transition section based on the visual cut information and a second predetermined threshold.
[0108] In this embodiment, the second predetermined threshold may be understood as a second preset threshold, and the transition section may be understood as a time section corresponding to a transition.
[0109] Here, there are no specific limitations on how the transition section is determined based on the visual cut information and the second predetermined threshold. For example, first, the change rate of the cut probability of the visual cut information can be determined by a corresponding change rate algorithm, where the change rate can be understood to represent the slope between the cut probabilities corresponding to two adjacent image information, and then the change rate of the cut probability is compared with the second predetermined threshold, and change rates smaller than the second predetermined threshold are selected. Finally, for each selected change rate, two image information corresponding to this change rate are determined, and the transition section corresponding to these two image information is determined based on the time positions at which the two image information exist.
[0110] S470: inputting the moving image in the transition section into a classification identification model to obtain a transition classification corresponding to the transition section;
[0111] In this embodiment, the type identification model may be understood as a model for identifying a transition type corresponding to a transition section. The type identification model is not limited to a specific model and may be, for example, a Temporal Shift Module (TSM) model. The transition information may include a transition section and a transition type. The transition type may be understood as a type of a transition display effect. The transition type is not limited to a specific model and may include, for example, a dissolve, a fade, etc. The electronic device inputs a moving image in a transition section into the type identification model and processes the moving image using the corresponding model, thereby obtaining a transition type corresponding to the transition section.
[0112] In one embodiment, before inputting the video in the transition section into the type identification model, time difference processing can be performed on the video in the transition section using a time difference algorithm, and then the processed video is input as input data into the type identification model, and the corresponding processing is performed to obtain a transition category corresponding to the transition section.
[0113] An embodiment of the present disclosure embodies a process for identifying audio information and image information and obtaining a identification result, a process for determining whether the media content to be identified has a preset effect based on the identification result, and a process after determining that the media content to be identified has a preset effect. This method obtains audio sound-insertion information and visual cut information by respectively identifying audio information and image information, which can be used to determine a sound-insertion probability. Furthermore, the sound-insertion probability is used to identify whether the media content to be identified has a preset effect, thereby effectively identifying whether the media content to be identified has a preset effect. Furthermore, after determining that the media content to be identified has a preset effect, a transition section and a transition category are determined, thereby enriching the content of preset effects corresponding to the media content to be identified and enriching the method for creating media content.
[0114] Optionally, identifying image information and obtaining visual cut information of the media content to be identified includes: inputting the image information into a cut identification model to obtain a cut probability of the image information; comparing the cut probability of each image information with a predetermined probability value, and selecting a cut probability from each cut probability based on the comparison result; and determining visual cut information for the media content to be identified based on the image information corresponding to the selected cut probabilities.
[0115] In this embodiment, the cut identification model may be understood as a model for identifying cut probabilities in image information, and is not limited to a specific cut identification model and may be, for example, a TransNetV2 model or a clipper model. The predetermined probability value may be understood as a preset probability value, and is not limited to this and may be flexibly set according to actual needs. The comparison result may be understood as a result of comparing each cut probability with a predetermined probability value.
[0116] In this embodiment, the process of identifying image information and obtaining visual cut information of the media content to be identified may be as follows: first, input the image information into a cut identification model, perform the corresponding processing, obtain the cut probability of the image information, compare the cut probability of each image information with a predetermined probability value, select a cut probability from each cut probability based on the comparison result, and finally determine the visual cut information of the media content to be identified based on the image information corresponding to the selected cut probability.
[0117] This embodiment does not specifically limit how a cut probability is selected from the cut probabilities based on the comparison result, and for example, a cut probability greater than a predetermined probability value may be selected as the selected cut probability. Therefore, this embodiment does not specifically limit how the visual cut information of the media content to be identified is determined based on the image information corresponding to the selected cut probability, and for example, the time position at which the image information corresponding to the selected cut probability exists may be determined as the cut position corresponding to the image information, and the determined cut position may be recognized as the visual cut information of the media content to be identified.
[0118] Optionally, determining a transition section based on the visual cut information and a second predetermined threshold includes: determining a rate of change of the cut probability of the visual cut information; selecting candidate transition locations from the visual cut information based on the rate of change and a second predetermined threshold; determining a transition section based on the candidate transition locations.
[0119] In this embodiment, a candidate transition position may be understood as a candidate time position for determining a transition section.
[0120] Here, there is no specific limitation on how to determine the change rate of the cut probability of the visual cut information, for example, the slope between the cut probabilities corresponding to two adjacent image information may be determined as the change rate of the cut probability. Accordingly, here, there is no specific limitation on how to select candidate transition positions from the visual cut information based on the change rate and the second predetermined threshold, for example, first, compare the change rate with the second predetermined threshold, and select from each change rate a change rate smaller than the second predetermined threshold, and then determine the time positions of the two image information corresponding to each selected change rate as candidate transition positions.
[0121] Furthermore, there are no specific limitations on how the transition section is determined based on the candidate transition positions. For example, for each selected rate of change, the section between two candidate transition positions corresponding to that rate of change may be determined as the transition section. Alternatively, using a candidate transition position with a higher time position as the reference, a time position within a certain time range before this candidate transition position may be selected and determined as the left endpoint of the transition section. Similarly, using a candidate transition position with a lower time position as the reference, a time position within a certain time range after this candidate transition position may be selected and determined as the right endpoint of the transition section. In this way, the transition section corresponding to this rate of change can be determined based on the left endpoint and the right endpoint.
[0122] In one embodiment, two adjacent transition sections whose distance between them is less than a predetermined distance threshold may be merged into one transition section by performing a merge process, and transition sections whose section size is less than a predetermined section threshold may be filtered.
[0123] Optionally, determining a probability of the media content to be identified having a preset effect based on the visual cut information and the audio cut information includes: determining a quantity of visual sound bites based on the visual cut information; determining a quantity of audio sound fits based on the audio sound fit information; determining an overlap quantity based on the visual cut information and the audio sound fitting information, the overlap quantity being the quantity of a portion where the distance between the position indicated by the visual cut information and the position indicated by the audio sound fitting information is shorter than a first preset value; determining a probability that the media content being identified will have the preset effect based on the visual fit quantity, the audio fit quantity, and the overlap quantity.
[0124] In this embodiment, the visual sound-insertion quantity may be understood as a visual sound-insertion quantity, and the audio sound-insertion quantity may be understood as an audio sound-insertion quantity. Here, there is no specific limitation on how to determine the visual sound-insertion quantity and the audio sound-insertion quantity. For example, a corresponding algorithm may be used to perform a discrimination process on the audio sound-insertion information and the visual cut information to obtain the corresponding visual sound-insertion quantity and the audio sound-insertion quantity.
[0125] The overlap quantity may be understood as the quantity of portions where the distance between the position indicated by the visual cut information and the position indicated by the audio sound fitting information is shorter than a first preset value. The first preset value may be understood as a value for evaluating the distance of the first fitted position, which is not specifically limited thereto and may be flexibly set according to actual needs.
[0126] This embodiment does not specifically limit how the overlap quantity is determined based on the visual cut information and the audio sound fit information. For example, for the visual sound fit corresponding to each visual cut information, the distance between the position of this visual sound fit (i.e., it may be considered as a time position) and each position of the audio sound fit in the audio sound fit information (i.e., it may be considered as a time position) is determined. Then, among each distance, the visual sound fit and audio sound fit corresponding to a distance shorter than a first preset value can be determined as an overlapping location. An overlapping location can be understood as a location where the distance between the position indicated by the visual cut information and the position indicated by the audio sound fit information is shorter than the first preset value. Furthermore, the determined number of overlapping locations is determined as the overlap quantity.
[0127] This embodiment does not specifically limit how the audio fitting probability that the media content to be identified has a preset effect is determined based on the visual audio fitting quantity, audio audio fitting quantity, and overlap quantity. For example, the ratio of the overlap quantity to the visual audio fitting quantity can be determined as the matching rate corresponding to the visual audio fitting, and the ratio of the overlap quantity to the audio audio fitting quantity can be determined as the matching rate corresponding to the audio audio fitting. Then, the audio fitting probability can be determined based on the determined two matching rates. For example, the audio fitting probability can be the average value of the two matching rates, or the weighted average value of the two matching rates.
[0128] Optionally, determining a probability of the media content to be identified having the preset effect based on the visual sound-in-place quantity, the audio sound-in-place quantity, and the overlap quantity includes: determining a sound-matching ratio, which is a ratio of the overlap quantity to the visual sound-match quantity; selecting an audio sound fitting position having a predetermined audio width from each audio sound fitting position; determining a ratio of positions indicated by the selected audio sound-fit information, the distance of which from the position indicated by the visual sound-fit information is shorter than a second preset value, as a sound-fit hit rate of the predetermined width; Among the audio widths corresponding to each audio sound fit information, a sound fit hit rate corresponding to each audio width is determined, and an average value of the sound fit hit rates corresponding to each audio width is determined as an average sound fit hit rate; The sound fitting probability is determined based on the sound fitting matching rate, the sound fitting hit rate within a predetermined range, and the average sound fitting hit rate.
[0129] In this embodiment, the sound-in-place matching rate may be understood as a probability representing a matching situation between the visual sound-in-place and the overlapping portion. In this embodiment, the sound-in-place matching rate can be determined as the ratio of the overlapping quantity to the visual sound-in-place quantity.
[0130] The predetermined width may be understood as a preset width value. The audio width may be understood as a width corresponding to an audio sound fit. The audio sound fit position may be understood as a position (i.e., time position) where the sound fit is located in the audio. In this embodiment, the audio width of the audio sound fit corresponding to each audio sound fit position can be determined, and then, from each audio sound fit position, an audio sound fit position whose audio width is a predetermined width can be selected.
[0131] The second preset value may be understood as a value for evaluating the distance of a predetermined second fitted position, but is not limited thereto and may be flexibly set according to actual needs. The ratio may be understood as a value representing the proportion of positions indicated by audio sound fit information whose distance from the position indicated by the visual sound fit information is shorter than the second preset value to the position indicated by the selected audio sound fit information. The sound fit hit rate may be understood as a probability value of a hit when the audio sound fit and the video sound fit overlap. In this embodiment, the proportion of positions indicated by the selected audio sound fit information whose distance from the position indicated by the visual sound fit information is shorter than the second preset value is determined as the sound fit hit rate for a predetermined width. Then, the sound fit hit rate for each audio width can be determined using the above sound fit hit rate method, and the average of the sound fit hit rates for each audio width can be determined as the average sound fit hit rate.
[0132] This embodiment does not specifically limit how the sound fit probability is determined based on the sound fit matching rate, the sound fit hit rate for a specified width, and the average sound fit hit rate. For example, the sum of the sound fit matching rate, the sound fit hit rate for a specified width, and the average sound fit hit rate may be determined as the sound fit probability, or the weighted sum of the sound fit matching rate, the sound fit hit rate for a specified width, and the average sound fit hit rate may be determined as the sound fit probability.
[0133] The following provides an exemplary explanation of the present disclosure.
[0134] 6 is a schematic diagram of the implementation of the sound-hamming probability determination method according to an embodiment of the present disclosure. As shown in FIG. 6, the implementation process of this method is as follows:
[0135] S10, receiving a video to be identified; Identified moving images may be considered to be identified media content.
[0136] S11: Perform video cut processing on the video to be classified to obtain visual cut information; S12, process the video to be identified according to a predetermined algorithm to obtain audio information; Here, the predetermined algorithm may be a beat tracking algorithm, an onset algorithm, or the like.
[0137] S13: Determine whether the video to be identified is a single image. If YES, execute S14; if not, execute S15; Here, a single image may be understood to mean that the moving image to be identified is configured in the form of a single (one) picture.
[0138] S14, the probability of sound jamming is 0 points, A sound-in-place probability of 0 points can indicate that the corresponding moving image to be classified is a moving image that does not have a preset effect.
[0139] S15, determining a sound matching rate, a sound matching hit rate, and an average sound matching hit rate based on the visual cut information and the audio sound matching information; Here, the specific determination method may refer to the above embodiment, and will not be further described here.
[0140] S16: The sound fitting probability is determined based on the sound fitting matching rate, the sound fitting hit rate, and the average sound fitting hit rate.
[0141] Here, the specific determination method may refer to the above embodiment, and will not be further described here.
[0142] 7 is a schematic diagram of the implementation of a video identification method according to an embodiment of the present disclosure. As shown in FIG. 7, the implementation process of this method includes:
[0143] Video frame extraction: A frame extraction process is performed on the video to be classified, and pictures (i.e., image information) of each frame of the video to be classified are obtained.
[0144] Cut detection: The extracted pictures of each frame are input into TransNetV2 to obtain a cut probability value scene_pred (i.e., cut probability) corresponding to each picture of each frame, and the smoothed predicted value scene_pred_avg is a value preset based on artificial experience. Cut position determination (i.e., visual cut information determination): A cut probability value greater than the smoothed predicted value is selected, and the time position of the picture of each frame corresponding to the selected cut probability value is determined as the corresponding cut position.
[0145] Calculation of transition section: 1) distinguish between hard cut and transition based on the scene_pred change rate, where hard cut and transition are distinguished based on the change rate of cut position (i.e., the change rate of cut probability of visual cut information), where the change rate corresponds to the slope between two adjacent cut positions; 2) determine the transition section by a low threshold (i.e., a second predetermined threshold), where if the slope is greater than the low threshold, the corresponding section attribute is hard cut, which means that no trick effect can be applied when splicing two frames of pictures, and simply one frame. It may be understood that the transition section is a transition from a picture of one frame to another picture of one frame. If the slope is smaller than a low threshold, the corresponding section attribute is a transition (i.e., a transition section). The low threshold is a preset value. The time position of the two-frame picture corresponding to the transition may be recognized as a candidate transition position. The transition section can be determined based on the candidate transition position. 3) Filtering and merging of transition sections. If the transition sections are adjacent, the sections are merged. If the transition section is too small, the section is filtered.
[0146] Transition classification: 1) Performing TSM+time difference to predict the transition type, in which a time difference process is first performed on a picture of a frame corresponding to a transition section, and the processed picture of the frame corresponding to the transition section is input to the TSM model as input data to obtain the transition type corresponding to this transition section; 2) Obtaining transition detail information, in which transition detail information corresponding to the determined transition type is determined based on the determined transition type and a preset mapping relationship between the transition type and the transition detail information, in which the transition detail information may be understood as information related to the transition type, but is not limited thereto.
[0147] Generation of transition fields: Using the relevant algorithm, classification processing is performed on the pictures of each frame of the video to be classified, and information such as transition fields (i.e., text information) is obtained.
[0148] FIG. 8 is a schematic diagram illustrating an implementation of a method for generating a sound-insertion template according to an embodiment of the present disclosure. As shown in FIG. 8, the implementation process of this method includes the following: For a video to be identified, a track separation process is performed on the video to be identified to obtain an audio clip (i.e., audio sound-insertion information); A video cut process is performed on the video to be identified to obtain a slot time length (i.e., the presentation time length of a resource, where a slot may be understood as a position corresponding to a sound-insertion clip); and transition detection is performed to obtain a transition animation (including a transition type). An optical character recognition (OCR) process is performed on the video to be identified to obtain the text content and position (i.e., text information) within the text detection box. Furthermore, font identification and font size calibration processing methods in the OCR process can obtain the text font and text font size (i.e., text information). A transition detection process is performed on the video to be identified to obtain information such as the transition section of the video to be identified. A sticker detection process is performed on the video to be identified to obtain information such as the stickers and sticker positions of the video to be identified. Stickers may be recognized as one of the video effects.
[0149] Then, a new template can be obtained by performing a classification process based on the video to be classified, using information such as the audio clip, slot time length, transition animation, text content, text position, text font size, transition section, stickers, etc., and a sound-fitting template can be generated.
[0150] 9 is a schematic diagram illustrating an implementation of a sound-fitting technique according to an embodiment of the present disclosure. As shown in FIG. 9, the vertical axis can represent audio width (i.e., energy), the horizontal axis (time) can represent time (i.e., time position), the broken line can represent a broken line composed of the audio of the video to be identified, the bending points of the broken line can be recognized as rhythm points of the music sound-fitting, the vertical straight line represents a line where the video sound-fitting is present, and the dots represent overlaps between the curved line and the straight line (i.e., overlapping points of the sound-fitting).
[0151] FIG. 10 is a structural schematic diagram of an information posting device according to an embodiment of the present disclosure. As shown in FIG. 10 , the device includes: a presentation module 510, a first response module 520, a third response module 530, and a fourth response module 540; wherein the presentation module 510 is used to present the target media content in a presentation interface; the first response module 520, in response to determining that the target media content is media content having the identified preset effect, is used to present a preset template effect control in the presentation interface, the preset effect being identified based on audio information and / or image information of the target media content; a third response module 530 for displaying a media content generation interface including a target template determined based on the preset effect in response to the preset template effect control being triggered in the presentation interface; The fourth response module 540 is used to respond to a media content generation operation on the media content generation interface and generate media content based on the target template.
[0152] A technical solution according to an embodiment of the present disclosure includes: first, a presentation module presents target media content in a presentation interface; a first response module, in response to determining that the target media content is media content with an identified preset effect, presents a preset template effect control in the presentation interface, where the preset effect is obtained by identifying the target media content based on audio information and / or image information of the target media content; then, in response to triggering the preset template effect control in the presentation interface, a third response module displays a media content generation interface including a target template determined based on the preset effect; and finally, a fourth response module, in response to a media content generation operation in the media content generation interface, generates media content based on the target template. The device presents the preset template effect control in the presentation interface including the media content with the preset effect, triggers the display of the media content generation interface using the control, and further generates media content for posting using the target template included in the media content generation interface, thereby realizing automatic media content generation, enriching the media content creation method and enhancing the interactive effect.
[0153] Optionally, the media content generation interface includes a resource selection interface, and the third response module 530 is A display unit for displaying instruction information in the resource selection interface is included, and the instruction information indicates the quantity of resources and / or the presentation time length of the resources that need to be selected by the target template, and the quantity is determined based on the preset attributes of the preset effects in the identified media content having the preset effects.
[0154] Optionally, the preset effect includes fit information, and determining the quantity based on preset attributes of the preset effect in the identified media content having the preset effect includes determining the quantity based on a number of fit clips in the identified media content having the preset effect.
[0155] Optionally, the quantity includes a first quantity and a second quantity, the first quantity being a quantity or predetermined quantity determined based on the number of sound-fitted clips in the identified media content having the preset effect, and the second quantity being the number of sound-fitted clips in the identified media content having the preset effect, and the first quantity being less than the second quantity.
[0156] Optionally, the apparatus comprises: a first response unit for displaying a selection completion control in the resource selection interface in response to the completion of the selection; a second response unit for displaying an editing interface in response to the selection completion control being triggered; Here, the termination condition includes that the quantity of the selected resource is a second quantity, or, if the value of the second quantity is greater than a first predetermined threshold, that the quantity of the selected resource is equal to or greater than a first quantity.
[0157] Optionally, the target media content is: including one or more of a first type of content and a second type of content; Here, the first type of content includes the content with the identified preset effect, and the second type of content includes the content to be posted after making the corresponding target template changes.
[0158] The information posting device according to the embodiments of the present disclosure can execute the information posting method according to any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution of the method.
[0159] FIG. 11 is a structural schematic diagram of a media content identification device with preset effects according to an embodiment of the present disclosure. As shown in FIG. 11 , the device includes: an acquisition module 610, an identification module 620, and a determination module 630; wherein the acquisition module 610 is used to acquire audio and image information of the media content to be identified; The identification module 620 is used to identify the audio information and the image information and obtain an identification result; The determination module 630 is used to determine whether the identified media content has a preset effect based on the identification result, so that the identified media content presents a preset template effect control in the presentation interface.
[0160] In this embodiment, an acquisition module first acquires audio information and image information of the media content to be identified, an identification module identifies the audio information and image information and obtains an identification result, and a determination module determines whether the media content to be identified has a preset effect based on the identification result, so that the media content to be identified presents a preset template effect control in the presentation interface. The device obtains the identification result by performing an identification process on the audio information and image information of the media content to be identified, and determines whether the media content to be identified has a preset effect based on the identification result, thereby improving the automation and efficiency of identifying the media content to be identified.
[0161] Optionally, the preset effect includes one or more of text information, sound-insertion information, transition information, and visual cut information.
[0162] Optionally, the identification result includes audio cut information of the audio information and visual cut information of the media content to be identified.
[0163] Optionally, the identification module 620: a first identification unit for identifying the audio information and obtaining audio tone information of the audio information; and a second identification unit for identifying the image information and obtaining visual cut information of the media content to be identified.
[0164] Optionally, the second identification unit comprises: an input subunit for inputting image information into a cut identification model and obtaining cut probabilities of the image information; a selection subunit for comparing the cut probability of each image information with a predetermined probability value and selecting a cut probability from each cut probability based on the comparison result; and an information determining subunit for determining visual cut information for the media content to be identified based on image information corresponding to the selected cut probability.
[0165] Optionally, the apparatus comprises: a section determination module for determining a transition section based on the visual cut information and a second predetermined threshold value after determining that the media content to be identified has a preset effect; a classification determination module for inputting the moving image in the transition section into a classification identification model to obtain a transition classification corresponding to the transition section; Here, the transition information includes a transition section and a transition category.
[0166] Optionally, the interval determination module: a change rate determination unit for determining a change rate of the cut probability of the visual cut information; a position selection unit for selecting candidate transition positions from the visual cut information based on the rate of change and a second predetermined threshold; and a section determination unit for determining a transition section based on the candidate transition positions.
[0167] Optionally, the determination module 630: a probability determination unit for determining a probability of the media content to be identified having a preset effect based on the visual cut information and the audio cut information; and an effect identification unit for determining whether the media content to be identified has a preset effect based on the sound-in probability.
[0168] Optionally, the probability determination unit is a first quantity determination subunit for determining a quantity of visual sound frames based on the visual cut information; a second quantity determining subunit for determining a quantity of audio sounds based on the audio sound information; a third number determining subunit for determining an overlap quantity based on the visual cut information and the audio sound-insertion information, the third number determining subunit being a quantity of portions where the distance between the position indicated by the visual cut information and the position indicated by the audio sound-insertion information is shorter than a first preset value; and a probability determination subunit for determining a probability of the media content to be identified having the preset effect based on the visual sound-in-place quantity, the audio sound-in-place quantity, and the overlap quantity.
[0169] Optionally, the probability determination subunit specifically: determining a sound-matching ratio, which is the ratio of the overlap quantity to the visual sound-match quantity; From each audio sound fitting position, an audio sound fitting position having a predetermined audio width is selected, determining a ratio of positions indicated by the selected audio sound-fit information and having a distance from the position indicated by the visual sound-fit information that is shorter than a second preset value as a sound-fit hit rate of the predetermined width; Among the audio widths corresponding to each audio sound fit information, a sound fit hit rate corresponding to each audio width is determined, and an average value of the sound fit hit rates corresponding to each audio width is determined as an average sound fit hit rate; It is used to determine the probability of fitting a sound based on the sound fitting matching rate, the sound fitting hit rate for a predetermined range, and the average sound fitting hit rate.
[0170] The device for identifying media content with preset effects according to an embodiment of the present disclosure can execute the method for identifying media content with preset effects according to any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution of the method.
[0171] It should be noted that each unit and module included in the above device is simply divided according to functional logic, but is not limited to the above divisions as long as it can realize the corresponding function. Furthermore, the specific names of each functional unit are merely intended to facilitate distinction from each other, and are not intended to limit the scope of protection of the embodiments of the present disclosure.
[0172] FIG. 12 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. Referring now to FIG. 12, it shows a structural schematic diagram of an electronic device 700 suitable for implementing an embodiment of the present disclosure. The electronic device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG. 12 is merely an example and does not impose any limitations on the functionality and scope of use of the embodiment of the present disclosure.
[0173] 12, electronic device 700 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 701, which can perform various appropriate operations and processes based on programs stored in read-only memory (ROM) 702 or programs loaded from storage device 708 into random access memory (RAM) 703. RAM 703 further stores various programs and data necessary for the operation of electronic device 700. Processing unit 701, ROM 702, and RAM 703 are connected to each other via bus 704. Edit / output (I / O) interface 705 is also connected to bus 704.
[0174] In general, devices such as input devices 706 including, for example, a touch screen, touch panel, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 707 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 708 including, for example, a magnetic tape, hard disk, etc.; and communication devices 709 may be connected to the I / O interface 705. The communication devices 709 may enable the electronic device 700 to exchange data with other devices through wireless or wired communication. While FIG. 12 illustrates the electronic device 700 having various devices, it should be understood that it is not required to implement or include all of the devices shown. More or fewer devices may alternatively be implemented or included.
[0175] In particular, according to embodiments of the present disclosure, the processes described with reference to the flowcharts above may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, the computer program including program code for performing the methods illustrated in the flowcharts. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 709, or may be installed from the storage device 708, or may be installed from the ROM 702. When executed by the processing device 701, the computer program performs the functions defined in the methods of the embodiments of the present disclosure.
[0176] The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.
[0177] The electronic device according to the embodiments of the present disclosure belongs to the same inventive concept as the information posting method or the media content identification method with preset effects according to the above embodiments, and the technical details not described in this embodiment can be referred to the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.
[0178] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon, which, when executed by a processor, realizes the information posting method or the method for identifying media content with preset effects according to the above embodiment.
[0179] It should be noted that the computer-readable medium of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a propagated data signal, either in baseband or as part of a carrier wave, bearing computer-readable program code. Such propagated data signals may take various forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which is capable of transmitting, propagating, or transmitting a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including, but not limited to, electrical wire, optical cable, RF (radio frequency), or the like, or any suitable combination of the above.
[0180] In some embodiments, clients and servers may communicate using any conventional, known, or future-developed network protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect via any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., an internetwork), and an end-to-end network (e.g., an ad hoc end-to-end network), and any conventional, known, or future-developed network.
[0181] The computer-readable medium may be included in the electronic device, or may exist independently and not be integrated into the electronic device.
[0182] Optionally, the computer-readable medium may carry one or more programs that, when executed by the electronic device, cause the electronic device to: present target media content in a presentation interface; present a preset template effect control in the presentation interface in response to determining that the target media content is media content having an identified preset effect, where the preset effect is obtained by identifying the target media content based on audio information and / or image information of the target media content; display a media content generation interface including a target template determined based on the preset effect in response to triggering the preset template effect control in the presentation interface; and generate media content based on the target template in response to a media content generation operation in the media content generation interface.
[0183] Optionally, the computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to obtain audio information and image information of media content to be identified, identify the audio information and the image information, and obtain an identification result; and, based on the identification result, determine whether the media content to be identified has a preset effect, so that the media content to be identified presents a preset template effect control in a presentation interface.
[0184] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages such as Java, Smalltalk, and C++, as well as general procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. When a remote computer is involved, the remote computer may be connected to the user's computer by any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., connected by the Internet using an Internet Service Provider).
[0185] The flowcharts and block diagrams in the figures illustrate possible system architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions shown in the blocks may occur in a different order than that shown in the figures. For example, two successively shown blocks may actually be executed substantially in parallel, or they may be executed in the reverse order, depending on the functionality involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified function or operation, or by a combination of dedicated hardware and computer instructions.
[0186] The modules or units described in the embodiments of the present disclosure may be implemented in software or hardware. Here, the names of the modules or units do not necessarily limit the units themselves. For example, the first response unit may be further described as "a unit that displays a selection completion control in a resource selection interface in response to a completion condition being satisfied."
[0187] As used herein, the functions described above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.
[0188] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include an electrical connection by one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0189] According to one or more embodiments of the present disclosure, Example 1 provides an information posting method, the method comprising: presenting the target media content in a presentation interface; presenting a preset template effect control in the presentation interface in response to determining that the target media content is media content having an identified preset effect, the preset effect being identified based on audio information and / or image information of the target media content; displaying a media content generation interface including a target template determined based on the preset effect in response to the preset template effect control in the presentation interface being triggered; and generating media content based on the target template in response to a media content generation operation on the media content generation interface.
[0190] According to one or more embodiments of the present disclosure, in Example 2, the method according to Example 1, wherein the media content generation interface includes a resource selection interface, and wherein displaying the media content generation interface includes: Displaying instruction information in the resource selection interface, the instruction information indicating the quantity of resources and / or the presentation time length of the resources that need to be selected by the target template, the quantity being determined based on preset attributes of the preset effects in the identified media content having the preset effects.
[0191] According to one or more embodiments of the present disclosure, in Example 3, according to the method described in Example 2, the preset effect includes one or more of text information, sound-in information, transition information, and visual cut information.
[0192] According to one or more embodiments of the present disclosure, in Example 4, the method according to Example 2 includes the preset effect including sound-in information, and determining the quantity based on preset attributes of the identified preset effect in the media content having the preset effect includes determining the quantity based on a number of sound-in clips in the identified media content having the preset effect.
[0193] According to one or more embodiments of the present disclosure, in Example 5, the method described in Example 3 includes the quantity including a first quantity and a second quantity, the first quantity being a quantity or predetermined quantity determined based on the number of audio-in-place clips in the identified target media content having a preset effect, the second quantity being the number of audio-in-place clips in the identified target media content having a preset effect, and the first quantity being less than the second quantity.
[0194] According to one or more embodiments of the present disclosure, in Example 6, the method described in Example 3 includes: displaying a selection completion control in the resource selection interface in response to a termination condition being satisfied; and displaying an editing interface in response to the selection completion control being triggered; Here, the termination condition includes that the quantity of the selected resource is a second quantity, or, if the value of the second quantity is greater than a first predetermined threshold, that the quantity of the selected resource is equal to or greater than a first quantity.
[0195] According to one or more embodiments of the present disclosure, in Example 7, the method of Example 1 further comprises: including one or more of a first type of content and a second type of content; Here, the first type of content includes the identified content with the preset effect, and the second type of content includes the content to be posted after making the corresponding target template changes.
[0196] According to one or more embodiments of the present disclosure, Example 8 provides a method for identifying media content having a preset effect, the method comprising: obtaining audio and image information for media content to be identified; distinguishing between the audio information and the image information and obtaining a distinguishing result; Based on the identification result, determining whether the identified media content has a preset effect, and causing the identified media content to present a preset template effect control in a presentation interface.
[0197] According to one or more embodiments of the present disclosure, in Example 9, according to the method described in Example 8, the preset effect includes one or more of text information, sound-in information, transition information, and visual cut information.
[0198] According to one or more embodiments of the present disclosure, in Example 10, according to the method described in Example 8, the identification result includes audio cut information of the audio information and visual cut information of the media content to be identified.
[0199] According to one or more embodiments of the present disclosure, in Example 11, the method according to Example 8, wherein the step of identifying the audio information and the image information and obtaining the identification result includes: identifying the audio information and obtaining audio timbre information for the audio information; and identifying the image information to obtain visual cut information for the identified media content.
[0200] According to one or more embodiments of the present disclosure, in Example 12, the method according to Example 11, wherein identifying the image information and obtaining visual cut information of the identified media content includes: inputting the image information into a cut identification model to obtain a cut probability for the image information; comparing the cut probability of each image information with a predetermined probability value, and selecting a cut probability from the cut probabilities based on the comparison result; and determining visual cut information for the identified media content based on image information corresponding to the selected cut probabilities.
[0201] According to one or more embodiments of the present disclosure, in Example 13, the method described in Example 8 includes: determining a transition section based on the visual cut information and a second predetermined threshold value after determining that the media content to be identified has a preset effect; inputting the moving image in the transition section into a type identification model to obtain a transition category corresponding to the transition section; Here, the transition information includes the transition section and the transition category.
[0202] According to one or more embodiments of the present disclosure, in Example 14, the method according to Example 3, wherein determining a transition section based on the visual cut information and a second predetermined threshold, as described above, includes: determining a rate of change of a cut probability of the visual cut information; selecting candidate transition locations from the visual cut information based on the rate of change and the second predetermined threshold; determining the transition section based on the candidate transition locations.
[0203] According to one or more embodiments of the present disclosure, in Example 15, the method of Example 10 may further include determining whether the media content to be identified has a preset effect based on the identification result, the method including: determining a probability that the identified media content has a preset effect based on the visual cut information and the audio cut information; and determining whether the media content to be identified has a preset effect based on the sound-in probability.
[0204] According to one or more embodiments of the present disclosure, in Example 16, the method of Example 15, further comprising: determining the probability of the identified media content having a preset effect based on the visual cut information and the audio cut information, determining a quantity of visual sound effects based on the visual cut information; determining a quantity of audio sound fits based on the audio sound fit information; determining an overlap quantity based on the visual cut information and the audio sound fitting information, wherein the overlap quantity is a quantity of a portion where a distance between a position indicated by the visual cut information and a position indicated by the audio sound fitting information is shorter than a first preset value; determining the fit probability that the identified media content has a preset effect based on the visual fit quantity, the audio fit quantity, and the overlap quantity;
[0205] According to one or more embodiments of the present disclosure, in Example 17, the method of Example 16 further includes determining the probability of the identified media content having a preset effect based on the visual sound-in-place quantity, the audio sound-in-place quantity, and the overlap quantity, as described above, by: determining a sound-matching ratio, which is a ratio of the overlap quantity to the visual sound-match quantity; selecting an audio sound fitting position having a predetermined audio width from each of the audio sound fitting positions; determining a ratio of positions indicated by the selected audio sound-fit information, the distance of which from the position indicated by the visual sound-fit information is shorter than a second preset value, as a sound-fit hit rate of the predetermined width; determining a sound fit hit rate corresponding to each audio width among the audio widths corresponding to each of the audio sound fit information, and determining an average value of the sound fit hit rates corresponding to each of the audio widths as an average sound fit hit rate; The sound fit probability is determined based on the sound fit matching rate, the sound fit hit rate for the predetermined width, and the average sound fit hit rate.
[0206] According to one or more embodiments of the present disclosure, Example 18 provides an electronic device, the electronic device comprising: one or more processing devices; a storage device for storing one or more programs; The one or more programs, when executed by the one or more processing devices, cause the one or more processing devices to implement the method of any one of Examples 1 to 17.
[0207] According to one or more embodiments of the present disclosure, Example 19 provides a storage medium including computer-executable instructions, which, when executed by a computer processing device, are used to perform the method described in any one of Examples 1 to 17.
[0208] The above description merely describes preferred embodiments and the technical principles of the present disclosure. As can be understood by those skilled in the art, the scope of the present disclosure is not limited to the technical solution of the specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the concept of the above disclosure. For example, it includes technical solutions formed by replacing the above features with technical features having similar functions (including but not limited to those disclosed in the present disclosure) with each other.
[0209] Although operations are described using a particular order, this should not be understood as requiring that these operations be performed in the particular order shown, or in any other order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes several specific implementation details, these should not be construed as limiting the scope of the present disclosure. Some features that are described in the context of a single embodiment may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments, either alone or in any suitable subcombination.
[0210] Although the present subject matter has been described in language specific to structural features and / or methodological logical operations, it should be understood that the subject matter defined by the appended claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms of implementing the claims.
Claims
1. An information posting method, comprising: presenting the target media content in a presentation interface; presenting a preset template effect control in the presentation interface in response to determining that the target media content is media content having an identified preset effect, the preset effect being identified based on at least one of audio information and image information of the target media content; displaying a media content generation interface including a target template determined based on the preset effect in response to the preset template effect control in the presentation interface being triggered; generating media content based on the target template in response to a media content generation operation on the media content generation interface.
2. The media content generation interface includes a resource selection interface, and displaying the media content generation interface comprises:
2. The method of claim 1, further comprising displaying instruction information in the resource selection interface, the instruction information indicating at least one of a quantity of resources and a presentation time length of the resources that need to be selected by the target template, the quantity being determined based on preset attributes of preset effects in the identified media content having the preset effects.
3. The method of claim 2 , wherein the preset effects include one or more of text information, sound-insertion information, transition information, and visual cut information.
4. 3. The method of claim 2, wherein the preset effect includes sound-fit information, and wherein determining the quantity based on preset attributes of the preset effect in the identified media content having the preset effect includes determining the quantity based on a number of clips in the identified media content having the preset effect that have sound fit.
5. 4. The method of claim 3, wherein the quantities include a first quantity and a second quantity, the first quantity being a quantity or a predetermined quantity determined based on the number of clips in the identified target media content having the preset effect that have been sound-fitted, and the second quantity being the number of clips in the identified target media content having the preset effect that have been sound-fitted, and the first quantity being less than the second quantity.
6. displaying a selection completion control in the resource selection interface in response to a termination condition being satisfied; and displaying an editing interface in response to the selection completion control being triggered; 4. The method of claim 3, wherein the termination condition includes a quantity of the selected resource being a second quantity, or a quantity of the selected resource being equal to or greater than a first quantity when the value of the second quantity is greater than a first predetermined threshold.
7. The target media content includes: including one or more of a first type of content and a second type of content; 2. The method of claim 1, wherein the first type of content includes content having an identified preset effect, and the second type of content includes content posted after making a corresponding target template change.
8. 1. A method for identifying media content having preset effects, comprising: obtaining audio and image information for media content to be identified; distinguishing between the audio information and the image information and obtaining a distinguishing result; and determining whether the identified media content has a preset effect based on the identification result, thereby causing the identified media content to present a preset template effect control in a presentation interface.
9. The method of claim 8 , wherein the preset effects include one or more of text information, sound-in information, transition information, and visual cut information.
10. The method of claim 8 , wherein the identification result includes audio cut information of the audio information and visual cut information of the media content to be identified.
11. distinguishing between the audio information and the image information and obtaining the distinguishing result, identifying the audio information and obtaining audio timbre information for the audio information; 9. The method of claim 8, further comprising identifying the image information and obtaining visual cut information for the identified media content.
12. Identifying the image information and obtaining visual cut information of the media content to be identified includes: inputting the image information into a cut identification model to obtain a cut probability for the image information; comparing the cut probability of each image information with a predetermined probability value, and selecting a cut probability from the cut probabilities based on the comparison result; and determining visual cut information for the identified media content based on image information corresponding to the selected cut probability.
13. determining a transition section based on visual cut information and a second predetermined threshold after determining that the media content to be identified has a preset effect; inputting the moving image in the transition section into a type identification model to obtain a transition category corresponding to the transition section; The method of claim 8 , wherein the transition information includes the transition section and the transition category.
14. determining the transition section based on the visual cut information and the second predetermined threshold; determining a rate of change of a cut probability of the visual cut information; selecting candidate transition locations from the visual cut information based on the rate of change and the second predetermined threshold; and determining the transition section based on the candidate transition locations.
15. determining whether the media content to be identified has a preset effect based on the identification result; determining a probability that the identified media content has a preset effect based on the visual cut information and the audio cut information; 11. The method of claim 10, further comprising determining whether the identified media content has a preset effect based on the sound-in probability.
16. determining the probability that the media content to be identified has a preset effect based on the visual cut information and the audio cut information; determining a quantity of visual sound effects based on the visual cut information; determining a quantity of audio sound fits based on the audio sound fit information; determining an overlap quantity based on the visual cut information and the audio sound fitting information, wherein the overlap quantity is a quantity of a portion where a distance between a position indicated by the visual cut information and a position indicated by the audio sound fitting information is shorter than a first preset value; 16. The method of claim 15, further comprising determining the probability of the identified media content having a preset effect based on the number of visual sound hits, the number of audio sound hits, and the overlap number.
17. determining the probability of the identified media content having a preset effect based on the visual sound fit quantity, the audio sound fit quantity, and the overlap quantity; determining a sound-matching ratio, which is a ratio of the overlap quantity to the visual sound-match quantity; selecting an audio sound fit position from each of the audio sound fit positions, the audio sound fit position having a predetermined audio width; determining a ratio of positions indicated by the selected audio sound-fit information, the distance of which from the position indicated by the visual sound-fit information is shorter than a second preset value, as a sound-fit hit rate of the predetermined width; determining a sound fit hit rate corresponding to each audio width among the audio widths corresponding to each of the audio sound fit information, and determining an average value of the sound fit hit rates corresponding to each of the audio widths as an average sound fit hit rate; The method of claim 16, comprising determining the sound-fit probability based on the sound-fit matching rate, the sound-fit hit rate for the predetermined width, and the average sound-fit hit rate.
18. An electronic device, one or more processing devices; a storage device for storing one or more programs; 18. An electronic device, wherein said one or more programs, when executed by said one or more processing devices, cause said one or more processing devices to implement the method of any one of claims 1 to 17.
19. 18. A storage medium containing computer-executable instructions, the computer-executable instructions, when executed by a computer processor, used to perform the method of any one of claims 1 to 17.
20. An information posting device, a presentation module for presenting the target media content in a presentation interface; a first response module for presenting a preset template effect control in the presentation interface in response to determining that the target media content is media content having an identified preset effect, the preset effect being identified based on at least one of audio information and image information of the target media content; a third response module for displaying a media content generation interface including a target template determined based on the preset effect in response to the preset template effect control being triggered in the presentation interface; a fourth response module for generating media content based on the target template in response to a media content generation operation on the media content generation interface.
21. 1. An apparatus for identifying media content with preset effects, comprising: an acquisition module for acquiring audio and image information of the media content to be identified; an identification module for identifying the audio information and the image information and obtaining an identification result; and a determination module for determining whether the identified media content has a preset effect based on the identification result, so that the identified media content presents a preset template effect control in a presentation interface.
Citation Information
Patent Citations
Video generation method and device and electronic equipment
CN111526427A
Leap point template generation method and device, equipment and storage medium
CN113613061A
Video bullet screen matching method and device, computer equipment and storage medium
CN114339362A
Media content display method and device, electronic equipment and storage medium
CN115114463A
Segmentation contour synchronization with beat
US20220406337A1