Video processing method, device, electronic device and storage medium

Abstract

[0013] The embodiments of the present disclosure provide a video processing method, apparatus, electronic device, and storage medium, which include: in response to a special effect trigger operation, determining special effect selection information; determining at least one special effect type to be applied corresponding to the special effect selection information; determining a target special effect type from the at least one special effect type to be applied; and converting the target text and / or the image to be processed into a target special effect image corresponding to the target special effect type. A technical solution of the embodiments of the present disclosure determines a corresponding style special effect type based on the image, the text, or a combination of the two, and further realizes the effect of converting the text and the image into the target special effect image based on the style special effect type, thereby improving the accuracy of determining the style special effect type and further improving the image quality and special effect display effect of the target special effect image.

Description

[Technical Field]

[0001] This application claims priority to a Chinese patent application bearing application number 202211401216.X, filed with the China Patent Office on November 9, 2022, and the entire contents of the above Chinese patent application are incorporated herein by reference.

[0002] SUMMARY OF THE DISCLOSURE Embodiments of the present disclosure relate to video processing methods, devices, electronic devices, and storage media. [Background technology]

[0003] With the development of network technology, more and more application programs have entered into users' lives, and in particular, a series of software for taking short videos is very popular among users.

[0004] Although software developers can add various special effect tools to applications for users to use in the process of shooting videos, the special effect tools currently provided to users are very limited, and the quality of videos and the richness of their content need to be further improved. In particular, when performing stylized special effect processing on images or editing processing on images, the display effect of special effect images generated according to the related special effect tools is poor. Summary of the Invention [Problem to be solved by the invention]

[0005] The present disclosure provides a video processing method, device, electronic device and storage medium for determining a corresponding style special effect type based on an image, text and a combination of the two, and further realizing the effect of converting the text and image into a target special effect image based on the style special effect type, thereby improving the accuracy of determining the style special effect type and further improving the image quality and special effect display effect of the target special effect image. [Means for solving the problem]

[0006] In aspect 1, an embodiment of the present disclosure comprises: determining special effect selection information including at least one of the target text, the image input feature, and the image to be processed in response to the special effect trigger operation; determining at least one special effect type to be applied corresponding to the special effect selection information; determining a target special effect type from the at least one waiting special effect type; converting the target text and / or image to be processed into a target special effect image corresponding to the target special effect type. A video processing method is provided.

[0007] In aspect 2, an embodiment of the present disclosure comprises: a special effect trigger operation response module for determining special effect selection information including at least one of target text, image input features, and a to-be-processed image in response to the special effect trigger operation; an application waiting special effect type determining module for determining at least one application waiting special effect type corresponding to the special effect selection information; a target special effect type determining module for determining a target special effect type from the at least one waiting-to-be-applied special effect type; a target special effect image determination module for converting the target text and / or the to-be-processed image into a target special effect image corresponding to the target special effect type; A video processing device is also provided.

[0008] In aspect 3, an embodiment of the present disclosure comprises: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the video processing method described in any one of the embodiments of the present disclosure. An electronic device is also provided.

[0009] In aspect 4, an embodiment of the present disclosure comprises: comprising computer-executable instructions for, when executed by a computer processor, performing the video processing method according to any one of the embodiments of the present disclosure; A storage medium is also provided. [Brief explanation of the drawings]

[0010] The above and other features, advantages, and aspects of each embodiment of the present disclosure will become more apparent with reference to the drawings and the following specific embodiments. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the objects and elements are not necessarily made to scale.

[0011] [Figure 1] 1 is a flowchart of a video processing method according to an embodiment of the present disclosure. [Figure 2] 1 is a flowchart of a video processing method according to an embodiment of the present disclosure. [Figure 3] 1 is a flowchart of a video processing method according to an embodiment of the present disclosure. [Figure 4] 1 is a flowchart of a video processing method according to an embodiment of the present disclosure. [Figure 5] FIG. 1 is a structural schematic diagram of a video processing device according to an embodiment of the present disclosure. [Figure 6] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the drawings. Although the drawings show several embodiments of the present disclosure, it should be understood that the present disclosure can be realized in various forms and should not be construed as being limited to the embodiments described herein, but rather, these embodiments are provided to provide a clearer and more complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are merely illustrative and are not intended to limit the scope of protection of the present disclosure.

[0013] It should be understood that the steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. Also, method embodiments may include additional steps and / or steps shown omitted from the execution. The scope of the present disclosure is not limited in this respect.

[0014] As used herein, the term "comprises" and variations thereof are open inclusive, i.e., "including, but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment." The term "another embodiment" means "at least one other embodiment." The term "some embodiments" means "at least some embodiments." Relevant definitions of other terms are provided below.

[0015] It should be noted that the concepts of "first," "second," etc. referred to in this disclosure are merely intended to distinguish between devices, modules, or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules, or units.

[0016] It should be understood that the modifications "one" and "multiple" referred to in this disclosure are exemplary but not limiting, and that those skilled in the art should understand them as "one or more" unless the context clearly indicates otherwise.

[0017] The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0018] It is understood that before using any of the technical solutions disclosed in each embodiment of the present disclosure, the type, scope of use, usage scenario, etc. of the personal information related to the present disclosure should be informed to the user in an appropriate manner in accordance with relevant laws and regulations, and the user's permission should be obtained.

[0019] For example, in response to receiving an active request from a user, presentation information is sent to the user to clearly indicate to the user that the requested operation requires the acquisition and use of the user's personal information, so that the user can autonomously choose, based on the presentation information, whether to provide the personal information to software or hardware, such as an electronic device, application program, server, or storage medium, that executes the operation of the technical solution disclosed herein.

[0020] In one preferred but non-limiting embodiment, the method of transmitting the presented information to the user in response to receiving an active request from the user may be, for example, a pop-up method, in which the presented information can be displayed in text format, and the pop-up may include a selection control for the user to select "agree" or "disagree" to providing personal information to the electronic device.

[0021] It is understood that the above process of notifying the user and obtaining permission is merely exemplary and does not limit the implementation of the present disclosure, and other methods that comply with relevant laws and regulations can also be applied to the implementation of the present disclosure.

[0022] It is understood that the data related to this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of corresponding laws, regulations and related provisions.

[0023] Before introducing the technical solution, an exemplary application scenario will be described first. The technical solution of the embodiments of the present disclosure can be applied to any scenario that requires generating a special effect video. For example, when a user uploads pre-collected images to a server corresponding to application software, or when images are collected in real time using a mobile terminal including an imaging device and target text entered by the user is obtained based on the display interface of the terminal device, the technical solution of the embodiments of the present disclosure can have three implementation modes when determining a target special effect image. The first implementation mode is when only the target text is obtained, determining at least one ready-to-be-applied special effect type based on keywords in the target text, and determining a target special effect type from the at least one ready-to-be-applied special effect type based on user needs or system selection. Furthermore, the target text can be converted into a related related image, and then fusing the related image with the target image corresponding to the target special effect type to obtain the target special effect image. A second implementation form may be that when only a to-be-processed image is obtained, at least one to-be-applied special effect type can be determined based on the image content in the to-be-processed image, and a target special effect type can be determined from the at least one to-be-applied special effect type based on user needs or system selection, and then the to-be-processed image and a target image corresponding to the target special effect type can be fused to obtain a target special effect image.In a third embodiment, when a target text and an image to be processed are simultaneously acquired, the two are combined to determine at least one type of special effect to be applied, and a target special effect type can be determined from the at least one type of special effect to be applied based on user needs or system selection. Furthermore, after fusing the related image, the image to be processed, and the target image corresponding to the target special effect type, a target special effect image can be obtained, thereby determining a corresponding style special effect type based on the image, text, and the combination of the two, and further realizing the effect of converting the text and image into the target special effect image based on the style special effect type, thereby improving the accuracy of determining the style special effect type and further improving the image quality and special effect display effect of the target special effect image.

[0024] 1 is a flowchart of a video processing method according to an embodiment of the present disclosure, which is applied to determining a target special effect type based on a target text and / or a target image to be processed, and then converting the target text and / or the target image to a target special effect image corresponding to the target special effect type. The method can be implemented by a video processing device, which can be implemented in the form of software and / or hardware, and preferably implemented by an electronic device, which can be a mobile terminal, a PC, a server, etc. The technical solutions according to the embodiment of the present disclosure can be implemented based on a client, a server, or a combination of a client and a server.

[0025] As shown in FIG. 1, the method includes the following steps:

[0026] In S110, in response to a special effect trigger operation, special effect selection information is confirmed.

[0027] Here, the device for executing the method for generating special effect videos according to the embodiments of the present disclosure can be integrated into application software supporting special effect video processing functions, and the software can be installed in an electronic device, preferably a mobile terminal or a PC, etc. The application software can be software for processing images / videos, and the specific application software is not described here; it is sufficient to realize image / video processing. It can also be a professionally developed application program for adding and displaying special effects, or it can be integrated into a corresponding page, and users can process special effect videos through the page integrated on the PC side.

[0028] In this embodiment, a control for triggering a special effect can be pre-developed in the application software or application program supporting the special effect video processing function, and when it is detected that the user has triggered the control, the special effect selection information can be determined in response to the special effect trigger operation.

[0029] Here, the special effect selection information includes at least one of the target text, the image input feature, and the image to be processed.

[0030] Here, the target text may be text that meets user needs. The image input features may be features determined after feature analysis of collected images. The to-be-processed images may be images that need to be processed. The images may be images collected based on terminal devices or images pre-stored in a storage space by application software. The terminal devices may refer to electronic products with image capture functions, such as cameras, smartphones, and tablet computers.

[0031] Preferably, determining the special effect selection information includes determining image input characteristics, where the image input characteristics are determined based on whether the called camera is a front camera or a rear camera.

[0032] Generally, when a user triggers an image capture control, the terminal device may call the front camera or the rear camera to capture an image based on preset capture parameters or capture parameters set when the application software was last closed. Note that the image input features corresponding to the image captured by the front camera are different from the image input features corresponding to the image captured by the rear camera. For example, the image captured by the front camera is mostly a face image of the user, and the corresponding image input features may be features corresponding to the user's facial features, while the image captured by the rear camera is mostly a full-body or half-body image of the user, and the corresponding image input features may include physical features based on the facial feature features.

[0033] In actual application, when detecting that a user triggers a special effect operation, first determine whether the called camera is a front camera or a rear camera, and then determine the corresponding image input characteristics based on the image feature parameters corresponding to the camera. The advantages of this setting are that it enhances the intelligence of the special effect tool, improves the accuracy of determining the special effect type, and improves the user experience.

[0034] In practical applications, the special effect selection information is usually determined only when a certain special effect operation is triggered, so the special effect trigger operation may include at least one of the following: triggering a special effect tool; audio information triggering a special effect wake-up word; and current limb movement matching a preset limb movement.

[0035] In this embodiment, a control for triggering a special effect tool can be preset. When a user triggers the control, a special effect tool display page can pop up on the display interface, and multiple special effect tools can be displayed on the display page. The user can trigger a corresponding special effect tool. When it is detected that the user has triggered a special effect tool corresponding to the collection of images to be processed, it means that a special effect trigger operation has been triggered. In another implementation, audio information of the user can be collected in advance, and the collected audio information can be analyzed and processed to identify text corresponding to the audio information. If the text corresponding to the audio information includes a preset wake-up word, preferably a word such as "take a current image" or "start the special effect function," it means that an image to be processed in the display interface can be acquired. In another implementation, several limb movements can be preset as special effect trigger operations. When it is detected that the limb movements currently being performed by the user within the field of view match the preset limb movements, it can be determined that a special effect operation has been triggered. Preferably, the preset limb movements can be actions such as raising a hand, opening a mouth, turning a head, etc.

[0036] In actual application, the images to be processed can be obtained based on any selection on the image display page of the terminal device, and when it is detected that a confirmation control or selection control has been triggered, it is determined that a special effect operation has been triggered, and the image selected at the current time can be set as the image to be processed; alternatively, multiple images can be stored in advance in the early development stage, and when it is detected that a special effect operation has been triggered by the user, they can be directly introduced from the storage space to the current client; or when it is detected that a special effect operation has been triggered by the user, an image uploaded by the user to the current client via an external device in real time or periodically can be set as the image to be processed.

[0037] In actual application, the corresponding text can be input based on the edit box displayed on the display interface of the terminal device, and the text input in this edit box can be used as the target text. Alternatively, an audio collection control can be developed in advance, and when the user triggers the audio collection control, audio information from the user can be collected. The collected audio information can be analyzed and processed to identify the text corresponding to the audio information, and the identified text can be used as the target text.

[0038] It should be noted that, when a special effect trigger operation is detected but the input of target text is not detected, only images to be processed are acquired, and the conversion of the target special effect image can be realized subsequently based only on the images to be processed; correspondingly, when the collection of images to be processed is not detected, only the target text is acquired, and the target special effect image can be determined based on the target text; when the input of target text is detected and the collection of images to be processed is also detected, the target special effect image can be determined based on the target text and the images to be processed simultaneously, and the embodiments of the present disclosure are not specifically limited thereto.

[0039] In S120, at least one special effect type to be applied corresponding to the special effect selection information is determined.

[0040] In this embodiment, the ready-to-apply special effect type may be a special effect type for performing stylized special effect processing on an image, preferably including, but not limited to, a cyberpunk style, a Picasso style, a Van Gogh style, a sumi-e style, and a geometric style.

[0041] In practical application, after determining the special effect selection information, the type of special effect to be applied corresponding to the special effect selection information can be determined.

[0042] In the actual application process, the method for determining the type of special effect to be applied corresponding to the target text is different from the method for determining the type of special effect to be applied corresponding to the image to be processed, so when determining the corresponding type of special effect to be applied, it can be processed respectively according to the corresponding determination method.

[0043] Preferably, determining at least one special effect type corresponding to the target text may involve pre-setting at least one important field, establishing a mapping relationship between each important field and a corresponding special effect type to be applied, and after obtaining the target text, traversing each field included in the target text based on each important field to determine at least one target important field corresponding to the target text, and determining at least one special effect type to be applied corresponding to the target text based on the mapping relationship between each target important field and a corresponding special effect type to be applied.

[0044] Preferably, determining at least one type of special effect to be applied corresponding to the image to be processed may include analyzing image content of the image to be processed based on a preset algorithm, obtaining a text description corresponding to the image to be processed, determining image content corresponding to the image to be processed based on the text description, determining scenes included in the image to be processed based on the image content, and further determining at least one type of special effect to be applied corresponding to the image to be processed based on a pre-established mapping relationship between the scenes and the special effect types to be applied.

[0045] In addition, the at least one special effect type waiting to be applied corresponding to the target text and the at least one special effect type waiting to be applied corresponding to the image waiting to be processed may be different special effect types or may be the same special effect type.

[0046] In addition, the special effect type waiting to be applied corresponding to the target text may be one or more. If there is one special effect type waiting to be applied, special effect image processing can be performed based on this special effect type. If there are multiple special effect types waiting to be applied, a selection can be made from the multiple special effect types waiting to be applied, and special effect image processing can be performed based on the selected special effect type waiting to be applied.

[0047] In addition, after determining at least one special effect type to be applied, the method further includes displaying a special effect thumbnail and a corresponding text description corresponding to each special effect type to be applied on the display interface, so that the user can be informed of the type name of each special effect type to be applied and can intuitively view the special effect display effect corresponding to each special effect type to be applied.

[0048] In this embodiment, the special effect thumbnail may be an image for representing the special effect display effect of the corresponding special effect type to be applied. An image most similar to the style characteristics of each special effect type to be selected may be pre-selected as the special effect thumbnail for that special effect type and stored in a corresponding storage space. Thus, when at least one special effect type to be applied is determined from each special effect type to be selected, the special effect thumbnail corresponding to that special effect type to be applied can be retrieved and displayed on the display interface. Preferably, the text description may include the special effect name, the special effect type, and a special effect description.

[0049] In actual application, after determining at least one type of special effect to be applied, a special effect thumbnail corresponding to each type of special effect to be applied is called up, and a text description corresponding to each type of special effect to be applied is determined. Furthermore, each special effect thumbnail and the corresponding text description can be displayed on the display interface according to a preset arrangement rule.

[0050] The preset arrangement rule may be a predetermined special effect type arrangement rule. Preferably, the preset arrangement rule may include a randomly determined or predetermined default arrangement rule, or a default arrangement rule determined or predetermined based on user history data. For example, the preset arrangement rule may include a list type, a tile type, a ring type, etc.

[0051] In S130, a target special effect type is determined from at least one waiting special effect type.

[0052] In this embodiment, after determining at least one special effect type to be applied, a target special effect type can be obtained by selecting from each of the special effect types to be applied. Here, the target special effect type may be the special effect type to be finally applied. For example, the target special effect type may be a cyberpunk type, in which case the finally obtained special effect image can resemble a cyberpunk image style.

[0053] In actual application, there may be at least two methods for determining a target special effect type from at least one special effect type waiting to be applied, and one method may be to determine the target special effect type based on a trigger operation for at least one special effect type waiting to be applied.

[0054] In a specific implementation, after obtaining at least one type of special effect to be applied, each type of special effect to be applied can be displayed on a display interface so that the user can select from multiple types of special effect to be applied by a trigger operation. When the user's trigger operation on at least one special effect to be applied is detected and a confirmation command is issued based on a confirmation control, the currently selected at least one type of special effect to be applied can be set as a target special effect type.

[0055] In addition, when it is detected that a user has triggered any waiting special effect type, the special effect thumbnail corresponding to this waiting special effect type can be enlarged according to a preset ratio to distinguish this waiting special effect type from other waiting special effect types that have not been triggered.

[0056] The other method may be to select a target special effect type from the at least one special effect type waiting to be applied according to a preset method if a trigger operation for the at least one special effect type waiting to be applied is not detected within a preset time.

[0057] In this embodiment, the preset time may be a preset selection time. The preset time may be any value, preferably 5 seconds. The preset method may be a preset special effect type selection method. Here, the preset method includes a method of randomly determining or presetting a default special effect type and a method of determining or presetting a default special effect type based on the target user's history data. The preset default special effect type may be any special effect type, preferably a cyberpunk special effect type.

[0058] In a specific implementation, after obtaining at least one special effect type to be applied, each special effect type to be applied is provided to the user, and a special effect type selection countdown may be displayed on the display interface, the countdown time being a preset selection time, the user can understand that they can select from multiple special effect types to be applied by triggering an operation, and when the selection time reaches the preset time, i.e., when the special effect type selection countdown reaches zero, if no trigger operation for each special effect type to be applied is detected within this period, a target special effect type can be selected from the at least one special effect type to be applied according to a preset manner.

[0059] Furthermore, the advantages of determining the target special effect type based on the above two methods are that it enhances the interaction experience when the user uses the special effect tool, meets the user's personalized needs, and improves the intelligence of the special effect tool.

[0060] It should be noted that the target special effect type determined based on the preset scheme can be changed by customizing the default selection parameters in this special effect tool.

[0061] In order to improve the special effect processing effect of this special effect tool and to present a smooth transition in the special effect processing process, the method further includes playing a transition video after determining the target special effect type, and displaying a target special effect image based on the transition video.

[0062] In this embodiment, the transition video may be a pre-defined video for representing transitions and transformations between scenes. For example, the transition video may include fade-in / fade-out or frame-in / frame-out. In actual application, multiple transition video types may be pre-developed in the early development stage. A user may determine the transition video to be played in the special effect processing process by setting parameters for the transition video in the special effect tool. After determining the target special effect type, the corresponding transition video may be played and the target special effect image may be displayed based on the transition video.

[0063] In addition, the special effect processing process further includes displaying a creation progress bar for creating a target special effect image at a target display position corresponding to the transition video while the transition video is being played, in order to notify the user of the special effect processing process in a timely manner.

[0064] In this embodiment, the creation progress bar may be an image for indicating the percentage of progress in creating the target special effect image. The creation progress bar may have any shape, preferably a long, circular, knotted, or a shape that matches the target special effect type. The style of the creation progress bar can also be set by the setting parameters of the special effect tool according to user needs to meet user personalization needs.

[0065] In a specific implementation, during playback of the transition video, a creation progress bar can be displayed at a target display position corresponding to the transition video to indicate the progress of the target special effect image. The advantage of this setting is that it allows the user to have a certain sense of the progress of the target special effect image processing and the time it may require, avoiding the application program not responding and the user not being aware of it, improving the user's interactivity with the interface, and further improving the user experience.

[0066] At S140, the target text and / or the to-be-processed image is converted into a target special effect image corresponding to the target special effect type.

[0067] In this embodiment, after determining the target special effect type, the target text and / or the to-be-processed image can be converted into a target special effect image corresponding to the target special effect type, where the target special effect image is the special effect image displayed on the display interface after being processed by the special effect tool.

[0068] It can be understood that when a special effect operation is triggered to obtain target text, a target special effect image can be determined based on the target text and the target special effect type; when a special effect operation is triggered to obtain an image to be processed, a target special effect image can be determined based on the image to be processed and the target special effect type; when a special effect operation is triggered to obtain target text and an image to be processed, a target special effect image can be determined based on the target text, the image to be processed and the target special effect type.

[0069] Preferably, converting the target text and / or the ready-to-be-processed image into a target special effect image corresponding to the target special effect type includes determining a target image associated with the target special effect type, and fusing the associated image and / or the ready-to-be-processed image associated with the target text with the target image to obtain the target special effect image.

[0070] In this embodiment, the target image may be a pre-stored special effect image material. For example, if the target special effect type is a water-ink painting type, the associated target image is an image related to the water-ink painting type, i.e., an image drawn in the water-ink painting style. In the actual application process, after determining a plurality of waiting-to-be-applied special effect types, a corresponding type identifier is set for each waiting-to-be-applied special effect type, and at least one waiting-to-be-applied image corresponding to each waiting-to-be-applied special effect type is determined, establishing a relationship between the type identifier and the corresponding waiting-to-be-applied image. Furthermore, when the target special effect type is determined, each waiting-to-be-applied image is stored in the image material library so that the corresponding target image can be retrieved from the image material library based on the identifier corresponding to the target special effect type.

[0071] In this embodiment, the related images related to the target text may be images determined based on keywords included in the target text. For example, if the target text is "baby, a beautiful illustration concept art anime key visual trending pixiv fanbox by Makoto Shinkai and Studio Ghibli, visually stunning," the related images related thereto are images containing babies.

[0072] In this embodiment, a related image, a to-be-processed image, and a target image are fused together based on a preset image processing algorithm to obtain a target special effect display image. Here, the image processing algorithm may be a color lookup table (LUT). Those skilled in the art should understand that the principle of the LUT may be to use a color to find its mapped color. This can be understood as a function LUT (R1, G1, B1) with three independent variables R, G, and B, whose output is the corresponding mapped values ​​R2, G2, and B2, thereby achieving the effect of changing the exposure and color of the screen.

[0073] In a specific implementation, after determining the target special effect type, a target image related to the target special effect type can be called up based on the target special effect type; furthermore, if there is only target text, the related image related to the target text can be fused with the target image to convert the related image into a target special effect image similar in style to the target image; if there is only a pending image, the pending image can be fused with the target image to convert the pending image into a target special effect image similar in style to the target image; if there is both target text and a pending image, the related image related to the target text, the pending image, and the target image can be fused to obtain a target special effect image similar in style to the target image. The advantages of such settings are that the special effect display effect of the target special effect image can be improved, the user's personalized needs can be met, and the user's usage experience can be improved.

[0074] Furthermore, when generating a target special effect image, the special effect intensity can be adjusted in advance so that the finally generated target special effect image can better meet the user's needs. For example, when the special effect intensity is set to "0", the similarity between the target special effect image and the image to be processed and / or related image is highest and the style features of the target image are not expressed; when the special effect intensity is set to "0.5", the similarity between the target special effect image and the image to be processed and / or related image is medium and the style features of the target image are expressed; when the special effect intensity is set to "1", the similarity between the target special effect image and the image to be processed and / or related image is lowest and the style features of the target image are fully expressed.

[0075] In addition, in order to make the target special effect image closer to the special effect display effect corresponding to the target special effect type, before the target special effect image is generated, the special effect image can be pre-processed based on preset parameters, so that the target special effect image can be finally obtained.

[0076] Based on this, before obtaining the target special effect image, the method further includes determining filter parameters corresponding to the target special effect type, and determining the target special effect image based on the filter parameters.

[0077] In this embodiment, the filter parameters may be customization parameters corresponding to the target special effect type. Preferably, the filter parameters may include, but are not limited to, saturation, contrast, clarity, highlights, shading, and hue. It should be noted that, for each target special effect type, corresponding filter parameters may be preset. Thus, when the target special effect type is determined, the image to be processed can be directly edited based on the corresponding filter parameters to obtain the target special effect image. For example, if the target special effect type is a watercolor painting type, the corresponding filter parameters may set saturation to 0. If the target special effect type is a cyberpunk type, the corresponding filter parameters may enhance the contrast between red and blue and increase highlights.

[0078] In the technical solution of the embodiments of the present disclosure, in response to a special effect trigger operation, special effect selection information is determined, and then at least one special effect type to be applied corresponding to the special effect selection information is determined, and a target special effect type is determined from the at least one special effect type to be applied. Finally, the target text and / or the image to be processed is transformed into a target special effect image corresponding to the target special effect type, thereby determining a corresponding style special effect type based on the image, the text, and a combination of the two. Furthermore, the effect of transforming the text and the image into the target special effect image based on the style special effect type is realized, thereby improving the accuracy of determining the style special effect type, further improving the image quality and special effect display effect of the target special effect image, and enhancing the interactivity of the user using the special effect tool, and further improving the user's usage experience.

[0079] 2 is a flowchart of a video processing method according to an embodiment of the present disclosure. Based on the above embodiment, if only a target text is obtained in response to a special effect trigger operation, a target special effect type can be determined based on the target text, and the target text can be converted into a target special effect image corresponding to the target special effect type. For specific implementations, please refer to the technical solution of this embodiment. Here, technical terms that are the same as or corresponding to those in the above embodiment will not be described again.

[0080] As shown in FIG. 2, the method specifically includes the following steps:

[0081] In S210, target text is obtained in response to a special effect trigger operation.

[0082] In practical applications, when a user's trigger operation on a special effect control is detected, in addition to being able to obtain the image to be processed, the target text can also be obtained, so that the application software can process the image to be processed based on the information contained in the target text.

[0083] Preferably, determining the special effect selection information includes obtaining a target text, and obtaining the target text includes displaying a text editing box in the target area of ​​the display interface and editing the target text in the text editing box.

[0084] In this embodiment, the target area may be any area in the display interface. The text editing box may be a window for supporting text editing. The text editing box can be used to receive user input and edits on text. In addition, it can also realize functions such as deleting, moving the insertion point, and selecting text.

[0085] In practical applications, a text editing control can be pre-developed, and when a user's trigger operation on the text editing control is detected, a text editing box can be displayed in the target area of ​​the display interface, allowing the user to input or edit the target text in the text editing box; or when a user triggers a special effect operation is detected, a text editing box can be directly displayed in the target area of ​​the display interface, allowing the user to edit the target text in the editing box. The advantages of such a configuration are that it improves the interactivity between the user and the display interface, meets the user's personalization needs, and improves the user experience.

[0086] In S220, at least one special effect type to be applied corresponding to the target text is determined.

[0087] In this embodiment, after obtaining the target text, at least one waiting special effect type corresponding to the target text can be determined, where the waiting special effect type may be a special effect type that matches each field included in the target text.

[0088] Preferably, determining at least one type of special effect to be applied corresponding to the target text includes: subjecting the target text to word segmentation processing to determine at least one keyword corresponding to the target text; and determining at least one type of special effect to be applied from a plurality of types of special effect to be selected based on the at least one keyword.

[0089] In this embodiment, the target text can be processed for word segmentation based on a preset word segmentation algorithm, where the preset word segmentation algorithm may be any algorithm capable of realizing word segmentation, and preferably may be a natural language processing algorithm.

[0090] In this embodiment, the keyword may be a predetermined word that can be identified by application software. Preferably, at least one keyword corresponding to the target text includes at least one of an object type, a corresponding scene, a corresponding style type, and a corresponding environment. Here, the object type may be an object type included in the target text that requires special effect processing. Preferably, the object type may include people, pets, characters, food, flowers, plants, buildings, etc. Preferably, the corresponding scene may include, but is not limited to, indoors, night views, street views, sunsets, etc. The corresponding style type may be a stylized image type arbitrarily input by the user. Preferably, the corresponding style type may include, but is not limited to, an oil painting type, a watercolor painting type, a manga type, a line drawing type, etc. The corresponding environment may include, but is not limited to, mountains, lakes, oceans, skies, etc. Illustratively, if the target text is "A beautiful painting by Vincent van Gogh, Post Impressionism, oil on canvas, trending on art station, starry night", the corresponding keywords include the belonging style type of "Post Impressionism canvas oil painting style".

[0091] In this embodiment, multiple keywords can be preset, and special effect types corresponding to each keyword can be created. These special effect types can be set as special effect types waiting for selection. Furthermore, an association relationship can be established between each keyword and the corresponding special effect type waiting for selection, and each special effect type waiting for selection can be stored in the preset storage space.

[0092] In actual application, after obtaining the target text, the target text is subjected to word segmentation processing based on a preset word segmentation algorithm to obtain at least one field, and each field is traversed based on preset keywords to determine at least one keyword corresponding to the target text, and then at least one ready-to-be-applied special effect type corresponding to the target text is determined from the plurality of ready-to-be-applied special effect types based on the association relationship between the keyword and the ready-to-be-applied special effect types. The advantages of this configuration are that it improves the accuracy of selecting ready-to-be-applied special effect types, meets the user's personalized needs, and improves the intelligence of the special effect tool.

[0093] It should be noted that there may be one or more special effect types waiting to be applied. If there is one special effect type waiting to be applied, this special effect type is set as the target special effect type and processing can be performed based on this target special effect type. If there are multiple special effect types waiting to be applied, the user can select from these special effect types waiting to be applied according to their needs and determine the target special effect type.

[0094] Furthermore, if there are multiple types of special effects waiting to be applied, keywords can be added or deleted from the original by re-editing the target text, so that the obtained types of special effects waiting to be applied can better meet the user's needs.

[0095] In S230, a target special effect type is determined from at least one waiting special effect type.

[0096] At S240, the target text is converted into a target special effect image corresponding to the target special effect type.

[0097] In practical application, after obtaining the target special effect type, a target image corresponding to the target special effect type is determined, and a related image related to the target text is determined, and then the related image and the target image are fused to obtain the target special effect image corresponding to the target special effect type.

[0098] In the technical solution of the embodiments of the present disclosure, in response to a special effect trigger operation, a target text is obtained, and then at least one special effect type to be applied corresponding to the target text is determined, and a target special effect type is determined from the at least one special effect type to be applied. Finally, the target text is converted into a target special effect image corresponding to the target special effect type, thereby determining a corresponding stylized special effect type based on keywords in the text, and further realizing the effect of converting the text into the corresponding target special effect image, which meets the user's personalized needs, enhances the user's interactivity when using special effect tools, and improves the user experience.

[0099] 3 is a flowchart of a video processing method according to an embodiment of the present disclosure. Based on the above embodiment, if only a to-be-processed image is acquired in response to a special effect trigger operation, a target special effect type can be determined based on the to-be-processed image, and the to-be-processed image can be converted into a target special effect image corresponding to the target special effect type. For specific implementations, please refer to the technical solution of this embodiment. Here, technical terms that are the same as or corresponding to those in the above embodiment will not be described again.

[0100] As shown in FIG. 3, the method specifically includes the following steps:

[0101] In S310, in response to a special effect trigger operation, an image to be processed is acquired.

[0102] In this embodiment, acquiring the image to be processed may include at least two forms. One form may be to select and acquire the image to be processed based on a plurality of images pre-stored in the storage space. Preferably, an image upload control is displayed on the display interface, and when a trigger operation on the image upload control is detected, a target image library is accessed and the image to be processed is determined from the target image library.

[0103] In this embodiment, the image upload control may be a control for executing an image upload function that was previously set in the development stage. The image upload control may be set in any area of ​​the display interface, and the embodiment of the present disclosure is not specifically limited thereto. The target image library may be a storage space for storing image materials. Images included in the target image library may include system default images previously stored by the developer, or may include customized images added by the user later during the application process.

[0104] In a specific implementation, an image upload control can be preset and displayed on the display interface. When it is detected that the user has triggered a special effect operation, the image upload control can be displayed on the display interface. When it is detected that the user has triggered the image upload control, a target image library display page can be popped up on the display interface or a target image display page can be jumped from the display interface. A plurality of images waiting to be selected can be displayed on the display page. When it is detected that the user has triggered any of the images waiting to be selected, the image waiting to be selected can be made an image waiting to be processed.

[0105] Preferably, another implementation may be to determine a pending image from at least one collected video frame if no trigger operation on the image upload control is detected within a preset time.

[0106] In this embodiment, the preset time may be a preset selected time, and may be any value, preferably 3 seconds.

[0107] In practical application, when detecting that a user has triggered a special effect operation, the terminal device can start a shooting function to acquire images to be processed and display an image selection countdown on the display interface, where the countdown time is a preset selection time. It can be understood that when the terminal device starts the shooting function, an image upload control is displayed on the display interface. When the waiting time reaches the preset time, i.e., when the image selection countdown reaches zero, if the user has not triggered the image upload control, the terminal device can determine an image to be processed from at least one video frame collected. The advantages of this setting are that it enhances the flexibility and versatility of the method for acquiring images to be processed, improves the user's interaction with the display interface, and further enhances the user experience.

[0108] In addition, determining the image to be processed from the at least one collected video frame may include at least two forms, and one implementation form may be that when the countdown ends, the video frame collected by the terminal device at this time is set as the image to be processed. Preferably, determining the image to be processed from the at least one collected video frame includes setting the video frame collected at the end of the countdown as the image to be processed.

[0109] In actual application, if no trigger operation of the user on the image upload control is detected within the preset time, the countdown displayed on the display interface will be zero, and the video frame collected by the terminal device at the current time can be the image to be processed.

[0110] Another implementation may be to display at least one video frame collected within a preset time period and determine the images to be processed based on a trigger operation on the at least one video frame.

[0111] In practical application, if a user's trigger operation on the image upload control is not detected within a preset time, the terminal device can process the video captured within the preset time according to a preset program, obtain at least one video frame, and display it on the display interface. The user can select from multiple video frames by trigger operation, and if a trigger operation on one of the video frames is detected, the video frame currently selected by the user can be set as the image to be processed. The advantages of this setting are that it enhances the diversity of the way to determine the images to be processed, improves the interactivity between the user and the display interface, meets the user's personalized needs, and further improves the user experience.

[0112] At S320, at least one type of special effect to be applied corresponding to the image to be processed is determined.

[0113] In this embodiment, after obtaining the to-be-processed image, at least one to-be-applied special effect type corresponding to the to-be-processed image can be determined, where the to-be-applied special effect type may be a special effect type that is compatible with the image content in the to-be-processed image.

[0114] In the actual application process, a mapping relationship between image content and the special effect types to be selected can be established in advance, i.e., at least one special effect type to be selected that best suits each image content can be determined, so that after obtaining an image to be processed, the image content can be analyzed to determine at least one special effect type to be applied corresponding to the image to be processed. For example, if the image to be processed is a landscape image, the corresponding special effect types to be applied may include a water-ink painting type or an oil painting type, etc.; if the image to be processed is a portrait image, the corresponding special effect types to be applied may include a cartoon type, an oil painting type, a pixelated type, etc.; if the image to be processed is an image containing a pet, the corresponding special effect type to be applied may be an abstract painting style type.

[0115] Preferably, determining at least one to-be-applied special effect type corresponding to the to-be-processed image includes: determining image content of the to-be-processed image; and determining at least one to-be-applied special effect type from the at least one to-be-selected special effect type based on the image content and the pre-established mapping relationship.

[0116] In this embodiment, the image content may be a description of the object, scene, and environment included in the image to be processed. Preferably, the image content may include at least one of an object type, a corresponding scene, a corresponding style type, and a corresponding environment. Here, the object type may be a type to which the object included in the image to be processed belongs. Preferably, the object type may include a person, a pet, a landscape, a building, etc. Note that the image to be processed may include one or more objects. If the image to be processed contains one object, a corresponding special effect type to be applied can be determined for this object type. If the image to be processed contains multiple objects and corresponds to multiple object types, at least one special effect type to be applied that is compatible with all of the object types of these objects can be determined. Preferably, the corresponding scene may include, but is not limited to, an indoor scene, a night view, a street view, a sunset, etc. The corresponding style type may be a style type corresponding to the image to be processed. Preferably, the corresponding style type may include, but is not limited to, an oil painting type, a watercolor painting type, a manga type, a line drawing type, etc. The home environment may include, but is not limited to, mountains, lakes, oceans, skies, and the like.

[0117] In this embodiment, the mapping relationship may be a pre-established mapping relationship between image content and a selection-ready special effect type, where the mapping relationship includes each image content and at least one selection-ready special effect type.

[0118] In a specific implementation, after obtaining a to-be-processed image, the to-be-processed image is processed according to a preset algorithm to determine image content corresponding to the to-be-processed image, and the image content is then analyzed to determine at least one to-be-selected special effect type that matches the image content from a plurality of to-be-selected special effect types according to a pre-established mapping relationship, thereby finally obtaining at least one to-be-selected special effect type corresponding to the to-be-processed image. The advantages of this configuration are that it improves the intelligence and personalized adaptability of the special effect tool, reduces the error rate of target special effect images, and improves the user experience.

[0119] In S330, a target special effect type is determined from at least one waiting special effect type.

[0120] In S340, the image to be processed is converted into a target special effect image corresponding to the target special effect type.

[0121] In practical application, after obtaining the target special effect type, a target image corresponding to the target special effect type is determined, and then the target image and the to-be-processed image are fused to obtain the target special effect image corresponding to the target special effect type.

[0122] In the technical solution of the embodiments of the present disclosure, in response to a special effect trigger operation, an image to be processed is obtained, and then at least one special effect type to be applied corresponding to the image to be processed is determined, and a target special effect type is determined from the at least one special effect type to be applied. Finally, the image to be processed is transformed into a target special effect image corresponding to the target special effect type, thereby determining a corresponding stylized special effect type based on the image content, and further realizing the effect of transforming the image into the corresponding target special effect image, thereby improving the intelligence of the special effect tool and effectively improving the display effect of the target special effect image.

[0123] 4 is a flowchart of a video processing method according to an embodiment of the present disclosure, and based on the above-mentioned embodiment, when a target text and a to-be-processed image are obtained in response to a special effect trigger operation, a target special effect type can be determined based on the target text and the to-be-processed image simultaneously, and the target text and the to-be-processed image can be converted into a target special effect image corresponding to the target special effect type, and specific embodiments can refer to the technical solution of this embodiment, where the same or corresponding technical terms as those in the above embodiment will not be described again.

[0124] As shown in FIG. 4, the method specifically includes the following steps:

[0125] At S410, in response to a special effect trigger operation, target text and images to be processed are obtained.

[0126] The method for acquiring the target text and the image to be processed is the same as that described in the above-mentioned embodiment, and therefore, the explanation of this step will be omitted here.

[0127] At S420, at least one type of special effect to be applied corresponding to the target text and the image to be processed is determined.

[0128] In this embodiment, after obtaining the target text and the image to be processed, at least one type of special effect to be applied corresponding to the target text and the image to be processed can be determined. Preferably, the type of special effect to be applied may include at least one type of special effect corresponding to the target text, at least one type of special effect corresponding to the image to be processed, or at least one type of special effect simultaneously corresponding to the target text and the image to be processed, etc., and the embodiment of the present disclosure is not specifically limited thereto.

[0129] In practical applications, when a target text is obtained and an image to be processed is also obtained, when determining the type of special effect to be applied, at least one type of special effect corresponding to the target text and at least one type of special effect corresponding to the image to be processed can be determined first, and then the union or intersection of these special effect types can be taken, and the final set obtained can be a set corresponding to at least one type of special effect to be applied. The implementation forms of union processing and intersection processing will be described in detail below.

[0130] Preferably, when performing union processing, a corresponding implementation may be to determine a first special effect type corresponding to the target text and a second special effect type corresponding to the image to be processed, determine a union including the first special effect type and the second special effect type, and obtain at least one special effect type to be applied.

[0131] In this embodiment, the first special effect type may be determined after analyzing keywords contained in the target text, and the second special effect type may be determined after analyzing image content in the image to be processed. Note that the number of the first special effect type and the second special effect type may both be one or more.

[0132] In a specific implementation, after obtaining the target text and the image to be processed, first, a first special effect type corresponding to the target text is determined based on the keywords contained in the target text, and a second special effect type corresponding to the image to be processed is determined based on the image content of the image to be processed. Then, the first special effect type and the second special effect type are merged to obtain a union including the first special effect type and the second special effect type, and this union is used as a set corresponding to at least one special effect type to be applied, thereby obtaining at least one special effect type to be applied corresponding to the target text and the image to be processed.

[0133] Preferably, when performing common part processing, a corresponding implementation may be to determine a first special effect type corresponding to the target text and a second special effect type corresponding to the image to be processed, determine a common part between the first special effect type and the second special effect type, and obtain at least one special effect type to be applied.

[0134] In practical application, after obtaining the first special effect type corresponding to the target text and the second special effect type corresponding to the image to be processed, a process can be performed to obtain the common part between the first special effect type and the second special effect type. Specifically, at least one special effect type overlapping the first special effect type and the second special effect type is determined, and a corresponding common part is constructed based on these special effect types. Furthermore, this common part is made into a set corresponding to at least one special effect type to be applied, thereby obtaining at least one special effect type to be applied that corresponds to the target text and the image to be processed.

[0135] The advantages of using the above two methods to determine at least one type of special effect to be applied are that it enhances the flexibility and diversity of the method for determining the type of special effect to be applied, improves the intelligence of the special effect tool, and further increases the variety and interest of the target special effect images, thereby improving the user's usage experience.

[0136] In S430, a target special effect type is determined from at least one waiting special effect type.

[0137] At S440, the target text and the to-be-processed image are converted into a target special effect image corresponding to the target special effect type.

[0138] In practical application, after obtaining the target special effect type, a target image corresponding to the target special effect type is determined, and an associated image related to the target text is determined. Then, the associated image, the image to be processed, and the target image are fused to obtain the target special effect image corresponding to the target special effect type.

[0139] In the technical solution of the embodiments of the present disclosure, in response to a special effect trigger operation, a target text and a waiting image are obtained, and then at least one waiting special effect type corresponding to the target text and / or the waiting image is determined, and a target special effect type is determined from the at least one waiting special effect type. Finally, the target text and / or the waiting image is transformed into a target special effect image corresponding to the target special effect type, thereby simultaneously determining a corresponding stylized special effect type based on the text and the image, thereby achieving the effect of transforming the text and the image into the corresponding target special effect image, thereby improving the accuracy of determining the stylized special effect type, further improving the image quality and special effect display effect of the target special effect image, and enhancing the interactivity of the user using the special effect tool, thereby further improving the user's usage experience.

[0140] FIG. 5 is a structural schematic diagram of a video processing device according to an embodiment of the present disclosure. For example, as shown in FIG. 5, the device includes a special effect trigger operation response module 510, a waiting-to-apply special effect type determination module 520, a target special effect type determination module 530, and a target special effect image determination module 540.

[0141] Here, the special effect trigger operation response module 510 is used to respond to the special effect trigger operation and determine special effect selection information including at least one of target text, image input feature, and image to be processed.

[0142] The waiting-to-be-applied special effect type determining module 520 is used for determining at least one waiting-to-be-applied special effect type corresponding to the special effect selection information.

[0143] The target special effect type determining module 530 is used for determining a target special effect type from the at least one waiting-to-be-applied special effect type.

[0144] The target special effect image determination module 540 is used to convert the target text and / or the target image to a target special effect image corresponding to the target special effect type.

[0145] Based on the above technical solutions, the special effect trigger operation response module 510 includes a waiting image acquisition sub-module, which includes a control display unit, a waiting image first determination unit and a waiting image second determination unit.

[0146] The control display unit is used to display the image upload control in the display interface.

[0147] The first image to be processed determination unit is used to jump to a target image library and determine the image to be processed from the target image library when a trigger operation on the image upload control is detected; or The second pending image determination unit is used for determining the pending image from at least one collected video frame when no trigger operation on the image upload control is detected within a preset time.

[0148] Based on the above technical solutions, the image to be processed second determining unit includes an image to be processed first determining sub-unit and an image to be processed second determining sub-unit.

[0149] The first determination subunit of the image to be processed is used to determine the video frame collected at the end of the countdown as the image to be processed; or The second determination subunit of the image to be processed is used to display at least one video frame collected within the preset time, and determine the image to be processed based on a trigger operation on the at least one video frame.

[0150] Based on the above technical solutions, the special effect trigger operation response module 510 includes a target text acquisition sub-module.

[0151] The target text acquisition sub-module is used to display a text edit box in the target area of ​​the display interface and edit the target text in the text edit box.

[0152] Based on the above technical solutions, the special effect trigger operation response module 510 includes an image input feature determination sub-module.

[0153] The image input feature determination sub-module is used to determine the image input feature according to whether the called camera is a front camera or a rear camera.

[0154] Based on the above technical solutions, the special effect selection information includes a target text, and the waiting special effect type determination module 520 includes a target text processing unit and a waiting special effect type determination unit.

[0155] The target text processing unit is used for processing the target text into words and determining at least one keyword corresponding to the target text.

[0156] The first determination unit for the type of special effect to be applied is used for determining the at least one type of special effect to be applied from a plurality of types of special effect to be selected according to the at least one keyword.

[0157] Based on the above technical solutions, the special effect selection information includes the image to be processed, and the module for determining the type of special effect to be applied 520 further includes an image content determining unit and a second determining unit for the type of special effect to be applied.

[0158] The image content determining unit is used for determining the image content of the to-be-processed image.

[0159] The second determination unit for determining the type of special effect to be applied is used for determining the at least one type of special effect to be applied from the at least one type of special effect to be selected according to the image content and a pre-established mapping relationship.

[0160] Here, the mapping relationship includes each image content and at least one corresponding special effect type waiting to be selected.

[0161] Based on the above technical solutions, the special effect selection information includes the image to be processed and the target text, and the special effect type determination module 520 to be applied further includes a special effect type determination unit, a union determination unit and an intersection determination unit.

[0162] The special effect type determining unit is used for determining a first special effect type corresponding to the target text and a second special effect type corresponding to the to-be-processed image.

[0163] A union determination unit is used to determine a union including the first special effect type and the second special effect type to obtain the at least one waiting-to-be-applied special effect type; or The common part determining unit is used for determining a common part between the first special effect type and the second special effect type, and obtaining the at least one waiting-to-be-applied special effect type.

[0164] Based on the above technical solutions, the device further comprises a special effect thumbnail display module.

[0165] The special effect thumbnail display module is used to, after determining the at least one special effect type to be applied, display a special effect thumbnail corresponding to each special effect type to be applied and a corresponding text description on the display interface.

[0166] Based on the above technical solutions, the target special effect type determining module 530 includes a first target special effect type determining unit and a second target special effect type determining unit.

[0167] a first target special effect type determining unit for determining the target special effect type according to a trigger operation for the at least one waiting special effect type; or The second target special effect type determination unit is used for selecting the target special effect type from the at least one special effect type waiting to be applied according to a preset manner when a trigger operation for the at least one special effect type waiting to be applied is not detected within a preset time.

[0168] Here, the preset method includes determining or presetting a default special effect type randomly, and determining or presetting a default special effect type based on the history data of a target user.

[0169] Based on the above technical solutions, the device further includes a transition video playback module.

[0170] The transition video playing module is used for playing a transition video after determining the target special effect type, and displaying the target special effect image according to the transition video.

[0171] Based on the above technical solutions, the device further comprises a creation progress bar display module.

[0172] The creation progress bar display module is used for displaying a creation progress bar for creating the target special effect image at a target display position corresponding to the transition video during playback of the transition video.

[0173] Based on the above technical solutions, the target special effect image determining module 540 includes a target image determining unit and an image fusion processing unit.

[0174] The target image determining unit is used for determining a target image associated with the target special effect type.

[0175] The image fusion processing unit is used for fusing the target image with the related image related to the target text and / or the to-be-processed image to obtain a target special effect image.

[0176] Based on the above technical solutions, the device further comprises a filter parameter determination module.

[0177] The filter parameter determination module is used for determining filter parameters corresponding to the target special effect type before fusing the target image with the related image related to the target text and / or the image to be processed and obtaining the target special effect image, and determining the target special effect image based on the filter parameters.

[0178] Based on the above technical solutions, the image content of the image to be processed and / or the keywords of the target text are: The category includes at least one of the following: target type, belonging scene, belonging style type, and belonging environment.

[0179] In the technical solution of the embodiments of the present disclosure, in response to a special effect trigger operation, special effect selection information is determined, and then at least one special effect type to be applied corresponding to the special effect selection information is determined, and a target special effect type is determined from the at least one special effect type to be applied. Finally, the target text and / or the image to be processed is transformed into a target special effect image corresponding to the target special effect type, thereby determining a corresponding style special effect type based on the image, the text, and a combination of the two. Furthermore, the effect of transforming the text and the image into the target special effect image based on the style special effect type is realized, thereby improving the accuracy of determining the style special effect type, further improving the image quality and special effect display effect of the target special effect image, and enhancing the interactivity of the user using the special effect tool, and further improving the user's usage experience.

[0180] A video processing device according to an embodiment of the present disclosure can execute the video processing method according to any embodiment of the present disclosure, and includes functional modules corresponding to the execution of the method and beneficial effects.

[0181] Note that the units and modules of the above-described device are merely divided according to functional logic and are not limited to the above divisions, as long as they can realize the corresponding functions. Furthermore, the specific names of the functional units are merely used to make them easier to distinguish from one another, and do not limit the scope of protection of the embodiments of the present disclosure.

[0182] FIG. 6 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. Hereinafter, referring to FIG. 6, a structural schematic diagram of an electronic device (e.g., a terminal device or server in FIG. 6) 600 applied to realize an embodiment of the present disclosure is shown. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-car terminals (e.g., in-car navigation terminals), etc., and fixed terminals such as digital TVs and desktop computers, etc. The electronic device shown in FIG. 6 is merely an example and does not impose any limitations on the functions and scope of use of the embodiment of the present disclosure.

[0183] 6, the electronic device 600 may include a processing unit (e.g., a central processor, a graphics processor, etc.) 601, which can perform various appropriate operations and processes based on programs stored in a read-only memory (ROM) 602 or loaded from a storage device 608 into a random access memory (RAM) 603. The RAM 603 further stores various programs and data necessary for the operation of the electronic device 600. The processing unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0184] Typically, input devices 606 including, for example, a touch panel, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc., output devices 607 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc., storage devices 608 including, for example, a magnetic tape, hard disk, etc., and communication devices 609 can be connected to the I / O interface 605. The communication devices 609 enable the electronic device 600 to communicate wirelessly or via wires with other devices to exchange data. While FIG. 6 illustrates the electronic device 600 with various devices, it should be understood that it is not necessary for the electronic device 600 to implement or include all of the illustrated devices. Instead, more or fewer devices may be implemented or included.

[0185] In particular, according to embodiments of the present disclosure, the processes described with reference to the flowcharts above may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program including program code for performing the methods illustrated in the flowcharts. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 609, installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, it performs the functions defined by the methods of the embodiments of the present disclosure.

[0186] The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0187] The electronic device according to the embodiment of the present disclosure belongs to the same inventive idea as the video processing method according to the above embodiment, and the technical details not described in detail in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0188] An embodiment of the present disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the video processing method according to the embodiment.

[0189] It should be noted that the computer-readable medium described in this disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination thereof. The computer-readable storage medium may be, for example, but is not limited to, an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. Further specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more leads, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used in or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, having computer-readable program code carried therein. Such propagated data signals may take various forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which is capable of transmitting, propagating, or transmitting a program for use in or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted over any suitable medium, including, but not limited to, electrical wire, optical cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

[0190] In some embodiments, the clients and servers may communicate using any now known or later developed network protocol, such as HTTP (Hyper Text Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include local area networks ("LANs"), wide area networks ("WANs"), networks off networks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), and any now known or later developed networks.

[0191] The computer-readable medium may be included in the electronic device, or may exist independently and not be attached to the electronic device.

[0192] The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device determining special effect selection information including at least one of the target text, the image input feature, and the image to be processed in response to the special effect trigger operation; Determine at least one special effect type to be applied corresponding to the special effect selection information; determining a target special effect type from the at least one waiting special effect type; The target text and / or image to be processed is converted into a target special effect image corresponding to the target special effect type.

[0193] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may run entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or a business server. When referring to a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., connected via the Internet using an Internet Service Provider).

[0194] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program, or portion of code, which includes one or more executable instructions for implementing a given logical function. It should be noted that in some alternative implementations, the functions noted in the blocks may occur in a different order than that noted in the figures. For example, two blocks shown as connected may actually execute substantially in parallel or in reverse order, depending on the functionality involved. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system that executes a given function or operation, or in a combination of dedicated hardware and computer instructions.

[0195] The units according to the embodiments of the present disclosure may be implemented in a software manner or a hardware manner, and the names of the units may not necessarily be limiting, for example, the first acquiring unit may be described as "a unit for acquiring at least two Internet Protocol addresses."

[0196] The functionality herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard parts (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0197] In the specification of this disclosure, a machine-readable medium may be a tangible medium that can contain or store a program used in or in conjunction with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the above. Further specific examples of machine-readable storage media include an electrical connection by one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk-read-only disk (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0198] The above description merely describes the preferred embodiments of the present disclosure and the technical principles used. Those skilled in the art should understand that the scope of the present disclosure is not limited to a technical solution composed of a specific combination of the above technical features, but also includes other technical solutions formed by any combination of the above technical features or their equivalent features, provided that the scope does not deviate from the spirit of the above disclosure. For example, a technical solution formed by mutually replacing the above features with technical features having similar functions (including but not limited to) disclosed in the present disclosure.

[0199] Additionally, although operations are described in a particular order, it should not be understood that these operations must be performed in the particular order shown, or in any forward order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes several specific implementation details, these should not be understood as limiting the scope of the present disclosure. Some features described in the description of a single embodiment may also be implemented in combination in a single embodiment. Conversely, various features described in the description of a single embodiment may be implemented in multiple embodiments, either alone or in any suitable subcombination.

[0200] Although the present subject matter has been described using language specific to structural features and / or methodological operations, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms of implementing the claims.

Claims

1. determining special effect selection information including one of the image input characteristics, the target text, and the image to be processed in response to the special effect trigger operation; determining at least one special effect type to be applied corresponding to the special effect selection information; determining a target special effect type from the at least one waiting special effect type; converting the target text and / or the to-be-processed image into a target special effect image corresponding to the target special effect type; determining the image input characteristics includes: determining the image input characteristics based on whether the called camera is a front camera or a rear camera; Video processing methods.

2. To determine the special effect selection information, acquiring the image to be processed; The acquiring of the image to be processed includes: Exposing an image upload control in the display interface; jumping to a target image library and determining the pending image from the target image library when a trigger action on the image upload control is detected; or determining the pending image from at least one collected video frame if no trigger operation on the image upload control is detected within a preset time. The method of claim 1.

3. Determining the ready-to-process image from at least one acquired video frame includes: the video frame collected at the end of the countdown is a ready image for processing, or displaying at least one video frame collected within the preset time period and determining the to-be-processed image based on a trigger operation on the at least one video frame. The method of claim 2.

4. To determine the special effect selection information, obtaining the target text; obtaining the target text displaying a text edit box in the target area of ​​a display interface; and editing the target text in the text edit box. The method of claim 1.

5. The special effect selection information includes the target text, and determining at least one type of special effect to be applied corresponding to the special effect selection information includes: performing a word segmentation process on the target text to determine at least one keyword corresponding to the target text; determining the at least one ready-to-be-applied special effect type from a plurality of ready-to-be-selected special effect types based on the at least one keyword; The method of claim 1.

6. The special effect selection information includes the image to be processed, and determining at least one type of special effect to be applied corresponding to the special effect selection information includes: determining image content of the pending image; determining the at least one to-be-applied special effect type from the at least one to-be-selected special effect type based on the image content and a pre-established mapping relationship; The mapping relationship includes each image content and at least one corresponding special effect type to be selected. The method of claim 1.

7. The special effect selection information includes the image to be processed and the target text, and determining at least one type of special effect to be applied corresponding to the special effect selection information includes: determining a first special effect type corresponding to the target text and a second special effect type corresponding to the image to be processed; determining a union including the first special effect type and the second special effect type to obtain the at least one waiting-to-be-applied special effect type; or determining an intersection between the first special effect type and the second special effect type to obtain the at least one waiting-to-be-applied special effect type; 2. The method of claim 1 .

8. After determining at least one type of special effect to be applied corresponding to the special effect selection information, and further comprising: correspondingly displaying a special effect thumbnail and a corresponding text description corresponding to each to-be-applied special effect type on the display interface. The method of claim 1.

9. Determining a target special effect type from the at least one waiting-to-be-applied special effect type includes: determining the target special effect type based on a trigger operation for the at least one waiting special effect type; or When a trigger operation for at least one waiting special effect type is not detected within a preset time, selecting the target special effect type from the at least one waiting special effect type according to a preset scheme; The preset method includes: randomly determining or presetting a default special effect type; and determining or presetting a default special effect type based on target user history data. The method of claim 1.

10. After determining the target special effect type, further comprising: playing a transition video; and displaying the target special effect image based on the transition video. The method of claim 1.

11. While the transition video is playing, further comprising displaying a creation progress bar for creating the target special effect image at a target display position corresponding to the transition video. The method of claim 10.

12. converting the target text and / or image to be processed into a target special effect image corresponding to the target special effect type, determining a target image associated with the target special effect type; fusing the target image with a related image related to the target text and / or the image to be processed, to obtain the target special effect image; The method of claim 1 .

13. before fusing the target image with a related image related to the target text and / or the image to be processed and obtaining the target special effect image; determining filter parameters corresponding to the target special effect type; and determining the target special effect image based on the filter parameters. The method of claim 12.

14. The image content of the image to be processed and / or the keywords of the target text are: At least one of the following is included: object type, belonging scene, belonging style type, and belonging environment; The method of claim 1.

15. a special effect trigger operation response module configured to respond to the special effect trigger operation and determine special effect selection information including one of the image input feature, the target text, and the image to be processed; an application-ready special effect type determining module configured to determine at least one application-ready special effect type corresponding to the special effect selection information; a target special effect type determining module configured to determine a target special effect type from the at least one waiting-to-be-applied special effect type; a target special effect image determination module configured to convert the target text and / or the to-be-processed image into a target special effect image corresponding to the target special effect type; determining the image input characteristics includes: determining the image input characteristics based on whether the called camera is a front camera or a rear camera; Video processing equipment.

16. one or more processors; a storage device configured to store one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the video processing method of any one of claims 1 to 14. electronic equipment.

17. comprising computer executable instructions for, when executed by a computer processor, performing the video processing method of any one of claims 1 to 14, storage medium.

Images