Image processing method, device, electronic device, storage medium, and program

Abstract

The present disclosure provides an image processing method, device, electronic device, and storage medium, which includes: displaying collected images to be processed on a main screen (S110) in response to detecting that an image processing condition is satisfied; and displaying at least one effect thumbnail on an effect display screen different from the main screen (S120), where each effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon.

Description

[Technical Field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This application claims priority to a Chinese patent application bearing application number 202211281053.6, filed with the State Intellectual Property Office of the People's Republic of China on October 19, 2022, the entire contents of which are incorporated herein by reference.

[0002] [Technical field] TECHNICAL FIELD The embodiments of the present disclosure relate to image processing technology, for example, to an image processing method, device, electronic device, and storage medium. [Background technology]

[0003] With the development of network technology, more and more applications are entering into users' lives, and a series of software that can shoot short videos is especially popular among users. Summary of the Invention

[0004] The present disclosure provides an image processing method, device, electronic device, and storage medium.

[0005] In a first aspect, an embodiment of the present disclosure provides an image processing method, which includes: displaying collected images to be processed on a main screen in response to detecting that an image processing condition is satisfied; and displaying at least one effect thumbnail on an effect display screen different from the main screen, where each effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon.

[0006] In a second aspect, an embodiment of the present disclosure provides an image processing device, the device including: a processed image display module and an effect thumbnail display module, the processed image display module is configured to display collected images to be processed on a main screen in response to detecting that an image processing condition is satisfied, and the effect thumbnail display module is configured to display at least one effect thumbnail on an effect display screen different from the main screen, where each effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon.

[0007] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device including one or more processors and a storage device, the storage device configured to store one or more programs, the one or more programs, when executed by the one or more processors, causing the one or more processors to implement any of the image processing methods of the embodiment of the present disclosure.

[0008] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium including computer-executable instructions that, when executed by a computer processor, perform any of the image processing methods of the embodiments of the present disclosure.

[0009] In the drawings, the same or similar reference numerals refer to the same or similar elements. The drawings are schematic, and the originals and elements are not necessarily drawn to scale. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure. [Figure 2] 1 is a user display screen of an image processing application according to an embodiment of the present disclosure. [Figure 3] FIG. 10 is a schematic diagram of an effect display screen according to an embodiment of the present disclosure. [Figure 4]FIG. 10 is a schematic diagram of an effect thumbnail according to an embodiment of the present disclosure. [Figure 5] FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure. [Figure 6] FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure. [Figure 7] FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure. [Figure 8] FIG. 10 is a schematic diagram of a preview window display position according to an embodiment of the present disclosure. [Figure 9] FIG. 10 is a schematic diagram of a preview window display position according to an embodiment of the present disclosure. [Figure 10] FIG. 10 is a schematic diagram of a preview window display position according to an embodiment of the present disclosure. [Figure 11] FIG. 10 is a schematic diagram of a preview window display position according to an embodiment of the present disclosure. [Figure 12] FIG. 10 is a schematic diagram illustrating an enlarged preview window according to an embodiment of the present disclosure. [Figure 13] FIG. 10 is a schematic diagram illustrating a preview window being reduced according to an embodiment of the present disclosure. [Figure 14] FIG. 10 is a schematic diagram of returning to a default screen according to an embodiment of the present disclosure. [Figure 15] 1 is a schematic diagram illustrating the configuration of an image processing device according to an embodiment of the present disclosure. [Figure 16] 1 is a schematic diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Software developers can add various effect items to applications that users can use while shooting videos, but these effects are usually displayed in the user's field of view as a single icon, which provides little information and makes it difficult for users to intuitively view the displayed effects.

[0012] To address the above situation, embodiments of the present disclosure provide an image processing method, apparatus, electronic device, and storage medium.

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Although the drawings show several embodiments of the present disclosure, it should be understood that the present disclosure may be realized in various forms and should not be limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are used for illustrative purposes only and do not limit the scope of protection of the present disclosure.

[0014] It should be understood that the steps described in the method embodiments of the present disclosure may be performed in a different order and / or in parallel. Also, method embodiments may include additional steps and / or omit steps shown. The scope of the present disclosure is not limited in this respect.

[0015] As used herein, the term "comprises" and variations thereof are open-ended, i.e., mean "including but not limited to." The term "based on" means "based at least in part on." The term "in one embodiment" refers to "at least one embodiment," the term "in another embodiment" refers to "at least one other embodiment," and the term "in some embodiments" refers to "at least some embodiments." Relevant definitions of other terms are provided below.

[0016] The concepts of "first," "second," etc. referred to in this disclosure are merely intended to distinguish between different devices, modules, or units, and do not limit the order or interdependence of the functions performed by these devices, modules, or units.

[0017] The modifications "one" and "multiple" referred to in this disclosure are intended to be exemplary rather than limiting, and should be understood by those of skill in the art as "at least one" unless the context clearly dictates otherwise.

[0018] The names of messages or information exchanged between devices in the embodiments of the present disclosure are used for illustrative purposes only and do not limit the scope of these messages or information.

[0019] It should be understood that before using any embodiment of the present disclosure, the type, scope, and use of personal information related to the present disclosure should be notified to the user in an appropriate manner in accordance with relevant laws and regulations, and the user's consent should be obtained.

[0020] For example, in response to receiving a voluntary request from a user, presentation information is sent to the user to clearly indicate to the user that the operation the user is about to perform requires the acquisition and use of the user's personal information, allowing the user to independently choose, based on the presentation information, whether or not to provide the personal information to software or hardware, such as an electronic device, application, server, or storage medium, that performs the operation of the embodiments of the present disclosure.

[0021] As an optional, non-limiting example, the method of transmitting the presented information to the user in response to receiving a voluntary request from the user may be, for example, a pop-up window, in which the presented information may be presented in text form. The pop-up window may also include a selection control that allows the user to select "allow" or "deny" the provision of personal information to the electronic device.

[0022] The above notification and user permission acquisition process is merely exemplary and does not limit the implementation manner of the present disclosure, and other manners that comply with relevant laws may be applied to embodiments of the present disclosure.

[0023] It is understood that data relating to the embodiments (including but not limited to the data itself, acquisition or use of the data) should comply with applicable laws and related requirements.

[0024] Before introducing the embodiments of the present disclosure, application scenarios will be described by way of example. The embodiments of the present disclosure can be applied to any scenario requiring display or processing of effects. For example, during video recording, effects can be applied to the subject to obtain a target effect image to be displayed. Also, during still image recording, for example, an image can be captured using a built-in camera of a terminal device, and then the captured image can be processed into an effect image to display the effect. In this embodiment, additional effects can include makeup, video, and moving images. In this embodiment, the target subject can be a user, or various captured images of animals or landscapes.

[0025] 1 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure. The embodiment of the present disclosure can enrich the effect thumbnails corresponding to each effect item on an effect display screen, allowing a user to intuitively understand the effect corresponding to each effect item. The method may be performed by an image processing device, which may be implemented in the form of software and / or hardware, or alternatively, by an electronic device, which may be a mobile terminal, a personal computer (PC), a server, or the like. The embodiment of the present disclosure may be performed by a server, a client, or a client and a server working together.

[0026] As shown in FIG. 1, the method includes the following steps:

[0027] In S110, in response to detecting that the image processing conditions are satisfied, the collected images to be processed are displayed on the main screen.

[0028] Here, an apparatus for performing a method for generating an effect video according to an embodiment of the present disclosure may be integrated into application software supporting an effect video processing function, and the software may be installed in an electronic device, which may optionally be a mobile terminal or a PC terminal. The application software may be image / video processing software, and the specific application software is not specifically described herein, as long as it can achieve image / video processing. It may also be a specially developed application, which is integrated into software or a corresponding page for adding and displaying effects, allowing a user to process the effect video through the page integrated in the PC terminal.

[0029] In this embodiment, a control for triggering the application of an effect is developed in advance in application software or an application supporting an effect video processing function. When it is detected that the user has triggered the control, a display screen is entered in response to the trigger operation of the effect selection, and this screen is the main screen. The image to be processed is the image to which the user adds an effect. The image to be processed may include images acquired through two routes. First, the image to be processed may be an image captured in real time. When the user triggers the capture control of the image capture device, the image capture device integrated in the mobile terminal is called, and the image captured by the image capture device corresponds to the environment to which the mobile terminal belongs. The image generated at this time becomes the image to be processed. Alternatively, the image to be processed may be an image captured in advance. The pre-captured image is sent to the display page of the main screen via the image upload interface of the application and becomes the image to be processed.

[0030] For example, when a user triggers application software or an application supporting a video effect processing function on a mobile terminal device, the user first enters the user display screen of the image processing application, and a control for accessing the imaging device of the mobile terminal device is preset on the user display screen, while a control for uploading previously captured images is also provided on the user display screen. When the user triggers the control for accessing the imaging device of the mobile terminal device, the mobile terminal device detects the need to activate the imaging device to take a photo, and displays an image corresponding to the current environment on the main screen, and the image collected and displayed on the display screen at this time may be the image to be processed. Alternatively, when the user triggers the control for uploading previously captured images, the user may enter the album of the mobile terminal device, search for and select the image to be processed from the album, and display the selected previously captured image on the main screen as the image to be processed. Note that the screen showing the image to be processed is the main screen.

[0031] For example, when a user triggers application software or an application, the user enters the user display screen of the image processing application. See Figure 2. As shown in Figure 2, the control located in the center at the bottom of the display screen is a control for calling up the imaging device of the mobile device. When the user triggers the control labeled "Take Photo," the mobile terminal device activates the imaging device to take a photo and displays an image corresponding to the current environment on the main screen. The control located in the lower right of the display screen is a control for uploading pre-taken images. When the user triggers the control labeled "Album," the user jumps to an album viewing screen, searches for and selects pre-taken images from the album of the mobile device, and displays the selected pre-taken image on the main screen as an image to be processed.

[0032] In S120, at least one effect thumbnail is displayed on an effect display screen different from the main screen.

[0033] The effect thumbnail includes an effect icon and an effect cover page corresponding to the effect icon.

[0034] In this embodiment, the effect display screen is a pre-developed display screen that displays various effect items. The effect display screen and the main screen are two different display screens. The effect display screen may be displayed half-hidden by the main screen. The difference between the effect display screen and the main screen is that they are different controls and different display screens. The effect thumbnails are effect display effects and item indicators corresponding to each effect item. The item indicators are effect icons, and the effect display effects are effect covers. The effect icons may be distinctive indicators representing the effect items, or alternatively, the indicators may be a single icon. The effect covers may be videos filmed by users using the effects corresponding to the effect icons, or may be videos filmed by stars or influencers using the effects corresponding to the effect icons.

[0035] For example, after a user triggers the "shoot" control, the main screen may display the image to be processed collected by the image collection device, while at the same time displaying at least one effect thumbnail on an effect display screen covering half of the main screen. To clearly introduce the effect display screen, an example is provided. Referring to FIG. 3, the main screen displays the image to be processed, and effect thumbnails are located on the effect display screen, which covers half of the main screen. Although there may be certain differences in the content displayed on the image to be processed depending on the area covered by the effect display screen, the image to be processed must be spread across the entire main screen. To display as many effect thumbnails as possible on the effect display screen, multiple effect thumbnails may be displayed on the effect display screen, arranged sequentially from left to right and top to bottom. For example, the effect display screen may display three effect thumbnails in a row, or multiple rows of effect thumbnails. The effect thumbnails may include effect icons and effect covers. To clearly introduce the effect thumbnails, an example is provided. 4, the effect icon is a "crown" sign, and the effect cover is a video shot with the effect item corresponding to the "crown" sign. The effect icon may be located at any position on the effect cover, and may be located at the upper left corner, upper right corner, lower left corner, or lower right corner.

[0036] According to an embodiment of the present disclosure, when it is detected that the image processing conditions are met, the collected images to be processed are displayed on the main screen, and at least one effect thumbnail is displayed on an effect display screen different from the main screen, where the effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon. This improves the problem in related technologies that users cannot intuitively view the display effects of effects, resulting in high costs for users to understand the effects, and by optimizing the content in the effect thumbnail, the amount of information displayed is increased, and the user's understanding of the effect content is improved.

[0037] By providing a more intuitive effect display method for users who select effect operations, the cost for users to understand the effect is reduced, which is advantageous for efficient interaction between the user and the effect display screen.

[0038] 5 is a flowchart of an image processing method according to an embodiment of the present disclosure. Based on the above embodiment, after displaying at least one effect thumbnail on the effect display screen of the main screen, a target effect thumbnail can be determined and applied to the image to be processed. For the embodiment, please refer to this embodiment. Here, technical terms that are the same as or correspond to those in the above embodiment will not be described again.

[0039] As shown in FIG. 5, the method includes the following steps:

[0040] In S210, if it is detected that the image processing conditions are met, the collected images to be processed are displayed on the main screen.

[0041] In S220, at least one effect thumbnail is displayed on an effect display screen different from the main screen.

[0042] At S230, a target effect is determined based on a trigger operation on at least one effect thumbnail.

[0043] In this embodiment, the target effect is an effect that the user wants to select and add to the image to be processed. When the user triggers the application software or application, the user enters the user display screen of the image processing application. As shown in FIG. 2, the control located at the bottom left of the display screen is the effect display control. When the "Effect" control is triggered, the main screen simultaneously displays the image to be processed and the effect display screen, as shown in FIG. 3. The effect display screen may include multiple effect thumbnails, which are arranged sequentially from left to right and top to bottom on the effect display screen. When an effect item corresponding to a certain effect thumbnail needs to be applied to the image to be processed, a trigger operation can be performed on the effect thumbnail. In this case, the triggered effect thumbnail corresponds to one target effect, so when the triggered effect thumbnail is the target effect thumbnail, it is possible to determine which target effect has been selected.

[0044] In S240, effect processing is performed on the image to be processed, and a target effect image corresponding to the target effect is obtained and displayed on the main screen.

[0045] Here, the display effect of the target effect image corresponds to the display effect of the effect cover of the target effect.

[0046] In this embodiment, the target effect image is the effect image obtained after applying the effect item corresponding to the target effect to the image to be processed. After obtaining the target effect image corresponding to the target effect, the target effect image is displayed on the main screen. In this way, each time a target effect is determined, the effect is applied to the image to be processed, and the user can advantageously observe in real time whether the current effect is suitable for the image to be currently processed.

[0047] For example, referring to FIG. 3, when a user triggers the effect of the "crown" mark, it indicates that the image to be processed is to achieve the effect shown on the effect cover, and the triggered effect is taken as the target effect, which is applied to the image to be processed to obtain the target effect image, which can then be displayed on the main screen.

[0048] In an embodiment of the present disclosure, when it is detected that the image processing conditions are met, the collected image to be processed is displayed on the main screen, at least one effect thumbnail is displayed on an effect display screen different from the main screen, a target effect is determined based on a trigger operation on at least one effect thumbnail, effect processing is performed on the image to be processed, a target effect image corresponding to the target effect is obtained, and displayed on the main screen. Each time a target effect is determined, the effect is applied to the image to be processed, and the user can observe in real time whether the current effect is suitable for the current image to be processed.

[0049] 6 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure. Based on the above embodiment, before displaying at least one effect thumbnail on the effect display screen, it is necessary to determine an effect cover corresponding to each effect icon, and generate an effect thumbnail based on the effect icon and the effect cover. Here, technical terms that are the same as or corresponding to the above embodiment will not be described again. As shown in FIG. 6, the method includes the following steps:

[0050] In S310, an effect cover corresponding to each effect icon is determined.

[0051] The effect cover image includes a static cover image or a dynamic cover image.

[0052] In practical application, when effect processing is performed, the number of effect items is relatively large. To determine the corresponding effect for each effect, each effect item must be triggered and its display effect must be determined, resulting in low efficiency. In contrast, the embodiments provided in the present disclosure predetermine an effect cover, which can represent an effect corresponding to an effect icon. Furthermore, the display effect obtained by applying the effect to the image to be processed can be quickly known. To improve the richness and fidelity of the effect thumbnail display, the effect cover may include a static cover image or a dynamic cover image. Here, the static cover image may be an image of a certain frame, and the dynamic cover image may be a stitching of multiple frame images. Setting a dynamic image has the advantage of enabling more effect effects to be displayed.

[0053] In the embodiment of the present disclosure, there are at least two methods for determining the effect cover. The first method determines the effect cover based on the user's trigger operation, thereby improving the interaction effect between the user and the display screen. The other method is for the spool server to dynamically update the effect cover corresponding to each effect icon based on big data during the development stage. Next, we will describe how each determination method determines the effect cover.

[0054] In the first manner, an effect cover corresponding to an effect icon is determined based on the effect-creation video uploaded by the target user corresponding to the effect icon.

[0055] Furthermore, the user can shoot an effect video based on each effect item, and after the user has finished shooting the effect video, he can create an effect cover corresponding to each effect mark to mark the effect corresponding to each effect item. In this way, the display effect of the effect cover can be customized, which has the advantage of meeting the user's individualized requirements and the matching between the effect items and the user.

[0056] In this embodiment, a user can upload a video they have created to the application as an effect cover, i.e., the user can create their own effect cover corresponding to an effect icon. For example, if a user has previously taken an image using an effect corresponding to a certain effect icon, the video content taken by the user can be uploaded to an effect thumbnail in the application and used as the effect cover for the effect thumbnail. In this way, the effect cover can be generated using an effect video they have created themselves, which has the effect of improving the autonomy of effect cover creation and enhancing the user's individualized needs.

[0057] A second manner of determining an effect cover may include, for each effect icon, obtaining a historical effect video and corresponding effect attributes associated with the current effect icon, determining a target historical effect video from the historical effect video based on the effect attributes, and determining an effect cover for the current effect icon based on the target historical effect video.

[0058] The effect cover corresponding to each effect icon may be determined during the development phase or during the application process of each effect item. There are two ways to set the effect cover during the application process. The first way is to periodically update the effect cover corresponding to each effect icon. Periodically updating the effect cover may involve periodically acquiring the effect attributes of each effect item and determining the effect cover based on the effect attributes. Alternatively, the effect attributes of each effect item may be acquired in real time and the effect cover may be updated in real time based on the latest popularity data. The second way is to update the effect cover corresponding to each effect icon based on the effect attributes of each effect video corresponding to each effect icon.

[0059] In this embodiment, effect videos shot by users related to the effects corresponding to each effect icon can be obtained based on the data of the application platform, and these video contents may be called historical effect videos. The effect attributes may be the popularity, exposure, and / or playback volume of the shot videos. The target historical effect video may be a video content with a relatively high effect attribute selected from the historical effect videos.

[0060] For example, each effect icon corresponds to one effect item. Based on the application platform's data, effect videos shot by users associated with the effect corresponding to each effect icon can be obtained. Based on information such as the popularity, number of views, and the like of the effect videos shot by the associated users, it can be determined which historical effect video is the most popular. This indicates that the user has a relatively high preference for this historical effect video, and this video can be selected as the target historical effect video. Based on the target historical effect video, an effect cover corresponding to the effect icon can be determined. In this way, users can preview the effect display effects based on the latest popularity, eliminating the need to repeatedly try multiple display effects, and increasing the user's tendency to select and use the effect corresponding to the effect icon.

[0061] Optionally, one or more video frames are determined from the target historical effect video to serve as the effect cover for the current effect icon.

[0062] In this embodiment, other influential users can select videos shot using effects corresponding to the effect icons, and select one or more frames of video content as effect cover pages based on the popularity, exposure, or playback volume of the shot videos, where selecting one video frame corresponds to a static effect cover page, and selecting multiple video frames corresponds to a dynamic effect cover page, which has the advantages of providing more information, enriching the display effect of the effect cover page, and allowing users to intuitively feel the effects of the effects.

[0063] At S320, an effect thumbnail is generated based on the effect icon and the corresponding effect cover.

[0064] For example, an effect icon is combined with an effect cover as an effect thumbnail, where the effect icon represents what the current effect is, and the effect cover is used to represent the display effect of the corresponding effect.

[0065] In an embodiment of the present disclosure, an effect cover corresponding to each effect icon is determined. The effect cover may include a static cover image or a dynamic cover image. An effect thumbnail is generated based on the effect icon and the corresponding effect cover. In this embodiment, the user does not need to try multiple display effects multiple times during the process of selecting an effect. Instead, by triggering an effect corresponding to a certain effect thumbnail based on the effect thumbnail, the user can know what the display effect will be like, thereby reducing the cost for the user to understand the effect.

[0066] 7 is a flow chart of an image processing method according to an embodiment of the present disclosure, and based on the above embodiment, the display content and display method of the effect display screen are further detailed, and the embodiment can be referred to. Here, the same or corresponding technical terms as those in the above embodiment will not be described here.

[0067] As shown in FIG. 7, the method includes the following steps:

[0068] In S410, if it is detected that the image processing conditions are met, the collected images to be processed are displayed on the main screen.

[0069] In S420, at least one effect thumbnail is displayed on an effect display screen different from the main screen.

[0070] In S430, if it is detected that the trigger operation on the effect display screen satisfies a predetermined condition, the display size of the effect display screens arranged in a tiled pattern on the main screen is adjusted and multiple effect thumbnails are displayed on the effect display screens.

[0071] In this embodiment, the predetermined condition may be sliding the effect display screen upward, sliding the effect display screen downward, sliding the effect display screen left, or sliding the effect display screen right. The display size of the effect display screen on the main screen may be adjustable, for example, the display size of the effect display screen on the main screen may be increased or decreased. For example, sliding the effect display screen upward or right increases the display size of the effect display screen, allowing more effect thumbnails to be displayed. Sliding the effect display screen downward or left decreases the display size of the effect display screen, allowing fewer effect thumbnails to be displayed. In this way, the user can view more effect thumbnails according to their needs during the process of selecting an effect, which is advantageous in meeting the user's personalized needs.

[0072] In S440, when the display ratio between the display size and the screen size of the main screen reaches a predetermined display ratio, a preview window corresponding to the main screen is popped up, and the image to be processed or the target effect image corresponding to the image to be processed is displayed in the preview window.

[0073] The window size of the preview window is smaller than the display size.

[0074] In this embodiment, the predetermined display ratio is a preset ratio value, which refers to the display ratio between the display size of the effect display screen and the screen size of the main screen, and for example, the predetermined display ratio may be 80% or 70%. The preview window is a small window that is the same as the display content of the main screen and can float above the display page of the effect display screen.

[0075] In actual application, the area of ​​the effect display screen can be adjusted, and the effect display screen can be enlarged or reduced. When the effect display screen is enlarged and the display ratio between the display size and the main screen reaches a certain display ratio, for example, 80% or 70%, the content on the main screen will have a poor display effect for the user. To clearly display the target effect image or the image to be processed, the display content on the main screen can be displayed in a preset window. The content displayed in the preview window is the same as the content displayed on the main screen. If the image displayed on the main screen is an image to be processed for which an effect thumbnail has not been triggered, the image displayed in the preview window is the original captured image or the original uploaded image, i.e., the image to be processed without effect processing. If the image displayed on the main screen is an image to be processed for which an effect thumbnail has been triggered, the image displayed in the preview window is the image to be processed with effect processing. This allows more effect thumbnails to be displayed while still effectively displaying the display content on the main screen.

[0076] In S450, when it is detected that the preview window is being dragged, the display position of the preview window on the effect display screen is adjusted based on the drag trajectory.

[0077] In this embodiment, the drag trajectory refers to the trajectory of the user's drag on the display screen relative to the preview window. The preview window can be dragged in any direction, and the position of the preview window on the display screen when the dragging stops becomes the display position of the current preview window on the effect display screen, and the preview window can be displayed at any position on the main screen.

[0078] For example, the display position of the preview window on the effect display screen may be adjusted by dragging the preview window. As shown in FIG. 8, the display position of the preview window may be located in the upper left corner of the display screen. As shown in FIG. 9, the display position of the preview window may be located in the upper right corner of the display screen. As shown in FIG. 10, the display position of the preview window may be located in the lower left corner of the display screen. As shown in FIG. 11, the display position of the preview window may be located in the lower right corner of the display screen. In this way, during the process of selecting an effect, the user can freely drag the display position of the preview window on the main screen according to their needs, allowing them to view more effect thumbnails and improving the adaptability of the application.

[0079] Optionally, when an operation that triggers a pinch out or pinch in on the preview window is detected, the window size of the effect display screen of the preview window is adjusted.

[0080] In this embodiment, the window size of the preview window's effect display screen can be adaptively adjusted. As shown in FIG. 12, when it is detected that two fingers are moving apart on the preview window, the size of the preview window can be enlarged. As shown in FIG. 13, when it is detected that two fingers are moving toward each other on the preview window, the size of the preview window can be reduced. In this way, the user can adjust the display size of the preview window's effect display screen according to their needs. By reducing the preview window, more effect thumbnails can be viewed, and by enlarging the preview window, a larger image to be processed can be viewed, which has the advantage of improving the user's visual experience.

[0081] In S460, if it is detected that the trigger operation on the preview window and / or the effect display screen satisfies the return condition, the screen is returned to the main screen to display the collected image to be processed or the target effect image, and a default screen of at least one thumbnail is displayed on an effect display screen different from the main screen.

[0082] In this embodiment, as shown in FIG. 3, the default screen is the screen of at least one thumbnail initially displayed on the user's screen. The return condition is a predetermined condition, which may be a downward slide of the preview window and / or the effect display screen, and if the slide direction or slide speed meets a certain condition, the default screen is returned to. Alternatively, the default screen can be returned to by double-clicking on the device screen. For example, as shown in FIG. 14, the user can return to the default screen by quickly sliding down on the device screen. In this way, there is an advantage that the user can quickly return to the default screen when he or she wants to log off from the current page.

[0083] In an embodiment of the present disclosure, the method includes: displaying the collected images to be processed on the main screen when it is detected that an image processing condition is satisfied; displaying at least one effect thumbnail on an effect display screen different from the main screen; adjusting the display size of the effect display screen tiled on the main screen when it is detected that a trigger operation on the effect display screen satisfies a predetermined condition; displaying multiple effect thumbnails on the effect display screen when it is detected that a trigger operation on the effect display screen satisfies a predetermined condition; popping up a preview window corresponding to the main screen and displaying the image to be processed or a target effect image corresponding to the image to be processed in the preview window when a display ratio between the display size and the screen size of the main screen reaches a predetermined display ratio; adjusting the display position of the preview window on the effect display screen based on the drag trajectory when it is detected that the preview window is being dragged; returning to the main screen to display the collected images to be processed or the target effect image when it is detected that a trigger operation on the preview window and / or the effect display screen satisfies a return condition; and displaying at least one default thumbnail screen on the effect display screen different from the main screen. A user can adjust the position and display area of ​​the effect display screen and the preview window according to their needs, thereby improving the user's visual experience and application adaptability.

[0084] FIG. 15 is a schematic diagram of the configuration of an image processing device according to an embodiment of the present disclosure. As shown in FIG. 15, the device includes a processed image display module 510 and an effect thumbnail display module 520.

[0085] The processed image display module 510 is configured to display the collected image to be processed on the main screen when it detects that the image processing conditions are met.

[0086] The effect thumbnail display module 520 is configured to display at least one effect thumbnail on an effect display screen that is different from the main screen.

[0087] The effect thumbnail includes an effect icon and an effect cover page corresponding to the effect icon.

[0088] Based on the above embodiments, the device further includes a target effect determining module and a target effect image display module.

[0089] The effect thumbnail determination module is configured to determine a target effect based on a trigger operation on at least one effect thumbnail.

[0090] The target effect image display module is configured to perform effect processing on the image to be processed, obtain a target effect image corresponding to the target effect, and display it on the main screen.

[0091] Here, the display effect of the target effect image corresponds to the display effect of the effect cover of the target effect.

[0092] Based on the above embodiments, the device further includes an effect cover determining module and an effect thumbnail generating module.

[0093] The effect cover determining module is configured to determine an effect cover corresponding to each effect icon, where the effect cover includes a static cover image or a dynamic cover image.

[0094] The effect thumbnail generating module is configured to generate an effect thumbnail based on the effect icon and the corresponding effect cover.

[0095] Based on the above embodiments, the effect cover determining module includes an effect attribute obtaining sub-module, a target effect determining sub-module and an effect cover determining sub-module.

[0096] The effect attribute acquisition sub-module is configured to acquire, for each effect icon, the historical effect animation and corresponding effect attributes associated with the current effect icon.

[0097] The target effect determination sub-module is configured to determine a target historical effect animation from the historical effect animation based on the effect attributes.

[0098] The effect cover determining sub-module is configured to determine the effect cover of the current effect icon based on the target historical effect video.

[0099] Based on the above embodiments, the effect cover determining sub-module includes an animation frame determining unit for determining one or more animation frames from the target historical effect animation to be the effect cover of the current effect icon.

[0100] Based on the above embodiments, the effect cover determination module includes an effect cover determination subunit configured to determine an effect cover corresponding to an effect icon based on the effect creation video uploaded by the target user corresponding to the effect icon.

[0101] Based on each of the above embodiments, the device further includes a display screen adjustment module that, when it detects that a trigger operation on the effect display screen satisfies a predetermined condition, adjusts the display size of the effect display screens arranged in tiles on the main screen so as to display multiple effect thumbnails on the effect display screens.

[0102] Based on the above embodiments, the display screen adjustment module further includes a preview window pop-up sub-module, which is configured to pop up a preview window corresponding to the main screen when the display ratio between the display size and the screen size of the main screen reaches a predetermined display ratio, and display the image to be processed or the target effect image corresponding to the image to be processed in the preview window, where the window size of the preview window is smaller than the display size.

[0103] Based on the above embodiments, the preview window pop-up sub-module further includes a display position adjusting unit, a window size adjusting unit and a main screen returning unit.

[0104] The display position adjusting unit is installed so that, when it is detected that the preview window is being dragged, the display position adjusting unit adjusts the display position of the preview window on the effect display screen based on the drag trajectory.

[0105] The window size adjusting unit is configured to adjust the window size of the effect display screen of the preview window when an operation triggering a pinch out or pinch in is detected on the preview window.

[0106] The main screen return unit is configured to return to the main screen to display the collected image to be processed or the target effect image when detecting that the trigger operation on the preview window and / or the effect display screen satisfies a return condition, and display at least one default screen of thumbnails on the effect display screen different from the main screen.

[0107] An embodiment of the present disclosure includes, when detecting that an image processing condition is met, displaying the collected image to be processed on the main screen, and displaying at least one effect thumbnail on an effect display screen different from the main screen, where the effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon, thereby improving the problem in related art that users cannot intuitively view the display effects of effects, resulting in high costs for users to understand the effects; optimizing the content of the effect thumbnail provides more information and improves users' understanding of the effect content.

[0108] The image processing device according to the embodiments of the present disclosure can execute the image processing method according to any embodiment of the present disclosure, and includes functional modules for executing the method and beneficial effects.

[0109] The units and modules included in the above device are simply divided by functional logic and are not limited to the above division, as long as they can realize the corresponding functions. Furthermore, the names of the functional units are intended to distinguish them from one another and do not limit the scope of protection of the embodiments of the present disclosure.

[0110] FIG. 16 is a schematic diagram of an electronic device according to an embodiment of the present disclosure. Reference will now be made to FIG. 16. FIG. 16 shows a schematic diagram of an electronic device (e.g., a terminal device or server in FIG. 16) 600 for implementing an embodiment of the present disclosure. The terminal device according to the embodiment of the present disclosure may include, but is not limited to, mobile devices such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (PADs), portable media players (PMPs), and in-vehicle devices (e.g., in-vehicle navigation devices), as well as fixed devices such as digital TVs and desktop computers. The electronic device shown in FIG. 16 is merely an example and does not impose any limitations on the functionality and scope of use of the embodiment of the present disclosure.

[0111] 16, the electronic device 600 may include a processor (e.g., a central processing unit, a graphics processor, etc.) 601, which may perform various appropriate operations and processes based on a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 into a random access memory (RAM) 603. The RAM 603 also stores various programs and data necessary for the operation of the electronic device 600. The processor 601, the ROM 602, and the RAM 603 are interconnected by a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0112] Devices such as input devices 606, typically including a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607, typically including a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 608, typically including a magnetic tape, hard disk, etc.; and communication devices 609, may be connected to the I / O interface 605. The communication devices 609 enable the electronic device 600 to exchange data with other devices via wireless or wired communication. While FIG. 16 illustrates the electronic device 600 with various devices, it is not required that the electronic device 600 implement or include all of the devices shown. Alternatively, the electronic device may include more or fewer devices.

[0113] In particular, according to embodiments of the present disclosure, the processes described with reference to the flowcharts above may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program including program code for performing the methods illustrated in the flowcharts. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 609, installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processor 601, the functions defined in the methods of the embodiments of the present disclosure are performed.

[0114] The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only and do not limit the scope of these messages or information.

[0115] The electronic device according to the embodiment of the present disclosure belongs to the same inventive concept as the image processing method according to the above embodiment, and the above embodiment can be referred to for technical details not described in detail in this embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0116] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon, the computer storage medium realizing the image processing method according to the embodiment when the program is executed by a processor.

[0117] It should be noted that the computer-readable storage medium according to the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the above. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. Examples of computer-readable storage media include, but are not limited to, an electrical connection having at least one conductor, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used in or in combination with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a propagating data signal, either in baseband or as part of a carrier wave, having computer-readable program code borne thereon. Such propagating data signals may take various forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable storage medium other than a computer-readable storage medium, which is capable of transmitting, propagating, or transmitting a program for use in or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable storage medium may be transmitted over any suitable medium, including, but not limited to, electrical wire, optical cable, radio frequency (RF), or the like, or any suitable combination thereof.

[0118] In some embodiments, clients and servers communicate using any now known or future developed network protocol, such as HyperText Transfer Protocol (HTTP), and may interconnect with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), WWW networks (e.g., the Internet), and end-to-end networks (e.g., ad hoc networks), as well as any now known or future developed networks.

[0119] The computer-readable storage medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0120] The computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to display the collected images to be processed on a main screen and display at least one effect thumbnail on an effect display screen different from the main screen when it detects that an image processing condition is met, where the effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon.

[0121] Alternatively, the computer-readable medium may carry one or more programs, which, when executed by the electronic device, cause the electronic device to, upon detecting that an image processing condition is satisfied, display the collected images to be processed on a main screen and display at least one effect thumbnail on an effect display screen different from the main screen, where the effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon.

[0122] Computer program code for carrying out the operations of the present disclosure may be written in at least one programming language or combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may run entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0123] The flowcharts and block diagrams in the figures illustrate possible system architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code, including at least one executable instruction for implementing a given logical function. It should be noted that the functions described in the blocks may alternatively occur in an order different from that described in the figures. For example, two blocks shown in succession may actually be executed essentially in parallel, or they may be executed in the reverse order, as determined by such functionality. Each block in the block diagrams and flowcharts, and combinations of blocks in the block diagrams and flowcharts, may be implemented in a system using dedicated hardware that performs a given function or operation, or may be implemented using a combination of dedicated hardware and computer instructions.

[0124] The units mentioned in the embodiments of the present disclosure may be implemented in a software manner or a hardware manner, and the unit names do not limit the units themselves, for example, a first acquisition unit may be described as a "unit for acquiring at least two Internet Protocol addresses."

[0125] The functions described herein may be performed, at least in part, by at least one hardware logic component. For example, without limitation, exemplary types of hardware logic components that may be used include Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Parts (ASSPs), Systems on Chips (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0126] In the context of this disclosure, a machine-readable storage medium may be a tangible medium that may contain or store a program for use by or in combination with an instruction execution system, device, or device. The machine-readable storage medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable storage medium includes, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination thereof. Examples of machine-readable storage media include at least one wire-based electrical connection, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0127] According to one or more embodiments of the present disclosure, [Example 1] provides an image processing method, which includes: displaying collected images to be processed on a main screen in response to detecting that an image processing condition is satisfied; and displaying at least one effect thumbnail on an effect display screen different from the main screen, where each effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon.

[0128] According to one or more embodiments of the present disclosure, [Example 2] provides an image processing method, the method further including: determining a target effect based on a trigger operation on the at least one effect thumbnail; performing effect processing on the image to be processed, obtaining a target effect image corresponding to the target effect, and displaying the target effect image on the main screen, where a display effect of the target effect image corresponds to a display effect of an effect cover of the target effect.

[0129] According to one or more embodiments of the present disclosure, [Example 3] provides an image processing method, optionally further including: determining an effect cover image corresponding to each effect icon; and generating an effect thumbnail based on the effect icon and the corresponding effect cover image, where the effect cover image includes a static cover image or a dynamic cover image.

[0130] According to one or more embodiments of the present disclosure, [Example 4] provides an image processing method, which optionally includes: for each effect icon, obtaining a historical effect video and corresponding effect attributes associated with the current effect icon; determining a target historical effect video from the historical effect video based on the effect attributes; and determining an effect cover of the current effect icon based on the target historical effect video.

[0131] According to one or more embodiments of the present disclosure, [Example 5] provides an image processing method, which optionally includes determining one or more video frames from a target historical effect video as effect images for a current effect icon.

[0132] According to one or more embodiments of the present disclosure, [Example 6] provides an image processing method, which optionally includes determining an effect cover corresponding to an effect icon based on an effect creation video corresponding to the effect icon uploaded by a target user.

[0133] According to one or more embodiments of the present disclosure, [Example 7] provides an image processing method, which optionally further includes, in response to detecting that a trigger operation on the effect display screen satisfies a predetermined condition, adjusting a display size of the effect display screen arranged in a tiled manner on the main screen, and displaying a plurality of effect thumbnails on the effect display screen.

[0134] According to one or more embodiments of the present disclosure, [Example 8] provides an image processing method, which optionally further includes, when a display ratio between the display size and a screen size of a main screen reaches a predetermined display ratio, popping up a preview window corresponding to the main screen, and displaying the image to be processed or a target effect image corresponding to the image to be processed in the preview window, where the window size of the preview window is smaller than the display size.

[0135] According to one or more embodiments of the present disclosure, [Example 9] provides an image processing method, which optionally further includes, in response to detecting that the preview window is being dragged, adjusting a display position of the preview window on an effect display screen based on the drag trajectory.

[0136] According to one or more embodiments of the present disclosure, [Example 10] provides an image processing method, which optionally further includes adjusting a window size of a preview window on an effect display screen in response to detecting an operation that triggers a pinch out or pinch in on the preview window.

[0137] According to one or more embodiments of the present disclosure, [Example 11] provides an image processing method, which optionally further includes, in response to detecting that a trigger operation on a preview window and / or an effect display screen satisfies a return condition, returning to a main screen to display the collected image to be processed or a target effect image, and displaying at least one default screen of thumbnails on an effect display screen different from the main screen.

[0138] According to one or more embodiments of the present disclosure, [Example 12] provides an image processing device, the device including: a processed image display module and an effect thumbnail display module, the processed image display module is configured to display collected images to be processed on a main screen in response to detecting that an image processing condition is satisfied; and the effect thumbnail display module is configured to display at least one effect thumbnail on an effect display screen different from the main screen, where each effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon.

[0139] Those skilled in the art should understand that the scope of the present disclosure is not limited to the specific combination of the above technical features, and also includes other embodiments formed by any combination of the above technical features or their equivalent features (for example, the above features are formed by mutually replacing technical features having similar functions (not limited to) disclosed in the present disclosure) as long as they do not deviate from the idea of ​​the above disclosure.

[0140] Also, although operations are described in a particular order, these operations do not have to be performed in the particular order or sequence shown. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although the above includes several implementation details, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of a single embodiment may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments alone or in any suitable subcombination.

[0141] Although the present subject matter has been described in language specific to structural features and / or method logic acts, it is to be understood that claimed subject matter is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. In response to detecting that the image processing condition is satisfied, displaying the collected image to be processed on the main screen; displaying at least one effect thumbnail on an effect display screen different from the main screen; Here, each effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon. Image processing methods.

2. determining a target effect based on a trigger operation on the at least one effect thumbnail; The method further includes: performing effect processing on the image to be processed, obtaining a target effect image corresponding to the target effect, and displaying the target effect image on the main screen; Here, the display effect of the target effect image corresponds to the display effect of the effect cover of the target effect. The image processing method according to claim 1 .

3. determining an effect cover corresponding to each effect icon; generating the effect thumbnail based on each effect icon and a corresponding effect cover; Here, the effect cover includes a static cover image or a dynamic cover image. The image processing method according to claim 1 .

4. Deciding which effect cover corresponds to which effect icon is For each effect icon, obtain a historical effect video and corresponding effect attributes associated with the current effect icon; determining a target historical effect animation from the historical effect animation based on the effect attributes; determining an effect image of the current effect icon based on the target historical effect image. The image processing method according to claim 3 .

5. determining an effect cover of the current effect icon based on the target historical effect video; determining one or more video frames from the target historical effect video as effect frames for the current effect icon; The image processing method according to claim 4.

6. Deciding which effect cover corresponds to which effect icon is determining an effect cover corresponding to the effect icon based on an effect creation video corresponding to the effect icon uploaded by the target user; The image processing method according to claim 3 .

7. and adjusting a display size of the effect display screens arranged in a tiled pattern on the main screen in response to detecting that a trigger operation on the effect display screen satisfies a predetermined condition, and displaying a plurality of effect thumbnails on the effect display screens. The image processing method according to claim 1 .

8. further comprising: popping up a preview window corresponding to the main screen when a display ratio between the display size and a screen size of the main screen reaches a predetermined display ratio, and displaying the image to be processed or a target effect image corresponding to the image to be processed in the preview window; Here, the window size of the preview window is smaller than the display size. The image processing method according to claim 7.

9. The method further includes adjusting the display position of the preview window on the effect display screen based on the drag trajectory in response to detecting that the preview window is being dragged. The image processing method according to claim 8.

10. The method further includes adjusting a window size of the preview window on the effect display screen in response to detecting an operation that triggers a pinch out or a pinch in on the preview window. The image processing method according to claim 8.

11. The method further includes returning to a main screen to display the collected image to be processed or the target effect image in response to detecting that a trigger operation on at least one of the preview window and the effect display screen satisfies a return condition, and displaying at least one default screen of thumbnails on an effect display screen different from the main screen. The image processing method according to claim 8.

12. including a processed image display module and an effect thumbnail display module; The processed image display module is configured to display the collected image to be processed on a main screen in response to detecting that an image processing condition is satisfied; the effect thumbnail display module is configured to display at least one effect thumbnail on an effect display screen different from the main screen; Here, each effect thumbnail includes an effect icon and an effect cover corresponding to the effect icon. Image processing device.

13. one or more processors and a storage device; the storage device is configured to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the image processing method according to any one of claims 1 to 11. electronic equipment.

14. A storage medium containing computer-executable instructions which, when executed by a computer processor, cause the computer processor to perform the image processing method of any one of claims 1 to 11.

Images