Image processing method, apparatus, electronic device, medium, and program product

Abstract

The present application relates to an image processing method, apparatus, electronic device, medium, and program product, and is used in the field of Internet technology. The method includes obtaining an image to be processed, obtaining target effect materials that match the image to be processed, rendering the image to be processed based on the target effect materials to generate a dynamic image corresponding to the image to be processed, automatically presenting the dynamic image, and generating and presenting video content in response to a click operation on the dynamic image.

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This application claims priority based on a Chinese application with an application number of 202210798152.5 and a filing date of July 6, 2022. The disclosure content of this Chinese application is hereby incorporated into this application in its entirety.

[0002] [Technical Field] This application relates to the field of Internet technologies, and in particular, to an image processing method, apparatus, electronic device, medium, and program product.

Background Art

[0003] Currently, among the mainstream Internet content ecosystems, the video ecosystem is relatively in line with user preferences. Users can generate video content and contribute to the video ecosystem with the video content.

Summary of the Invention

Problems to be Solved by the Invention

[0004] To solve the above - mentioned technical problems or at least partially solve the above - mentioned technical problems, this application provides an image processing method, apparatus, electronic device, medium, and program product.

Means for Solving the Problems

[0005] According to a first aspect of this application, an image processing method is provided. This method includes: obtaining an image to be processed; obtaining target effect materials matching the image to be processed; rendering the image to be processed based on the target effect materials to generate a dynamic image corresponding to the image to be processed; automatically presenting the dynamic image; including generating and presenting video content in response to a click operation on the dynamic image.

[0006] According to some embodiments of the present application, obtaining an image to be processed may include when detecting a preview operation on the currently captured image, obtaining the currently captured image and using the currently captured image as the image to be processed. The above-mentioned automatically presenting the dynamic image may include automatically presenting the dynamic image on the preview interface of the currently captured image.

[0007] According to some embodiments of the present application, obtaining an image to be processed may include, when detecting entering the album interface, obtaining images of a preset number of minutes closest to the current time, and using at least one of the obtained images of the preset number of minutes as the image to be processed. The above-mentioned automatically presenting the dynamic image may include automatically presenting at least one of the dynamic images on the album interface.

[0008] According to some embodiments of the present application, obtaining target effect materials matching the image to be processed may include selecting target effect materials from each effect material in the material library based on the usage status information of each effect material in the material library, and / or identifying the image to be processed to obtain feature information of the image to be processed, and obtaining target effect materials matching the image to be processed based on the feature information of the image to be processed.

[0009] According to some embodiments of the present application, the usage information may include the last usage time and / or the number of usage times. Based on the usage information of each effect material in the material library, selecting a target effect material from each of the effect materials may include: sorting each effect material in the material library based on the last usage time to obtain a first sorting result; sorting each effect material in the material library based on the number of usage times to obtain a second sorting result; selecting a target effect material from each of the effect materials based on the first sorting result and / or the second sorting result.

[0010] According to some embodiments of the present application, rendering the image to be processed based on the target effect material and generating a dynamic image corresponding to the image to be processed may include: reading a single target effect material; constructing a rendering timestamp of the target effect material; creating a material texture corresponding to the target effect material; creating an image texture corresponding to the image to be processed; texture-blending the material texture and the image texture, associating with the rendering timestamp, and generating a dynamic image corresponding to the image to be processed.

[0011] According to some embodiments of the present application, generating video content in response to a click operation on the dynamic image may include: acquiring audio data, decrypting the audio data to obtain pulse code modulation data; decrypting the image to be processed to obtain original image data, and creating a texture corresponding to the original image data; Creating a material texture corresponding to the target effect material; Combining the texture corresponding to the original image data and the material texture corresponding to the target effect material to obtain a combined texture; It may include combining and encoding the combined texture and the pulse-coded modulation data to generate video content.

[0012] According to a second aspect of the present application, an image processing apparatus is provided. This image processing apparatus includes: An image acquisition module for the image to be processed to acquire the image to be processed; A target effect material acquisition module for acquiring a target effect material that matches the image to be processed; A dynamic image generation module for rendering the image to be processed based on the target effect material and generating a dynamic image corresponding to the image to be processed; A dynamic image presentation module for automatically presenting the dynamic image; A video content generation module for generating video content in response to a click operation on the dynamic image; It may include a video content presentation module for presenting the video content.

[0013] According to some embodiments of the present application, when the image acquisition module for the image to be processed detects a preview operation on the currently captured image, it may acquire the currently captured image and use the currently captured image as the image to be processed. The dynamic image presentation module may further be used to automatically present the dynamic image on the preview interface of the currently captured image.

[0014] According to some embodiments of the present application, when the image acquisition module to be processed further detects that it has entered the album interface, it may obtain images of a preset number of minutes closest to the current time, and at least one of the obtained images of the preset number of minutes may be used as the image to be processed. The dynamic image presentation module may further be used to automatically present at least one of the dynamic images in the album interface.

[0015] According to some embodiments of the present application, the target effect material acquisition module may further select a target effect material from each effect material in the material library based on the usage status information of each effect material in the material library, and / or identify the image to be processed, obtain the feature information of the image to be processed, and obtain a target effect material that matches the image to be processed based on the feature information of the image to be processed.

[0016] According to some embodiments of the present application, the usage status information includes the last usage time and / or the usage frequency, and the target effect material acquisition module may further sort each effect material in the material library based on the last usage time to obtain a first sorting result; sort each effect material in the material library based on the usage frequency to obtain a second sorting result; select a target effect material from each effect material based on the first sorting result and / or the second sorting result, and may be used to realize selecting a target effect material from each effect material based on the usage status information of each effect material in the material library.

[0017] According to some embodiments of the present application, the dynamic image generation module may further be used to read a single target effect material, configure the rendering timestamp of the target effect material, create a material texture corresponding to the target effect material, create an image texture corresponding to the image to be processed, texture blend the material texture and the image texture, and associate it with the rendering timestamp to generate a dynamic image corresponding to the image to be processed.

[0018] According to some embodiments of the present application, the video content generation module may further be used to obtain audio data, decode the audio data to obtain pulse code modulation data, decode the image to be processed to obtain original image data, create a texture corresponding to the original image data, create a material texture corresponding to the target effect material, synthesize the texture corresponding to the original image data and the material texture corresponding to the target effect material to obtain a synthesized texture, and synthesize and encode the synthesized texture and the pulse code modulation data to generate video content.

[0019] According to a third aspect of the present application, an electronic device is provided, which includes a processor and a memory. When executed by the processor, the memory stores a computer program and / or instructions for implementing the method described in the first aspect of the present application.

[0020] According to a fourth aspect of the present application, a computer-readable storage medium is provided, on which a computer program and / or instructions for implementing the method described in the first aspect of the present application are stored when executed by a processor.

[0021] According to a fifth aspect of the present application, there is provided a computer program product, which, when running on a computer, includes a computer program and / or instructions for causing the computer to execute the method described in the first aspect of the present application.

[0022] According to a sixth aspect of the present application, the present disclosure provides a computer program, which, when executed by a processor, includes program code for implementing the method described in the first aspect of the present application.

Brief Description of the Drawings

[0023] The drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present application and used to interpret the principles of the present application together with the specification.

[0024] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following briefly introduces the drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative efforts.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Best Mode for Carrying Out the Invention

[0025] To better understand the above objects, features, and advantages of the present application, the following further describes the solutions of the present application. It should be noted that, unless there is a conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.

[0026] In the following description, many specific details are set forth to facilitate a thorough understanding of the present application. However, the present application may be implemented using other methods different from those described herein. Obviously, the embodiments in the specification are only some embodiments of the present application, not all embodiments.

[0027] In Internet applications, many users share their work and life by creating videos and uploading them to social platforms (such as short video platforms). For example, users can shoot images and / or videos using a camera shooting application, perform editing on the images and / or videos, and then generate a video using a video production tool and upload it to a social platform.

[0028] However, in camera shooting applications, since video content is relatively easy to attract other users, users shoot more image content using camera shooting applications, and generally only store the images locally after shooting, and the propagation value of image content is relatively low. Although users can generate video content based on image content, the propagation value of the image content generated by camera shooting applications is still relatively low.

[0029] To solve the above problems, embodiments of the present application provide an image processing method, apparatus, electronic device, medium, and program product for improving the conversion rate of converting an image into a video. Since the video ecology is relatively in line with the user's preferences, the dissemination value of the image content captured by the camera shooting system application can be improved.

[0030] In particular, in some embodiments of the present application, for an image to be processed in a camera shooting system application (for example, an image captured by a user in real time, or an image already stored in an album), a target effect material that matches the image to be processed is obtained, and based on the target effect material, the image to be processed is rendered, and a dynamic image corresponding to the image to be processed can be generated. Compared with the static image to be processed, the dynamic image is clearer and more vivid. By automatically presenting the dynamic image, the user can be guided to generate video content based on the image to be processed, and the conversion rate of converting the image into a video can be improved. Since the video ecology is relatively in line with the user's preferences, by improving the conversion rate of converting the image into a video, the dissemination value of the image content generated by the conventional camera shooting system application can be improved.

[0031] Referring to FIG. 1, FIG. 1 shows a schematic diagram of the system architecture of an exemplary application environment of an image processing method applicable to an embodiment of the present application. The system architecture 100 includes a terminal device 101, a network 102, and a server 103. The network 102 is a medium for providing a communication link between the terminal device 101 and the server 103. The network 102 may include various connection types, such as wired, wireless communication links, or optical fiber cables. The terminal device 101 includes, but is not limited to, a desktop computer, a portable computer, a smartphone, a tablet computer, etc. A camera shooting system application may be installed on the terminal device 101, and the user may shoot an image or video with this camera shooting system application and view this image or video in the album. The server 103 may be a server corresponding to this camera shooting system application.

[0032] It should be understood that the numbers of the terminal device, network, and server in FIG. 1 are schematic. Depending on the requirements of implementation, any number of terminal devices, networks, and servers may be provided. For example, the server 103 may be a server cluster composed of multiple servers, etc.

[0033] The image processing method according to the embodiment of this application may be executed by a camera shooting system application in the terminal device 101. For example, the user shoots through the camera shooting system application in the terminal device 101 to generate an image, and this image is the image to be processed. The camera shooting system application can obtain this image to be processed from the terminal device 101, and can obtain target effect materials matching the image to be processed from the local material library of the terminal device 101 and / or the server 103. This target effect material is an effect material for generating a dynamic image. Based on the target effect material, the image to be processed is rendered to generate a dynamic image corresponding to the image to be processed. By automatically presenting the dynamic image, the user is guided to generate corresponding video content based on the image to be processed.

[0034] Referring to FIG. 2, FIG. 2 is a schematic diagram of the image processing method in the embodiment of this application. As can be seen from the figure, by generating a dynamic image corresponding to the image to be processed and automatically presenting this dynamic image, the user is guided to generate this video content based on the image to be processed, and the conversion rate of converting the image into a video can be improved. Furthermore, the propagation value of the image to be processed is improved.

[0035] Referring to FIG. 3, FIG. 3 is a flowchart of the image processing method in the embodiment of this application, and may include the following steps.

[0036] Step S310, obtain the image to be processed.

[0037] Step S320, obtain target effect materials matching the image to be processed.

[0038] Step S330, based on the target effect material, render the image to be processed to generate a dynamic image corresponding to the image to be processed.

[0039] Step S340: Automatically present a dynamic image.

[0040] Step S350: In response to a click operation on the dynamic image, generate and present video content.

[0041] For the image processing method of the embodiments of the present application, for an image to be processed in a camera shooting system application (for example, an image captured by a user in real time, or an image already stored in an album, etc.), a target effect material matching the image to be processed is obtained, and based on the target effect material, the image to be processed is rendered, and a dynamic image corresponding to the image to be processed can be generated. Compared with a static image to be processed, a dynamic image is clearer and more vivid. By automatically presenting the dynamic image, the user can be guided to generate this video content based on the image to be processed, and the conversion rate of converting the image into a video can be improved. Since the video ecology is relatively in line with the user's preferences, by improving the conversion rate of converting the image into a video, the propagation value of the image content generated by the conventional camera shooting system application can be improved.

[0042] The following will introduce the image processing method of the embodiments of the present application in more detail.

[0043] In step S310, obtain an image to be processed.

[0044] For a camera shooting system application, its core user path is for the user to capture an image and preview the shooting effect of the image. In some embodiments, the image to be processed may be an image captured by the user in real time by the camera shooting system application. When a preview operation on the currently captured image is detected, the currently captured image can be obtained and used as the image to be processed.

[0045] In addition, the user may enter the album interface of the camera shooting application and edit the images that have already been taken. In some embodiments, when it is detected that the user has entered the album interface, images of a preset number of minutes closest to the current time are acquired, and at least one of the acquired images of the preset number of minutes is set as the image to be processed. The preset number may be 1 or an integer greater than 1. For example, the 8 images closest to the current time may be acquired, that is, 8 images to be processed may be acquired. Also, for example, the 8 images closest to the current time may be acquired, and several of them may be selected as the images to be processed, for example, randomly selected, or selected according to the chronological order, image attributes, etc. When acquiring multiple images to be processed, the same processing process may be executed for each image to be processed.

[0046] In step S320, a target effect material that matches the image to be processed is acquired.

[0047] The developer of the camera shooting application can generate effect materials by an effect editing tool (i.e., an editor) for the user to use. The types of effect materials include filters, makeup, effects, videos, stickers, characters, audio, etc. In this way, when taking an image, the user may directly select the effect material that the user is interested in and generate an image including this effect material. Or, after taking and generating an image, the user may edit this image to generate an image including this effect material.

[0048] The target effect material is an effect material that matches the image to be processed. Each terminal device may have a corresponding material library locally, and various effect materials are stored in the material library. For example, when editing an image, the user may first download an effect material and then use this effect material, and this downloaded effect material may be stored in the local material library. As can be understood, this material library may be continuously updated. Regarding the effect materials in the material library, the user does not need to download them from the network and can directly use them next time. In some embodiments, after obtaining the user's permission, the usage status information of each effect material in the material library is obtained, and based on the usage status information of each effect material in the material library, the target effect material may be selected from each effect material.

[0049] According to some embodiments of the present application, the usage status information of a single effect material includes, but is not limited to, the last usage time of the effect material and / or the number of times this effect material is used. Based on the usage status information of each effect material in the material library, each effect material may be sorted based on the last usage time to obtain a first sorting result. For example, each effect material is sorted in ascending order of the last usage time, and the higher the sorting of the effect material, the closer the last usage time of this effect material is to the current time.

[0050] Similarly, each effect material in the material library may be sorted based on the number of times used to obtain a second sorting result. For example, sort in descending order of the number of times used to obtain a second sorting result. The higher the sorting of the effect material, the more times the user uses this effect material, indicating that this effect material is preferred by the user.

[0051] Subsequently, based on the first sorting result and / or the second sorting result, target effect materials are selected from each effect material. For example, the first N1 effect materials can be selected from the first sorting result, and the first N2 effect materials can be selected from the second sorting result. The intersection of the first N1 effect materials and the first N2 effect materials can be selected as the target effect materials. Or, the union of the first N1 effect materials and the first N2 effect materials can be selected as the target effect materials, etc.

[0052] In some embodiments, from each effect material in the material library, effect materials whose last usage time is less than a preset time period (e.g., within one week) from the current time can be selected, and effect materials whose usage times are greater than a preset number of times (e.g., 5 times, etc.) can be selected. Furthermore, the intersection of both can be selected as the target effect materials, etc.

[0053] Not only can target effect materials be obtained from the material library, but on the premise of obtaining user consent, the image to be processed can also be identified and the feature information of the image to be processed can be obtained. For example, due to the characteristics of camera shooting system applications, the captured images are generally divided into three categories: portraits, landscapes, and objects. When further segmented according to the features of the images, portrait features can be divided into gender features, facial features, age features, etc.; landscape features can be divided into urban architecture features, weather features, plant features, etc.; object features can be further segmented into interest features, etc. For example, if the object included in the image is a soccer ball, it can be analyzed that the user may be interested in sports, and thus the interest feature can be obtained. Based on the feature information of the image to be processed, target effect materials that match the image to be processed can be obtained. For example, target effect materials can be obtained from the cloud. The effect materials in the cloud may be configured by the operator and may include effect materials pre-configured according to network hotspots and holidays. They can be changed according to changes in network hotspots and holidays and have relatively high flexibility.

[0054] In step S330, based on the target effect materials, the image to be processed is rendered to generate a dynamic image corresponding to the image to be processed.

[0055] In the embodiments of the present application, the image to be processed may be directly rendered using the target effect materials. The image to be processed may also be rendered according to a video template. The video template may be a template generated by a video creator during the video production process. The video template may include various different effect materials. Other users may use this video template to generate video contents with different contents but similar forms.

[0056] After obtaining the target effect material, a video template matching the target effect material may be obtained. Since one or more effect materials are used in a single video template, a correspondence relationship between the video template and the effect material may be established, and one video template may correspond to one or more effect materials. Based on this correspondence relationship, a video template corresponding to the target effect material, that is, a video template matching the target effect material, may be obtained. Based on the target effect material and the video template, an image to be processed may be rendered by a rendering tool (such as OpenGL), and a dynamic image corresponding to the image to be processed may be generated.

[0057] Since the rendering of the dynamic image includes multiple frames, the material information included in the dynamic image can add the concept of a time interval, and therefore, a material dynamic image rendering protocol can be designed. The material dynamic image rendering protocol may include related texture parameters, such as rendering width, rendering height, rendering level, rendering start timestamp, rendering end timestamp, and the like. Referring to FIG. 4, the flow of generating a dynamic image according to the material dynamic image rendering protocol may include the following steps.

[0058] Step S410, read a single target effect material.

[0059] Step S420, configure the rendering timestamp of the target effect material.

[0060] Step S430, create a material texture corresponding to the target effect material.

[0061] In the embodiments of the present application, the texture parameters of the target effect material may be configured according to the material dynamic image rendering protocol, for example, the texture width, texture height, texture transparency, etc. may be configured.

[0062] Step S440: Determine whether this target effect material is the last target effect material.

[0063] If the target effect material is the last target effect material, execute step S450; otherwise, return to step S410, read the next target effect material, and repeat the execution of the above steps until the processing of the last target effect material is completed.

[0064] Step S450: Create an image texture corresponding to the image to be processed.

[0065] Step S460: Texture blend the material texture and the image texture, associate it with the rendering timestamp, and generate a dynamic image corresponding to the image to be processed.

[0066] For example, the number of target effect materials is two, which are a filter and a particle animation respectively. By the above method, the material texture of the filter is created in sequence, for example, texture parameters can be configured, and the rendering timestamp of the filter can be configured. The material texture of the particle animation is created, for example, texture parameters can be configured, and the rendering timestamp of the particle animation can be configured, and finally the image is converted into a particle animation with a filter effect.

[0067] In step S340, automatically present the dynamic image and guide the user to generate corresponding video content based on the image to be processed.

[0068] If the image to be processed is the currently captured image, a dynamic image may be automatically presented in the preview interface of the currently captured image. For example, the dynamic image may be presented in a pop-up window or in a jump manner. If the image to be processed is an image in an album, a plurality of dynamic images may be automatically presented in the album interface. For example, a plurality of dynamic images may be presented at the top of the album interface. Referring to FIG. 5, FIG. 5 is a schematic diagram of a scenario for generating a dynamic image in an embodiment of the present application, and may include two scenarios: a scenario where a user directly captures an image using a camera shooting system application, and a scenario where a user enters an album interface. Depending on different scenarios, a dynamic image may be presented to the user in order to guide the user to generate video content.

[0069] In step S350, in response to a click operation on the dynamic image, video content is generated and presented.

[0070] After presenting the dynamic image, in response to a click operation (such as a click operation or a double-click operation, etc.) on the dynamic image, video content may be generated and presented. For the dynamic images corresponding to each of the plurality of images to be processed, the user may slide from the plurality of dynamic images to select a dynamic image that the user is interested in, and generate the corresponding video content. As can be seen, the process of generating video content is simple and fast, and the user can directly experience it without the need for secondary operations.

[0071] It should be noted that, different from the method for generating a moving image described above, the method for generating video content has a relatively complex process for generating video content because the decoding of the video data stream has a relatively high complexity for images. In some embodiments, audio data (for example, audio data that may be composed of background) may be acquired, the audio data may be decoded, and pulse code modulation (PCM) data may be obtained. Decode the image to be processed, obtain the original image data (for example, it may be RGBA data), and create a texture corresponding to the original image data. Create a material texture corresponding to the target effect material, synthesize the texture corresponding to the original image data and the material texture corresponding to the target effect material, and obtain a synthesized texture. Synthesize the synthesized texture and the pulse code modulation data, encode them, and generate video content.

[0072] The image processing method according to the embodiments of the present application provides a moving image for converting an image into a video in a local real-time rendering manner when the user triggers the local generation of an image or enters the album interface, and guides the user to generate corresponding video content. By combining the characteristics of the camera shooting system application, cloud services, and image features, various effect materials are provided to the user, the richness and diversity of the conversion from an image to a video are improved, and the purpose of further enhancing the video conversion is achieved. According to the above guidance, the conversion rate of the user converting an image into a video can be improved. And when the user directly clicks on the moving image, the corresponding video content can be generated simply and quickly. Since the video ecology is relatively in line with the user's preferences, the propagation value of the image content generated by the conventional camera shooting system application can be improved.

[0073] According to the embodiments of the above method, the embodiments of the present application further provide an image processing apparatus. Referring to FIG. 6, the image processing apparatus 600 includes An image acquisition module 610 for acquiring an image to be processed A target effect material acquisition module 620 for acquiring a target effect material that matches the image to be processed, a dynamic image generation module 630 for rendering the image to be processed based on the target effect material and generating a dynamic image corresponding to the image to be processed, a dynamic image presentation module 640 for presenting the dynamic image and guiding the user to generate corresponding video content based on the image to be processed, a video content generation module 650 for generating video content in response to a click operation on the dynamic image, and a video content presentation module 660 for presenting the video content.

[0074] According to some embodiments of the present application, when the image acquisition module 610 to be processed detects a preview operation on the currently captured image, the currently captured image may be acquired and used as the image to be processed. The dynamic image presentation module 640 may further be used to automatically present the dynamic image in the preview interface of the currently captured image.

[0075] According to some embodiments of the present application, when the image acquisition module 610 to be processed detects that it has entered the album interface, it may acquire the images of the preset number of minutes closest to the current time, and at least one of the acquired preset number of minutes of images may be used as the image to be processed. The dynamic image presentation module 640 may further be used to automatically present at least one dynamic image in the album interface.

[0076] According to some embodiments of the present application, the target effect material acquisition module 620 may further select target effect materials from each effect material based on the usage status information of each effect material in the material library, and / or identify the image to be processed, obtain the feature information of the image to be processed, and based on the feature information of the image to be processed, obtain the target effect materials that match the image to be processed and / or the effect materials pre-configured according to network hotspots or holidays.

[0077] According to some embodiments of the present application, the usage status information includes the last usage time and / or the number of usage times, and the target effect material acquisition module 620 may further sort each effect material in the material library based on the last usage time to obtain a first sorting result; sort each effect material in the material library based on the number of usage times to obtain a second sorting result; select target effect materials from each effect material based on the first sorting result and / or the second sorting result, and may be used to realize the selection of target effect materials from each effect material based on the usage status information of each effect material in the material library.

[0078] According to some embodiments of the present application, the dynamic image generation module 630 may further be used to read a single target effect material, configure the rendering time stamp of the target effect material, create the material texture corresponding to the target effect material, create the image texture corresponding to the image to be processed, texture blend the material texture and the image texture, and associate it with the rendering time stamp to generate a dynamic image corresponding to the image to be processed.

[0079] According to some embodiments of the present application, the video content generation module 650 may further be used to obtain audio data, decrypt the audio data to obtain pulse code modulation data, decrypt the image to be processed to obtain image original data, create a texture corresponding to the image original data, create a material texture corresponding to the target effect material, synthesize the texture corresponding to the image original data and the material texture corresponding to the target effect material to obtain a synthesized texture, and synthesize and encode the synthesized texture and the pulse code modulation data to generate video content.

[0080] Since the specific details of each module or unit in the above device have already been described in detail in the corresponding method, no further description will be given here.

[0081] It should be noted that although some modules or units of the devices for performing operations are mentioned in the above detailed description, such a classification is not mandatory. In fact, according to the embodiments of the present application, the features and functions of the two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided and embodied in a plurality of modules or units.

[0082] In an exemplary embodiment of the present application, an electronic device is further provided, including a processor and a memory for storing executable instructions for the processor, where the processor is configured to execute the executable instructions to implement the image processing method according to the embodiments of the present application.

[0083] FIG. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application, where the image processing solution according to the embodiment of the present disclosure can be implemented. It should be noted that the electronic device 700 shown in FIG. 7 is only an example and should not impose any restrictions on the functions and usage scope of the embodiments of the present application.

[0084] As shown in FIG. 7, the electronic device 700 includes a central processing unit (CPU) 701, which can execute various appropriate operations and processes based on a program stored in a read-only memory (ROM) 702 or a program loaded from a storage section 708 into a random access memory (RAM) 703. Various programs and data necessary for system operations are stored in the RAM 703. The central processing unit 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0085] An input section 706 including a keyboard, a mouse, etc., an output section 707 including, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc., a storage section 708 including a hard disk, etc., and a communication section 709 including a network interface card such as a local area network (LAN) card, a modem, etc. are connected to the I / O interface 705. The communication section 709 executes communication processing via, for example, an Intercool network. A drive 710 is also connected to the I / O interface 705 as necessary. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as necessary, facilitating the installation of a computer program read from it into the storage section 708 as necessary.

[0086] In particular, according to the embodiments of the present application, the process described with reference to the above flowchart may be implemented as a computer software program. For example, the embodiments of the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and this computer program includes program code for executing the method shown in the flowchart. In such an embodiment, this computer program may be downloaded and installed from a network via the communication part 709, and / or installed from the removable media 711. When this computer program is executed by the central processing unit 701, various functions defined by the device of the present application are executed.

[0087] In the embodiments of the present application, a computer-readable storage medium is further provided, on which a computer program is stored, and when the computer program is executed by a processor, the above image processing method is realized.

[0088] It should be noted that the computer-readable storage medium shown in this application may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof, but not limited thereto. More specific examples of computer-readable storage media may include electrical connections having one or more conductors, portable computers, magnetic disks, hard disks, random access memories, read-only memories, erasable programmable read-only memories (EPROMs or flash memories), optical fibers, portable compact disc read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination of the above, but not limited thereto. In this application, the computer-readable storage medium may be any tangible medium that contains or stores a program, and this program may be used by or in combination with an instruction execution system, apparatus, or device. The program code included in the computer-readable storage medium can be transmitted through any suitable medium, including but not limited to wireless, electrical wires, optical cables, radio frequencies, etc., or any suitable combination of the above.

[0089] In an embodiment of this application, a computer program product is further provided. When the computer program product runs on a computer, it causes the computer to execute the above image processing method.

[0090] In an embodiment of this application, a computer program is further provided. The computer program includes program code. When the program code is executed by a processor, it realizes the image processing method described in the embodiments of this disclosure.

[0091] It should be noted that in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. And the term "comprising", "including" or any other variation thereof is intended to cover non-exclusive "including", so that a process, method, article or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements specific to such a process, method, article or device. In the absence of further limitations, an element limited by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article or device comprising the said element.

[0092] The above are only specific embodiments of the present application and enable those skilled in the art to understand or implement the present application. Various modifications to these examples will be apparent to those skilled in the art, but the general principles defined in this specification may be implemented in other examples without departing from the spirit or scope of the present application. Therefore, the present application is not limited to these examples described in this specification, but conforms to the broadest scope consistent with the principles and novel features disclosed in this specification.

Claims

1. obtaining an image to be processed; obtaining a target effect material that matches the image to be processed; rendering the image to be processed based on the target effect material to generate a dynamic image corresponding to the image to be processed; automatically presenting the dynamic image; generating and presenting video content in response to a click operation on the dynamic image, the image processing method comprising:

2. The obtaining of the image to be processed includes, when detecting a preview operation on the currently captured image, obtaining the currently captured image and using the currently captured image as the image to be processed; The automatically presenting of the dynamic image includes automatically presenting the dynamic image on a preview interface of the currently captured image, the method according to claim 1.

3. The obtaining of the image to be processed includes, when detecting entry into an album interface, obtaining images of a preset number of minutes closest to the current time, and using at least one of the obtained images of the preset number of minutes as the image to be processed; The automatically presenting of the dynamic image includes automatically presenting at least one dynamic image on the album interface, the method according to claim 1.

4. The obtaining of the target effect material that matches the image to be processed includes selecting a target effect material from each effect material based on usage status information of each effect material in a material library, and / or identifying the image to be processed to obtain feature information of the image to be processed, and obtaining a target effect material that matches the image to be processed based on the feature information of the image to be processed, the method according to claim 1.

5. The usage status information includes the last usage time and / or the number of usage times, and The selecting of the target effect material from each effect material based on the usage status information of each effect material in the material library includes sorting each effect material in the material library based on the last usage time to obtain a first sorting result; Sorting each effect material in the material library based on the number of uses to obtain a second sorting result; The method according to claim 4, comprising selecting a target effect material from each of the effect materials based on the first sorting result and / or the second sorting result.

6. The rendering of the image to be processed based on the target effect material to generate a dynamic image corresponding to the image to be processed is: Reading a single target effect material; Constructing a rendering time stamp of the target effect material; Creating a material texture corresponding to the target effect material; Creating an image texture corresponding to the image to be processed; The method according to claim 1, comprising texture blending the material texture and the image texture and associating with the rendering time stamp to generate a dynamic image corresponding to the image to be processed.

7. Generating video content in response to a click operation on the dynamic image is: Obtaining audio data, decrypting the audio data to obtain pulse code modulation data; Decrypting the image to be processed to obtain image original data, and creating a texture corresponding to the image original data; Creating a material texture corresponding to the target effect material; Synthesizing the texture corresponding to the image original data and the material texture corresponding to the target effect material to obtain a synthesized texture; The method according to claim 1, comprising synthesizing and encoding the synthesized texture and the pulse code modulation data to generate video content.

8. An image acquisition module to be processed for acquiring an image to be processed; A target effect material acquisition module for acquiring a target effect material that matches the image to be processed; A dynamic image generation module for rendering the image to be processed based on the target effect material to generate a dynamic image corresponding to the image to be processed; A dynamic image presentation module for automatically presenting the dynamic image; A video content generation module for generating video content in response to a click operation on the dynamic image. An image processing apparatus including a video content presentation module for presenting the video content.

9. An electronic device including a processor and a memory, wherein the memory stores a computer program and / or instructions for realizing the image processing method according to any one of claims 1 to 7 when executed by the processor.

10. A computer-readable storage medium storing a computer program and / or instructions for realizing the image processing method according to any one of claims 1 to 7 when executed by a processor.

11. A computer program product including a computer program and / or instructions for causing a computer to execute the image processing method according to any one of claims 1 to 7 when the computer program product runs on the computer.

12. A computer program including program code used to realize the image processing method according to any one of claims 1 to 7 when executed by a processor.

Images