Material generation method, image processing method and device

Abstract

This application provides a material generation method, image processing method, and apparatus, wherein the material generation method includes: providing raw material on an operation interface; determining adjustment parameters for the material to be generated in response to a user's parameter adjustment operation on the operation interface; and compiling and processing the generation code of the raw material based on the adjustment parameters to obtain the material to be generated. This solution solves the problem of low material generation efficiency caused by the need to manually add materials one by one, achieving the technical effect of generating materials based on material code and parameter adjustment.

Description

Technical Field

[0001] The present application belongs to the field of data processing technology, and in particular relates to a material generation method, an image processing method and a device. Background Art

[0002] Image libraries store multiple assets, which are typically designed and uploaded one by one by designers. Typically, designers need to design the required assets based on design requirements, and can only design one asset at a time. This results in significant manpower and financial costs associated with creating an asset library.

[0003] To address the above issues, no effective solutions have been proposed so far. Summary of the Invention

[0004] The purpose of this application is to provide a material generation method, image processing method and device, which can simply and efficiently generate materials that meet the requirements.

[0005] This application provides a material generation method, image processing method and device which are implemented as follows:

[0006] A material generation method, comprising:

[0007] Provide original materials on the operation interface;

[0008] In response to a parameter adjustment operation of a user on the operation interface, determining adjustment parameters of the material to be generated;

[0009] Based on the adjustment parameters, the generation code of the original material is compiled to obtain the material to be generated.

[0010] A material generation method, comprising:

[0011] Providing original material on the operation interface, wherein the original material is dynamic material;

[0012] In response to the user's operation on the operation interface, determining the adjustment parameters of the dynamic material to be generated;

[0013] Based on the adjustment parameters, the generation code of the original material is compiled to obtain the dynamic material to be generated.

[0014] An image processing method, comprising:

[0015] Get the image to be processed uploaded by the user;

[0016] Matching original materials for the image to be processed from a material library, and fusing the original materials with the image to be processed to obtain an initial fused image;

[0017] receiving a user's parameter adjustment of the original material;

[0018] According to the parameter adjustment of the original material, the initial fused image is adjusted to generate an adjusted fused image.

[0019] An image processing method, comprising:

[0020] Get the image to be processed uploaded by the user;

[0021] Determining original materials to be fused, where the original materials are generated by compiling the generated code;

[0022] Based on the generation code of the original material, a fusion material matching the image to be processed is generated, so as to fuse the fusion material with the image to be processed.

[0023] A material generating device, comprising:

[0024] Provide a module for providing original materials on the operation interface;

[0025] a determination module, configured to respond to a parameter adjustment operation by a user on the operation interface and determine adjustment parameters of the material to be generated;

[0026] The compiling module is used to compile the generation code of the original material based on the adjustment parameters to obtain the material to be generated.

[0027] A material generating device, comprising:

[0028] Providing a module for providing original material on the operation interface, wherein the original material is a dynamic material;

[0029] A determination module, configured to respond to user operations on the operation interface and determine adjustment parameters of the dynamic material to be generated;

[0030] The compiling module is used to compile the generation code of the original material based on the adjustment parameters to obtain the dynamic material to be generated.

[0031] An image processing device, comprising:

[0032] The acquisition module is used to obtain the image to be processed uploaded by the user;

[0033] A matching module, configured to match an original material for the image to be processed from a material library, and fuse the original material with the image to be processed to obtain an initial fused image;

[0034] A receiving module, configured to receive parameter adjustments made by a user on the original material;

[0035] The adjustment module is used to adjust the initial fused image according to the parameter adjustment of the original material to generate an adjusted fused image.

[0036] An image processing device, comprising:

[0037] The acquisition module is used to obtain the image to be processed uploaded by the user;

[0038] A determination module, configured to determine original materials to be fused, wherein the original materials are generated by compiling the generated code;

[0039] The generation module is used to generate a fusion material that matches the image to be processed based on the generation code of the original material, so as to fuse the fusion material with the image to be processed.

[0040] A processing device includes a processor and a memory for storing processor-executable instructions, wherein when the processor executes the instructions, the following steps are implemented:

[0041] Provide original materials on the operation interface;

[0042] In response to a parameter adjustment operation of a user on the operation interface, determining adjustment parameters of the material to be generated;

[0043] Based on the adjustment parameters, the generation code of the original material is compiled to obtain the material to be generated.

[0044] A processing device includes a processor and a memory for storing processor-executable instructions, wherein when the processor executes the instructions, the following steps are implemented:

[0045] Get the image to be processed uploaded by the user;

[0046] Matching original materials for the image to be processed from a material library, and fusing the original materials with the image to be processed to obtain an initial fused image;

[0047] receiving a user's parameter adjustment of the original material;

[0048] According to the parameter adjustment of the original material, the initial fused image is adjusted to generate an adjusted fused image.

[0049] A computer-readable storage medium having computer instructions stored thereon, wherein the instructions, when executed, implement the steps of the following method:

[0050] Provide original materials on the operation interface;

[0051] In response to a parameter adjustment operation of a user on the operation interface, determining adjustment parameters of the material to be generated;

[0052] Based on the adjustment parameters, the generation code of the original material is compiled to obtain the material to be generated.

[0053] A computer-readable storage medium having computer instructions stored thereon, wherein the instructions, when executed, implement the steps of the following method:

[0054] Get the image to be processed uploaded by the user;

[0055] Matching original materials for the image to be processed from a material library, and fusing the original materials with the image to be processed to obtain an initial fused image;

[0056] receiving a user's parameter adjustment of the original material;

[0057] According to the parameter adjustment of the original material, the initial fused image is adjusted to generate an adjusted fused image.

[0058] The material generation method, image processing method, and device provided by the present application provide original materials on an operation interface, and users can perform parameter adjustment operations on the operation interface. According to the user's parameter adjustment operations, the adjustment parameters of the material to be generated can be determined. Based on these adjustment parameters, the generation code of the original material can be compiled and processed to obtain the material to be generated. That is, the original material can be generated based on the material code, and then the user can adjust the parameters based on the original material, and then compile the code to obtain the new material. The above solution solves the problem of low material generation efficiency caused by the need for existing materials to be added one by one manually, and achieves the technical effect of simply and efficiently generating the desired material. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in this application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0060] Figure 1 This is the architecture diagram of the material generation system provided by this application;

[0061] Figure 2 It is a method flow chart of the material generation method provided by this application;

[0062] Figure 3 This is a schematic diagram of the process of the material generation and image synthesis system provided by this application;

[0063] Figure 4This is a schematic diagram of the visual parameter adjustment interface provided by this application;

[0064] Figure 5 This is a schematic diagram of the effect of the product object + solid color background + dynamic elements provided by this application;

[0065] Figure 6 This is a schematic diagram of the product object + dynamic effect + background image provided by this application;

[0066] Figure 7 This is a schematic diagram of the architecture of the computer terminal provided by this application;

[0067] Figure 8 This is a structural block diagram of the material generation device provided in this application. DETAILED DESCRIPTION

[0068] In order to enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0069] In order to solve the problem that the existing material generation process requires a lot of manpower and financial resources, this example provides a material generation system, such as Figure 1 As shown, it may include: user 101 , display device 102 and processing device 103 .

[0070] The user 101 may have different attributes in different scenarios. For example, the user may be a material designer or a material user. If the user is a material designer, they can generate new materials by adjusting parameters. If the user is a material user, they can adjust parameters to generate materials that meet their needs or requirements and use the generated materials.

[0071] The display device 102 may be a single display with display function, or a device integrated with the processing device 103 , that is, the display device and the processing device may be integrated or separately provided, and this application does not limit this.

[0072] The processing device 103 can provide raw material on an operation interface; in response to a user's parameter adjustment operation on the operation interface, determine adjustment parameters for the material to be generated; and, based on the adjustment parameters, compile the generation code for the raw material to obtain the material to be generated. Specifically, the processing device 103 can provide a material upload interface; then, receive the generation code for the raw material uploaded via the upload interface, and visually display the raw material on the display device 102 based on the generation code.

[0073] Specifically, the generated code for the raw material can be encoded using a visually displayable encoding method, such as, but not limited to, P5.js, Three.js, vanta.js, cables.js, and Unity, as the coding method selected for technology selection. This allows for a visual display of the raw generated code, creating a visual interface for adjustable parameters.

[0074] Specifically, when compiling the generated code of the original material, the parameters of the corresponding element code in the generated code of the original material can be updated based on the adjustment parameters; and the updated generated code is compiled. That is, the original code is the production code of the original material, which already has some parameter settings or parameter value ranges. After the user adjusts the parameters on the visual interface, these adjustments will update the parameter settings in the code, thereby generating new or adjusted code. The adjusted code is then compiled to obtain the material to be generated.

[0075] The aforementioned adjustment parameters include parameter adjustment units for multiple material elements; at least one material element is a dynamic element, such as dynamic effects like sonic turbulence, emulsion polymerization, particle bouncing, emulsion leveling, and bubble aggregation. A material element can contain one or more of these dynamic elements, resulting in a dynamic material. For example, for a gradual sonic turbulence, the color, horizontal speed, and vertical speed of the sound wave can be adjusted to determine the dynamic effect.

[0076] When compiling based on the adjustment parameters and the generation code of the original material, it is possible to perform fission according to the compilation results to obtain multiple materials to be generated. That is, multiple materials can be generated by fission based on the generation code and the adjustment parameters. For example, in the generation code of the original material, the value range of a certain material is set, and when adjusting the parameters, the specific value of the material is set. Then, within the value range, the values ​​near the specific value can be used as the value for fission of the material, and then multiple materials are combined with each other to fission multiple result combinations, thereby forming multiple materials. Alternatively, in the generation code of the original material, the value range of a certain material is set, and when adjusting the parameters, a smaller value range of the material is set. Then, fission can be performed within the smaller value range, that is, the values ​​within the smaller value range can be used as the value for fission of the material, and then, when combining multiple materials, multiple result combinations can be fissioned, thereby forming multiple materials.

[0077] The code for generating the raw material described above can be generated by: determining the constituent elements of the material, the values ​​of the non-adjustable elements within the constituent elements, and the options or value ranges of the adjustable elements within the constituent elements; and generating the code for generating the raw material based on the determined constituent elements, the values ​​of the non-adjustable elements within the constituent elements, and the options or value ranges of the adjustable elements within the constituent elements. That is, during the generation of the code, it can be determined which constituent elements are adjustable and which are adjustable. For adjustable elements, it is necessary to confirm their options or value ranges, such as which colors are available, the value range of the circular radius, etc. For non-adjustable elements, a specific value is determined, such as determining that the waveform is a sine wave, etc. Based on the selection and setting of these constituent elements, encoding according to a preset programming language can generate the code for generating the raw material.

[0078] Figure 2 It is a method flow chart of an embodiment of a material generation method described in the present application. Although the present application provides method operation steps or device structures as shown in the following embodiments or drawings, more or fewer operation steps or module units may be included in the method or device based on routine or no creative labor. In the steps or structures where there is no necessary causal relationship logically, the execution order of these steps or the module structure of the device is not limited to the execution order or module structure described in the embodiments of the present application and shown in the drawings. When the method or module structure is applied to an actual device or terminal product, it can be connected in accordance with the method or module structure shown in the embodiment or drawings for sequential execution or parallel execution (for example, a parallel processor or multi-threaded processing environment, or even a distributed processing environment).

[0079] like Figure 2As shown, the material generation method may include the following steps:

[0080] Step 201: providing original material on the operation interface;

[0081] Step 202: responding to the user's parameter adjustment operation on the operation interface, determining the adjustment parameters of the material to be generated;

[0082] Step 203: Based on the adjustment parameters, compile the generation code of the original material to obtain the material to be generated.

[0083] Specifically, raw material is provided on an interface, and users can adjust parameters there. These adjustments determine the adjustment parameters for the material to be generated. Based on these adjustment parameters, the code for generating the raw material is compiled to produce the material to be generated. In other words, users can adjust parameters based on the raw material, then compile the code to generate the new material. This solution solves the problem of inefficient material generation caused by the need to manually add materials one by one, achieving the technical effect of simply and efficiently generating the desired material.

[0084] If the original material is a dynamic material, the material to be generated is also a dynamic material. For example, it can be a dynamic material with dynamic effects such as particle jumping, emulsion leveling, and bubble aggregation.

[0085] The above-mentioned method of generating materials based on the original material generation code and parameter adjustment can be applied in the image processing process. Specifically, after obtaining the image to be processed, the original materials can be matched, and then an initial fused image can be obtained. Parameters can be adjusted based on the initial fused image to form the final fused image. Alternatively, multiple materials can be pre-generated, and then after obtaining the image to be processed, they can be directly matched and fused with the multiple fused materials. Alternatively, the system can automatically generate one or more materials that match the image to be processed based on the material generation code, and then fuse them with the image to be processed.

[0086] For example, a user-uploaded image to be processed can be obtained. Then, an original material can be matched to the image to be processed from a material library. The original material and the image to be processed are then fused to obtain an initial fused image. The user can then adjust the parameters of the original material. Based on the parameter adjustments to the original material, the initial fused image is adjusted to generate an adjusted fused image. In other words, in this process, the user can adjust the parameters of the original material based on the initial fused image to form an adjusted fused image.

[0087] When matching the original material for the image to be processed from the material library, the following steps may be performed: identifying a target object from the image to be processed; determining image features of the target object; and then, based on the image features, determining the original material matching the image to be processed from the material library. In other words, the original material matching the image to be processed is determined using feature matching.

[0088] In specific implementation, the image area of ​​the target object can be identified and extracted from the image to be processed; then the original material is used as the background material and image fused with the extracted image area of ​​the target object; the image fusion result is subjected to boundary fusion processing to obtain an initial fused image.

[0089] During image processing, manual parameter adjustment is unnecessary, allowing the system to automatically adjust parameters to determine the most appropriate matching material. For example, a user-uploaded image to be processed can be obtained; the original material to be fused can be determined, and the original material can be compiled and generated using the generated code; based on the generated code of the original material, a fusion material that matches the image to be processed is generated, and then the fusion material is used to fuse with the image to be processed.

[0090] Specifically, based on the generation code of the original material, generating a fusion material that matches the image to be processed, and using the fusion material to fuse with the image to be processed, can include: based on the generation code of the original material, generating multiple fusion materials that match the image to be processed; fusing the multiple fusion materials with the image to be processed respectively to obtain multiple fused images to be processed.

[0091] During image processing, the system can also identify and extract the image area of ​​the target object from the image to be processed, and then intelligently recommend material parameters based on the image area of ​​the target object. For example, it can recommend a set of parameters (one set of parameters corresponds to one material effect), or it can recommend multiple sets of parameters. If a set of parameters is recommended, the user can determine whether to adopt this set of parameters. If multiple sets of parameters are recommended, the user can select the parameters that meet their needs from these multiple sets of parameters as the final material parameters to form an image fusion between the material and the image to be processed. Furthermore, if the image to be processed is a product image to be advertised, then when the system recommends material parameters from the image to be processed, it can take into account factors such as the transaction volume, recall rate, and conversion rate of previous products to recommend material parameters to users.

[0092] Taking into account that different users have different needs when processing images, or in other words, the platform can differentiate users and open different permissions for users of different levels or with different needs. For example, if it is a lower-level user, then only the materials recommended by the platform can be used, and the parameters of the materials cannot be adjusted by the user. If it is a higher-level user, then the functional permissions of platform recommendations and self-adjustment can be opened, so that the platform can more efficiently match different user needs and diversified needs.

[0093] In actual image processing scenarios, sometimes the images uploaded by users are non-compliant, such as indecent images or photos that do not comply with legal regulations. The platform provides image filtering, which allows for preliminary screening of uploaded images to determine compliance. Only compliant images are then processed for material matching and image fusion.

[0094] Regarding specific application scenarios, considering that most e-commerce platforms use product SKUs with white background images, if designing or converting product images that reflect the product's characteristics is required, e-commerce users generally need to hire professionals to perform image processing, or process each image themselves, which requires significant human and financial resources. Some current image synthesis methods outsource the images to be processed to designers for pattern creation. This requires outsourced designers to design and generate a large amount of image material, which is costly and therefore cannot be effectively promoted.

[0095] To this end, in this example, a material generation and image synthesis system is provided, which can be used as follows: Figure 3 As shown, it can include: a material generation part and an image synthesis part, wherein the material generation part can include: creative code generation, parameter adjustment, code compilation, and material fission.

[0096] Specifically, creative code refers to the use of computer programming technology to create designs and art with code to complete graphic and image work. The creative code generation stage may include:

[0097] 1) Technology selection: that is, choosing which coding method is best for coding. Considering the need for visual display, when selecting a coding method, it is necessary to choose a coding method that can be visually displayed. For example, you can choose, but are not limited to: P5.js, Three.js, vanta.js, cables.js, and Unity as the coding method selected for technology selection.

[0098] 2) Creative image programming: Specifically, based on the characteristics of the product or content (for example, the product is sparkling water, cosmetics, etc.), creative image programming is performed through the selected encoding method to generate the initial material code.

[0099] The initial material code can include which dynamic elements correspond to each type of product, as well as which colors to choose from. During the programming process, all material list contents can be directly set as data variables, eliminating the need for manual data tagging. Specifically, image materials can be understood as various visual elements that supplement the main product image (such as polka dots, stripes, lighting effects, textures, colors, etc.). By combining these elements with the main product image, brand new image materials and content can be formed.

[0100] The parameter adjustment phase may include:

[0101] Parameter adjustment, specifically, can visualize the material code (i.e., visual display of dynamic materials) and form a visual interface for adjustable parameters (i.e., an adjustable parameter panel). Designers can then adjust the parameters on the adjustable parameter panel to achieve the desired presentation effect. After the parameters are adjusted, the code can be packaged and integrated, and then uploaded to the cloud for code compilation and material fission. Specifically, the parsing, listing, and exporting processes can be achieved through the parsing capabilities of cloud video segments.

[0102] As for code packages, they can be diverse. Code packages that are common to all categories can be set up, that is, they can be applicable to most categories; they can also be classified according to attributes, so that the code packages can be applied to similar attributes or the same type of products, thereby enhancing the characteristics of the products; category customization can also be carried out, and code packages can be set up specifically for a certain category, thereby greatly enhancing the product characteristics and quality of the original products.

[0103] In the image synthesis part, the main task is to realize the application of the background materials obtained by the above fission. Specifically, it can include: machine learning stage and commercial application stage.

[0104] For the machine learning stage, the generated background material can be combined with the target product for information annotation and machine learning, so that after obtaining the product image, the corresponding background material can be matched more accurately. In the commercial application stage, the background material after machine learning can be directly put into use, and a data interface can be provided to the user. After the user uploads the image to be processed (for example, it can be a product image), an image with a background can be generated for it, and the background is dynamic. Furthermore, multiple images can be generated for the user to choose from, or multiple background materials can be matched for the user to choose from. This application does not limit this.

[0105] Based on the above-mentioned material generation and image synthesis system, material generation can be performed in the following manner:

[0106] Step 1: Obtaining an initial material code, wherein the initial material code is obtained by programming dynamic background materials according to content characteristics requirements;

[0107] Specifically, sample data of multiple sample categories (for example, skin care products, bottled beverages, clothing, etc.) can be obtained, and then, feature extraction is performed on the sample data of these multiple sample categories to obtain feature information, and then demand analysis is performed based on the feature information to obtain the characteristic requirements of each sample category in the multiple sample categories.

[0108] For example, the above-mentioned characteristic information may include but is not limited to at least one of the following: shape, color, and category attributes. For example, the lotion bottle is red, cylindrical in shape, and the liquid in the bottle is flowing. These can all be used as characteristic information of the lotion category sample, and the characteristic requirements of the category can be analyzed based on this characteristic information. For example, the background color can be set to the same color as the bottle body, and the dynamic element can have a flowing feeling to match the characteristics of the lotion. For example, if the sample category is headphones, the corresponding dynamic element can be sound waves, etc. That is, the characteristic requirements of the category can be determined based on its own characteristic information.

[0109] Step 2: Visually display the initial material code to form a visual interface of adjustable parameters;

[0110] The initial source code can be displayed visually to form a parameter adjustment panel on which the designer can adjust the parameters. The adjustable area in the visual interface of the adjustable parameters can include, but is not limited to, at least one of the following: a data adjustment bar and a data input box.

[0111] like Figure 4 As shown, creative codes can be displayed visually, and users can Figure 4 The visual interface allows for parameter settings. For example, you can select the desired bubble color, the number of bubbles, the bubble size range, the horizontal and vertical speed of the bubbles, the background change speed, and the intermediate color. Designers can set and adjust the values ​​of dynamic materials or the value space on the visual interface to adjust parameters, and then proceed to code packaging and other operations.

[0112] For example, for headphones, it can be Figure 4 This sonic turbulence background can be like this for emulsions Figure 4This is the background of emulsion polymerization. By adjusting the values ​​or value ranges of various parameters, you can adjust the specific sonic turbulence and the amplitude of emulsion polymerization. You can also achieve dynamic effects such as particle jumping, emulsion uniformity, and bubble aggregation.

[0113] Step 3: receiving parameter values ​​set for each dynamic background material element in the initial material code on the visual interface, and generating material code carrying the parameter values;

[0114] Step 4: compile the material code carrying the parameter values, and perform fission according to the compilation result to obtain multiple dynamic image background materials.

[0115] Specifically, the material code carrying the parameter values ​​is compiled, and fission is performed based on the compilation results to obtain multiple dynamic image background materials. This can include parsing the parameter values ​​or value ranges of each dynamic material element from the material code carrying the parameter values; performing fission based on the parameter values ​​or value ranges of each dynamic material element to obtain multiple dynamic image background materials; and deriving the multiple dynamic image background materials. In other words, fission and combination can be performed based on specific value parameters set by the designer and parameter ranges set during programming to obtain a final background material solution.

[0116] For example, by setting the effect of parameter ranges for a single creative code package, at least multiple different visual sensory styles can be obtained. And because it spans multiple categories, different content materials can be randomly generated in different parameter ranges, and then associated with multiple sets of color schemes, so that multiple list results can be obtained.

[0117] That is, starting from the needs of the content, the initial creation is carried out, and then the content of the initial creation is parameterized and adjusted, and then the adjusted parameters are compiled, and finally fission is performed according to the compilation to obtain multiple dynamic image background materials, and then the input image can be processed, so that background materials can be generated in batches simply and efficiently.

[0118] The above-mentioned dynamic background material elements may include but are not limited to at least one of the following: the image used by the background material, the color used by the background material, the component units of the dynamic elements in the background material, and the value range of each component unit.

[0119] After multiple dynamic image background materials are formed, they can be packaged and sent to the server so that when users launch products, the product images uploaded by users can be processed to form product images with dynamic backgrounds. Based on this, image processing can be performed according to the following steps:

[0120] Step 1: Receive the uploaded image to be processed containing the target object;

[0121] Step 2: Determine a dynamic image background material that matches the image to be processed from a material library storing a plurality of dynamic image background materials;

[0122] In actual implementation, determining a dynamic image background material that matches the image to be processed from a library of multiple dynamic image background materials can be done by identifying the target object from the image to be processed; determining the image features of the target object; and, based on the image features, determining a dynamic image background material that matches the image to be processed from the library of multiple dynamic image background materials. For example, after acquiring the image to be processed, if it is identified that the target object in the image to be processed is a red bottle of lotion, the image features of the red bottle of lotion can be extracted, and then a dynamic image background material that matches it can be matched to obtain a background that matches the target object, making the matched background material more suitable for the target object. For example, if the bottle is red, red can be selected as the background color, and if the bottle is blue, blue can be selected as the background color, so that the characteristics of the object can be more effectively presented.

[0123] However, it is worth noting that the above-mentioned color adaptation is only an exemplary description. In actual implementation, it can be selected or adjusted according to actual needs, and this application does not limit this.

[0124] Step 3: Perform image fusion on the determined dynamic image background material and the image to be processed to obtain a dynamic target object image.

[0125] Specifically, after the determined dynamic image background material is fused with the image to be processed to obtain a dynamic target object image, the dynamic target object image can be sent to the target user (for example, the image to be processed is uploaded by the user and needs to be processed and returned to the user, so the platform provides the user with an image processing process); or, the dynamic target object image can be displayed (for example, the platform provides real-time image processing and display functions, so after the dynamic image is processed, it can be directly displayed); or, the dynamic target object image is uploaded to the target server for advertising delivery (for example, the platform provides a product delivery function, so the user uploads his own product image, and the platform will process the image to obtain an image with a dynamic rendering background that complies with the rules and requirements. After obtaining the image, it can be directly uploaded to the server for product display or advertising delivery).

[0126] The above-mentioned image features may include but are not limited to at least one of the following: the shape of the target object, the color of the target object, and the category attribute of the target object.

[0127] Specifically, the determined dynamic image background material is fused with the image to be processed to obtain a dynamic target object image. This can be accomplished by identifying and extracting an image region of the target object from the image to be processed; fusing the extracted image region of the target object with the determined dynamic image background material; and performing boundary fusion processing on the image fusion result to obtain a dynamic target object image. In other words, the original image and the dynamic image background material are combined to obtain a dynamic target object image.

[0128] In actual implementation, the background can be a combination of a product object + a solid color background + dynamic elements, or a product object + dynamic effects + a background image. This can be a parameter-adjusted extension of a fission style and a single code package, or a combination of a fission style and a single code style with a background image superimposed. When setting the background pattern for a single style in a single creative code package, you can choose a solid color background or a background image. For example, you can pre-store hundreds of variations of solid color background images, and any image in the resource center can serve as the background image.

[0129] For example, Figure 5 The two image examples shown are schematic diagrams of the effect of only product objects + solid color background + dynamic elements, such as Figure 6 As shown, this is a schematic diagram of the effect of product object + dynamic effect + background image.

[0130] The above-mentioned background material generation method and image processing method can be applied to the commodity background image scene. For example, the above-mentioned method can simply and efficiently upgrade a single commodity white background image to a dynamic commodity image, and has the ability of continuous iteration. Specifically, through standardized parameter decoding, the standard unification and parsing capabilities of various canvases can be achieved. Through the parsing capabilities of cloud video, the full process of content creation including parsing, fission, and export can be achieved. Through data effect reflux and machine learning, the optimization and iteration of creative code can be achieved to achieve the purpose of intelligent design. That is, through the creative code method, computer art can be used to directly produce design materials, thereby reducing a large amount of outsourcing labor costs; through code parameterization, all material fission content can be formed by directly setting data variables, without the need for a large amount of manpower for data labeling; further, the materials produced by fission can be dynamic, so as to obtain a better visual experience and commercial conversion rate.

[0131] The method embodiments provided in the above embodiments of the present application can be executed in a computer terminal or similar computing device. Taking running on a computer terminal as an example, Figure 7 FIG. 1 is a hardware structure block diagram of a computer terminal for a material generation method according to an embodiment of the present invention. Figure 7As shown, the computer terminal 10 may include one or more (only one is shown in the figure) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission module 106 for communication functions. It will be understood by those skilled in the art that Figure 7 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 7 More or fewer components than shown, or with Figure 7 Different configurations shown.

[0132] Memory 104 can be used to store software programs and modules for application software, such as the program instructions / modules corresponding to the material generation method in the embodiments of the present invention. Processor 102 executes the software programs and modules stored in memory 104 to perform various functional applications and data processing, thereby implementing the material generation method for the application described above. Memory 104 can include high-speed random access memory (RAM) and can also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, memory 104 can further include memory remotely located relative to processor 102, and such remote memory can be connected to computer terminal 10 via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0133] The transmission module 106 is configured to receive or transmit data via a network. A specific example of the aforementioned network may include a wireless network provided by the communications provider of the computer terminal 10. In one embodiment, the transmission module 106 includes a network interface controller (NIC), which can be connected to other network devices via a base station to enable communication with the Internet. In another embodiment, the transmission module 106 may be a radio frequency (RF) module, which is configured to communicate with the Internet wirelessly.

[0134] At the software level, the above-mentioned material generation device can be as follows Figure 8 Shown, including:

[0135] Providing module 801, for providing original material on the operation interface;

[0136] A determination module 802 is configured to determine adjustment parameters of the material to be generated in response to a parameter adjustment operation performed by the user on the operation interface;

[0137] The processing module 803 is used to compile the generation code of the original material based on the adjustment parameters to obtain the material to be generated.

[0138] In one embodiment, the providing module 801 may include: a providing unit for providing a material uploading interface; a receiving unit for receiving a generation code of the original material uploaded through the uploading interface; and a display unit for visually displaying the original material based on the generation code.

[0139] In one embodiment, the processing module 803 may include: an updating unit configured to update parameters of corresponding element codes in the generated code of the original material based on the adjustment parameters; and a compiling unit configured to compile the updated generated code.

[0140] In one embodiment, the above-mentioned adjustment parameters may include an adjustment parameter unit of multiple material elements; at least one material element is a dynamic element. When the material elements of the adjustment parameter unit include dynamic elements, the material to be generated is a dynamic material.

[0141] In one embodiment, the processing module 803 may specifically perform fission according to the compilation result to obtain a plurality of materials to be generated.

[0142] In one embodiment, the generation code of the above-mentioned original material can be generated by the following method: determining the constituent elements of the material, the values ​​of the non-adjustable elements in the constituent elements, and the optional items or value ranges of the adjustable elements in the constituent elements; generating the generation code of the original material based on the determined constituent elements, the values ​​of the non-adjustable elements in the constituent elements, and the optional items or value ranges of the adjustable elements in the constituent elements.

[0143] In one embodiment, the material to be generated may be a dynamic material.

[0144] In an embodiment of the present application, an image processing device is further provided, which may include:

[0145] The acquisition module is used to obtain the image to be processed uploaded by the user;

[0146] A fusion module is used to match the original material for the image to be processed from the material library, and fuse the original material with the image to be processed to obtain an initial fused image;

[0147] A receiving module, configured to receive parameter adjustments made by a user on the original material;

[0148] The adjustment module is used to adjust the initial fused image according to the parameter adjustment of the original material to generate an adjusted fused image.

[0149] In one embodiment, the above-mentioned fusion module may include: an identification unit for identifying a target object from the image to be processed; a first determination unit for determining the image features of the target object; and a second determination unit for determining, from the material library, the original material that matches the image to be processed based on the image features.

[0150] In one embodiment, the above-mentioned fusion module may include: an identification unit, used to identify and extract the image area of ​​the target object from the image to be processed; a fusion unit, used to use the original material as background material and perform image fusion with the extracted image area of ​​the target object; boundary processing, used to perform boundary fusion processing on the image fusion result to obtain an initial fused image.

[0151] In an embodiment of the present application, an image processing device is also provided, which may include: an acquisition module for acquiring an image to be processed uploaded by a user; a determination module for determining the original material to be fused, wherein the original material is compiled and generated by a generated code; and a fusion module for generating a fusion material that matches the image to be processed based on the generated code of the original material, so as to fuse the fusion material with the image to be processed.

[0152] In one embodiment, the above-mentioned fusion module may include: a generation unit, which is used to generate multiple fusion materials matching the image to be processed based on the generation code of the original material; and a fusion unit, which is used to fuse the multiple fusion materials with the image to be processed respectively to obtain multiple fused images to be processed.

[0153] The embodiments of the present application also provide a specific implementation of an electronic device capable of implementing all the steps of the material generation method in the above embodiment. The electronic device specifically includes the following: a processor, a memory, a communication interface, and a bus; wherein the processor, the memory, and the communication interface communicate with each other via the bus; the processor is used to call a computer program in the memory, and when the processor executes the computer program, all the steps of the material generation method in the above embodiment are implemented. For example, the processor executes step 1: providing original material on the operation interface;

[0154] Step 2: responding to the user's parameter adjustment operation on the operation interface, determining the adjustment parameters of the material to be generated;

[0155] Step 3: Based on the adjustment parameters, compile the generation code of the original material to obtain the material to be generated.

[0156] The material generation method, image processing method, and device provided in this application provide raw materials on an operation interface, and users can perform parameter adjustment operations on the operation interface. Based on the user's parameter adjustment operations, the adjustment parameters of the material to be generated can be determined. Based on these adjustment parameters, the generation code of the raw material can be compiled and processed to obtain the material to be generated. In other words, the user can adjust the parameters based on the raw material, and then compile the code to obtain the new material. The above solution solves the problem of low material generation efficiency caused by the need to manually add existing materials one by one, and achieves the technical effect of simply and efficiently generating the desired material.

[0157] The embodiments of the present application also provide a computer-readable storage medium capable of implementing all steps of the material generation method in the above embodiments. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, all steps of the material generation method in the above embodiments are implemented. For example, when the processor executes the computer program, the following steps are implemented:

[0158] Step 1: Provide original materials on the operation interface;

[0159] Step 2: responding to the user's parameter adjustment operation on the operation interface, determining the adjustment parameters of the material to be generated;

[0160] Step 3: Based on the adjustment parameters, compile the generation code of the original material to obtain the material to be generated.

[0161] The material generation method, image processing method, and device provided in this application provide raw materials on an operation interface, and users can perform parameter adjustment operations on the operation interface. Based on the user's parameter adjustment operations, the adjustment parameters of the material to be generated can be determined. Based on these adjustment parameters, the generation code of the raw material can be compiled and processed to obtain the material to be generated. In other words, the user can adjust the parameters based on the raw material, and then compile the code to obtain the new material. The above solution solves the problem of low material generation efficiency caused by the need to manually add existing materials one by one, and achieves the technical effect of simply and efficiently generating the desired material.

[0162] The various embodiments in this specification are described in a progressive manner. Similar portions between the various embodiments can be referenced to each other. Each embodiment focuses on the differences between the other embodiments. In particular, the hardware + program embodiments are generally similar to the method embodiments, so their description is relatively simple. For relevant portions, refer to the description of the method embodiments.

[0163] The foregoing description of this specification describes specific embodiments. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0164] Although the present application provides method operation steps as described in the embodiments or flowcharts, more or fewer operation steps may be included based on conventional or non-creative work. The order of steps listed in the embodiments is only one way of executing the steps among many steps and does not represent the only execution order. When the actual device or client product is executed, it can be executed in sequence or in parallel according to the method shown in the embodiments or the drawings (for example, in a parallel processor or multi-threaded processing environment).

[0165] The systems, devices, modules, or units described in the above embodiments may be implemented by computer chips or entities, or by products having certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, an in-vehicle human-computer interaction device, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0166] Although the present specification embodiment provides the method operation steps as described in the embodiment or flow chart, more or less operation steps may be included based on conventional or non-creative means. The order of steps listed in the embodiment is only one way in the order of execution of many steps and does not represent a unique execution order. When the device or terminal product in practice is executed, it can be performed in sequence or in parallel according to the method shown in the embodiment or the accompanying drawings (such as a parallel processor or a multi-threaded processing environment, or even a distributed data processing environment). The term "comprise", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, product or equipment including a series of elements not only include those elements, but also include other elements not clearly listed, or also include elements inherent to such process, method, product or equipment. In the absence of more restrictions, it is not excluded that there are other identical or equivalent elements in the process, method, product or equipment including the elements.

[0167] For the convenience of description, the above devices are described in terms of functions divided into various modules. Of course, when implementing the embodiments of this specification, the functions of each module can be implemented in the same or multiple software and / or hardware, or the modules that implement the same function can be implemented by a combination of multiple sub-modules or sub-units, etc. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0168] Those skilled in the art will also appreciate that, in addition to implementing the controller in pure computer-readable program code, it is entirely possible to implement the same functionality by logically programming the method steps in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, embedded microcontrollers, and the like. Therefore, such a controller can be considered a hardware component, and the devices included therein for implementing various functions can also be considered structures within the hardware component. Alternatively, the devices for implementing various functions can be considered both software modules implementing the method and structures within the hardware component.

[0169] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, as well as combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowcharts and / or block diagrams. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0170] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0171] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0172] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0173] Memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0174] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0175] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the embodiments of this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0176] Embodiments of this specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform specific tasks or implement specific abstract data types. Embodiments of this specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communications network. In distributed computing environments, program modules may be located in local and remote computer storage media, including storage devices.

[0177] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between the various embodiments can be referenced across them. Each embodiment focuses on the differences from the other embodiments. In particular, since the system embodiments are generally similar to the method embodiments, their description is relatively simple. For relevant parts, reference can be made to the description of the method embodiments. Throughout this specification, reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with that embodiment or example are included in at least one embodiment or example of the embodiments in this specification. In this specification, the schematic representations of these terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and integrate the different embodiments or examples, and features of different embodiments or examples, described in this specification, without conflict.

[0178] The above description is merely an example of the embodiments of this specification and is not intended to limit the embodiments of this specification. For those skilled in the art, various modifications and variations of the embodiments of this specification are possible. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of this specification shall be included within the scope of the claims of the embodiments of this specification.

Claims

1. A material generation method, comprising: Provide original materials on the operation interface; In response to a parameter adjustment operation performed by a user on the operation interface, determining adjustment parameters of the material to be generated, wherein the operation interface includes parameter adjustment units for a plurality of material elements; at least one material element is a dynamic element, and the material to be generated is a dynamic material; Based on the adjustment parameters, compile the generation code of the original material to obtain the material to be generated; The generation code of the original material is generated by: determining the constituent elements of the material, the values ​​of the non-adjustable elements in the constituent elements, and the options or value ranges of the adjustable elements in the constituent elements; generating the generation code of the original material based on the determined constituent elements, the values ​​of the non-adjustable elements in the constituent elements, and the options or value ranges of the adjustable elements in the constituent elements; Wherein, in response to the parameter adjustment operation of the user on the operation interface, determining the adjustment parameters of the material to be generated includes: visually displaying the material code to form a panel of adjustable parameters; Among them, based on the adjustment parameters, the generation code of the original material is compiled to obtain the material to be generated, including: based on the adjustment parameters, the parameters of the corresponding element code in the generation code of the original material are updated; the updated generation code is compiled and fissioned according to the compilation result, including: taking the numerical value near the specific value of the parameter as the value of the material fission, and then combining multiple materials with each other to fission out multiple result combinations, thereby forming multiple materials.

2. The method according to claim 1, further comprising: Provide material upload interface; Receiving a generated code of the original material uploaded through the upload interface; The original material is visually displayed based on the generated code.

3. A material generation device, comprising: Provide a module for providing original materials on the operation interface; a determination module, configured to determine adjustment parameters of the material to be generated in response to a parameter adjustment operation performed by a user on the operation interface, wherein the operation interface includes parameter adjustment units for a plurality of material elements; at least one material element is a dynamic element, and the material to be generated is a dynamic material; A compiling module, configured to compile the generation code of the original material based on the adjustment parameters to obtain the material to be generated; The generation code of the original material is generated by: determining the constituent elements of the material, the values ​​of the non-adjustable elements in the constituent elements, and the options or value ranges of the adjustable elements in the constituent elements; generating the generation code of the original material based on the determined constituent elements, the values ​​of the non-adjustable elements in the constituent elements, and the options or value ranges of the adjustable elements in the constituent elements; Wherein, in response to the parameter adjustment operation of the user on the operation interface, determining the adjustment parameters of the material to be generated includes: visually displaying the material code to form a panel of adjustable parameters; Among them, based on the adjustment parameters, the generation code of the original material is compiled to obtain the material to be generated, including: based on the adjustment parameters, the parameters of the corresponding element code in the generation code of the original material are updated; the updated generation code is compiled and fissioned according to the compilation result, including: taking the numerical value near the specific value of the parameter as the value of the material fission, and then combining multiple materials with each other to fission out multiple result combinations, thereby forming multiple materials.

4. The device according to claim 3, characterized in that The providing module includes: A providing unit for providing a material uploading interface; A receiving unit, configured to receive a generated code of the original material uploaded through the upload interface; A display unit is used to visually display the original material based on the generated code.

5. A processing device comprising a processor and a memory for storing processor-executable instructions, wherein when the processor executes the instructions, the processor performs the following steps: Provide original materials on the operation interface; In response to the user's parameter adjustment operation on the operation interface, the adjustment parameters of the material to be generated are determined, wherein: The operation interface includes a parameter adjustment unit for multiple material elements; at least one material element is a dynamic element, and the material to be generated is a dynamic material; Based on the adjustment parameters, compile the generation code of the original material to obtain the material to be generated; The generation code of the original material is generated by: determining the constituent elements of the material, the values ​​of the non-adjustable elements in the constituent elements, and the options or value ranges of the adjustable elements in the constituent elements; generating the generation code of the original material based on the determined constituent elements, the values ​​of the non-adjustable elements in the constituent elements, and the options or value ranges of the adjustable elements in the constituent elements; Wherein, in response to the parameter adjustment operation of the user on the operation interface, determining the adjustment parameters of the material to be generated includes: visually displaying the material code to form a panel of adjustable parameters; Among them, based on the adjustment parameters, the generation code of the original material is compiled to obtain the material to be generated, including: based on the adjustment parameters, the parameters of the corresponding element code in the generation code of the original material are updated; the updated generation code is compiled and fissioned according to the compilation result, including: taking the numerical value near the specific value of the parameter as the value of the material fission, and then combining multiple materials with each other to fission out multiple result combinations, thereby forming multiple materials.

6. A computer-readable storage medium having computer instructions stored thereon, wherein the instructions, when executed, implement the steps of the following method: Provide original materials on the operation interface; In response to the user's parameter adjustment operation on the operation interface, the adjustment parameters of the material to be generated are determined, wherein: The operation interface includes a parameter adjustment unit for multiple material elements; at least one material element is a dynamic element, and the material to be generated is a dynamic material; Based on the adjustment parameters, compile the generation code of the original material to obtain the material to be generated; The generation code of the original material is generated by: determining the constituent elements of the material, the values ​​of the non-adjustable elements in the constituent elements, and the options or value ranges of the adjustable elements in the constituent elements; generating the generation code of the original material based on the determined constituent elements, the values ​​of the non-adjustable elements in the constituent elements, and the options or value ranges of the adjustable elements in the constituent elements; Wherein, in response to the parameter adjustment operation of the user on the operation interface, determining the adjustment parameters of the material to be generated includes: visually displaying the material code to form a panel of adjustable parameters; Among them, based on the adjustment parameters, the generation code of the original material is compiled to obtain the material to be generated, including: based on the adjustment parameters, the parameters of the corresponding element code in the generation code of the original material are updated; the updated generation code is compiled and fissioned according to the compilation result, including: taking the numerical value near the specific value of the parameter as the value of the material fission, and then combining multiple materials with each other to fission out multiple result combinations, thereby forming multiple materials.

Images