Image processing method and device
By receiving image input, displaying element information and generating related materials, the image and material are directly integrated, and the problems of cumbersome and complex operation in the existing technology are solved, and simplified personalized wallpaper design and high-quality vision are realized Effect.
Patent Information
- Application Number
- CN202411318260.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-20
- Publication Date
- 2025-01-03
AI Technical Summary
The existing image processing technology is complicated when adding materials, and requires manual cutting, cropping, scaling and color grading. The operation is complicated and it is difficult to achieve personalized wallpaper design and has an impact on image quality.
By receiving image input, displaying element information, generating relevant materials, and performing fusion processing, directly fusing materials with images, simplifying processing flow, lowering design thresholds, and improving visual effects.
The image processing process is simplified, the difficulty of personalized wallpaper design is reduced, the visual effects and emotional expression of the wallpaper are improved, the diverse needs of users are met, and the easy personalized and creative wallpaper design is achieved.
Smart Images

Figure CN119251335A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to an image processing method and device. Background Art
[0002] With the continuous development of electronic equipment technology, the application of images is becoming more and more extensive. When users use images, they often need to process the images to meet their personalized needs.
[0003] For example, when a user needs to set a personalized wallpaper, the wallpaper can be first processed by an electronic device, some materials can be added to the captured travel image, and then the travel image with the added materials can be set as the wallpaper of the electronic device.
[0004] However, in the above image processing process, it is usually necessary to first find the required material from a large number of local or network materials, and then manually perform a series of processing operations such as cutout processing, cropping processing, scaling processing and color adjustment processing. As a result, the image processing process is relatively cumbersome. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide an image processing method and device that can simplify the image processing process.
[0006] In a first aspect, an embodiment of the present application provides an image processing method, the method comprising: receiving a first input of a first image; in response to the first input, displaying at least one element information corresponding to the first image; receiving a second input of a first element information in the at least one element information; in response to the second input, generating at least one material related to the first element information; receiving a third input of a first material in the at least one material; in response to the third input, performing fusion processing on the first material and the first image to obtain a second image.
[0007] In a second aspect, an embodiment of the present application provides an image processing device, which includes a receiving module, a display module, a generating module and a processing module; the receiving module is used to receive a first input of a first image; the display module is used to display at least one element information corresponding to the first image in response to the first input; the receiving module is also used to receive a second input of a first element information in at least one element information; the generating module is used to generate at least one material related to the first element information in response to the second input; the receiving module is also used to receive a third input of a first material in at least one material; the processing module is used to perform fusion processing on the first material and the first image in response to the third input to obtain a second image.
[0008] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0010] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
[0011] In a sixth aspect, an embodiment of the present application provides a computer program / program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.
[0012] In an embodiment of the present application, a first input of a first image can be received; in response to the first input, at least one element information corresponding to the first image is displayed; and a second input of the first element information in the at least one element information is received; in response to the second input, at least one material related to the first element information is generated; and a third input of the first material in the at least one material is received; in response to the third input, the first material and the first image are fused to obtain a second image. Through this scheme, on the one hand, the element information corresponding to the first image can be displayed by an input of the first image, and then at least one material related to the first element information can be directly generated for user selection by an input of the first element information therein, without the need to search in a large number of local or network materials; on the other hand, the first material and the first image can be directly fused by only an input of the first material in the at least one material to obtain a second image after adding the first material, without the need to manually perform a series of processing operations such as cutout processing, cropping processing, scaling processing and color adjustment processing; this can simplify the image processing process. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] Figure 1 It is one of the flow charts of the image processing method provided in the embodiment of the present application;
[0014] Figure 2 This is the second flowchart of the image processing method provided in the embodiment of the present application;
[0015] Figure 3 This is the third flowchart of the image processing method provided in the embodiment of the present application;
[0016] Figure 4 This is the fourth flowchart of the image processing method provided in the embodiment of the present application;
[0017] Figure 5 This is the fifth flowchart of the image processing method provided in the embodiment of the present application;
[0018] Figure 6 This is one of the interface schematic diagrams of the image processing method provided in the embodiment of the present application;
[0019] Figure 7 This is the second interface schematic diagram of the image processing method provided in the embodiment of the present application;
[0020] Figure 8 This is the third interface schematic diagram of the image processing method provided in the embodiment of the present application;
[0021] Fig. 9 This is the fourth interface schematic diagram of the image processing method provided in the embodiment of the present application;
[0022] Fig.10 This is the fifth interface schematic diagram of the image processing method provided in the embodiment of the present application;
[0023] Fig.11 This is the sixth interface schematic diagram of the image processing method provided in the embodiment of the present application;
[0024] Fig.12 This is the seventh interface schematic diagram of the image processing method provided in the embodiment of the present application;
[0025] Fig.13 This is the eighth interface schematic diagram of the image processing method provided in the embodiment of the present application;
[0026] Fig.14 This is the ninth interface diagram of the image processing method provided in the embodiment of the present application;
[0027] Fig.15 is a schematic diagram of an image processing device provided in an embodiment of the present application;
[0028] Fig.16 is a schematic diagram of an electronic device provided in an embodiment of the present application;
[0029] Fig.17 It is a hardware schematic diagram of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION
[0030] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0031] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0032] The term "indication" in this application can be a direct indication (or explicit indication) or an indirect indication (or implicit indication). A direct indication can be understood as the sender explicitly informing the receiver of specific information, operations to be performed, or request results in the sent indication; an indirect indication can be understood as the receiver determining the corresponding information according to the indication sent by the sender, or making a judgment and determining the operation to be performed or the request result according to the judgment result.
[0033] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".
[0034] The image processing method and device provided in the embodiments of the present application are described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0035] With the continuous development of electronic equipment technology, the application of images is becoming more and more extensive. When users use images, they often need to process the images to meet their personalized needs.
[0036] In the daily use of smartphones, wallpaper is not only a decorative element, but also an important way for users to express their personalities. Especially after traveling, people hope to set the travel images they took as wallpapers on their smartphones so that they can recall the beautiful moments at any time. However, directly setting travel images as wallpapers often seems monotonous and lacks personalized features. Users usually expect to add some special materials to the travel images first, such as marks of travel locations, notes on their mood during the trip, or descriptions of specific scenery in the travel images, and then set the travel images with the added materials as wallpapers on their smartphones. This makes the wallpapers more memorable and ornamental.
[0037] However, current image processing technologies have certain limitations for adding materials to images. For example, specific parts of an image can be extracted through image processing for personalized design, but these technologies have certain defects in wallpaper customization on mobile phone platforms: on the one hand, fine cutouts require a lot of time and effort, and require a high level of technical mastery; especially when extracting complex backgrounds or subjects, errors are prone to occur, resulting in poor image effects. On the other hand, although image processing software is powerful, it is complex to operate and requires users to have certain graphics processing knowledge. For ordinary users, the image processing process is cumbersome and difficult to achieve the desired effect. And after multiple image processing of an image, the image quality may be affected, and problems such as pixel blur may occur.
[0038] In short, in the above-mentioned image processing process, it is usually necessary to first find the required materials from a large number of local or network materials, and then manually perform a series of processing operations such as cutout processing, cropping processing, scaling processing and color adjustment processing. This makes the image processing process more cumbersome. The relevant technology usually requires the use of professional design software and skills, which consumes a lot of time and energy, and is complicated to operate for ordinary users, making it difficult to achieve personalized customization. Therefore, there is an urgent need for a simpler and more effective solution so that users can easily convert images into colorful and personalized wallpapers to meet the needs of personalized and creative design. How to simplify the image processing process and meet diverse needs has become a technical problem worthy of in-depth research and solution.
[0039] In order to solve the above problems, the embodiments of the present application provide an image processing method and device. The image processing method provided by the embodiments of the present application can be applied to the scene of personalized wallpaper production.
[0040] Exemplarily, when a user needs to use a travel image as a personalized wallpaper, the electronic device can first receive a first input from the user for the travel image, and in response to the first input, display at least one element information corresponding to the travel image; then receive a second input from the user for a first element information in the at least one element information, and in response to the second input, generate at least one material related to the first element information; then receive a third input from the user for a first material in the at least one material, and in response to the third input, perform a fusion process on the first material and the travel image to obtain a fused image, that is, the wallpaper required by the user. Through this solution, on the one hand, by first inputting a travel image, the element information corresponding to the travel image can be displayed, and then by inputting the first element information therein, at least one material related to the first element information can be directly generated for the user to choose, without having to search in a large amount of local or network materials; on the other hand, by only inputting the first material in the at least one material, the first material and the travel image can be directly merged to obtain an image with the first material added, without having to manually perform a series of processing operations such as cutout processing, cropping processing, scaling processing and color adjustment processing; in this way, through processes such as element extraction, intelligent material generation, and rapid wallpaper production, the image processing process can be simplified, the design threshold of personalized wallpapers can be lowered, the difficulty of users making personalized wallpapers can be simplified, the visual effect and emotional expression of wallpapers can be improved, the diverse needs of users can be met, and users can easily achieve personalized and creative wallpaper design.
[0041] It should be noted that the image processing method provided in the embodiments of the present application may be executed by an image processing device, an electronic device, or a functional module in an electronic device, etc. In some embodiments of the present application, an electronic device executing the image processing method is taken as an example to illustrate the image processing method provided in the embodiments of the present application.
[0042] Figure 1 FIG. 1 is a flow chart showing an image processing method provided by an embodiment of the present application. Figure 1 As shown, the image processing method provided in the embodiment of the present application may include the following steps 101 to 106.
[0043] Step 101: An electronic device receives a first input of a first image.
[0044] Optionally, in the embodiment of the present application, the first image may be an image stored in the electronic device, or an image stored in a server corresponding to any application in the electronic device, etc.
[0045] For example, taking the above-mentioned first image as an image stored in an electronic device as an example, the first image may be an image in a gallery of the electronic device; wherein the first image may be an image captured by a camera application of the electronic device and stored in the gallery, or an image downloaded from the network and stored in the gallery, etc.
[0046] Optionally, in an embodiment of the present application, the format of the above-mentioned first image may include but is not limited to: bitmap image (Bitmap, BMP), Joint Photographic Experts Group (Joint Photographic Experts Group, JPEG), Portable Network Graphics (Portable Network Graphics, PNG), Graphics Interchange Format (Graphics Interchange Format, GIF), Tag Image File Format (Tag Image File Format, TIFF) or Scalable Vector Graphics (Scalable Vector Graphics, SVG) and any other possible image formats.
[0047] Optionally, in an embodiment of the present application, the image parameters of the first image may be any display parameters; wherein the display parameters include but are not limited to at least one of the following: display size, display shape, display color, display transparency, display brightness, etc.
[0048] Optionally, in an embodiment of the present application, the first input may be used to extract and display element information of an image.
[0049] Optionally, in the embodiment of the present application, the first input may be any possible form of input such as touch input, voice input or physical key input.
[0050] For example, taking the above-mentioned first input as touch input as an example, the first input may include but is not limited to: single-click input, double-click input, triple-click input, long press input, heavy press input, sliding input or special trajectory input performed by the user through a finger or a stylus; among them, the special trajectory input may include but is not limited to: circular trajectory input, elliptical trajectory input, heart-shaped trajectory input, wavy trajectory input, square trajectory input, rectangular trajectory input, diamond trajectory input or trapezoidal trajectory input and other arbitrary trajectory inputs.
[0051] For example, taking the above-mentioned first input as voice input as an example, the first input may include but is not limited to: voice "extract element information of the image" or voice "display element information of the image" and any other possible voice inputs.
[0052] For example, taking the above-mentioned first input as a physical button input as an example, the first input may include but is not limited to any of the following items: the input of pressing the lock screen button and the volume plus button at the same time, the input of pressing the lock screen button and the volume "-" button at the same time, the input of pressing the volume "+" button and the volume minus button at the same time, and the input of pressing the lock screen button, the volume plus button and the volume minus button at the same time.
[0053] Step 102: The electronic device displays at least one element information corresponding to the first image in response to the first input.
[0054] Optionally, in an embodiment of the present application, the element information corresponding to the image may be text information of the elements included in the image content of the image; wherein the elements may include but are not limited to at least one of the following: any element such as sea, sunshine, coconut, sky, waves, beach, puppy or pine tree.
[0055] Optionally, in the embodiment of the present application, the at least one element information may be text information of part or all of the elements included in the image content of the first image.
[0056] For example, assuming that the image content of the first image includes elements of sea, sunshine, sky and waves, then the at least one element information may be text information corresponding to the sea, sunshine, sky and waves respectively, or may be text information corresponding to the sea, sunshine and sky respectively, or may be text information corresponding to the sunshine and sky respectively, and so on.
[0057] Optionally, in the embodiment of the present application, after receiving the first input, the electronic device may first extract the at least one element information from the first image, and then display the at least one element information.
[0058] Optionally, in an embodiment of the present application, the electronic device may extract the at least one element information through an artificial intelligence (AI) model for extracting image element information; specifically, after the electronic device receives the first input, the image data of the first image may be input into the AI model, and then the AI model outputs the at least one element information.
[0059] Exemplarily, the electronic device may first display the first image on an image editing interface, and then extract the at least one element information through a single-click input of the user on an "element extraction" control in the image editing interface, and then display the extracted at least one element information on the image editing interface.
[0060] Optionally, in the embodiment of the present application, the first input may include a first sub-input and a second sub-input. Figure 1 ,like Figure 2As shown, the above step 102 can be specifically implemented through the following steps 102a and 102b.
[0061] Step 102a: The electronic device displays all element information corresponding to the first image in response to the first sub-input.
[0062] Optionally, in an embodiment of the present application, the first sub-input may be used to extract and display all element information corresponding to the image.
[0063] Optionally, in the embodiment of the present application, the first sub-input may be any possible form of input such as touch input, voice input or physical key input.
[0064] For example, taking the above-mentioned first sub-input as touch input as an example, the first sub-input may include but is not limited to: single-click input, double-click input, triple-click input, long press input, heavy press input, sliding input or special trajectory input performed by the user through a finger or a stylus; among them, the special trajectory input may include but is not limited to: circular trajectory input, elliptical trajectory input, heart-shaped trajectory input, wavy trajectory input, square trajectory input, rectangular trajectory input, diamond trajectory input or trapezoidal trajectory input and other arbitrary trajectory inputs.
[0065] For example, taking the first sub-input as voice input, the first sub-input may include but is not limited to: voice "extract all element information of the image" or voice "display all element information of the image" and any other possible voice inputs.
[0066] For example, taking the above-mentioned first sub-input as a physical button input as an example, the first sub-input may include but is not limited to any of the following items: the input of pressing the lock screen button and the volume "+" button at the same time, the input of pressing the lock screen button and the volume "-" button at the same time, the input of pressing the volume "+" button and the volume "-" button at the same time, and the input of pressing the lock screen button, the volume "+" button and the volume "-" button at the same time.
[0067] Step 102b: The electronic device updates the displayed element information from all element information to at least one element information in response to the second sub-input.
[0068] The second sub-input is used for at least one of the following: deleting element information, modifying element information, and adding element information.
[0069] Optionally, in the embodiment of the present application, the second sub-input may be any possible form of input such as touch input, voice input or physical key input.
[0070] For example, taking the above-mentioned second sub-input as touch input as an example, the second sub-input may include but is not limited to: single-click input, double-click input, triple-click input, long press input, heavy press input, sliding input or special trajectory input performed by the user through a finger or a stylus; among them, the special trajectory input may include but is not limited to: circular trajectory input, elliptical trajectory input, heart-shaped trajectory input, wavy trajectory input, square trajectory input, rectangular trajectory input, diamond trajectory input or trapezoidal trajectory input and other arbitrary trajectory inputs.
[0071] For example, taking the second sub-input as voice input, the second sub-input may include but is not limited to: voice "delete XX element information", voice "modify XX element information" or voice "add XX element information" and any other possible voice inputs.
[0072] For example, taking the above-mentioned second sub-input as a physical button input as an example, the second sub-input may include but is not limited to any of the following: the input of pressing the lock screen button and the volume "+" button at the same time, the input of pressing the lock screen button and the volume "-" button at the same time, the input of pressing the volume "+" button and the volume "-" button at the same time, and the input of pressing the lock screen button, the volume "+" button and the volume "-" button at the same time.
[0073] Optionally, in an embodiment of the present application, after receiving the above-mentioned second sub-input from the user, the electronic device may, in response to the second sub-input, perform at least one of the following: delete at least one element information among all the above-mentioned element information, modify at least one element information among all the above-mentioned element information, and add new element information to all the above-mentioned element information; in this way, the displayed element information can be updated from all the element information to the above-mentioned at least one element information.
[0074] For example, assuming that all the above-mentioned element information displayed by the electronic device includes element information a, element information b and element information c, then after receiving the above-mentioned second sub-input, the electronic device can delete element information a, and the displayed element information can be updated to element information b and element information c; or element information b can be modified to element information d, and the displayed element information can be updated to element information a, element information c and element information d; or new element information e can be added, and the displayed element information can be updated to element information a, element information b, element information c and element information e.
[0075] Optionally, in the embodiment of the present application, updating the displayed element information from all the above element information to the at least one element information can be understood as: the electronic device cancels display of all the element information and displays the at least one element information.
[0076] In the embodiment of the present application, after the electronic device displays all the element information of the first image, it can update the displayed element information from all the element information to at least one of the above-mentioned element information through the user's input. Therefore, the user can manually modify the element information corresponding to the first image again after obtaining all the element information, so that the electronic device can display the element information that meets the user's needs, thereby improving the accuracy and flexibility of displaying the element information.
[0077] Step 103: The electronic device receives a second input of the first element information in the at least one element information.
[0078] Optionally, in an embodiment of the present application, the first element information may be one element information or multiple element information among the at least one element information.
[0079] Optionally, in an embodiment of the present application, the second input may be used to generate material related to the element information.
[0080] Optionally, in the embodiment of the present application, the second input may be any possible form of input such as touch input, voice input or physical key input.
[0081] For example, taking the above-mentioned second input as touch input as an example, the second input may include but is not limited to: a single-click input, a double-click input, a triple-click input, a long press input, a heavy press input, a sliding input or a special trajectory input of the above-mentioned first element information by a user through a finger or a stylus; wherein, the special trajectory input may include but is not limited to: circular trajectory input, elliptical trajectory input, heart-shaped trajectory input, wavy trajectory input, square trajectory input, rectangular trajectory input, diamond trajectory input or trapezoidal trajectory input and other arbitrary trajectory inputs.
[0082] For example, taking the second input as voice input, the second input may include but is not limited to: voice "generate the material of the first element information" or voice "display the material of the first element information" and any other possible voice inputs.
[0083] For example, taking the above-mentioned second input as a physical button input as an example, the second input may include but is not limited to any of the following items: the input of pressing the lock screen button and the volume "+" button at the same time, the input of pressing the lock screen button and the volume "-" button at the same time, the input of pressing the volume "+" button and the volume "-" button at the same time, and the input of pressing the lock screen button, the volume "+" button and the volume "-" button at the same time.
[0084] Step 104: The electronic device generates at least one material related to the first element information in response to the second input.
[0085] Optionally, in an embodiment of the present application, the at least one material mentioned above may include but is not limited to at least one of the following: image material, text material, audio material, video material, etc.
[0086] For example, assuming that the first element information is sunlight, the electronic device can generate sunlight image material, sunlight cartoon material and text material of "sunshine is like poetry, sprinkled in the heart" after receiving the second input.
[0087] For another example, assuming that the first element information is the sea, then after receiving the second input, the electronic device can generate a sea image material, an audio material of the sound of waves, and a text material of "facing the sea, spring flowers are blooming".
[0088] Optionally, in an embodiment of the present application, the electronic device may generate the at least one material mentioned above through an AI model for generating material related to element information; specifically, after the electronic device receives the second input mentioned above, the first element information may be input into the AI model, and then the AI model outputs the at least one material.
[0089] Optionally, in an embodiment of the present application, after generating the at least one material related to the first element information, the electronic device may display the at least one material in real time.
[0090] Step 105: The electronic device receives a third input of a first material in at least one material.
[0091] Optionally, in the embodiment of the present application, the first material may be one material or multiple materials among the at least one material.
[0092] Optionally, in an embodiment of the present application, the third input may be used to perform fusion processing on the material and the image.
[0093] Optionally, in the embodiment of the present application, the third input may be any possible form of input such as touch input or voice input.
[0094] For example, taking the third input as a touch input, the third input may be an input of dragging the first material to the display area of the first image, or may be an input of clicking on the first material and the first image respectively.
[0095] For example, taking the third input as voice input, the third input may include but is not limited to: voice "merge the first material and the first image" or voice "merge the first material and the first image" and any other possible voice inputs.
[0096] Step 106: In response to the third input, the electronic device performs a fusion process on the first material and the first image to obtain a second image.
[0097] It should be noted that the above-mentioned fusion processing, namely image fusion processing, refers to the process of subjecting image data about the same target collected by multiple source channels to image processing and computer technology, so as to extract the beneficial information in each channel to the maximum extent, and finally integrate them into high-quality images to improve the utilization rate of image information, improve the accuracy and reliability of computer interpretation, and enhance the spatial resolution and spectral resolution of the original image, so as to facilitate monitoring.
[0098] Optionally, in an embodiment of the present application, the above-mentioned fusion processing method mainly includes an image fusion method based on deep learning and a traditional image fusion method.
[0099] Among them, with the rise of deep learning, the emergence of deep learning-based image fusion algorithms such as autoencoders, generative adversarial networks, and converters has made a qualitative leap in image fusion performance. These methods aim to integrate complementary information from different source images into a single fused image to fully characterize the imaging scene and facilitate subsequent visual tasks.
[0100] For example, the above fusion processing method can be a residual SwinTransformer (i.e., hierarchical visual transformer) fusion network for infrared and visible light image fusion, which includes three main parts: global feature extraction, fusion layer, and feature reconstruction. This method uses a pure transformer network to establish a fully-attentional feature encoding backbone to model long-range dependencies, which has stronger representation capabilities than convolutional neural networks. In addition, a sequence matrix feature fusion strategy based on the L1 norm is designed. By measuring the row and column vector dimensions of the source image, the brightness competitiveness of the infrared target and the clear details of the visible background can be retained, further improving the performance of image fusion1.
[0101] Traditional image fusion methods rely more on basic operations and algorithms of image processing, such as histogram processing, edge extraction, etc., as well as steps such as feature extraction, image registration, image deformation and image fusion. These methods usually involve image preprocessing, feature extraction and matching, geometric transformation and final image fusion to achieve effective integration of multimodal image information.
[0102] The specific process of the above fusion processing can refer to the specific description in the relevant technology. In order to avoid repetition, it will not be repeated here.
[0103] It can be understood that the second image is an image obtained by adding the first material to the first image.
[0104] Optionally, in the embodiment of the present application, the image format of the second image may be the same as or different from the image format of the first image.
[0105] For example, assuming that the image format of the first image is JPEG, the image format of the second image may also be JPEG, or may be GIF.
[0106] In the image processing method provided in the embodiment of the present application, on the one hand, by first inputting the first image, the element information corresponding to the first image can be displayed, and then by inputting the first element information therein, at least one material related to the first element information can be directly generated for the user to select, without having to search among a large number of materials locally or on the network; on the other hand, by only inputting the first material in the at least one material, the first material and the first image can be directly fused to obtain a second image after adding the first material, without having to manually perform a series of processing operations such as cutout processing, cropping processing, scaling processing, and color adjustment processing; this can simplify the image processing process.
[0107] Optionally, in the embodiment of the present application, the first element information may include N element information, where N is a positive integer. Figure 1 ,like Figure 3 As shown, after the above step 104, the image processing method provided in the embodiment of the present application may further include the following step 107.
[0108] Step 107: The electronic device stores the material related to each element information in the N element information in a material set to obtain N material sets.
[0109] Optionally, in an embodiment of the present application, after obtaining the above-mentioned N material sets, the electronic device can display the N material sets; and after receiving the user's input on a certain material set among the N material sets, the electronic device can display the materials in the material set for the user to select.
[0110] For example, assuming that the N element information includes the sea and the beach, after generating the at least one material, the electronic device can store the sea-related materials in the at least one material in a sea material package, and store the beach-related materials in the at least one material in a beach material package, thereby obtaining the sea material package and the beach material package, that is, the N material sets. Then, if the user clicks on the sea material package, the electronic device can display the materials in the sea material package; if the user clicks on the beach material package, the electronic device can display the materials in the beach material package; this makes it easier for the user to select the required materials by classification.
[0111] In the embodiment of the present application, after the electronic device generates the at least one material, it can classify and store the at least one material according to the corresponding element information. Therefore, the at least one material can be displayed in an orderly manner to facilitate the user to select the required material therefrom.
[0112] Optionally, in the embodiment of the present application, combined with Figure 3 ,like Figure 4 As shown, after the above step 107, the image processing method provided in the embodiment of the present application may further include the following steps 108 and 109.
[0113] Step 108: The electronic device receives a fourth input of a first material set among the N material sets.
[0114] The fourth input is used for at least one of the following: deleting material, regenerating material, and adding material.
[0115] Optionally, in the embodiment of the present application, the first material set may be one material set or multiple material sets among the N material sets.
[0116] Optionally, in the embodiment of the present application, the fourth input may be any possible form of input such as touch input, voice input or physical button input.
[0117] For example, taking the above-mentioned fourth input as touch input as an example, the fourth input may include but is not limited to: single-click input, double-click input, triple-click input, long press input, heavy press input, sliding input or special trajectory input of the above-mentioned first material set by the user through a finger or a stylus; among them, the special trajectory input may include but is not limited to: circular trajectory input, elliptical trajectory input, heart-shaped trajectory input, wavy trajectory input, square trajectory input, rectangular trajectory input, diamond trajectory input or trapezoidal trajectory input and other arbitrary trajectory inputs.
[0118] For example, taking the fourth input as voice input, the fourth input may include but is not limited to: voice "delete XX material in the first material set", voice "regenerate the material in the first material set" or voice "add XX material in the first material set" and any other possible voice inputs.
[0119] For example, taking the above-mentioned fourth input as a physical button input as an example, the fourth input may include but is not limited to any of the following items: the input of pressing the lock screen button and the volume "+" button at the same time, the input of pressing the lock screen button and the volume "-" button at the same time, the input of pressing the volume "+" button and the volume "-" button at the same time, and the input of pressing the lock screen button, the volume "+" button and the volume "-" button at the same time.
[0120] Step 109: The electronic device updates the material in the first material set in response to the fourth input.
[0121] Optionally, in an embodiment of the present application, after receiving the above-mentioned fourth input from the user, the electronic device may, in response to the fourth input, execute at least one of the following: delete at least one material in the above-mentioned first material set, regenerate the materials in the above-mentioned first material set, and add new materials to the above-mentioned first material set; in this way, the materials in the first material set can be updated.
[0122] Optionally, in an embodiment of the present application, the electronic device regenerates the material in the above-mentioned first material set, which can be understood as: the electronic device regenerates the material in the first material set while retaining the original material in the above-mentioned first material set; or, the electronic device deletes the original material in the above-mentioned first material set and regenerates the material in the first material set.
[0123] For example, assuming that the first material set includes material 1, material 2, and material 3, after receiving the fourth input, the electronic device may delete material 1; or may delete material 1, material 2, and material 3, and regenerate material 4 and material 5; or may add a new material 6. In this way, the electronic device may update the materials in the first material set, so that the user can select from the new materials.
[0124] In the embodiment of the present application, after obtaining the above-mentioned N material sets, since the electronic device can update the materials in the first material set through the user's fourth input to the first material set, the materials in the displayed material set can be updated at any time according to the user's usage requirements, so that the user can select the required materials from different materials.
[0125] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 5 As shown, after the above step 106, the image processing method provided in the embodiment of the present application may further include the following steps 110 and 111.
[0126] Step 110: The electronic device receives a fifth input of the second image.
[0127] Optionally, in an embodiment of the present application, the fifth input may be used to perform related functional operations on the image.
[0128] Optionally, in the embodiment of the present application, the fifth input may be any possible form of input such as touch input, voice input or physical button input.
[0129] For example, taking the above-mentioned fifth input as touch input as an example, the fifth input may include but is not limited to: single-click input, double-click input, triple-click input, long press input, heavy press input, sliding input or special trajectory input of the above-mentioned second image by the user through a finger or a stylus; among them, the special trajectory input may include but is not limited to: circular trajectory input, elliptical trajectory input, heart-shaped trajectory input, wavy trajectory input, square trajectory input, rectangular trajectory input, diamond trajectory input or trapezoidal trajectory input and other arbitrary trajectory inputs.
[0130] For example, taking the fifth input as voice input, the fifth input may include but is not limited to: voice "share the second image" or voice "adjust the display size of the second image" and any other possible voice inputs.
[0131] For example, taking the above-mentioned fifth input as a physical button input as an example, the fifth input may include but is not limited to any of the following items: the input of pressing the lock screen button and the volume "+" button at the same time, the input of pressing the lock screen button and the volume "-" button at the same time, the input of pressing the volume "+" button and the volume "-" button at the same time, and the input of pressing the lock screen button, the volume "+" button and the volume "-" button at the same time.
[0132] Step 111: The electronic device performs a first operation on the second image in response to a fifth input.
[0133] The first operation includes at least one of the following: an adjustment operation of display parameters and a sharing operation.
[0134] Optionally, in the embodiment of the present application, the adjustment operation of the above display parameters may include but is not limited to at least one of the following: cropping, scaling, changing filters, color adjustment, etc.
[0135] Optionally, in an embodiment of the present application, the above-mentioned display parameter adjustment operation can be used to adjust the display parameters of the above-mentioned second image to adjust the display effect of the second image.
[0136] Optionally, in an embodiment of the present application, the above-mentioned sharing operation may be a sharing operation to a first object; wherein the first object may include but is not limited to at least one of the following: a contact in an instant messaging application, a server corresponding to a social application, etc.
[0137] Optionally, in an embodiment of the present application, after obtaining the second image, the electronic device may display the second image and a function control corresponding to the second image; then the electronic device may perform the first operation on the second image through the user's fifth input to the function control.
[0138] In an embodiment of the present application, since the electronic device can adjust the display parameters of the second image or share the second image through user input after obtaining the above-mentioned second image, it is possible to further perform functional operations on the obtained second image, thereby expanding the functional operations to meet the different usage needs of users.
[0139] The image processing method provided in the embodiments of the present application is exemplarily described below with reference to the accompanying drawings.
[0140] For example, the image processing method provided in the embodiment of the present application can be combined with AI capabilities to customize personalized wallpapers, so that users can easily achieve personalized and creative wallpaper design. The image processing method specifically includes the following steps:
[0141] Step A: Upload the image to be edited and enter the wallpaper customization console.
[0142] Since the purpose of this example is to design a personalized and creative wallpaper based on an existing image, you need to upload an image as the wallpaper base first. After the upload is successful, the interface will switch to the custom operation panel. Figure 6 As shown in the figure, the operation panel consists of the following from top to bottom: basic element library, tool bar, image to be edited, and basic material library. The subsequent wallpaper design process is completed on this operation panel.
[0143] Step B: Use the [Element Extraction] function to extract the basic elements contained in the image and generate a basic element library.
[0144] like Figure 7 As shown, the user can click the [Element Extraction] button in the toolbar on the left side of the image to allow the electronic device to extract basic element information in the image, such as: sea, beach, sunshine, coconut, sky, waves, etc.
[0145] Step C: manually correct, delete, or add the element extraction results for future use.
[0146] (1) If the user is not satisfied with the extraction results, the basic element library can be manually modified. Figure 8 As shown, users can long press an element to enter element editing mode. In editing mode, users can modify the element by clicking the element name, and delete unnecessary elements by clicking the delete button in the upper right corner.
[0147] (2) If the user wants to add elements themselves, Fig. 9 As shown, you can click the Add Element button on the left toolbar and enter the element name in the pop-up box at the bottom of the interface to complete the element addition.
[0148] Step D: Select elements from the basic element library and generate a basic material library through AI capabilities.
[0149] (1) Fig.10 As shown, users can drag and drop basic elements onto the image. AI will automatically generate related materials based on the element names for users to choose from. Users can select one or more materials to add to the image.
[0150] (2) Fig.11 As shown, all generated materials will be automatically stored in the basic material library. Users can click on the corresponding material package to view the existing materials and add them to the image by dragging and dropping.
[0151] Step E: Edit and add to the generated basic material library.
[0152] (1) If the user no longer needs a material package, the user can long press any material package to enter the material library editing mode. In the editing mode, the user can click the delete button in the upper right corner to delete the unnecessary material package. The specific process can refer to the relevant description in the above step C.
[0153] (2) If the user is not satisfied with the content of a generated material package, Fig.11 As shown, you can expand the content of the material package and click the "Change Batch" button in the lower right corner to regenerate the material.
[0154] (3) If the user wants to add materials, Fig.12 As shown, you can click the Add Material button on the left toolbar and enter the element name in the pop-up box at the bottom of the interface to complete the element addition.
[0155] Step F: Combine various materials to create a first draft of your custom wallpaper.
[0156] like Fig.13 As shown, users can carefully select, combine and match various materials from the material packages of various themes in the basic material library, and finally add them to the image to form a preliminary draft of a custom wallpaper.
[0157] Step 107: Wallpaper polishing and wallpaper sharing.
[0158] like Fig.14 As shown, after the first draft is completed, the user can click the wallpaper polishing button to enter the wallpaper polishing page to adjust the wallpaper effects such as cropping, scaling, filtering, and coloring, as well as share the wallpaper.
[0159] In this way, the efficiency of wallpaper customization can be improved: by combining AI capabilities to extract the basic element information of the image, users can quickly complete the customization of the wallpaper basic element library, greatly reducing the time and energy of users adding elements by themselves. And the degree of personalization of wallpapers can be improved: by using AI capabilities, a basic material library suitable for the scene can be generated based on the basic element library, and customized wallpapers can be quickly and accurately produced according to image content and user needs, making the wallpaper more personalized and emotional. And it can enhance user experience: the implementation method of the present invention enables users to easily customize wallpapers with emotions and stories, which enhances users' emotional identification and usage experience of wallpapers.
[0160] The above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.
[0161] The image processing method provided in the embodiment of the present application can be executed by an image processing device. In the embodiment of the present application, an image processing device executing the image processing method is taken as an example to illustrate the image processing device provided in the embodiment of the present application.
[0162] like Fig.15 As shown, an embodiment of the present application provides an image processing device 150 , which may include a receiving module 151 , a display module 152 , a generating module 153 and a processing module 154 .
[0163] Among them, the receiving module 151 can be used to receive a first input of a first image. The display module 152 can be used to display at least one element information corresponding to the first image in response to the first input received by the receiving module 151. The receiving module 151 can also be used to receive a second input of a first element information in the at least one element information. The generating module 153 can be used to generate at least one material related to the first element information in response to the second input received by the receiving module 151. The receiving module 151 can also be used to receive a third input of a first material in the at least one material. The processing module 154 can be used to perform fusion processing on the first material and the first image in response to the third input received by the receiving module 151 to obtain a second image.
[0164] In a possible implementation, the first input may include a first sub-input and a second sub-input. The display module 152 may be specifically configured to display all element information corresponding to the first image in response to the first sub-input; and to update the displayed element information from all element information to the at least one element information in response to the second sub-input, wherein the second sub-input is used for at least one of the following: deleting element information, modifying element information, and adding element information.
[0165] In a possible implementation, the first element information may include N element information, where N is a positive integer, and the image processing device 150 may further include a storage module. The storage module may be configured to store the material related to each element information in the N element information in a material set after the generating module 153 generates the at least one material related to the first element information in response to the second input received by the receiving module 151, thereby obtaining N material sets.
[0166] In a possible implementation, the receiving module 151 may also be used to receive a fourth input of a first material set in the N material sets after the storage module stores the material related to each element information in the N element information in a material set to obtain the N material sets. The processing module 154 may also be used to update the material in the first material set in response to the fourth input received by the receiving module 151. The fourth input is used for at least one of the following: deleting material, regenerating material, and adding material.
[0167] In a possible implementation, the receiving module 151 may also be used to receive a fifth input on the second image after the processing module 154 performs a fusion process on the first material and the first image in response to the third input received by the receiving module 151 to obtain the second image. The processing module 154 may also be used to perform a first operation on the second image in response to the fifth input received by the receiving module 151, and the first operation includes at least one of the following: an adjustment operation of display parameters and a sharing operation.
[0168] In the image processing device provided in the embodiment of the present application, on the one hand, the image processing device can first display the element information corresponding to the first image by inputting the first image, and then directly generate at least one material related to the first element information for the user to select by inputting the first element information therein, without having to search in a large amount of local or network materials; on the other hand, the image processing device can directly merge the first material and the first image by only inputting the first material in the at least one material, so as to obtain a second image after adding the first material, without having to manually perform a series of processing operations such as cutout processing, cropping processing, scaling processing and color adjustment processing; this can simplify the image processing process.
[0169] The image processing device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0170] The image processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0171] The image processing device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0172] like Fig.16 As shown, an embodiment of the present application further provides an electronic device 100, including a processor 101 and a memory 102, wherein the memory 102 stores programs or instructions that can be executed on the processor 101, and when the program or instructions are executed by the processor 101, the various steps of the above-mentioned image processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.
[0173] It should be noted that the electronic devices in the embodiments of the present application include mobile electronic devices and non-mobile electronic devices.
[0174] Fig.17 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0175] like Fig.17As shown, the electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010 and other components.
[0176] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.17 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0177] Among them, the user input unit 1007 can be used to receive a first input for a first image. The display unit 1006 can be used to display at least one element information corresponding to the first image in response to the first input received by the user input unit 1007. The user input unit 1007 can also be used to receive a second input for a first element information in the at least one element information. The processor 1010 can be used to generate at least one material related to the first element information in response to the second input received by the user input unit 1007. The user input unit 1007 can also be used to receive a third input for a first material in the at least one material. The processor 1010 can also be used to perform fusion processing on the first material and the first image in response to the third input received by the user input unit 1007 to obtain a second image.
[0178] In a possible implementation, the first input may include a first sub-input and a second sub-input. The display unit 1006 may be specifically configured to display all element information corresponding to the first image in response to the first sub-input; and to update the displayed element information from all element information to the at least one element information in response to the second sub-input, wherein the second sub-input is used for at least one of the following: deleting element information, modifying element information, and adding element information.
[0179] In a possible implementation, the first element information may include N element information, where N is a positive integer. The memory 1009 may be configured to store the material related to each element information in the N element information in a material set after the processor 1010 generates the at least one material related to the first element information in response to the second input received by the user input unit 1007, thereby obtaining N material sets.
[0180] In a possible implementation, the user input unit 1007 may also be used to store the material related to each element information in the N element information in a material set, and after obtaining the N material sets, receive a fourth input for a first material set in the N material sets. The processor 1010 may also be used to update the material in the first material set in response to the fourth input received by the user input unit 1007. The fourth input is used for at least one of the following: deleting a material, regenerating a material, and adding a material.
[0181] In a possible implementation, the user input unit 1007 may also be used to receive a fifth input on the second image after the processor 1010 performs fusion processing on the first material and the first image in response to the third input received by the user input unit 1007 to obtain the second image. The processor 1010 may also be used to perform a first operation on the second image in response to the fifth input received by the user input unit 1007, the first operation including at least one of the following: an adjustment operation of display parameters and a sharing operation.
[0182] In the electronic device provided in the embodiment of the present application, on the one hand, the electronic device can first display the element information corresponding to the first image by inputting the first image, and then directly generate at least one material related to the first element information for the user to select by inputting the first element information therein, without having to search in a large amount of local or network materials; on the other hand, the electronic device can directly merge the first material and the first image by only inputting the first material in the at least one material, so as to obtain a second image after adding the first material, without having to manually perform a series of processing operations such as cutout processing, cropping processing, scaling processing and color adjustment processing; this can simplify the image processing process.
[0183] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0184] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0185] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.
[0186] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned image processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0187] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0188] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0189] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0190] An embodiment of the present application provides a computer program / program product, which is stored in a storage medium. The program / program product is executed by at least one processor to implement the various processes of the above-mentioned image processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0191] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0192] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0193] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An image processing method, characterized in that: The method comprises: receiving a first input of a first image; In response to the first input, displaying at least one element information corresponding to the first image; receiving a second input of a first element information in the at least one element information; In response to the second input, generating at least one material related to the first element information; receiving a third input of a first material of the at least one material; In response to the third input, a fusion process is performed on the first material and the first image to obtain a second image.
2. The method according to claim 1, characterized in that The first input includes a first sub-input and a second sub-input; The step of displaying at least one element information corresponding to the first image in response to the first input includes: In response to the first sub-input, displaying all element information corresponding to the first image; In response to the second sub-input, the displayed element information is updated from the all element information to the at least one element information, and the second sub-input is used for at least one of the following: deleting element information, modifying element information, and adding element information.
3. The method according to claim 1, characterized in that The first element information includes N element information, where N is a positive integer; After generating at least one material related to the first element information in response to the second input, the method further includes: The material related to each of the N element information is stored in a material set to obtain N material sets.
4. The method according to claim 3, characterized in that After storing the material related to each of the N element information in a material set to obtain N material sets, the method further includes: Receiving a fourth input of a first material set among the N material sets; In response to the fourth input, updating the material in the first material set; The fourth input is used for at least one of the following: deleting material, regenerating material, and adding material.
5. The method according to any one of claims 1 to 4, characterized in that After performing fusion processing on the first material and the first image in response to the third input to obtain a second image, the method further includes: receiving a fifth input of the second image; In response to the fifth input, a first operation is performed on the second image, where the first operation includes at least one of the following: an adjustment operation of a display parameter, and a sharing operation.
6. An image processing device, characterized in that: The device comprises a receiving module, a display module, a generating module and a processing module; The receiving module is used to receive a first input of a first image; The display module is configured to display at least one element information corresponding to the first image in response to the first input received by the receiving module; The receiving module is further used to receive a second input of the first element information in the at least one element information; The generating module is configured to generate at least one material related to the first element information in response to the second input received by the receiving module; The receiving module is further configured to receive a third input of a first material in the at least one material; The processing module is used to perform fusion processing on the first material and the first image in response to the third input received by the receiving module to obtain a second image.
7. The device according to claim 6, characterized in that The first input includes a first sub-input and a second sub-input; The display module is specifically used to display all element information corresponding to the first image in response to the first sub-input; and to update the displayed element information from all element information to at least one element information in response to the second sub-input, and the second sub-input is used for at least one of the following: deleting element information, modifying element information, and adding element information.
8. The device according to claim 6, characterized in that The first element information includes N element information, N is a positive integer, and the device also includes a storage module; The storage module is used to store the material related to each of the N element information in a material set after the generation module generates the at least one material related to the first element information in response to the second input received by the receiving module, so as to obtain N material sets.
9. The device according to claim 8, characterized in that The receiving module is further configured to store the materials related to each of the N element information in a material set in the storage module, and after obtaining the N material sets, receive a fourth input of a first material set in the N material sets; The processing module is further configured to update the material in the first material set in response to the fourth input received by the receiving module; The fourth input is used for at least one of the following: deleting material, regenerating material, and adding material.
10. The device according to any one of claims 6 to 9, characterized in that The receiving module is further configured to receive a fifth input of the second image after the processing module performs fusion processing on the first material and the first image in response to the third input received by the receiving module to obtain the second image; The processing module is further configured to perform a first operation on the second image in response to the fifth input received by the receiving module, where the first operation includes at least one of the following: an adjustment operation of display parameters and a sharing operation.
Citation Information
Cited By
Image processing method and apparatus
WO2026149395A1
