Image layout scheme generation method, layout image generation method, and electronic device
By analyzing reference images using electronic devices to generate image layout schemes, the problem of the lack of universality and ease of use of image layout techniques in existing technologies is solved, realizing automated and efficient image layout and improving user experience.
Patent Information
- Application Number
- CN202510200590.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-21
- Publication Date
- 2026-08-25
AI Technical Summary
In existing technologies, image layout techniques lack universality and ease of use. Users need to operate manually or rely on specific templates, resulting in high learning costs and uncontrollable layout effects.
Electronic devices analyze reference images to generate image layout schemes, including image features and processing steps, and automatically generate layout images that are similar in effect to the reference images.
It improves the efficiency of image layout and user experience, meets the needs of different users and scenarios, and is versatile and easy to use, without relying on the user's learning and operation capabilities.
Smart Images

Figure CN122636764A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic equipment technology, and in particular to a method for generating image layout schemes, a method for generating layout images, and an electronic device. Background Technology
[0002] With the rapid development of image editing and enhancement technologies, there are increasingly more scenarios for image enhancement using smartphones and other smart devices. This greatly satisfies users' social needs for recording life and sharing daily moments, such as posting... In this context, users expect the images they share to be as aesthetically pleasing as possible. Therefore, users have increasingly higher demands for image layout and presentation.
[0003] Currently, most image layout techniques are achieved through manual operation by users or by applying specific templates from a particular application. These methods lack universality and ease of use for different users or scenarios. Therefore, the development of image layout technology based on aesthetic appeal still faces many challenges and opportunities. Summary of the Invention
[0004] This application provides a method for generating image layout schemes, a method for generating layout images, and an electronic device, which can generate image layout schemes according to user needs, thereby enabling image layout based on the generated image layout schemes, meeting user needs for image layout effects, and improving user experience.
[0005] Firstly, embodiments of this application provide a method for generating an image layout scheme, which can be applied to an electronic device. Here, "electronic device" can refer to the electronic device itself, or to a processor, module, chip, or chip system within the electronic device that implements the method. The following description uses an electronic device as an example; the method includes the following steps:
[0006] An electronic device acquires a first reference image; the first reference image is generated based on a combination and layout of multiple first materials; the multiple first materials include at least one first image material; the electronic device analyzes the first reference image to generate a first image layout scheme; wherein, the first image layout scheme includes at least one set of image features determined according to the at least one first image material, and multiple processing steps for multiple target materials; the multiple target materials include at least one target image material having the at least one set of image features; the electronic device saves the first image layout scheme.
[0007] Optionally, the first image layout scheme can be used to combine and layout the multiple target materials, or it can be used to guide users or electronic devices to combine and layout the multiple target materials.
[0008] This method allows electronic devices to generate corresponding image layout schemes based on acquired reference images. This enables the generation of layouts with the same or similar effects as the reference image. Users can select reference images that meet their display requirements to generate layout schemes, allowing the electronic device to create layouts that satisfy user needs and improve the user experience. This method is not limited by user learning or operational abilities, nor by specific scenarios or image editing applications; it is versatile and easy to use.
[0009] In one possible design, the electronic device can analyze the first reference image and generate a first image layout scheme through the following steps:
[0010] The electronic device performs image analysis on the first reference image to obtain the plurality of first materials that make up the first reference image;
[0011] The electronic device performs image analysis on the plurality of first materials in the first reference image and generates the first image layout scheme.
[0012] Through this design, electronic devices can obtain a first image layout scheme corresponding to the first reference image by performing image analysis and screen analysis on the first reference image.
[0013] In one possible design, the electronic device performs image analysis on the plurality of first materials in the first reference image to generate the first image layout scheme, including:
[0014] The electronic device performs image analysis on the plurality of first materials in the first reference image to obtain layout technique knowledge of the first reference image; wherein, the layout technique knowledge of the first reference image includes at least one of the following: image features of each first image material, image processing method of each first image material, layout style of the at least one first image material in the first reference image, image processing method of the first reference image, and layout logic of the first reference image; the electronic device generates the first image layout scheme based on the layout technique knowledge of the first reference image.
[0015] Through this design, the electronic device disassembles and extracts the typography techniques used in the first reference image, so that a first image typography scheme can be generated based on the typography techniques of the first reference image, so that a typography image with the same or similar typography effect as the first reference image can be generated subsequently based on the first image typography scheme.
[0016] In one possible design, the plurality of first materials further includes at least one first supplementary material, any one of which is a material of a type other than an image material; the plurality of target materials further includes at least one target supplementary material corresponding to the at least one first supplementary material; the layout technique knowledge of the first reference image also includes: the type and / or style of each first supplementary material.
[0017] In one possible design, any of the first supplementary materials can be of the following types: text material, sticker material, or motion effect material.
[0018] In one possible design, the electronic device can perform image analysis on the plurality of first materials in the first reference image based on the typesetting skills knowledge stored in the typesetting skills knowledge base, and obtain the typesetting skills knowledge of the first reference image; wherein, the typesetting skills knowledge base contains the typesetting skills knowledge of the first reference image.
[0019] Through this design, an electronic device can be equipped with a typography skills knowledge base, so that it can rely on the large amount of typography skills knowledge in the typography skills knowledge base to accurately decompose and extract the typography skills knowledge used in the first reference image.
[0020] In one possible design, the electronic device can generate the first image layout scheme based on the layout techniques of the first reference image through the following steps:
[0021] The electronic device determines the image features of the at least one first image material and the multiple processing steps of the plurality of first materials based on the layout techniques of the first reference image; and generates the first image layout scheme based on the image features of the at least one first image material and the multiple processing steps of the plurality of first materials.
[0022] Through this design, the electronic device can obtain a first image layout scheme based on the layout techniques of the first reference image.
[0023] In one possible design, the at least one set of image features in the first image layout scheme are the same as the image features of the at least one first image material; and the multiple processing steps of the multiple target materials in the first image layout scheme are the same as the multiple processing steps of the multiple first materials.
[0024] In one possible design, the first image layout scheme also includes device capability information required for at least one processing step;
[0025] The electronic device can also determine the equipment capabilities required for the at least one processing step based on the set of equipment capabilities of the electronic device.
[0026] Through this design, in the subsequent image layout process using the first image layout scheme, the capability dependency of the first image layout scheme can be determined. The electronic device can call the corresponding device capability when executing specific processing steps to ensure the successful execution of the processing steps.
[0027] In one possible design, any set of image features includes at least one of the following:
[0028] The type of image material, the scene depicted in the image material, and the type of objects in the image material.
[0029] In one possible design, any processing step in the first image layout scheme includes any of the following:
[0030] A first image processing is performed on a target image material; wherein the first image processing includes at least one of the following: segmentation and cropping, color adjustment, scaling, adding filters, and image cutout;
[0031] According to a first layout style, the at least one target image material is processed to generate a first original layout image; the first layout style includes at least one of the following: collage, cropping, and stacking;
[0032] Add at least one target supplementary material to the first original layout image or the at least one target image material to generate a second original layout image;
[0033] The first original layout image or the second original layout image is subjected to a second image processing; wherein the second image processing includes at least one of the following: color adjustment and adding filters.
[0034] In one possible design, the electronic device acquires the first reference image through the following steps:
[0035] The electronic device displays a first user interface on a screen; when receiving a first operation performed by the user on the first user interface, the electronic device acquires the first reference image input by the user; wherein, the first operation is the operation of the user inputting the first reference image.
[0036] Through this design, the electronic device can acquire a first reference image input by the user for generating an image layout scheme.
[0037] In one possible design, the electronic device may further determine at least one first target image material and determine the first image layout scheme; wherein the at least one first target image material corresponds one-to-one with the at least one set of image features, and the image features of any first target image material match the corresponding set of image features; and according to the multiple processing steps included in the first image layout scheme, the multiple first target materials are processed to obtain a first layout image; wherein the multiple first target materials include the at least one first target image material.
[0038] This design allows electronic devices to arrange at least one target image material according to an image layout scheme, generating a layout image. This method is not limited by user learning and operational capabilities, nor by specific scenarios or image editing applications, possessing versatility and ease of use. Because at least one target image material used to generate the layout image matches at least one set of image features contained in the image layout scheme, this method ensures that the layout effect of the generated layout image is the same as or similar to the layout effect of the reference image corresponding to the image layout scheme. In summary, this method can improve image layout efficiency.
[0039] In one possible design, the electronic device can select at least one first target image material from the image library of the electronic device based on the at least one set of image features included in the first image layout scheme; each first target image material has a corresponding set of image features.
[0040] With this design, electronic devices can select at least one suitable first target image material from the image library based on the first image layout scheme after determining the first image layout scheme.
[0041] In one possible design, the electronic device can determine the first image layout scheme from a plurality of stored image layout schemes.
[0042] In one possible design, the electronic device can determine the first image layout scheme from a plurality of stored image layout schemes by:
[0043] Method 1: Determine the first image layout scheme selected by the user from the plurality of image layout schemes;
[0044] Method 2: Determine the first image layout scheme from among the plurality of image layout schemes based on the user preference settings information of the first image layout scheme;
[0045] Method 3: Determine the first image layout scheme that the user uses most frequently among the multiple image layout schemes.
[0046] With this design, the electronic device can determine the first image layout scheme based on the user's selection, or autonomously select the image layout scheme based on the user's preference or the user's usage frequency.
[0047] In one possible design, the electronic device can determine the at least one first target image material selected by the user.
[0048] In one possible design, the electronic device determines the first image layout scheme through the following steps:
[0049] The electronic device determines the image features of each of the at least one first target image materials; the electronic device determines the first image layout scheme from a plurality of stored image layout schemes based on the image features of the at least one first target image material; wherein, the first image layout scheme contains at least one set of image features that have the highest similarity to the image features of the at least one first target image material; and the image features of any first target image material contain at least one image feature from a corresponding set of image features.
[0050] This design allows electronic devices to determine a suitable image layout scheme based on pre-defined image materials.
[0051] In one possible design, after obtaining the first layout image, the electronic device can also display the first layout image on a screen; or display a first notification message or a first control on the screen; wherein the first notification message is used to prompt the user that the first layout image has been generated, and the first control displays a thumbnail of the first layout image; when a second operation is received from the user on the first notification message or the first control, the first layout image is displayed on the screen.
[0052] Secondly, embodiments of this application provide a method for generating layout images, which can be applied to electronic devices. Here, "electronic device" can refer to the electronic device itself, or to a processor, module, chip, or chip system within the electronic device that implements the method. The following description uses an electronic device as an example; the method includes the following steps:
[0053] An electronic device determines at least one first target image material and determines a first image layout scheme; wherein, the first image layout scheme includes at least one set of image features and multiple processing steps for multiple target materials; the multiple target materials include at least one target image material having the at least one set of image features; the at least one first target image material corresponds one-to-one with the at least one set of image features, and the image features of any first target image material match the corresponding set of image features; the electronic device processes the multiple first target materials according to the multiple processing steps included in the first image layout scheme to obtain a first layout image; wherein, the multiple first target materials include the at least one first target image material.
[0054] This method allows electronic devices to arrange at least one target image material according to an image layout scheme, generating a layout image. This method is not limited by user learning and operational capabilities, nor by specific scenarios or image editing applications, possessing versatility and ease of use. Because at least one target image material used to generate the layout image matches at least one set of image features contained in the image layout scheme, this method ensures that the layout effect of the generated layout image is the same as or similar to the layout effect of the reference image corresponding to the image layout scheme. In summary, this method can improve image layout efficiency.
[0055] In one possible design, the electronic device can select at least one first target image material from the image library of the electronic device based on the at least one set of image features included in the first image layout scheme; each first target image material has a corresponding set of image features.
[0056] In one possible design, the electronic device can determine the first image layout scheme from a plurality of stored image layout schemes.
[0057] In one possible design, the electronic device can determine the first image layout scheme from a plurality of stored image layout schemes by:
[0058] Method 1: Determine the first image layout scheme selected by the user from the plurality of image layout schemes; or
[0059] Method 2: Determine the first image layout scheme from among the plurality of image layout schemes based on the user preference settings information of the first image layout scheme;
[0060] Method 3: Determine the first image layout scheme that the user uses most frequently among the multiple image layout schemes.
[0061] In one possible design, the electronic device can determine the at least one first target image material selected by the user.
[0062] In one possible design, the electronic device determines the first image layout scheme through the following steps:
[0063] The electronic device determines the image features of each of the at least one first target image materials; the electronic device determines the first image layout scheme from a plurality of stored image layout schemes based on the image features of the at least one first target image material; wherein, the first image layout scheme contains at least one set of image features that have the highest similarity to the image features of the at least one first target image material; and the image features of any first target image material contain at least one image feature from a corresponding set of image features.
[0064] In one possible design, the electronic device may also display the first layout image on a display screen; or display a first notification message or a first control on a display screen; wherein the first notification message is used to prompt the user that the first layout image has been generated, and the first control displays a thumbnail of the first layout image; when a user operation is received on the first notification message or the first control, the first layout image is displayed on the display screen.
[0065] Thirdly, embodiments of this application provide an electronic device including a display screen, one or more processors, and a memory; the one or more processors are coupled to the memory, and the one or more processors are configured to read a computer program stored in the memory to execute the method provided in the first or second aspect. The computer program code includes computer instructions.
[0066] Fourthly, embodiments of this application provide a chip including a processor coupled to a memory. The processor is used to call computer program instructions stored in the memory during runtime to implement the methods provided in the first or second aspect. Optionally, the chip may further include components such as a memory, a communication interface, and a power supply module. The memory is used to store computer programs; the communication interface is used to receive and send data; and the power supply module is used to supply power to the processor.
[0067] Fifthly, embodiments of this application provide a computer storage medium storing computer program instructions that, when executed on an electronic device, cause the computer to perform the methods provided in the first or second aspect described above.
[0068] In a sixth aspect, embodiments of this application provide a computer program product, the computer program product including computer program instructions; when the computer program instructions are executed on a computer, the computer causes the computer to perform the method provided in the first aspect or the second aspect.
[0069] The technical effects that can be achieved by any of the second to sixth aspects mentioned above can be described with reference to the technical effects that can be achieved by any possible design in the first aspect mentioned above. The repetitions will not be discussed. Attached Figure Description
[0070] Figure 1 A schematic diagram of an electronic device provided in an embodiment of this application;
[0071] Figure 2 A schematic diagram of the software structure of an electronic device provided in an embodiment of this application;
[0072] Figure 3 A flowchart illustrating an image layout scheme generation method provided in this application embodiment;
[0073] Figure 4 A schematic diagram illustrating an image layout scheme generation method provided in an embodiment of this application;
[0074] Figure 5 A schematic diagram illustrating an image layout method provided in an embodiment of this application;
[0075] Figure 6 An example image layout diagram provided for an embodiment of this application;
[0076] Figure 7 An example diagram illustrating layout techniques for a reference image 1 provided in this application embodiment;
[0077] Figure 8 A flowchart illustrating a method for generating typesetting images provided in this application embodiment;
[0078] Figure 9 This is a structural diagram of an electronic device provided in an embodiment of this application. Detailed Implementation
[0079] This application provides a method for generating image layout schemes, a method for generating layout images, and an electronic device, which can generate image layout schemes according to user needs, thereby enabling image layout based on the generated image layout schemes, meeting user needs for image layout effects, and improving user experience.
[0080] The following explanations of some terms used in this application are provided to facilitate understanding by those skilled in the art.
[0081] 1) Electronic equipment refers to devices or apparatuses that have data connectivity, data calculation, and processing capabilities. Electronic equipment may have a display screen to show a user interface for human-computer interaction.
[0082] For example, the electronic device in this application may be a tablet computer, personal computer (PC), laptop computer, computer, netbook, in-vehicle computer, in-vehicle terminal, smartphone, smart wearable device (e.g., smartwatch, smart bracelet, smart glasses, smart helmet, etc.), personal digital assistant (PDA), smart home device (e.g., smart TV, smart mirror, smart speaker, etc.). This application does not limit the specific form of the electronic device.
[0083] Electronic devices can perform their functions and provide services to users through an operating system they run. For example, the electronic device may, but is not limited to, running an operating system... Or other operating systems.
[0084] 2) Layout image, which is an image generated based on the layout of multiple materials.
[0085] 3) Reference image. In this embodiment, the reference image is a layout image generated based on a combination of multiple materials, which the user uses as a layout template so that the user's electronic device can generate a layout image with a similar layout effect to the reference image based on the image stored in the image library.
[0086] 4) Materials refer to materials used in image layout, design, editing, or creation. In the embodiments of this application, materials are the materials needed to combine them into a layout image.
[0087] For example, the multiple materials constituting a layout image may include, but are not limited to, at least one of the following types: image materials, text materials, sticker materials, animation materials, etc. The number of any one type of material constituting a layout image may be one or more.
[0088] Optionally, since image materials are the most important materials in a layout, other types of materials besides image materials can be collectively referred to as supplementary materials, added materials, or other materials. For ease of description, in the following description and embodiments of this application, other types of materials besides image materials will be referred to as supplementary materials.
[0089] It should also be noted that the materials used to compose the layout image can include raw, unprocessed material or processed material. For example, the image materials used to compose the layout image can be raw images selected by the user or electronic device from the electronic device's image library without any image processing, or images after image processing (cropping, cutout, filtering, etc.) has been performed on the raw images. Taking layout image A as an example: the multiple split images obtained after splitting layout image A can all be called image materials, and some of these split images may be obtained after image processing based on the raw image; the raw image selected by the user or electronic device from the image library before generating layout image A can also be called image material, and the raw image processed by the electronic device during the generation of layout image A can also be called image material.
[0090] 5) Knowledge of layout techniques for images, which is the information on the measures and / or resources used to process, combine and arrange multiple materials into a single layout image.
[0091] For example, the knowledge of layout techniques for layout images may include, but is not limited to, at least one of the following: the image characteristics of each image material, the screen processing method of each image material, the type and / or style of each supplementary material, the layout style of all image materials in the layout image, the screen processing method of the layout image, and the layout logic of the layout image.
[0092] The following is a brief explanation of each typesetting technique:
[0093] 1. The image features of the image material may include, but are not limited to, at least one of the following: the type of the image material, the scene depicted by the image material, and the type of objects in the image material.
[0094] For example, image materials can be categorized as follows: portraits, animals (which can be further subdivided into cats, dogs, rabbits, etc.), landscapes, and objects. Optionally, the portrait category can be further subdivided into: selfies, ID photos, half-body portraits, full-body portraits, family photos, group photos, friend photos, baby photos, etc.; the animal category can be further subdivided into: cats, dogs, rabbits, fish, etc.; the landscape category can be further subdivided into: natural landscapes such as mountains, water, grasslands, forests, snow scenes, and the sea, as well as cultural landscapes; and the object category can be further refined based on the type of objects in the image material.
[0095] For example, the scenes depicted in the image materials can include: family, travel, sports, work, entertainment, leisure, etc.
[0096] For example, the types of objects in an image may include: vehicles, equipment, houses, flowers, books, etc.
[0097] 2. Image processing methods for image materials, i.e., image processing methods to adapt image materials to layout requirements. Optional, image processing methods may include, but are not limited to: segmentation and cropping, color correction, scaling, adding filters, and background removal.
[0098] 3. Types and styles of each supplementary material. Supplementary material types can include: text materials, sticker materials, animation materials, etc. The style of a supplementary material refers to its shape or appearance. Taking text materials as an example, the style of text materials can include: text content, size, color, font, and other characteristics.
[0099] 4. The layout style of all image materials in the layout image may include, but is not limited to: collage, cropping, stacking, etc.
[0100] 5. The image processing methods for layout images may include, but are not limited to, color correction, adding filters, etc.
[0101] 6. The layout logic of the image, that is, the rules or patterns on which the image is laid out. For example, the layout logic of the image may be a layout script that relies on the capabilities of the local device.
[0102] It should be noted that the image processing methods of the above-mentioned image materials, the layout style of all image materials in the layout image, and the image processing methods of the layout image all require electronic devices to rely on their own device capabilities (software capabilities and / or hardware capabilities) to achieve.
[0103] 6) The device capabilities of electronic devices, namely the functions and performance of electronic devices, enabling them to complete specific tasks or meet user needs. For example, the device capabilities of electronic devices may include: computing power (such as processor performance indicators), storage capacity (such as the type of storage medium and storage performance indicators), and software support capabilities (the various functions of the electronic device's operating system or applications).
[0104] In this application embodiment, the device capability that supports electronic devices in generating layout images based on multiple materials may include: computing power, storage capacity, image processing capabilities (such as having at least one of the following image processing capabilities: segmentation, cropping, color adjustment, scaling, adding filters, cutout, collage, stacking, etc.), and the ability to call image processing applications.
[0105] 7) Image layout scheme, including: image features of the image materials needed to generate the layout image, and processing steps for multiple materials, including the image materials. The image layout scheme is used to combine and arrange multiple materials, or to guide users to combine and arrange multiple materials.
[0106] Based on the image layout scheme, electronic devices can find target image materials that meet specific image characteristics, and process multiple target materials, including the target image material, based on the processing steps in the image layout scheme, and finally obtain the layout image.
[0107] For example, any processing step in an image layout scheme may include any of the following:
[0108] Image processing of image materials; wherein, image processing of any image material may include at least one of the following: segmentation and cropping, color correction, scaling, adding filters, and cutout;
[0109] According to a set layout style, at least one image material is processed to generate a first original layout image; wherein, the set layout style includes at least one of the following: collage, cropping, stacking;
[0110] Add at least one supplementary image to the first original layout image or at least one image image to generate a second original layout image;
[0111] The first original layout image or the second original layout image is processed; wherein the processing includes at least one of the following: color adjustment, adding filters.
[0112] 8) A control is a component that encapsulates data and / or program to activate certain functions or applications of an electronic device. Optionally, in the user interface, controls may be presented in various forms, including but not limited to cards, virtual buttons, icons, pop-ups, etc.
[0113] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.
[0114] In the embodiments of this application, descriptions such as "when," "under the circumstances," "if," and "if" all refer to the control device making corresponding actions under certain objective circumstances. They are not time limits, nor do they require the control device to make judgments during implementation, nor do they imply any other limitations.
[0115] It should be noted that in this application, "used for indicating" can include both direct and indirect indication. When describing information as being used to indicate A, it can include whether the information directly or indirectly indicates A, but does not necessarily mean that the information contains A. Taking first information used to indicate first content as an example, the first information can contain the first content, or a part of the first content, or an identifier, index, indicator, etc., of the first content, and can also contain algorithms, calculation parameters, etc., for determining the first content. This application does not limit the manner of "indication".
[0116] In this application, "containing / including A" may be equivalent to "containing / including information A". Information A is used to indicate A.
[0117] In addition, it should be understood that in the description of this application, the words "first" and "second" are used only for the purpose of distinguishing descriptions and should not be construed as indicating or implying relative importance or order.
[0118] Currently, in order to meet the social needs of recording life and sharing daily life, users need to beautify their images. Users want the images they share to have exquisite designs, so users have increasingly higher requirements for the layout of images.
[0119] Currently, many users refer to online tutorials on aesthetic image layout and complete image layouts using image editing applications. This approach requires users to learn various layout techniques from these tutorials and master the use of editing applications. This high level of user involvement results in a high learning curve, complex operation, and unpredictable final display quality of the layout image.
[0120] In other solutions, users can rely on specific layout templates in certain image editing applications to achieve image layout. However, this approach is inflexible, lacks versatility and ease of use, and produces poor layout results, failing to meet users' layout needs.
[0121] Based on this, embodiments of this application provide a method for generating image layout schemes, a method for generating layout images, and an electronic device. In this scheme, the electronic device can generate a corresponding image layout scheme based on an acquired reference image, so that a layout image with the same or similar layout effect as the reference image can be generated subsequently based on this image layout scheme. Based on this method, users can select a reference image whose display effect meets their needs to generate an image layout scheme, thereby enabling the electronic device to achieve image layout and obtain a layout image based on the generated image layout scheme, thus satisfying the user's needs for image layout effects and improving the user experience. This method is not limited by user learning and operational capabilities, nor is it limited to specific scenarios or specific image editing applications; it has universality and ease of use.
[0122] The solutions provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.
[0123] This application provides an electronic device that can implement the image layout scheme generation method and layout image generation method provided in this application. See below for reference. Figure 1 The structure of the electronic device provided in the embodiments of this application will be described.
[0124] like Figure 1 As shown, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a SIM card interface 195, etc.
[0125] Processor 110 may include one or more processing units, such as a central processing unit (CPU), an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.
[0126] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from this memory. By providing memory, the number of times the processor 110 accesses data in the internal memory 121 can be reduced, thus reducing the processor 110's waiting time and improving system efficiency.
[0127] Display screen 194 is used to display various user interfaces. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays screens 194, where N is a positive integer greater than 1. Display screen 194 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, display screen 194 may display windows, images, videos, web pages, or documents, etc.
[0128] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, program code for at least one application, etc. The operating system may include, but is not limited to, […]. The storage program area may store computer programs for implementing the image layout scheme generation method provided in the embodiments of this application. When the processor 110 executes these computer programs, the electronic device can execute the image layout scheme generation method. The storage data area may store data created during the use of the electronic device 100, such as at least one reference image and the image layout scheme corresponding to each reference image, as well as image libraries, etc.
[0129] In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0130] The sensor module 180 may include, but is not limited to, fingerprint sensors, touch sensors, pressure sensors, magnetic sensors, ambient light sensors, barometric pressure sensors, bone conduction sensors, etc.
[0131] A touch sensor, also known as a "touch panel," can be located on the display screen 194. The touch sensor detects touch operations applied to or near it. It transmits the detected touch operation to an application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some embodiments, the touch sensor can be integrated with the display screen 194 to form a touch display. In other embodiments, the touch sensor may be located on the surface of the electronic device 100, in a different position than the display screen 194.
[0132] The wireless communication function of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Mobile communication module 150 can provide wireless communication solutions for electronic device 100, including 2G / 3G / 4G / 5G. Wireless communication module 160 can provide wireless communication solutions for electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies.
[0133] It should be understood that Figure 1 The electronic device 100 shown is merely an example and does not constitute a limitation on the electronic device. In practical applications, the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0134] The software system of the electronic device 100 provided in this application embodiment can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment takes a layered architecture as an example. Figure 2 The software structure of an electronic device is illustrated by example.
[0135] A layered architecture divides the software within an electronic device into several layers, each with a clear role and function. Layers can communicate with each other through software interfaces. For example... Figure 2 As shown, the software architecture of an electronic device, from top to bottom, includes at least the following: application layer, system service layer, and kernel layer. Additionally, an electronic device may include a hardware abstraction layer (HAL), which provides hardware resource support for the electronic device.
[0136] The application layer is the top layer of the operating system, including the operating system's native applications and installed third-party applications, such as camera, gallery, calendar, Bluetooth, music, video, messaging, calculator, chat applications, video applications, music applications, electronic map applications, social applications, image editing applications, etc.
[0137] The system service layer is an important part of the operating system of an electronic device, including various system services provided by the operating system. For example, the system service layer may include: window management service, operation management service, notification management service, layer management service, input management service, image layout management service, etc.
[0138] The window management service manages the display and configuration of the window library. Based on display settings and multiple management functions, it controls the display of windows or interfaces on the screen, adjusting their transparency, position, and size. It also includes features such as screen locking and screenshot capabilities. The window management service can obtain parameters such as screen size and resolution, and can identify display areas in the user interface, such as the status bar.
[0139] The operation and management service is responsible for starting, switching, and scheduling various components in the system, as well as managing and scheduling applications.
[0140] Notification management services allow applications to display notification information in the status bar, as well as to convey informational messages. These messages can disappear automatically after a short pause, without requiring user interaction.
[0141] The input management service is used to collect, process, and distribute user operation information and input events. For example, the input management service can receive operation information reported by touch drivers or other input device drivers (such as keyboard drivers, mouse drivers, etc.), convert it into input events, and distribute the input events to other modules for processing.
[0142] Layer management service is a standalone service provided by the operating system of an electronic device. It is a low-level, resident service of the operating system. During device operation, this layer management service needs to run continuously, and the operating system prioritizes allocating resources to it to ensure that it can perform image compositing at any time, thereby ensuring that the electronic device can display the user interface in real time. The layer management service is mainly responsible for the creation, control, and management of layers. It composites and renders the image frames of the corresponding window in each layer, and finally combines the graphic frames from all layers into the image of the user interface to be displayed on the screen.
[0143] An image layout management service is provided to offer users related services for image layout. In this application, the layer management service can generate a corresponding image layout scheme based on a reference image; subsequently, it can also generate layout images with the same or similar layout effect as the reference image based on the image layout scheme.
[0144] It should be noted that the system service layer can also have other system services, which will not be elaborated here.
[0145] Optionally, between the application layer and the system service layer, the software architecture of the electronic device may also include an application framework layer (FWK) (not shown in the figure). The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer may include some predefined functions. For example, the application framework layer may include a content provider, a view system, a phone manager, a resource manager, etc. The content provider stores and retrieves data, making this data accessible to applications in the application layer. The view system includes visual components, such as components that display text, images, documents, etc.; components in the view system can be used to build the user interface of the application. The phone manager provides the communication functions of the electronic device.
[0146] The kernel layer provides the core system services of the operating system, such as security, memory management, process management, network protocol stack, and driver models, all of which are implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to electronic devices, including: display drivers; keyboard drivers; mouse drivers; Flash drivers for memory-based devices; camera drivers; audio drivers; Bluetooth drivers; WiFi drivers; and touch drivers.
[0147] HAL (Hardware Interface Layer) is the interface layer between the operating system kernel and the hardware circuitry of an electronic device, and its purpose is to abstract the hardware. For example, HAL can include various sensors, displays, cameras, hardware composers (HWCs), and other hardware components in an electronic device. The HWC is primarily responsible for image compositing and display.
[0148] It should be noted that, Figure 2 This is merely an example of the software architecture of an electronic device, simply listing some layers and software modules, and does not constitute any limitation on the software architecture of the electronic device. In practical applications, the operating system of an electronic device may include other layers, or each layer may include other software modules for implementing one or more functions or services. Furthermore, this application does not limit the specific layer where each software module resides. For example, some system services in the system service layer may be deployed in the application framework layer or in the kernel layer.
[0149] Furthermore, this application does not specifically limit the names of the various software modules in the software structure. For example, in In operating systems, the window management service can be WindowManagerServer (WMS), the layer management service can be the layer management engine (SurfaceFlinger), and the input management service can be InputManagerService. InputManagerService can include modules such as input management (InputManager), event hub (EventHub), and input dispatcher (InputDispatcher). operating system( In an OS, the window management service can be SceneBoard (SCB), the layer management service can be RenderService (RS), and the input management service can be Multimodal Input Service (INPUT).
[0150] To meet the complex and diverse image layout needs of users, this application provides an image layout scheme generation method. This method can be applied to, for example... Figure 1 The electronic device shown can have a software structure as follows: Figure 2 As shown. See below. Figure 3 The flowchart shown below provides a detailed description of the embodiments of this application.
[0151] S301: The electronic device acquires a first reference image. The first reference image is generated based on a layout of multiple first materials. The multiple first materials include at least one first image material.
[0152] Optionally, the electronic device can acquire the first reference image in various ways. For example, the electronic device can download the first reference image from the Internet based on user operation; or the electronic device can receive the first reference image sent by other electronic devices via wireless connection; or the electronic device can acquire a reference image saved by the user. In short, after a user sees a layout image on the Internet, other electronic devices, or other locations that meets their aesthetic or needs, they can save it as a reference image to the electronic device so that the electronic device can subsequently obtain the image layout scheme corresponding to that layout image.
[0153] Optionally, the electronic device may save the acquired first reference image to a storage space in a specific storage path used to implement the image layout function.
[0154] In one embodiment, the electronic device can interact with the user through a user interface to realize the image layout scheme generation process. Optionally, the electronic device can display a first user interface on a screen; receive a first operation performed by the user on the first user interface, and acquire a first reference image input by the user; wherein, the first operation is the operation of the user inputting the first reference image. Optionally, when the electronic device receives the operation performed by the user on the first user interface to start generating the image layout scheme, it initiates the execution of S302-S303 to execute the first image layout scheme generation process corresponding to the first reference image.
[0155] In another implementation, the electronic device may also automatically trigger the execution of S302-S303 in the background after acquiring the first reference image without user interaction, and execute the first image layout scheme generation process corresponding to the first reference image.
[0156] S302: The electronic device analyzes the first reference image and generates a first image layout scheme. The first image layout scheme includes at least one set of image features determined based on the at least one first image material, and multiple processing steps involving multiple target materials; wherein the multiple target materials include: at least one target image material having at least one set of image features, and at least one target supplementary material corresponding to at least one first supplementary material.
[0157] In this embodiment of the application, the first image layout scheme can be used to combine and layout the multiple target materials, or it can be used to guide the user or electronic device to combine and layout the multiple target materials.
[0158] In this embodiment of the application, the electronic device can perform the above-described process of generating the first image layout scheme in step S302 through steps 3021 and 3022.
[0159] Step 3021: The electronic device performs image analysis on the first reference image to obtain multiple first materials that make up the first reference image. Among these multiple first materials, at least one first image material is included.
[0160] Optionally, all of the multiple first materials may be image materials, meaning that the multiple first materials may include multiple first image materials. Alternatively, the multiple first materials may also include other types of materials, meaning that the multiple first materials may include at least one first image material and at least one first supplementary material; any one of the first supplementary materials may be a material of a type other than an image material. When the multiple first materials include one first image material, they may also include at least one first supplementary material. Optionally, the at least one first supplementary material may include other types of materials such as text materials, sticker materials, and animation materials, which is not limited in this application.
[0161] In one implementation, an electronic device can perform image analysis and understanding on a first reference image based on a visual perception model to obtain multiple first materials that make up the first reference image. This visual perception model is used to intelligently analyze an image from a visual perspective, obtain multiple components within the image, and thus determine the material for each component. The visual perception model can be trained using multiple sets of training samples, each set of training samples including a layout image and multiple materials that make up the layout image.
[0162] Optionally, the electronic device can also determine the relationships between the multiple first materials by performing image analysis on the first reference image. For example, if two or more materials are in a combined relationship, these materials are spliced or stacked together in the first reference image. Another example is that one material can serve as a background for other materials.
[0163] Step 3022: The electronic device performs image analysis on multiple first materials in the first reference image and generates a first image layout scheme corresponding to the first reference image.
[0164] In one implementation, the electronic device executes S3022 by following steps A1-A2:
[0165] Step A1: The electronic device performs image analysis on multiple first materials in the first reference image to obtain layout technique knowledge of the first reference image; wherein, the layout technique knowledge of the first reference image includes at least one of the following: image features of each first image material, image processing method of each first image material, layout style of at least one first image material in the first reference image, image processing method of the first reference image, and layout logic of the first reference image. When the multiple first materials include at least one first supplementary material, the layout technique knowledge of the first reference image may also include the type and / or style of each first supplementary material.
[0166] Optionally, to determine the typesetting techniques used in the typesetting image, the electronic device may have a typesetting technique knowledge base, which may store a set of typesetting technique knowledge. In step A1, the electronic device can perform image analysis on multiple first materials in the first reference image based on the typesetting technique knowledge stored in the typesetting technique knowledge base, thereby decomposing and extracting the typesetting technique knowledge used in the first reference image to obtain the typesetting technique knowledge of the first reference image. Furthermore, when the electronic device also obtains the relationship between the multiple first materials in S3021, during step A1, the electronic device can also analyze the relationship between the multiple first materials based on the typesetting technique knowledge stored in the typesetting technique knowledge base, thereby determining the typesetting technique knowledge of the first reference image, making the typesetting technique knowledge of the first reference image determined by the electronic device more comprehensive and richer.
[0167] The typesetting skills knowledge base includes typesetting skills knowledge of the first reference image, meaning that the typesetting skills knowledge of the first reference image is a subset of the typesetting skills knowledge set in the typesetting skills knowledge base.
[0168] For information on typesetting techniques and the concepts of each item within them (such as image features, image processing methods, etc.), please refer to the explanation of terms in point 5 above.
[0169] Step A2: The electronic device generates a first image layout scheme corresponding to the first reference image based on the layout techniques of the first reference image.
[0170] Optionally, in step A2, the electronic device can determine at least one image feature of a first image material from the layout technique knowledge of the first reference image; additionally, the electronic device can arrange the layout technique knowledge of the first reference image to determine multiple processing steps for multiple first materials; then, the electronic device can generate a first image layout scheme corresponding to the first reference image based on the image features of the at least one first image material and the multiple processing steps for the multiple first materials. Wherein, at least one set of image features in the first image layout scheme are the image features of the at least one first image material; the multiple processing steps for the multiple target materials are the same as the multiple processing steps for the multiple first materials.
[0171] It should be noted that the target material processed in a certain processing step of the first image layout scheme corresponds to the first material processed in that processing step on the generated first reference image. That is, the target image material processed in the same processing step corresponds to the first image material (i.e., the target image material and the first image material have the same image features). When the multiple first materials constituting the first reference image include at least one first supplementary material, the multiple target materials also include at least one target supplementary material; based on this, the target supplementary material processed in the same processing step corresponds to the first supplementary material (i.e., the target supplementary material and the first supplementary material have the same type and / or style).
[0172] Any processing step in the first image layout scheme includes any one of the following:
[0173] a. Perform first-screen processing on a target image material; wherein, the first-screen processing includes at least one of the following: segmentation and cropping, color adjustment, scaling, adding filters, and image cutout;
[0174] b. According to the first layout style, perform layout processing on at least one target image material to generate a first original layout image; the first layout style includes at least one of the following: collage, crop, stacking;
[0175] c. Add at least one target supplementary material to the first original layout image or at least one target image material to generate a second original layout image;
[0176] d. Perform second image processing on the first original layout image or the second original layout image; wherein, the second image processing includes at least one of the following: color adjustment, adding filters.
[0177] It should be noted that the first image layout scheme may include at least two of the steps described above. In practical scenarios, the specific steps included in the first image layout scheme depend on the actual situation of the first reference image. The image generated based on the last step in the first image layout scheme is the final layout image. For example, if the last step in the first image layout scheme is step b above, then the first original layout image generated based on step b is the final layout image generated based on the first image layout scheme.
[0178] In one implementation, the first image layout scheme may further include device capability information required for at least one processing step. Based on this, in the above process, the electronic device may also determine the device capabilities required for the at least one processing step according to its device capability set; finally, the electronic device may generate a first image layout scheme corresponding to a first reference image based on the image features of the at least one first image material, multiple processing steps for multiple first materials, and the device capabilities required for the at least one processing step. The device capability set of the electronic device includes the device capabilities required for the at least one processing step.
[0179] S303: Electronic devices save the first image layout scheme.
[0180] Optionally, in one embodiment, the electronic device can save a first reference image and a first image layout scheme so that the layout effect of the first image layout scheme can be presented to the user through the first reference image, and the user can subsequently select the first image layout scheme by selecting the first reference image.
[0181] In this embodiment, the user can save multiple reference images in the electronic device based on user needs, and then the electronic device can generate and save multiple image layout schemes through the above S301-S303, generate an image layout toolbox (or creative layout), so as to provide multiple image layout schemes to facilitate the electronic device or the user to select the target image layout scheme for image layout according to specific circumstances.
[0182] In this embodiment, after S304, the electronic device can further utilize a saved image layout scheme to perform image layout, thereby generating a layout image with the same or similar layout effect as the reference image of the image layout scheme. The following description continues using the first image layout scheme as an example; the electronic device can generate the layout image through the following steps B1-B2:
[0183] Step B1: The electronic device determines at least one first target image material and determines a first image layout scheme; wherein, the at least one first target image material corresponds one-to-one with at least one set of image features in the first image layout scheme, and the image features of any first target image material match the corresponding set of image features.
[0184] Wherein, the image features of any first target image material match the corresponding set of image features, including: the image features of the first target image material are the same as the corresponding set of image features (i.e., the first target image material has the corresponding set of image features); or the image features of the first target image material contain at least one image feature from the corresponding set of image features (i.e., there is a subset between the image features of the first target image material and the corresponding set of image features); or the similarity between the image features of the first target image material and the corresponding set of image features is higher than a set similarity threshold.
[0185] Step B2: The electronic device processes multiple first target materials according to the multiple processing steps included in the first image layout scheme to obtain a first layout image; wherein, the multiple first target materials include at least one first target image material.
[0186] In addition, the electronic device can prompt the user that the first layout image has been generated through the following step B3.
[0187] Step B3: Optionally, after generating the layout image, the electronic device can also directly display the first layout image on the screen. Alternatively, the electronic device can also display a first notification message or a first control on the screen; upon receiving a second operation performed by the user on the first notification message or the first control, the electronic device can display the first layout image on the screen. The first notification message is used to notify the user that the first layout image has been generated, and the first control displays a thumbnail of the first layout image.
[0188] Optionally, the first control can be a card, pop-up window, or other similar control; this application does not limit the shape or position of the first control. The second operation is a user operation whereby the user confirms opening the first layout image. For example, the second operation can be a click operation.
[0189] In this application embodiment, depending on the specific implementation scenario, the electronic device may perform the image layout process through, but is not limited to, the following implementation methods:
[0190] Implementation Method 1: Electronic Device Recommendation Strategy. This means that after determining the image layout scheme, the electronic device can select suitable image materials for image layout. The specific process is shown in steps C1-C4:
[0191] Step C1: In a scenario where an electronic device saves multiple image layout schemes, the electronic device can determine the first image layout scheme from the multiple saved image layout schemes.
[0192] Optionally, the electronic device may, but is not limited to, select a first image layout scheme from multiple image layout schemes in the following ways:
[0193] Method 1: The electronic device can determine the user's first image layout scheme from multiple image layout options. For example, the user can select the first image layout scheme from multiple options as the image layout scheme used by the background recommendation strategy.
[0194] Method 2: The electronic device can determine the first image layout scheme from multiple image layout schemes based on the user preference settings of the first image layout scheme.
[0195] For example, users can save or like reference images based on their preferred layout, which is equivalent to adding user preference settings to the image layout of the reference images. Based on this, electronic devices can use the image layout of the saved or electronic reference images as the image layout scheme used by the background recommendation strategy.
[0196] Method 3: Electronic devices can determine the first image layout scheme that the user uses most frequently from multiple image layout schemes.
[0197] Electronic devices can maintain the corresponding user usage frequency for each image layout scheme. When a user selects each image layout scheme for image layout, the electronic device can update the user usage frequency of that image layout scheme.
[0198] Step C2: The electronic device selects at least one first target image material from its image library based on at least one set of image features included in the first image layout scheme. Each first target image material corresponds one-to-one with the at least one set of image features; each first target image material has a corresponding set of image features.
[0199] In step C2, the electronic device can intelligently analyze the images in the image library and select at least one first target image material that conforms to the at least one set of image features.
[0200] Step C3: The electronic device processes multiple first target materials according to the multiple processing steps included in the first image layout scheme to obtain a first layout image; wherein, the multiple first target materials include at least one first target image material selected by step C2.
[0201] Optionally, when the plurality of first materials constituting the first reference image further includes at least one first supplementary material, the plurality of first target materials may also include at least one first target supplementary material corresponding to the at least one first supplementary material. Optionally, each first target supplementary material has the same type and / or style as the corresponding first supplementary material. In one implementation, the electronic device may directly use the at least one first supplementary material as the first target supplementary material; in another implementation, the electronic device may generate or search for the corresponding at least one first target supplementary material based on the type and style of the at least one first supplementary material.
[0202] Step C4: Optionally, the electronic device may prompt the user in the user interface to generate a first layout image in the background so that the user can view the first layout image. The specific process can be referred to step B3 above.
[0203] In one implementation, the electronic device can display a first notification message or a first control on the currently displayed second user interface while generating the first layout image; and display the first layout image upon receiving a second operation performed by the user on the first notification message or the first control. Through this implementation, the electronic device can display a notification message or the first control in real time on the currently displayed user interface while generating the first layout image, prompting the user that the first layout image has been generated in the background, so that the user can subsequently choose whether to view the first layout image according to their personal preference.
[0204] In another implementation, after generating the first layout image, when the electronic device displays a specific third user interface on the screen, a first control is displayed in the third user interface; when a second operation is received from the user on the first control, the first layout image is displayed. Optionally, the first control can be a card, pop-up window, or other control in the third user interface, and this application does not limit the shape or position of the first control. For example, the first control can be a card or pop-up window in the main interface of the electronic device; or the first control can be a card or pop-up window with functions such as recommended viewing, recall, and featured items displayed in the gallery window when the electronic device opens the gallery.
[0205] With this implementation, after the electronic device generates the first layout image, it can display the first control in a specific third user interface when the electronic device displays the first layout image, so as to prompt the user that the first layout image has been generated in the background, so that the user can choose whether to view the first layout image according to their own wishes.
[0206] Through implementation method one, electronic devices can use image layout schemes (or layout effects) as a starting point to perform the image layout process in the background, and generate layout images to recommend to users without their knowledge.
[0207] Implementation Method Two: User-Triggered Strategy. After the user selects image materials, the electronic device chooses a suitable image layout scheme for image arrangement. The specific process can be shown in steps D1-D5:
[0208] Step D1: The electronic device determines at least one first target image material selected by the user.
[0209] For example, an electronic device displays a fourth user interface on a screen, the fourth user interface containing at least one first target image material selected by the user; the electronic device determines the at least one first target image material selected by the user in the fourth user interface.
[0210] Step D2: The electronic device determines the image features of each first target image in at least one first target image material.
[0211] Optionally, the electronic device may initiate the execution of step D2 and subsequent steps upon receiving a fifth operation performed by the user on the fourth or fifth user interface. The fifth operation is the user's confirmation of the layout of at least one first target image material.
[0212] Optionally, the electronic device may perform image or scene analysis (i.e., scene analysis and content understanding) on at least one first target image material to determine the image features of each first target image material.
[0213] Step D3: The electronic device determines a first image layout scheme from a plurality of saved image layout schemes based on the image features of the at least one first target image material; wherein, the first image layout scheme contains at least one set of image features that have the highest similarity to the image features of at least one second target image material; the at least one first target image material corresponds one-to-one with the at least one set of image features, and the image features of any first target image material contain at least one image feature from the corresponding set of image features.
[0214] Optionally, the electronic device can calculate the similarity between image features of at least one first target image material and at least one set of image features contained in each image layout scheme, thereby selecting the first image layout scheme from multiple image layout schemes. In this way, the electronic device can use the first image layout scheme to perform image layout on the at least one first target image material to generate a first layout image with the same or similar display effect as the first reference image corresponding to the first image layout scheme.
[0215] Step D4: The electronic device processes multiple first target materials according to the multiple processing steps included in the first image layout scheme to obtain a first layout image; wherein, the multiple first target materials include: at least one first target image material.
[0216] Optionally, when the plurality of first materials constituting the first reference image also include at least one first supplementary material, the plurality of first target materials may also include at least one first target supplementary material corresponding to at least one first supplementary material.
[0217] For a description of at least one supplementary material for the first target, please refer to the description of at least one supplementary material for the first target in step C3 of Embodiment 1, which will not be repeated here.
[0218] Step D5: The electronic device displays the first layout image on the screen.
[0219] Through the second implementation method, the electronic device can automatically select a suitable image layout scheme based on the user's operation after the user selects the image material to be laid out, thereby realizing one-click image layout based on the image material.
[0220] In summary, this application provides a method for generating image layout schemes. In this method, an electronic device can generate a corresponding image layout scheme based on an acquired reference image, so that a layout image with the same or similar layout effect as the reference image can be generated subsequently based on this scheme. Based on this method, users can select a reference image whose display effect meets their needs to generate an image layout scheme, thereby enabling the electronic device to achieve image layout and obtain a layout image based on the generated scheme, thus satisfying the user's needs for image layout effects and improving the user experience. This method is not limited by user learning and operational capabilities, nor is it limited to specific scenarios or specific image editing applications; it has universality and ease of use.
[0221] based on Figure 3 As shown in the embodiments, this application also provides an image layout scheme generation method, namely, an image layout toolbox construction process, see reference. Figure 4 As shown. Electronic devices may include image layout agents and image layout toolkits.
[0222] An image layout intelligent agent is responsible for intelligently analyzing and processing each input reference image to obtain the corresponding image layout scheme. This image layout intelligent agent can also be called an image layout scheme parsing module.
[0223] The image layout toolbox is used to store multiple image layout schemes.
[0224] The knowledge base may include a typography skills knowledge base and a device capability base. The typography skills knowledge base stores a set of typography skills knowledge required for the image typography process. For example, the composition of the typography skills knowledge set may be as follows: Figure 4 As shown in the diagram, the device energy reservoir is used to store the set of device capabilities possessed by electronic devices.
[0225] The following is combined Figure 4 The methods provided in the embodiments of this application will be described in detail.
[0226] When a user sees a layout image on the internet, another electronic device, or somewhere on their current electronic device that matches their aesthetic preferences or needs, they can save it as a reference image to a specific storage path on the electronic device. During this process, the electronic device can interact with the user through a user interface to obtain the reference image; or it can receive reference images sent from other electronic devices via a wireless connection; or it can access reference images uploaded or saved by the user.
[0227] When an electronic device initiates the image layout scheme generation method, the image layout agent can intelligently analyze and process the acquired reference image to obtain the corresponding image layout scheme. Optionally, the image layout agent can intelligently analyze the reference image using a multimodal understanding model.
[0228] In one implementation, the image layout agent may include three modules: a material intelligent analysis module, a layout technique extraction module, and a layout scheme planning module. The following description uses the intelligent analysis process of the image layout agent on reference image 1 to illustrate these three modules.
[0229] The intelligent material analysis module can perform image analysis and understanding on reference image 1 based on a visual perception model, thereby obtaining multiple first materials that make up reference image 1.
[0230] The layout technique extraction module can combine a large amount of image layout knowledge stored in the image layout knowledge base to analyze multiple primary materials in Reference Image 1, decompose and extract the layout technique knowledge used in Reference Image 1, and obtain the layout technique knowledge of Reference Image 1. The layout technique knowledge of Reference Image 1 includes the following content, which can be referenced... Figure 3 The description of the layout techniques for the first reference image in step A1 of the illustrated embodiment will not be repeated here.
[0231] Optionally, the layout technique extraction module can utilize a multimodal understanding model to perform image analysis on multiple primary materials in reference image 1, including object recognition, scene analysis, composition technique analysis, and layout script analysis, thereby obtaining layout technique knowledge of reference image 1.
[0232] The layout scheme planning module combines the layout capabilities of the large model with the equipment capabilities of the electronic devices in the equipment energy library to arrange the layout techniques of reference image 1. It determines at least one set of image features (i.e., material suggestions) of the image materials needed to achieve the layout effect of reference image 1, multiple processing steps, and the capability dependencies of each processing step (i.e., the equipment capabilities required for each processing step) and the material dependencies of each processing step (i.e., the materials that need to be processed for each processing step). Based on the layout results generated in the previous step, it obtains image layout scheme 1 corresponding to reference image 1. The specific process of the layout scheme planning module generating image layout scheme 1 corresponding to reference image 1 based on the layout techniques of reference image 1 can be found in [reference needed]. Figure 3 The description of step A2 in the illustrated embodiment will not be repeated here.
[0233] Finally, the electronic device can store each reference image generated by the image layout agent and the corresponding image layout scheme for each reference image in the image layout toolbox, so that the electronic device or the user can select the target image layout scheme in the image layout toolbox for image layout according to the specific situation.
[0234] In addition, based on Figure 3 or Figure 4 As illustrated in the embodiments, this application also employs two image layout methods, namely, image layout application methods based on image layout schemes. The two image layout schemes will be described below with reference to different embodiments.
[0235] Example 1: Recommendation strategy for electronic devices.
[0236] In this embodiment 1, the electronic device can select a target image layout scheme from multiple image layout schemes stored in the image layout toolbox. Then, based on the material suggestions in the target image layout scheme, it intelligently analyzes a large number of images in the image library and selects target image materials that meet the material suggestions. Next, the electronic device can perform image layout processing on the target image material based on the target image layout scheme, ultimately obtaining a layout image with a layout effect similar to the reference image corresponding to the target image layout scheme. Finally, the electronic device can prompt the user to generate the layout image in the background through notification messages, thumbnails of the layout image, or controls. The specific process of embodiment 1 can be found in [reference needed]. Figure 3 The embodiments shown describe implementation method one.
[0237] Example 2: User-triggered strategy.
[0238] In this embodiment 2, the electronic device can select a target image layout scheme from the image layout toolbox based on the target image material selected by the user in the image library and multiple image layout scheme suggestions stored therein. The electronic device can then perform image layout processing on the target image material based on the target image layout scheme, ultimately obtaining a layout image with a similar layout effect to the reference image corresponding to the target image layout scheme. The specific process of embodiment 2 can be found in [reference needed]. Figure 3 The embodiments shown describe implementation method two.
[0239] See Figure 5 As shown, the image layout scheme 1 corresponding to reference image 1 will be used as an example to explain the image layout process of the electronic device in the above two embodiments.
[0240] like Figure 5 As shown, image layout scheme 1 may include the following three types of content:
[0241] Material suggestions, i.e., at least one set of image features. Each set of image features is used to determine one image material. The at least one image material determined by the at least one set of image features is the image material required to achieve the layout effect of reference image 1.
[0242] Capability dependency refers to the equipment capabilities required for each processing step in image layout scheme 1.
[0243] The processing steps refer to the multiple processing steps in image layout scheme 1, as well as the material dependencies for each step.
[0244] The image layout process for electronic devices includes the following steps:
[0245] S1: The electronic device determines the image layout scheme 1 and the target image material.
[0246] In the above embodiment 1, the electronic device can select a target image layout scheme (i.e., image layout scheme 1) from multiple image layout schemes stored in the image layout toolbox; and then select the target image material from the image library according to the material suggestions in image layout scheme 1.
[0247] In the above embodiment 2, the electronic device can select a target image layout scheme (i.e., image layout scheme 1) that matches the target image material selected by the user based on the target image material selected in the image library and the material suggestions of multiple image layout schemes stored in the image layout toolbox.
[0248] The external dependency of the electronic device executing S1 is an image in the gallery.
[0249] S2: The electronic device can perform image layout preprocessing based on the capability dependencies of each processing step in image layout scheme 1. For example, the electronic device can determine whether its current set of device capabilities contains the device capabilities required for each processing step. Furthermore, if the set of device capabilities contains the device capabilities required for a certain processing step, the electronic device can activate that device capability in the background.
[0250] S3: The electronic device performs image layout processing on multiple target materials, including the target image material, according to the processing steps in image layout scheme 1, thereby generating a layout image 1 with a layout effect similar to that of the reference image 1 corresponding to image layout scheme 1.
[0251] The following is combined Figure 6 and Figure 7 An example is provided.
[0252] In generation Figure 6 In the process of image layout scheme 1 corresponding to reference image 1, the material intelligent analysis module in the image layout intelligent agent of the electronic device can perform image analysis and understanding on reference image 1 to obtain multiple materials (i.e., material 1 to material 7) that make up reference image 1, such as Figure 6 As shown in the image. The layout technique extraction module can analyze multiple materials in reference image 1 to obtain layout technique knowledge of reference image 1, such as... Figure 7 As shown. Afterwards, the layout scheme planning module can then... Figure 7 The layout techniques of the reference image 1 are used to arrange the images to obtain the image layout scheme 1 corresponding to the reference image 1.
[0253] In the subsequent image layout process of the electronic device, the electronic device can generate a layout image 1 similar in layout effect to the reference image 1, based on the above image layout process, according to image layout scheme 1, and multiple target materials including image materials (material 1-1 to material 5-1). As described in the above image layout process, the image materials used by the electronic device to generate the layout image 1 conform to the material suggestions (at least one set of image features) in image layout scheme 1, that is, each image material used by the electronic device to generate the layout image 1 has the same or similar image features as the image materials used in the reference image 1. In addition, each supplementary material used by the electronic device to generate the layout image 1 is the same as the supplementary material used in the reference image 1.
[0254] Based on the above embodiments, this application also provides a method for generating layout images. This method can be applied to, for example... Figure 1 The electronic device shown can have a software structure as follows: Figure 2 As shown. See below. Figure 8The flowchart shown below provides a detailed description of the embodiments of this application.
[0255] S801: The electronic device determines at least one first target image material and determines a first image layout scheme. The first image layout scheme includes at least one set of image features and multiple processing steps for multiple target materials; the multiple target materials include: at least one target image material having at least one set of image features; at least one first target image material corresponds one-to-one with at least one set of image features, and the image features of any first target image material match the corresponding set of image features.
[0256] The first image layout scheme can be achieved through, for example... Figure 3 The illustrated embodiment provides a solution for generating the first image layout scheme. Optionally, the first image layout scheme can be generated by an electronic device or downloaded by the electronic device from other electronic devices, servers, etc., and this application does not limit this. That is, the device that generates the image layout scheme and the device that uses the image layout scheme can be the same device or different devices, and this application does not limit this.
[0257] S802: The electronic device processes multiple first target materials according to the multiple processing steps included in the first image layout scheme to obtain a first layout image; wherein, the multiple first target materials include at least one first target image material.
[0258] Optionally, after generating the layout image, the electronic device can also directly display the first layout image on the screen. Alternatively, the electronic device can also display a first notification message or a first control on the screen; upon receiving a user operation performed by the user on the first notification message or the first control, the electronic device can display the first layout image on the screen. The first notification message is used to notify the user that the first layout image has been generated, and the first control displays a thumbnail of the first layout image.
[0259] Optionally, the first control can be a card, pop-up window, or other control; this application does not limit the shape or position of the first control. The user operation is a user action confirming the opening of the first layout image. For example, the second operation can be a click operation.
[0260] Implementation method 1: The electronic device can first determine a first image layout scheme, and then determine at least one first target image material based on the first image layout scheme.
[0261] Optionally, in this embodiment, the electronic device can select at least one first target image material from the image library of the electronic device according to at least one set of image features included in the first image layout scheme; each first target image material has a corresponding set of image features.
[0262] Optionally, the first image layout scheme can be determined by the electronic device from a plurality of saved image layout schemes. Optionally, the electronic device can determine the first image layout scheme from a plurality of saved image layout schemes through, but is not limited to, the following implementation:
[0263] Method 1: Determine the first image layout scheme selected by the user from multiple image layout schemes.
[0264] Method 2: Determine the first image layout scheme from among multiple image layout schemes based on the user preference settings of the first image layout scheme.
[0265] Method 3: Determine the most frequently used image layout scheme among multiple image layout schemes.
[0266] For a detailed description of this first embodiment, please refer to [link / reference]. Figure 3 The implementation method shown in the examples describes a recommendation strategy for electronic devices, which will not be repeated here.
[0267] Implementation method 2: The electronic device can determine a first image layout scheme based on at least one first target image material that has been determined in advance.
[0268] Optionally, in this embodiment, the electronic device may determine at least one first target image material selected by the user.
[0269] Optionally, the electronic device may determine the first image layout scheme by means of the following steps:
[0270] The electronic device determines the image features of each first target image in at least one first target image material;
[0271] The electronic device determines a first image layout scheme from multiple saved image layout schemes based on the image features of at least one first target image material; wherein, the first image layout scheme contains at least one set of image features that have the highest similarity to the image features of at least one first target image material; and the image features of any first target image material contain at least one image feature from a corresponding set of image features.
[0272] For a detailed description of this second implementation method, please refer to [link / reference]. Figure 3 The description of the user triggering strategy in Implementation Method 2 of the illustrated embodiments will not be repeated here.
[0273] In summary, this application provides a method for generating a typed image. In this method, an electronic device can perform image typesetting on at least one target image material according to an image typesetting scheme to generate a typed image. This method is not limited by user learning and operational capabilities, nor is it limited to specific scenarios or specific image editing applications; it possesses versatility and ease of use. Because the at least one target image material used to generate the typed image matches at least one set of image features contained in the image typesetting scheme, this method can ensure that the typesetting effect of the generated typed image is the same as or similar to the typesetting effect of the reference image corresponding to the image typesetting scheme. In conclusion, this method can improve image typesetting efficiency.
[0274] It should be noted that in the above embodiments, the concepts and explanations of the same terms can be referenced to each other, and the same or similar steps can also be referenced to each other.
[0275] It should also be noted that each step in the above embodiments can be executed by the corresponding device, or by components such as chips, processors, or chip systems within that device. The embodiments of this application do not limit their execution. The above embodiments are merely illustrative examples of execution by the corresponding device. Furthermore, the specific implementation methods or examples in the above embodiments do not limit the solutions provided by the embodiments of this application.
[0276] It should be noted that in the above embodiments, some steps may be selected for implementation, and the order of the steps in the figures may be adjusted. This application does not limit this. It should be understood that performing some of the steps in the figures, adjusting the order of the steps, or combining them in a specific implementation all fall within the protection scope of this application.
[0277] It is understood that, in order to achieve the functions described in the above embodiments, each device involved in the above embodiments includes a hardware structure and / or software module corresponding to perform each function. Those skilled in the art should readily recognize that, based on the units and method steps of the various examples described in conjunction with the embodiments disclosed in this application, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.
[0278] It is understood that the architecture and application scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. As those skilled in the art will know, with the evolution of network architecture and the emergence of new services, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems.
[0279] It should be noted that the "steps" in the embodiments of this application are merely illustrative and are intended to better understand one method of presentation used in the embodiments. They do not constitute a substantial limitation on the execution of the solution of this application. For example, the "step" can also be understood as a "feature". Furthermore, the steps do not constitute any limitation on the execution order of the solution of this application. Any changes to the order of steps, or the merging or splitting of steps made on this basis without affecting the overall solution implementation, resulting in a new technical solution, are also within the scope of disclosure of this application.
[0280] Based on the same concept, embodiments of this application also provide an electronic device. For example... Figure 9 As shown, the electronic device 900 includes a display screen 901, one or more processors 902, and a memory 903. Optionally, the electronic device 900 may also include a transceiver 904. For example, the above components can be connected via one or more communication buses. The one or more computer programs are stored in the memory 903 and configured to be executed by the one or more processors 902. The one or more computer programs include instructions that can be used to cause the electronic device 900 to perform various steps of the methods in the above embodiments.
[0281] For example, the above-mentioned one or more processors 902 may specifically be Figure 1 The processor 110; the memory 903 mentioned above can specifically be... Figure 1 The internal memory 121 is located within the transceiver 904. Figure 1 The mobile communication module 150 or wireless communication module 160 is included; the display screen 901 can be... Figure 1 The display screen 194 in this embodiment is not limited in any way in this application.
[0282] Based on the same concept, embodiments of this application also provide an electronic device, which includes units for performing the various steps of the methods provided in the above embodiments.
[0283] For details on the specific functions of each module, please refer to the above embodiments; they will not be repeated here.
[0284] Based on the above embodiments, this application also provides a computer program product, which includes instructions; when the computer program is run on a computer, it causes the computer to execute the method provided in the above embodiments.
[0285] Based on the above embodiments, this application also provides a computer-readable storage medium storing computer program instructions, which, when executed by a computer, cause the computer to perform the methods provided in the above embodiments.
[0286] Optionally, the aforementioned computer may include, but is not limited to, control devices.
[0287] The storage medium can be any available medium that a computer can access. For example, but not limited to, a computer-readable medium can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.
[0288] Based on the above embodiments, this application also provides a chip for reading a computer program stored in a memory to implement the method provided in the above embodiments. Optionally, the chip may include a processor and a memory, wherein the processor is coupled to the memory and is used to read the computer program stored in the memory to implement the method provided in the above embodiments.
[0289] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the functions involved in the control device in the above embodiments. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete components.
[0290] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0291] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0292] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0293] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
Claims
1. A method for generating image layout schemes, applied to electronic devices, characterized in that, include: Obtain the first reference image; The first reference image was generated based on the layout of multiple first materials; The plurality of first materials includes at least one first image material; The first reference image is analyzed to generate a first image layout scheme; wherein, the first image layout scheme includes at least one set of image features determined based on the at least one first image material, and multiple processing steps for multiple target materials; the multiple target materials include at least one target image material having the at least one set of image features; Save the first image layout scheme.
2. The method as described in claim 1, characterized in that, The step of analyzing the first reference image and generating a first image layout scheme includes: Image analysis is performed on the first reference image to obtain the plurality of first materials that make up the first reference image; The image analysis is performed on the plurality of first materials in the first reference image to generate the first image layout scheme.
3. The method as described in claim 2, characterized in that, The step of performing image analysis on the plurality of first materials in the first reference image to generate the first image layout scheme includes: The image analysis is performed on the plurality of first materials in the first reference image to obtain the layout technique knowledge of the first reference image; wherein, the layout technique knowledge of the first reference image includes at least one of the following: the image features of each first image material, the image processing method of each first image material, the layout style of the at least one first image material in the first reference image, the image processing method of the first reference image, and the layout logic of the first reference image. Based on the layout techniques of the first reference image, a layout scheme for the first image is generated.
4. The method as described in claim 3, characterized in that, The plurality of first materials further include at least one first supplementary material, wherein any one first supplementary material is a material of a type other than image material; the plurality of target materials further include at least one target supplementary material corresponding to the at least one first supplementary material; The typography knowledge of the first reference image also includes: the type and / or style of each first supplementary material.
5. The method as described in claim 4, characterized in that, The type of any first supplementary material is any of the following: text material, sticker material, or animation material.
6. The method according to any one of claims 3-5, characterized in that, The step of performing image analysis on the plurality of first materials in the first reference image to obtain layout technique knowledge of the first reference image includes: Based on the layout skills knowledge stored in the layout skills knowledge base, the multiple first materials in the first reference image are analyzed to obtain the layout skills knowledge of the first reference image; wherein, the layout skills knowledge base contains the layout skills knowledge of the first reference image.
7. The method according to any one of claims 3-6, characterized in that, The step of generating the first image layout scheme based on the layout techniques of the first reference image includes: Based on the layout techniques of the first reference image, determine the image features of the at least one first image material and the multiple processing steps of the multiple first materials; Based on the image features of the at least one first image material and the multiple processing steps of the multiple first materials, the first image layout scheme is generated.
8. The method as described in claim 7, characterized in that, The at least one set of image features in the first image layout scheme are the same as the image features of the at least one first image material; the multiple processing steps of the multiple target materials in the first image layout scheme are the same as the multiple processing steps of the multiple first materials.
9. The method according to any one of claims 1-8, characterized in that, The first image layout scheme also includes equipment capability information required for at least one processing step.
10. The method according to any one of claims 1-9, characterized in that, Any set of image features includes at least one of the following: The type of image material, the scene depicted in the image material, and the type of objects in the image material.
11. The method according to any one of claims 1-10, characterized in that, Any processing step in the first image layout scheme includes any one of the following: A first image processing is performed on a target image material; wherein the first image processing includes at least one of the following: segmentation and cropping, color adjustment, scaling, adding filters, and image cutout; According to a first layout style, the at least one target image material is processed to generate a first original layout image; the first layout style includes at least one of the following: collage, cropping, and stacking; Add at least one target supplementary material to the first original layout image or the at least one target image material to generate a second original layout image; The first original layout image or the second original layout image is subjected to a second image processing; wherein the second image processing includes at least one of the following: color adjustment and adding filters.
12. The method according to any one of claims 1-11, characterized in that, The acquisition of the first reference image includes: Display the first user interface on the screen; The system receives a first operation performed by the user on the first user interface and obtains the first reference image input by the user; wherein the first operation is the operation of the user inputting the first reference image.
13. The method according to any one of claims 1-12, characterized in that, The method further includes: Determine at least one first target image material and determine the first image layout scheme; wherein, the at least one first target image material corresponds one-to-one with the at least one set of image features, and the image features of any first target image material match the corresponding set of image features; According to the multiple processing steps included in the first image layout scheme, multiple first target materials are processed to obtain a first layout image; wherein, the multiple first target materials include at least one first target image material.
14. The method as described in claim 13, characterized in that, The determination of at least one first target image material includes: Based on the at least one set of image features included in the first image layout scheme, at least one first target image material is selected from the image library of the electronic device; each first target image material has a corresponding set of image features.
15. The method as described in claim 14, characterized in that, Determining the first image layout scheme includes: The first image layout scheme is determined from among the multiple saved image layout schemes.
16. The method as described in claim 15, characterized in that, Determining the first image layout scheme from a plurality of saved image layout schemes includes: The first image layout scheme selected by the user is determined from the plurality of image layout schemes; or Based on the user preference settings of the first image layout scheme, the first image layout scheme is determined from the plurality of image layout schemes; or Among the multiple image layout schemes, the first image layout scheme that is most frequently used by the user is determined.
17. The method as described in claim 13, characterized in that, The determination of at least one first target image material includes: Determine the at least one first target image material selected by the user.
18. The method as described in claim 17, characterized in that, Determining the first image layout scheme includes: Determine the image features of each first target image material in the at least one first target image material; Based on the image features of the at least one first target image material, the first image layout scheme is determined from a plurality of saved image layout schemes; wherein, the first image layout scheme contains at least one set of image features that have the highest similarity to the image features of the at least one first target image material; and the image features of any first target image material contain at least one image feature from a corresponding set of image features.
19. The method according to any one of claims 13-18, characterized in that, The method further includes: Display the first layout image on the screen; or A first notification message or a first control is displayed on the screen; wherein the first notification message is used to prompt the user that the first layout image has been generated, and the first control displays a thumbnail of the first layout image; when a second operation is received from the user on the first notification message or the first control, the first layout image is displayed on the screen.
20. A method for generating typesetting images, applied to electronic devices, characterized in that, include: The method involves determining at least one first target image material and determining a first image layout scheme; wherein the first image layout scheme includes at least one set of image features and multiple processing steps for multiple target materials; the multiple target materials include at least one target image material having the at least one set of image features; the at least one first target image material corresponds one-to-one with the at least one set of image features, and the image features of any first target image material match the corresponding set of image features; According to the multiple processing steps included in the first image layout scheme, multiple first target materials are processed to obtain a first layout image; wherein, the multiple first target materials include at least one first target image material.
21. The method as described in claim 20, characterized in that, The determination of at least one first target image material includes: Based on the at least one set of image features included in the first image layout scheme, at least one first target image material is selected from the image library of the electronic device; each first target image material has a corresponding set of image features.
22. The method as described in claim 21, characterized in that, Determining the first image layout scheme includes: The first image layout scheme is determined from among the multiple saved image layout schemes.
23. The method as described in claim 22, characterized in that, Determining the first image layout scheme from a plurality of saved image layout schemes includes: The first image layout scheme selected by the user is determined from the plurality of image layout schemes; or Based on the user preference settings of the first image layout scheme, the first image layout scheme is determined from the plurality of image layout schemes; or Among the multiple image layout schemes, the first image layout scheme that is most frequently used by the user is determined.
24. The method as described in claim 20, characterized in that, The determination of at least one first target image material includes: Determine the at least one first target image material selected by the user.
25. The method as described in claim 24, characterized in that, Determining the first image layout scheme includes: Determine the image features of each first target image material in the at least one first target image material; Based on the image features of the at least one first target image material, the first image layout scheme is determined from a plurality of saved image layout schemes; wherein, the first image layout scheme contains at least one set of image features that have the highest similarity to the image features of the at least one first target image material; and the image features of any first target image material contain at least one image feature from a corresponding set of image features.
26. The method according to any one of claims 20-25, characterized in that, The method further includes: Display the first layout image on the screen; or A first notification message or a first control is displayed on the screen; wherein the first notification message is used to prompt the user that the first layout image has been generated, and the first control displays a thumbnail of the first layout image; when a user operation is received on the first notification message or the first control, the first layout image is displayed on the screen.
27. An electronic device, characterized in that, The electronic device includes: A display screen used to show the user interface; Memory is used to store computer program instructions; A processor for executing the computer program instructions to support the electronic terminal device in implementing the method as described in any one of claims 1-26.
28. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions that, when executed by a processing circuit, implement the method as described in any one of claims 1-26.
29. A computer program product containing instructions, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-26.