Picture displaying method and system, picture processing method and system, picture uploading method, picture generating method, and electronic device

Abstract

Embodiments of the present application provide a picture displaying method and system, a picture processing method and system, a picture uploading method, a picture generating method, and an electronic device. The picture displaying method comprises: in response to an operation of a user, obtaining a second picture related to the user, wherein the second picture is generated on the basis of at least one decoration material and a first picture of a target object, and the at least one decoration material is related to the user; and displaying the second picture on a client interface. According to the technical solution provided in the embodiments of the present application, the second picture displayed for the user is a picture decorated and related to the user, such that the user can directly perceive that the target object is closely related to the user, making it more immersive.

Description

Image display, processing, uploading and generation method, system and electronic device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on September 11, 2023, with application number 202311168286.X and application name “Image display, processing, uploading and generation method, system, electronic device”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of computer technology, and in particular to a method, system, and electronic device for displaying, processing, uploading, and generating images. Background Art

[0003] Currently, product images displayed on e-commerce platforms are one of the core elements of product information. Consumers often use product images to understand product content. Most product images are taken by merchants themselves. These images often have relatively simple backgrounds, such as solid colors, outdoor or indoor scenes, which are not very appealing to users.

[0004] Summary of the Invention

[0005] The present application provides a method, system, and electronic device for displaying, processing, uploading, and generating images that solve the above-mentioned problems or at least partially solve the above-mentioned problems.

[0006] In the first embodiment of the present application, a method for displaying an image is provided. The method includes:

[0007] In response to a user operation, obtaining a second image related to the user; wherein the second image is generated based on at least one decorative material and the first image of the target object, and the at least one decorative material is related to the user;

[0008] The second picture is displayed on the client interface.

[0009] In a second embodiment of the present application, a method for processing an image is provided. The method includes:

[0010] Obtaining a first image of a target object;

[0011] determining at least one decorative material suitable for the target object;

[0012] generating a second picture based on the at least one decorative material and the first picture;

[0013] The second picture is associated with the target object so as to be displayed when a user who is related to the at least one decorative material visits the target object.

[0014] In the third embodiment of the present application, a method for uploading an image is provided. The method includes:

[0015] Responding to the image upload request, obtaining a first image of the target object;

[0016] determining at least one decorative material suitable for the target object;

[0017] generating a second picture based on the at least one decorative material and the first picture;

[0018] Display the second image so that the uploader can review and confirm whether to upload it;

[0019] The second picture is used for display when a user who is related to the at least one decorative material visits the target object.

[0020] In a fourth embodiment of the present application, a method for generating an image is provided. The method includes:

[0021] Using the object information of the target object, triggering a preset analysis model to determine at least one decoration material suitable for the target object;

[0022] Using the first picture of the target object and the at least one decorative material as drawing materials of a preset drawing model, generating a second picture of the target object;

[0023] The second picture is used for display when a user who is related to the at least one decorative material visits the target object.

[0024] In a fifth embodiment of the present application, a method for displaying a product image is provided. The method includes:

[0025] In response to a user operation, determining a target address;

[0026] Based on the target address, obtaining a product image of the product; wherein the product image is generated based on the original product image and background material, and the background material is related to the characteristics of the region where the target address belongs and the characteristics of the product itself;

[0027] Displaying a product image of the product on a webpage or application page corresponding to the region to which the target address belongs;

[0028] The target address is selected by the user or located by the user client.

[0029] In a sixth embodiment of the present application, a method for processing a product image is provided. The method includes:

[0030] Get the sales area of ​​the product;

[0031] Determining, based on the sales region, background material suitable for the product and having characteristics of the sales region;

[0032] Based on the original image of the product and the background material, generating a product image in which the product is displayed in a scene corresponding to the background material;

[0033] The product image is used to be displayed on a web page or application page corresponding to the sales area.

[0034] In a seventh embodiment of the present application, a method for displaying an image is provided. The method includes:

[0035] Determine the regional version of the target application;

[0036] Determining, based on the regional version coverage area, at least one decoration material suitable for the target object and having characteristics of the covered area;

[0037] generating a second picture of the target object based on the first picture of the target object and the at least one decoration material;

[0038] The second image is used to be displayed when a user using the regional version application accesses the target object.

[0039] In an eighth embodiment of the present application, a picture display system is provided. The system includes:

[0040] The first client is configured to request the server to obtain a second image of the target object in response to a user operation;

[0041] The server is configured to obtain, based on the relevant information of the user, a second image related to the user, and send the second image to the first client; wherein the second image is generated based on at least one decorative material and the first image of the target object, and the at least one decorative material is related to the user;

[0042] The first client is further configured to display the second image on a client interface.

[0043] In a ninth embodiment of the present application, a picture processing system is provided. The system includes:

[0044] The second client is configured to send a first image of a target object to the server in response to the image upload request;

[0045] The server is configured to determine at least one decorative material suitable for the target object, and generate a second image based on the at least one decorative material and the first image;

[0046] The second client is used to display the second image so that the uploader can review and confirm whether to upload it;

[0047] The second picture is used for display when a user who is related to the at least one decorative material visits the target object.

[0048] In another embodiment of the present application, an electronic device is provided. The electronic device includes: a memory and a processor, wherein the memory is configured to store a computer program; and the processor, coupled to the memory, is configured to execute the computer program stored in the memory to implement the steps provided in the embodiment of the image display method, the steps provided in the embodiment of the image processing method, the steps in the embodiment of the image uploading method, the steps in the image generation method, the steps in the embodiment of the product image display method, or the steps in the embodiment of the product image processing method of the present application.

[0049] The present application also provides an embodiment of a computer-readable storage medium having a computer program stored thereon, which, when executed, can implement the steps of the method provided in each of the above embodiments.

[0050] The present application also provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, causes the processor to perform the steps in the above method.

[0051] This embodiment of the present application provides a technical solution that, after detecting a user action, obtains a second image relevant to the user and displays the second image on a client interface. The second image is generated based on at least one decorative material relevant to the user and a first image of the target object. This solution demonstrates that the second image displayed to the user is a decorated and relevant image. This allows the user to directly perceive the target object's close relevance to them, creating a more engaging experience.

[0052] Another technical solution provided by an embodiment of the present application determines at least one suitable decorative material for a target object, generates a second image based on the at least one decorative material and a first image of the target object, and associates the second image with the target object so that it can be displayed when a user associated with the at least one decorative material visits the target object. This solution pre-decorates the first image of the target object, generates the decorated second image, and associates it with the target object. When a user associated with the target object visits the target object, the user can directly perceive the target object's close relevance to them, making the display more engaging.

[0053] In another technical solution provided by an embodiment of the present application, after the uploader uploads a first image of a target object, the uploader can automatically determine at least one suitable decorative material for the target object. Based on the at least one decorative material and the first image of the target object, the uploader can then review and confirm whether to upload the first image. If the uploader reviews and confirms the upload, the corresponding platform application can display the second image when a user who has a correlation with the at least one decorative material visits the target object. This entire process only requires the uploader to upload the first image of the target object, without requiring extensive user involvement. This helps the uploader increase the relevance of the target object image to users and attract more user attention.

[0054] This embodiment of the present application also provides a technical solution that utilizes artificial intelligence technology to decorate a first image of a target object, so that the decorated second image is relevant to the user, thereby increasing the user's attention to the target object. Specifically, the target object's object information is used to trigger a preset analysis model to determine at least one decorative material suitable for the target object. The first image of the target object and the at least one decorative material are then used as drawing materials for a preset drawing model to generate a second image of the target object. This improves image generation efficiency and is suitable for large-scale image processing tasks on the platform.

[0055] Another technical solution provided by the embodiments of the present application is to determine, based on the sales region of a product, background material for the product that reflects the characteristics of the sales region; generate a product image of the product displayed in a scene corresponding to the background material based on the original product image and the background material; and display the product image on a webpage or application page corresponding to the sales region. Thus, the embodiments of the present application provide a new approach, whereby the same product has different product images for different sales regions, each with local characteristics. This allows local users to perceive the product image as being closely related to them and more immersive when viewing it on a webpage or application page corresponding to that sales region. Alternatively, users in one sales region can view the product image of a product on a webpage or application page corresponding to a second sales region, visually picturing the user purchasing the product in the first sales region and then using it in the second sales region, creating a stronger sense of immersion. For example, a user is going on a beach vacation and, before their vacation, searches for beach-appropriate long dresses at their residence. The user can then view product images of such products on the webpage or application page corresponding to the vacation region.

[0056] For merchants, it is the sales area of ​​the product. For consumers (or users), it is the location address (or area) or the address (or area) selected by the user. Based on the above solution, the technical solution provided in the embodiment of the present application can obtain the product image of the product based on the client location address or the address selected by the user after the user operates; and then display it on the web page or application page corresponding to the area to which the address belongs. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] FIG1a is a schematic diagram of a first image display system provided by an embodiment of the present application;

[0058] FIG1b is a schematic diagram of a second image display system provided in an embodiment of the present application;

[0059] FIG1c is a schematic diagram of a third image processing system provided by an embodiment of the present application;

[0060] FIG2 is a schematic diagram of a flow chart of a method for displaying an image according to an embodiment of the present application;

[0061] FIG3 is a flow chart of an image processing method according to an embodiment of the present application;

[0062] 4 and 5 are schematic diagrams showing the principle of a merchant inputting a corresponding original image, product information, etc. for a product according to an embodiment of the present application;

[0063] FIG6 is a schematic diagram showing the principle of drawing a product image using a preset drawing model in one embodiment of the present application;

[0064] FIG7 illustrates the technical solution provided by the embodiment of the present application in the form of a signaling diagram;

[0065] FIG8 is a flow chart of a method for uploading pictures according to an embodiment of the present application;

[0066] FIG9a is a schematic diagram of a flow chart of a method for processing a product image according to an embodiment of the present application;

[0067] FIG9 b is a schematic diagram of a flow chart of a method for displaying product images according to an embodiment of the present application;

[0068] FIG10 is a schematic diagram of a flow chart of a method for generating an image according to an embodiment of the present application;

[0069] FIG11 is a structural block diagram of an image display device provided in one embodiment of the present application;

[0070] FIG12 is a structural block diagram of an image processing device provided in one embodiment of the present application;

[0071] FIG13 is a structural block diagram of an image generation device provided in an embodiment of the present application;

[0072] FIG14 is a structural block diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0073] Currently, most product images displayed on e-commerce platforms have relatively simple backgrounds and lack content related to consumers' actual use of the products. This makes it difficult for consumers to fully perceive the relevance of the products to themselves. To address this issue, this application provides a technical solution that can generate product images that are relevant to consumers based on the original product images uploaded by merchants. By displaying product images to relevant consumers, consumers can feel the close connection between the products and themselves, helping to increase their attention to the products.

[0074] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0075] Some processes described in the specification, claims, and figures of this application include multiple operations that appear in a specific order. These operations may be executed in a different order than the order in which they appear in this document, or in parallel. Operation numbers, such as 101 and 102, are simply used to distinguish between different operations and do not imply any order of execution. Furthermore, these processes may include more or fewer operations, and these operations may be executed sequentially or in parallel. It should be noted that terms such as "first" and "second" are used herein to distinguish between different messages, devices, modules, etc., and do not imply a sequential order, nor do they limit "first" and "second" to different types. The term "or / and" in this application simply describes an association relationship between associated objects, indicating that three possible relationships can exist. For example, "A or / and B" indicates that A can exist alone, A and B can exist simultaneously, or B can exist alone. The character " / " in this application generally indicates that the associated objects are in an "or" relationship. It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a product or system comprising a series of elements includes not only those elements, but also other elements that are not explicitly listed, or also includes elements that are inherent to such product or system. In the absence of further restrictions, an element defined by the statement "comprising a ..." does not exclude the presence of other identical elements in the product or system comprising the element. In addition, the following embodiments are only some of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of this application.

[0076] Before introducing the solutions provided by the embodiments of this application, some terms involved in this application are first explained.

[0077] Image generation service is a functional service that uses artificial intelligence (AI) technology to automatically generate content, such as AICG (AI-Generated Content), and more specifically, SD (Stable Diffusion). SD is an AI drawing tool that can be based on text-to-image (text2img) and image-to-image (img2img), and can be called in batches through the Web UI interface (page) and API (Application Programming Interface). Among them, text-to-image refers to the generation of corresponding images based on the input text. Image-to-image refers to the generation of new images based on the input text and reference images. Specifically, the generated new image is obtained by modifying the input reference image according to the input text description.

[0078] The page corresponding to the above-mentioned SD in the image generation mode can be found in page B shown in Figure 3. As shown in page B, the image generation functions of SD in the image generation mode mainly include but are not limited to the following categories: partial drawing (inpaint), partial drawing mask upload (inpaint upload), etc. Among them, partial drawing refers to redrawing only a specific area in the uploaded original image, while ensuring that other areas remain unchanged. Partial drawing mask upload refers to redrawing only the area in the original image that belongs to the mask mark. The mask can be created in other tools (such as Photoshop, etc.) and uploaded.

[0079] The basic parameters for generating an image include, but are not limited to, the following: resize mode, mask blur, masked content, and inpaint area. Resize mode refers to the resizing options available when the original image size differs from the size of the generated image. These options include stretching (just resizing, which adjusts the image's width and height to the original image's width and height) and cropping (cropping and resizing, which cuts the image to match the original image's width and height). Mask blur generally ranges from 0 to 64. Mask modes include inpaint masked (redrawing only the masked area) and inpaint not masked. Masked content includes fill and original. For a more detailed introduction to each of these basic parameters, please refer to the existing content.

[0080] Natural language processing models driven by artificial intelligence technology, such as ChatGPT (Chat Generative Pre-trained Transformer, chatbot), use advanced artificial intelligence and natural language processing technologies to understand and generate natural conversation content. They can be used in various scenarios, such as customer service, entertainment, language learning, etc., and can provide high-quality, accurate and natural language services.

[0081] The various method embodiments provided in this application can be implemented on the hardware corresponding to the image processing system described below. Specifically, in one embodiment, the image processing system includes: a first client and a server; wherein,

[0082] The first client is configured to respond to a user's operation and request the server to obtain a second image of the target object;

[0083] The server is configured to obtain, based on the relevant information of the user, a second image related to the user, and send the second image to the first client; wherein the second image is generated based on at least one decorative material and the first image of the target object, and the at least one decorative material is related to the user;

[0084] The first client is further configured to display the second image on a client interface.

[0085] The above-mentioned image processing system can be an e-commerce system in the e-commerce field. Accordingly, the target object can be any object sold online through the e-commerce system, such as clothes, shoes, bags and other commodities. Alternatively, the above-mentioned image processing system can also be applied to the social field, such as social e-commerce, social knowledge payment, etc.

[0086] FIG. 1 a and FIG. 1 b show an example of applying the image processing system provided by this embodiment to the field of e-commerce.

[0087] Furthermore, in another embodiment, the image processing system includes: a second client and a server; wherein,

[0088] The second client is used to respond to the image upload request and send the first image of the target object to the server;

[0089] The server is configured to determine at least one decorative material suitable for the target object, and generate a second image based on the at least one decorative material and the first image;

[0090] The second client is used to display the second image so that the uploader can review and confirm whether to upload it;

[0091] The second picture is used for display when a user who is related to the at least one decorative material visits the target object.

[0092] Similarly, the image processing system can also be an e-commerce system in the e-commerce field. Accordingly, the target object can also be any object sold online through the e-commerce system, such as clothes, shoes, bags, etc. The image uploader can be a merchant.

[0093] FIG1c shows an example of the image processing system provided in this embodiment being applied in the field of e-commerce.

[0094] The following describes the system embodiment provided by this application from the perspective that the above-mentioned image processing system is an e-commerce system and the target object is a commodity.

[0095] The various method embodiments provided herein can be implemented on the hardware corresponding to the e-commerce system shown in Figures 1a and 1b. Referring to Figures 1a and 1b, the e-commerce system may include: a first client 11 and a server 12. The first client 11 can be understood as a client on the consumer (or user) side in the e-commerce field.

[0096] The first client 11 is configured to request a product image of a product from the server 12 in response to a user operation;

[0097] The server 12 is used to obtain a product image of a product that is relevant to the user based on the relevant information of the user, and send the product image to the first client 11; wherein, the product image is generated based on at least one decorative material and the original image of the product, and the at least one decorative material is relevant to the user.

[0098] The first client 11 is used to display the product image on a client interface.

[0099] The above-mentioned product image can be the second image mentioned in the above embodiment; the original image of the product can be the first image.

[0100] The user's related information may include, but is not limited to, the user's demographic type, the user's location, the season of the user's location, the time of day of the user's location, the user's preferred environment (indoor / outdoor), etc. It should be noted that the user's privacy-related information is obtained only with the user's permission.

[0101] For example, in the scenario shown in Figure 1a, the user is a young woman, and her current location is Hainan. Based on the relevant information of these users, the server obtains a product image of a young female model wearing a dress (product) at the beach.

[0102] In one specific embodiment, the original product image is uploaded to the server 12 by the second client 13 corresponding to the e-commerce merchant. Based on the information provided by the merchant, the server 12 determines at least one decorative material suitable for the product. It then generates a product image based on the at least one decorative material and the original product image, and then associates and stores the product image with the product. Specifically, the server performs the aforementioned steps when the e-commerce merchant uploads the original product image, pre-processing the product image to generate and store the decorated product image. This means that the product image generation process can be completed offline.

[0103] In actual applications, the server 12 can generate multiple decorated product images for the product. For example, for the dress shown in Figure 1a, the server can generate a first product image of a young female model wearing the dress at the beach, and can also generate a second product image of a young female model wearing the dress on campus, and so on. The multiple generated product images are all stored in association with the product. If a first female user located in Hainan accesses the product through an application, the server can obtain the first product image and display it on the first client interface corresponding to the first female user. If a second female user located in ** University accesses the product through an application, the server can obtain the second product image and display it on the first client interface corresponding to the second female user.

[0104] Of course, the process of generating product images on the server side can also be completed online. That is, in another specific embodiment, after the first client sends a product image acquisition request to the server side, the server side 12 can decorate the original image of the product that the user wants to access in real time based on the relevant information of the first client user, and feed back the decorated product image to the user for display on the user-side first client interface. In the embodiment shown in Figure 1b, the first client side 11 is used to respond to the user's access operation and obtain the relevant information of the user. The server side 12 is used to determine at least one decorative material based on the relevant information of the user; generate a product image based on the at least one decorative material and the original image of the product; and send the product image to the first client side 11. The first client side 11 is used to display the product image on the interface.

[0105] For example, the user's relevant information includes: young woman, London, England, and the local season is summer. Based on this relevant information, the server 12 can determine decorative elements such as: outdoor, young female model, summer, and London Bridge. It can then generate a product image based on these decorative elements and the original product image. This product image might be: a young woman wearing a long skirt standing on London Bridge in summer. The user will immediately feel a sense of familiarity when seeing this product image, imagining themselves standing on London Bridge in a long skirt, and thus become motivated to purchase.

[0106] Furthermore, FIG1c shows a schematic diagram of the e-commerce system including a second client 13 and a server 12. The second client 13 can be understood as a client on the merchant side in the e-commerce field. Specifically,

[0107] The second client 13 is configured to respond to the product image upload request and send the original product image to the server;

[0108] The server 12 is configured to determine at least one decorative material suitable for the product, and generate a product image based on the at least one decorative material and the original image;

[0109] The second client 13 is used to display the product image so that the uploader can review and confirm whether to upload it;

[0110] The product image is used to be displayed when a user who is related to the at least one decorative material visits the product.

[0111] Similarly, the original image of the above-mentioned product can be the first image mentioned in the above embodiment; the product image can be the second image.

[0112] In this embodiment, the decorative materials may include at least one of the following: product image background materials, materials displayed in conjunction with the product, the type of model used to display the product, etc. Among them, product image background materials may include, but are not limited to: scenic spots and historical sites backgrounds, scenic area backgrounds (such as the seaside, mountains, etc.), indoor backgrounds (which can be further subdivided into: bedrooms, kitchens, dining rooms, living rooms, etc.), park backgrounds, school backgrounds (which can be further subdivided into: classrooms, laboratories, playgrounds, gymnasiums, etc.), grass backgrounds, sky backgrounds, etc. The materials displayed in conjunction with the product will vary for different types of products. For example, for clothing products, the materials displayed in conjunction with the product may include, but are not limited to: belts, headwear, brooches, scarves, bags, etc. For footwear products, the materials displayed in conjunction with the product may include, but are not limited to: socks, shoelaces, etc. For furniture products, the materials displayed in conjunction with the product may include, but are not limited to: books and ornaments on bookshelves, cushions and carpets on sofas, etc.; these are not listed here one by one.

[0113] It's worth noting that the server can generate multiple product images for a single product, each using different decorative materials. For example, if a merchant sells a product to multiple countries through an e-commerce platform, the server can generate product images tailored to users in each country.

[0114] It should be noted that the server 11 can be a server, a service cluster consisting of multiple servers, a virtual server deployed on a server or service cluster, or a cloud server, etc., and this embodiment does not limit this. The hardware devices corresponding to the first client 12 and the second client 13 can be mobile phones, computers, tablet computers, smart wearable devices, etc., and this embodiment does not specifically limit this.

[0115] The specific contents of the corresponding functions of the above-mentioned server, first client and second client will be described in detail in the following method embodiments.

[0116] An embodiment of the present application provides a method for displaying an image. The execution subject of all steps in the method may be the first client in the above-mentioned image processing system. Specifically, the method for displaying an image includes:

[0117] S11. In response to a user operation, obtaining a second image related to the user; wherein the second image is generated based on at least one decorative material and the first image of the target object, and the at least one decorative material is related to the user;

[0118] S12. Display the second picture on the client interface.

[0119] In some feasible embodiments, the target object is associated with multiple pictures, and the pictures have corresponding picture tags.

[0120] Accordingly, the above-mentioned S11 “obtaining a second picture related to the user” may specifically include:

[0121] S111. Determine keywords based on the relevant information of the user;

[0122] S112. Searching for at least one second picture whose picture label matches the keyword among the multiple pictures;

[0123] The image label of the second image is determined by at least one decorative material on which it is based.

[0124] In another possible implementation, the step of “obtaining a second picture related to the user” in S11 may specifically include:

[0125] S111′, determining the at least one decoration material according to the relevant information of the user;

[0126] S112′: Generate a second picture based on the at least one decoration material and the first picture of the target object.

[0127] Furthermore, the above-mentioned decorative materials may include but are not limited to at least one of the following: background material, material displayed in combination with the target object, and model type for displaying the target object.

[0128] Furthermore, the target object may be a product on an e-commerce platform (also known as an online product). Accordingly, the first image is a picture uploaded by the merchant. The picture uploaded by the merchant may be a photo of the product with a solid color background, etc.

[0129] For detailed description of the specific implementation of each step in this picture display method embodiment, please refer to the relevant content described below in conjunction with Figure 2.

[0130] Based on the above content, the following describes the technical solution corresponding to the image display method provided in the embodiment of the present application, taking the target object as a product, the first image as the original image of the product, and the second image as the product image obtained after the original image is decorated as an example. Figure 2 shows a flow chart of the image display method provided in an embodiment of the present application. The execution subject of all steps in the method described in this embodiment can be the first client in the above system. Specifically, the method includes:

[0131] 101. In response to a user operation, obtain a product image that is relevant to the user; wherein the product image is generated based on at least one decorative material and an original image of the product, and the at least one decorative material is relevant to the user;

[0132] 102. Display the product image on the client interface.

[0133] In the above 101, the user's operation can be the user clicking on an e-commerce website or application (APP), and the corresponding client interface is the e-commerce website homepage or APP homepage. Alternatively, the user's operation can be the user entering a product name in a search box or input box and clicking Search; the corresponding client interface is the search results display page. Alternatively, the user's operation can be the user clicking on a product category on the homepage; the corresponding client interface is the product list page corresponding to that product category. Alternatively, the user's operation can be the user clicking on a specific product page; the corresponding client interface is that product page, and so on.

[0134] The above steps 101 and 102 illustrate the process of obtaining and displaying a product image of a product on the client interface. In fact, if the client interface needs to display product images of multiple products, the process of obtaining and displaying the product images of each product can be the process of the above steps 101 and 102.

[0135] There may be a situation where some products have corresponding product images decorated with decorative materials, but the product images are not relevant to users; and / or some products do not have product images decorated with decorative materials; for these products, the original images of the products are displayed on the client interface.

[0136] The technical solution provided in this embodiment, after detecting a user's action, obtains a product image related to the user and displays it on the client interface. The product image is generated based on at least one decorative material related to the user and the original image of the product. This solution demonstrates that the product image displayed to the user is a decorated and relevant image. This allows the user to directly perceive the product's close relevance to them, making the user more engaged.

[0137] Furthermore, there are multiple product images associated with the product. The decorative materials based on each product image are different in order to adapt to different types of users. The multiple product images associated with the product can be generated by the server in the above-mentioned system embodiment in an offline state. The first client, which is the execution subject of the method described in this embodiment, can regularly obtain the product image of the product from the server and store it locally, or synchronize it to the first client after the server updates the multiple product images of a certain product; accordingly, the execution subject of the following steps 1011 and 1012 can be the first client. Alternatively, the multiple product images associated with the product are stored on the server, and the first client sends the relevant information of the user to the server, which queries the image in the multiple product images associated with the product and feeds back the product image that is relevant to the user; accordingly, the execution subject of the following steps 1011 and 1012 can be the server.

[0138] The step of “obtaining a product image related to the user” in step 101 above includes:

[0139] 1011. Determine keywords based on the relevant information of the user;

[0140] 1012. Searching for a product graph whose graph label matches the keyword among multiple product graphs associated with the product;

[0141] The image label of a product image is determined by at least one decorative element it's based on. For example, consider a product image for a "T-shirt." This image is generated based on the decorative element "London Bridge, young female model" and a solid background image of the T-shirt. Accordingly, the image label for this product image is "London Bridge, young female model." A simpler implementation would simply use "London Bridge, young female model" as the image label for the product image.

[0142] Alternatively, the product image of the product is generated online, which may be that the first client determines at least one decorative material based on the user's relevant information in response to the user's operation, and generates the product image based on the at least one decorative material and the original image of the product; or the first client obtains the user's relevant information and sends the user's relevant information to the server in response to the user's operation; the server determines at least one decorative material based on the user's relevant information, generates the product image based on the at least one decorative material and the original image of the product, and feeds back the generated product image to the first client.

[0143] It should be noted that the product images of the product that are relevant to the user can be one or more images. If there are multiple images, the multiple images can be scrolled and displayed on the client interface when executing step 102.

[0144] It should be noted that the above embodiment does not provide a detailed description of the process of determining the decorative material and generating the product image, which will be specifically described in the following embodiments.

[0145] Another embodiment of the present application provides an image processing method. The execution subject of the method may be a server. The execution subject of the method of this embodiment may also be a first client or a second client, or the first client and the server may execute the method in collaboration, or the second client and the server may execute the method in collaboration. Specifically, the image processing method includes:

[0146] S21, obtaining a first image of the target object;

[0147] S22, determining at least one decorative material suitable for the target object;

[0148] S23, generating a second picture based on the at least one decorative material and the first picture;

[0149] S24: Associating the second image with the target object, so as to display the second image when a user who is related to the at least one decorative material visits the target object.

[0150] Furthermore, in an implementable solution, the above-mentioned S22 “determining at least one decoration material suitable for the target object” may specifically include:

[0151] S221, determining at least one decorative material based on the target object information and the target market information of the target object; wherein the target market information includes at least one of: a sales area and a target population; and / or

[0152] S222: Determine the at least one decoration material according to the material configuration information set by the first image provider.

[0153] Furthermore, a specific implementation of the above-mentioned S221 "determining the at least one decorative material according to the object information of the target object and the target market information of the product" can be implemented by the following steps:

[0154] S2211: Trigger a preset analysis model so that the preset analysis model feeds back the at least one decoration material based on the object information and the target market information.

[0155] Furthermore, in an implementable solution, the above-mentioned S23 “generating a second picture based on the at least one decorative material and the first picture” may include:

[0156] Separating the target object from the first image; splicing the separated target object with the at least one decorative material as a background of the target object to obtain the second image; or

[0157] The second picture is generated by using the first picture, the area information of the main area of ​​the target object in the first picture, and the at least one decorative material as drawing materials of a preset drawing model.

[0158] Accordingly, another embodiment of the present application further provides a method for uploading a picture corresponding to the above-mentioned picture processing method. The method for uploading a picture includes:

[0159] S31. Responding to the image upload request, obtaining a first image of the target object;

[0160] S32, determining at least one decorative material suitable for the target object;

[0161] S33, generating a second picture based on the at least one decorative material and the first picture;

[0162] S34: Display the second image so that the uploader can review and confirm whether to upload it;

[0163] The second picture is used for display when a user who is related to the at least one decorative material visits the target object.

[0164] Similarly, the target object described in the above-mentioned image processing method embodiment or image uploading method embodiment can be an online product. The first image can be the original image of the product, and the second image can be a product image obtained by modifying the original image. For a detailed description of the specific implementation of each step in the above-mentioned image processing method embodiment, please refer to the relevant content described below in conjunction with Figure 3. For a detailed description of the specific implementation of each step in the image uploading method embodiment, please refer to the relevant content described below in conjunction with Figure 8.

[0165] Based on the above content, the image processing method and image uploading method provided in the embodiment of the present application are described in detail, taking the target object as a product, the first image as the original image of the product, and the second image as the product image obtained after the original image is decorated as an example. The details are as follows:

[0166] Figure 3 shows a flow chart of the image processing method provided by an embodiment of the present application. The execution subject of the method can be a server, and the server can be a single server, a service cluster, a virtual server deployed on a server, or a cloud, etc., which is not limited by the embodiment of the present application. Of course, if the hardware device corresponding to the first client or the second client has strong computing power, the execution subject of the method of this embodiment can also be the first client or the second client. Alternatively, the first client and the server collaborate to execute (that is, some steps are executed by the first client, and the other steps are executed by the server), or the second client and the server collaborate to execute. As shown in Figure 3, the commodity image processing method provided by the embodiment of the present application includes the following steps:

[0167] 201. Obtain the original image of the product.

[0168] 202. Determine at least one decorative material suitable for the product.

[0169] 203. Generate a product image based on the at least one decorative material and the original image.

[0170] 204. Associate the product image with the product to display it when a user who is related to the at least one decorative material visits the product.

[0171] In step 201 above, the original image of the product may be provided by the merchant. The products may include, but are not limited to, the following types of goods: clothing, home furnishings, shoes, bags (handbags, school bags, luggage, etc.), scarves, hats, gloves, belts, accessories (such as bracelets, rings, necklaces, earrings, headwear, etc.), watches, handheld electronic devices (such as mobile phones, laptops, tablets, etc.), etc. This application primarily uses clothing as an example to introduce the technical solution provided by this application. The original image of the product may be uploaded by the merchant through the interactive interface provided by the second client.

[0172] In the above 202, at least one decorative material can be determined based on the product information of the product and the target market information of the product. The target market information includes at least one of the sales area and the target population. The target population can be simply understood as: the product is suitable for the youth user group, the product is suitable for the male or female group, etc. And / or the at least one decorative material is determined based on the material configuration information set by the original image provider (i.e., the merchant). For example, the second client provides a material configuration function for the merchant, and the merchant can fill in or select the material configuration content on the material configuration page. The material configuration items that can be filled in or selected on the material configuration page may include but are not limited to: the product is suitable for the season, suitable for the venue (office, sports field, leisure place, etc.), suitable for men or women, suitable for teenagers / youth / middle-aged / elderly groups, suitable materials for matching, etc.

[0173] The above-mentioned product information may include but is not limited to product identification (such as product name), product attribute information (such as category (such as clothing), color, material, etc.). The product information may be uploaded by the merchant through the interactive interface provided by the second client; and / or the second client or server may obtain the product by identifying the original image of the product through image recognition technology (such as OCR (Optical Character Recognition) technology, machine learning model, etc.); and / or the product information is obtained by the second client or server through image search based on the original image of the product, etc. This embodiment does not specifically limit the method of obtaining product information.

[0174] The sales regions mentioned above can be input by the merchant. Alternatively, the server can determine them based on the product's historical sales in various regions. For example, if a product's sales are highest in the eastern coastal region, the sales region for that product can be determined as the eastern coastal region. Alternatively, the server can identify the product's target audience based on product information and determine the region where that audience is concentrated as the product's sales region.

[0175] The following will explain how to obtain product information and sales areas in combination with specific application scenarios.

[0176] Figure 4 illustrates a specific application scenario corresponding to the embodiment of the present application. A merchant successfully logs in to the merchant backend page provided by an e-commerce platform through a second client 13 and clicks the "Publish Product" function control on the merchant backend page to enter the "Publish Product" page A shown in Figure 4. Subsequently, the merchant can upload the original image g of the product and enter product information on the "Publish Product" page for the product to be published. After completing the input, the merchant can click the "Publish" control. In response to the merchant's click, the second client 13 sends a product publishing request to the server. After receiving this product publishing request, the server can obtain the original image and product information of the product uploaded by the merchant from the information carried in this product publishing request. At the same time, the second client 13 pops up a prompt box 01, which displays a reminder message to remind the merchant whether to decorate the original image (such as whether to generate corresponding product display renderings based on regional sales in Figure 4). The prompt box 01 also displays a first selection control (a "Yes" control) and a second selection control (a "No" control). If the merchant clicks the first selection control, it indicates that the merchant has triggered a confirmation operation in response to the reminder information, confirming authorization to process the original image of the product uploaded by the merchant. In response to the confirmation operation, the second client 13 displays a page corresponding to the image generation service (such as page B shown in Figure 4), on which the merchant can perform corresponding input operations to enter the product sales area, etc. For example, if the merchant enters the information "the background is the beath by the sea" in the prompt word input box 21 on page B shown in Figure 4, it indicates that the product is intended to be sold in a coastal city. Alternatively, the second client simply displays an input box, in which the merchant can enter the product sales area. Alternatively, the second client outputs a query message in the form of voice to inquire about the product sales area, and the product sales area is determined based on the merchant's voice response to the query message. If the merchant clicks the second selection control, it indicates that the merchant has triggered a rejection operation in response to the reminder information. After the server responds to the rejection operation, it saves the original image and product information uploaded by the merchant and ends.

[0177] Figure 5 illustrates another specific application scenario corresponding to the embodiment of the present application. A merchant uploads a product image to the server via a second client 13. Product information can be determined by the server based on the product image. Specifically, as shown in Figure 5, a merchant uploads the product image to the "Publish Product" page A' and clicks the "Publish" control. In response to this click, the second client 13 sends a product publishing request to the server 12, which includes the product image uploaded by the merchant. The product image is a main image of the product with a solid background, primarily used to showcase its appearance and features. After receiving the product image uploaded by the merchant from the received product publishing request, the server 12 uses image recognition technology to identify the product in the image and obtain product information. Furthermore, the server 12 can combine historical sales information collected for the product or similar products to determine suitable sales regions for the product. For example, if the product information obtained through identification includes colors such as dress, blue, and gauze, the server can determine that the product is suitable for summer and young women. Combined with the historical sales information collected, it is analyzed that the majority of consumers in Region A are young females, so Region A can be determined to be a suitable sales area for the product.

[0178] Based on the above example content, in one feasible technical solution, the method provided in this embodiment may further include the following steps:

[0179] Sa1, in response to a user triggering a publishing operation on the original image of the product, outputting a reminder message to remind whether the original image needs to be decorated;

[0180] Sa2. If the first user triggers a confirmation operation for the reminder information, the product information and target market information of the product are obtained, or a material configuration page is displayed so that the original image provider can set material configuration information through the material configuration page.

[0181] Accordingly, the above step 202 of “determining at least one decorative material suitable for the product” may include:

[0182] Determine the at least one decorative material based on the product information and the target market information of the product; wherein the target market information includes at least one of: a sales area and a target population; and / or

[0183] The at least one decoration material is determined according to the material configuration information set by the original image provider.

[0184] Furthermore, in step Sa2, the product information and / or target market information may be determined by identifying the product subject in the original image; and then combining the collected historical sales information of the product or similar products to determine the appropriate sales region for the product. Alternatively, the product information and / or target market information may be input by the merchant (e.g., the original image provider) through a corresponding input page.

[0185] Using the product information and sales areas obtained above, we can analyze the user group type, season, and scene (such as indoor / outdoor, indoor can be further subdivided into home, office, exhibition hall, library, shopping mall, etc., and outdoor can be further subdivided into parks, community gardens, squares, scenic spots, landmark buildings, etc.) that the product is suitable for when it is sold in the sales area.

[0186] Specifically, the above step of "determining the at least one decorative material based on the commodity information and the target market information of the commodity" can be implemented using artificial intelligence technology. For example,

[0187] A preset analysis model is triggered so that the preset analysis model feeds back the at least one decoration material based on the commodity information and the target market information.

[0188] The aforementioned preset analysis model may be a machine learning model trained using a large amount of relevant training data. For example, the machine learning model may be a natural speech processing model, which can be triggered by a query to provide feedback on at least one decorative material suitable for the product. In other words, the aforementioned step of "triggering the preset analysis model to provide feedback on the at least one decorative material based on the product information and the target market information" may include:

[0189] Sb1. Generate consulting questions based on the product information and the target market information;

[0190] Sb2. Using consultation questions, trigger a natural language processing model to provide feedback on at least one decorative material suitable for the product.

[0191] In a specific implementation, the natural speech processing model may be, but is not limited to, a ChatGPT conversational robot. Taking the ChatGPT conversational robot as an example, assuming that the aforementioned region is a certain region L, and the product information includes: dress, blue, cotton, etc., then the generated consultation question may be: When targeting users in region L, the cotton blue dress can be used by the type of people, season, geographical location, and whether it is suitable for indoor or outdoor use; then, the ChatGPT conversational robot is called, and the consultation question is input into the ChatGPT conversational robot, thereby obtaining the ChatGPT conversational robot output reply information, such as the reply information may be "This dress is suitable for young women to wear in the summer and is very suitable for vacationing on the ** beach in region L. On a beach vacation, wearing this dress can well adapt to the hot and humid environment of the beach." Based on the above reply information, it is determined that at least one decorative material may include: outdoor, ** beach, young women, and summer.

[0192] After at least one decorative material is determined, a product image of the product may be generated based on the at least one decorative material and the original image of the product.

[0193] The above step 203 of “generating a product image based on the at least one decorative material and the original image” may include:

[0194] 2031. Separate the product body from the original image; use the at least one decorative material as a background of the product body and splice it with the separated product body to obtain the product image; or

[0195] 2032. Use the original image, the area information of the main area of ​​the product in the original image, and the at least one decorative material as drawing materials of a preset drawing model to generate the product image.

[0196] The "area information of the main product area in the original image" in step 2032 can be manually marked or determined using image recognition technology. The area in the original image other than the main product area is the area to be drawn, or a small area of ​​the main product area is also the area to be drawn. For example, if the product is a long skirt and at least one decorative element includes a belt, then the waist of the skirt is also the area to be drawn.

[0197] For example, as shown in Figure 4, in addition to being able to input the sales area of ​​the product through Page B, Page B also provides a mask image upload interface. Merchants can upload (input) the mask image m corresponding to the original image of the product through this interface. The white area in the mask image m is the area to be drawn, and the black area is the non-drawing area. The area in the original image of the product that corresponds to the white area in the mask image m is the area to be drawn. The above-mentioned mask m can be obtained by the merchant by processing the original image of the product with the help of tools such as PS. Alternatively, when the merchant selects a graphic function such as local drawing for the original image of the product, the area to be drawn is the area circled (selected) by the merchant using graffiti or other methods for the product image. However, in order to ensure the accuracy of the determination of the area to be drawn, it is preferred to use a mask to determine the area to be drawn in the product image.

[0198] Alternatively, the server can determine the area of ​​the product image that requires drawing. For example, the server can use image recognition technology to identify and analyze the main area of ​​the product image, and then determine the main area of ​​the product as the non-drawing area, and determine the area of ​​the product image other than the main area as the area that requires drawing.

[0199] Based on the above content, in a specific implementation scheme, the method provided in this embodiment may further include the following steps:

[0200] Sc1. In response to a user's mask image upload operation, obtaining a mask image corresponding to the product image; determining area information of the product main area based on the mask image; or

[0201] Sc2. In response to the merchant triggering an area selection operation on the product image, determining the selected area in the product image as area information of the product main area; or

[0202] Sc3. Identify the original image of the product to identify the main area of ​​the product; and obtain area information of the main area of ​​the product based on the identification result.

[0203] It should be added here that: if the original image of the product contains other objects used to set off the product in addition to the product body, in order to ensure the accuracy of recognition and avoid misidentifying other objects that serve as the product body as the product body, the original image of the product can be recognized based on the obtained product information to accurately identify the product body.

[0204] During specific implementation, the preset drawing model may be an image generation model based on artificial intelligence technology, such as stable diffusion (abbreviated as SD).

[0205] Continuing with Figure 4, using the preset drawing model SD as an example, the merchant uploads the mask m through the second client's page B and clicks the "Generate" control 11. In response to this click, the second client sends a generate request to the server. This generate request carries the product image g, the mask m, and at least one decorative material (which can be understood as the basic parameters for generating the image). In response to this generate request, the server passes the product image g, the mask m, and the at least one decorative material to the SD. Then, referring to Figure 6, the SD executes the following steps:

[0206] 1) Using a text encoder (a special Transformer language model), extract the semantic information of at least one decorative material (i.e., the semantic vector shown in FIG6 );

[0207] 2) To accelerate the subsequent image generation process, an image encoder is used to encode and compress the original product image g and the regional information of the product main area determined by the mask m from the pixel space into a low-dimensional latent space to obtain a latent image. Noise is then added to the latent image and a diffusion process is performed to obtain a latent noise map. The image encoder can be a variational autoencoder (VAE).

[0208] 3) The potential noise map obtained above and the extracted semantic information are used as input to the image information generator, where the semantic information is the control condition of the image information generator; the image information generator is executed, and the information output by the image information generator is further input to the subsequent image decoder. The image decoder uses the information output by the image information generator to reconstruct the image, thereby generating a new product image.

[0209] It should be noted that merchants can also configure corresponding image generation parameters on Page B, as shown in Figure 4, such as zoom mode, mask blur, mask mode, masked content, drawing area, etc. The server can pass these merchant-configured image generation parameters to the SD, thereby completing the generation of new product images based on the received image generation parameters. Of course, merchants can also choose not to configure these image generation parameters and directly use the default values.

[0210] Furthermore, the generated product display effect image can be returned to the merchant for review, so that the merchant can decide whether to adopt the product image. If the merchant triggers the adoption (confirmation save) operation, the product image can be persisted; conversely, if the merchant triggers the regeneration operation, the above steps can be re-executed to regenerate the product image. That is, the method provided in this embodiment can also include the following steps:

[0211] Sd1, displaying a product image of the product;

[0212] Sd2. Detecting the operation triggered by the merchant on the product image;

[0213] Sd3. If a confirmation operation is detected, the product image is associated with the product and saved;

[0214] Sd4. If a regeneration operation is detected, re-execute the above steps 201 to 203.

[0215] FIG4 shows an example of displaying a generated product image G in the image display area 41 on page B corresponding to SD. If the merchant triggers a save operation for the displayed product image G, such as clicking the "Save" icon or the "Zip" icon located below the display area 41, the product image can be saved using a key-value data storage format. When saving, the product image's image tag (e.g., the image tag includes, but is not limited to, product identification, product sales region, and user group type) can be used as the key, and the URL of the product image G can be used as the value. The icons located below the display area 41, from left to right, represent the following functions: the "Folder" icon indicates opening the folder where the current image is located, the "Save" icon indicates downloading the current image as a PNG format for saving, the "Zip" icon indicates downloading the current image as a zip compressed file for saving, and the ">>Send to img2img" icon indicates using the current image as the base image (original image) for image generation.

[0216] In summary, the technical solution provided by this embodiment determines at least one suitable decorative material for a product, generates a product image based on the at least one decorative material and the product's original image, and associates the product image with the product so that it can be displayed when a user associated with the at least one decorative material visits the product. This solution pre-decorates the product's original image, generates a decorated product image, and associates it with the product. This image is then displayed to users who visit the product, allowing them to directly perceive the product's close relevance and engage with the user.

[0217] Furthermore, the method provided in this embodiment may further include the following steps:

[0218] Se1. In response to a product access request triggered by a user, obtain relevant information of the user;

[0219] Se2. Determine keywords based on the relevant information of the user;

[0220] Se3. In the product image collection, search for product images whose image labels match the keywords; if there are any, display the searched product images; otherwise, display the original image of the product.

[0221] For example, a young female user in Region L accesses a product (dress) through a first client. Based on the user's information, the keywords "Region L, young woman" are determined. Then, within the corresponding image collection for the product (dress), a search is performed to find product images relevant to the user. For example, a product image of a young woman similar to the user wearing the dress on a beach in Region L during the summer is displayed on the first client interface. Upon seeing this product image, the user will perceive the dress as relevant to them and become more interested in purchasing it.

[0222] A specific solution provided by the above-mentioned embodiment can be represented by the signaling diagram shown in Figure 7. The embodiment shown in Figure 7 presupposes that the merchant accepts the server's modification of the original product image. Specifically, as shown in Figure 7, the merchant uploads a product image, product information, and sales region (e.g., Region A) to the server. After receiving the image, product information, and sales region, the server triggers a preset analysis model (e.g., ChatGPT). Based on the product information and sales region, the server triggers a preset analysis model (e.g., ChatGPT). The preset analysis model generates at least one decorative element suitable for the product (e.g., outdoor, beach in Region A, young woman, summer). After obtaining the at least one decorative element, the server triggers a preset drawing model. The preset drawing model uses the product image, regional information (e.g., a mask image) of the main product area in the image, and the at least one decorative element as the drawing element for a preset drawing model. The preset drawing model then creates an image of a young woman wearing a dress (product) strolling on a beach on a summer day. The server sends this product image to a second client. The second client displays the product image for the merchant to review. If the merchant confirms to adopt the product image, the second client sends a confirmation instruction to the server, and the server responds to the instruction and stores the product image in association with the product image.

[0223] A young female user in Region A triggers a product access operation through the first client. In response, the first client sends a product access request to the server. This product access request may include the product identifier and user-related information (Region A, young woman, etc.). After receiving the product access request, the server searches the corresponding image collection for product images related to the user (e.g., a product image of a young woman wearing a dress (product) walking on a beach on a summer day). If the image is found, it is fed back to the first client for display on the first client interface. Otherwise, the original image of the product is returned.

[0224] Based on the content described in the above application, another embodiment of the present application also provides a method for uploading a product image, which corresponds to the solution from the perspective of the second client side. The execution subject of the method provided in this embodiment can be the second client mentioned in the above system, or some steps are performed by the second client and some steps are performed by the server. Specifically, as shown in the flow chart of Figure 8, the method for uploading a product image includes:

[0225] 301. Responding to a product image upload request, obtaining the original product image;

[0226] 302. Determine at least one decorative material suitable for the product;

[0227] 303. Generate a product image based on the at least one decorative material and the original image;

[0228] 304. Display the product image so that the uploader can review and confirm whether to upload it;

[0229] The product image is used to be displayed when a user who is related to the at least one decorative material visits the product.

[0230] The specific implementation of the above steps 302 and 303 can be found in the relevant content above and will not be described here in detail.

[0231] In this embodiment, after a merchant uploads a product image, the platform automatically determines at least one suitable decorative material for the product. Based on the at least one decorative material and the product image, the platform generates a product image, which the merchant then reviews and confirms. If the merchant approves the upload, the product image is displayed to users on the e-commerce platform application who access the product and are associated with the at least one decorative material. This entire process requires only the merchant user to upload a single original product image, eliminating the need for the merchant to participate extensively. This helps merchants increase the relevance of their product images and attract more user attention.

[0232] Based on the inventive ideas of the technical solutions of this application, other solutions can be further expanded. For example, the product images displayed on the web pages or application pages corresponding to different regions for the same product are different. For example, the web page or application page corresponding to region A displays a product image with the characteristics of region A. For example, for the same clothing product, there is a landmark building where Internet celebrities check in in region A, then the product image of the clothing displayed on the web page or application page corresponding to region A is a street shot of a model wearing the clothing at the landmark building where Internet celebrities check in. If there is an ancient town in region B, then the product image is a picture of a model wearing the clothing and walking in the ancient town; and so on. Therefore, referring to Figure 9a, another embodiment of the present application further provides a product image processing method, and the execution subject of this method can be the server in the above system. Specifically, the product image processing method includes:

[0233] 401. Get the sales area of ​​the product;

[0234] 402. Determine, based on the sales region, background material suitable for the product and having characteristics of the sales region;

[0235] 403. Based on the original image of the product and the background material, generate a product image in which the product is displayed in a scene corresponding to the background material;

[0236] The product image is used to be displayed on a web page or application page corresponding to the sales area.

[0237] Furthermore, the above 402 may specifically include:

[0238] The preset analysis model is triggered, and the preset analysis model determines background materials suitable for the commodity and having characteristics of the sales region based on the commodity information of the sales region and the commodity.

[0239] Specifically, background materials may include but are not limited to: outdoor backgrounds (such as grasslands, riversides, beaches, mountains, community gardens, streets, scenic spots, etc.), indoor backgrounds (such as bedrooms, living rooms, offices, hotels, shopping malls, etc.), objects that can be matched with products to highlight the characteristics of the products (such as ornaments, pendants, etc.), etc.

[0240] Furthermore, the method may further include: obtaining background configuration information set by a merchant, so as to determine background material based on the sales region, the product information of the product and the background configuration information set by the merchant.

[0241] When the preset analysis model is triggered, consulting questions can be generated based on the sales area and the product information of the product. The consulting questions are used to trigger the preset analysis model so that the preset analysis model can provide background materials suitable for the product and with the characteristics of the sales area.

[0242] The above 403 may trigger a preset drawing model, which generates a product image of the product displayed in a scene corresponding to the background material based on the original image of the product and the background material.

[0243] Among them, the relevant contents of the preset analysis model and the preset drawing model can be found in the above content and will not be repeated here.

[0244] The technical solution provided by this embodiment determines, based on the sales region of a product, background material characteristic of the sales region for the product; generates a product image of the product displayed in a scene corresponding to the background material based on the original product image and the background material; and displays the product image on a webpage or application page corresponding to the sales region. This embodiment of the application provides a new approach, enabling the same product to have different product images with local characteristics for different sales regions. This allows local users to perceive the product image as being closely related to them and more immersive when viewing it on a webpage or application page corresponding to that sales region. Alternatively, users in one sales region can view the product image of a product on a webpage or application page corresponding to a second sales region, visually picturing the user purchasing the product in the first sales region and then using it in the second sales region, creating a stronger sense of immersion. For example, a user is going on a beach vacation and, before their vacation, searches for beach-appropriate long dresses in their home area. The user can then view the product image of this type of product on the webpage or application page corresponding to the vacation region.

[0245] For merchants, it is the sales area of ​​the product. For consumers (or users), it is the location address (or area) or the address (or area) selected by the user. Based on the above solution, this application also provides a product image display method, as shown in Figure 9b, the method includes:

[0246] 501. Determine a target address in response to a user operation;

[0247] 502. Based on the target address, obtain a product image of the product; wherein the product image is generated based on the original product image and background material, and the background material is related to characteristics of the region where the target address belongs and characteristics of the product itself;

[0248] 503. Displaying a product image of the product on a webpage or application page corresponding to the region to which the target address belongs;

[0249] The target address is selected by the user or located by the user client.

[0250] The process of generating the product image and determining the background material in the above 502 can be referred to the contents of the above embodiment and will not be described in detail here.

[0251] In addition, this application also provides a new approach, namely, using artificial intelligence technology to decorate the original image of a target object. Specifically, a preset analysis model is used to first analyze at least one decorative material suitable for the target object, and then a preset drawing model is used to generate a first image of the target object based on the original image of the target object and the at least one decorative material. Therefore, this application also provides an image generation method, which includes the following steps:

[0252] S51. Using object information of a target object, triggering a preset analysis model to determine at least one decoration material suitable for the target object;

[0253] S52: Using the first picture of the target object and the at least one decorative material as drawing materials of a preset drawing model to generate a second picture of the target object;

[0254] The second picture is used for display when a user who is related to the at least one decorative material visits the target object.

[0255] Furthermore, the preset analysis model is a natural language processing model. Accordingly, in one possible implementation, the step S51 of "using the object information of the target object to trigger the preset analysis model to determine the at least one decorative material" may specifically include:

[0256] S511. Generate consulting questions based on the object information;

[0257] S512: Utilize the consultation question to trigger the natural language processing model to feedback at least one decoration material suitable for the target object.

[0258] Furthermore, the method provided in this embodiment may further include the following steps:

[0259] Obtain target market information of the target object, so as to utilize the object information and the target market information when triggering a preset analysis model; wherein the target market information includes at least one of: a sales region and a target population.

[0260] The method provided in this embodiment may further include the following steps:

[0261] Acquire area information of a main area of ​​a target object in the original image, and use the area information, the original image, and the at least one decorative material as drawing materials of the preset drawing model.

[0262] The target object in this embodiment of the image generation method can be a product on an e-commerce platform. Accordingly, the first image can be the original image of the product, and the second image can be the product image generated by modifying the original image.

[0263] Based on the above content, taking the target object as a product, the first picture as the original picture of the product, and the second picture as the product picture generated after the original picture is decorated as an example, the embodiment of the image generation method provided by this application is described in detail. Specifically, as shown in Figure 10, the flow chart of the product picture generation method. The execution subject of the method described in this embodiment can be the server in the system mentioned above, or it can be the first client or the second client. As shown in Figure 10, the product picture generation method includes:

[0264] 601. Using product information of a product, trigger a preset analysis model to determine at least one decorative material suitable for the product;

[0265] 602. Using the original image of the product and the at least one decorative material as drawing materials of a preset drawing model to generate a product image of the product;

[0266] The product image is used to be displayed when a user who is related to the at least one decorative material visits the product.

[0267] In a specific embodiment, the preset analysis model is a natural language processing model. Accordingly, the above 601 "using the product information of the product to trigger the preset analysis model to determine the at least one decorative material" may include:

[0268] 6011. Generate consultation questions based on the product information;

[0269] 6012. Utilize the consultation question to trigger the natural language processing model to feedback at least one decorative material suitable for the product.

[0270] Furthermore, the method provided in this embodiment may further include the following steps:

[0271] 603. Obtain target market information of the product, so as to utilize the product information and target market information when triggering a preset analysis model; wherein the target market information includes at least one of: sales region and target population; and / or

[0272] 604 : Acquire region information of a main area of ​​the product in the original image, and use the region information, the original image, and the at least one decorative material as drawing materials of the preset drawing model.

[0273] For the specific implementation of the above steps 601 to 604, please refer to the above content and will not be described in detail here.

[0274] The technical solution provided in this embodiment utilizes artificial intelligence technology to decorate original product images, ensuring that the decorated product images are relevant to visiting users and increasing their attention to the products. Specifically, a preset analysis model is triggered using product information to determine at least one decorative material suitable for the product. The original product image and the at least one decorative material are then used as drawing materials for a preset drawing model to generate a product image. This improves the efficiency of product image generation and is suitable for processing large quantities of product images on e-commerce platforms.

[0275] The following uses overseas e-commerce as an example to illustrate the solution provided by this application in combination with specific application scenarios. Specifically, it includes:

[0276] S1: A merchant launches a new product, a T-shirt. They upload basic information (product name and attributes) and an original image (e.g., a white background image) and select the country "UK." The second client prompts the merchant whether to generate a differentiated product image based on the currently selected UK.

[0277] S2: If the merchant agrees, the process goes to S3; if the merchant refuses, the process ends.

[0278] S3. The server calls the preset analysis model based on the product name and attributes and the merchant's selection of the United Kingdom. The preset analysis model provides multiple decorative materials, namely, outdoor, summer, young women, London Bridge, etc.

[0279] S4. The server passes the original image, the marked fixed image area information, and multiple decorative materials to a preset drawing model similar to stable diffusion. The preset drawing model generates an image that combines the young woman product subject and (outdoors, London Bridge, young woman, summer), such as a product image of a young woman wearing a T-shirt running on London Bridge on a summer day.

[0280] S5. The server returns the product image to the merchant for review.

[0281] S6. The second client displays the product image, and the merchant decides whether to use the product image.

[0282] S7. If the merchant adopts the product image, the second client triggers the server to save the image using the product ID + country identifier + user type as the key and the URL of the product image as the value.

[0283] S8. When a young user from the UK visits this product (T-shirt), the user's first client triggers the server to query whether there is a corresponding product image using the product ID + country identifier + user type as the key.

[0284] S9. If there is a result in the query in step S8, the server returns the product image generated by the first client "merchant" for the "British user", otherwise the default original product image is displayed.

[0285] When young British users saw the product image of a young woman using the product on London Bridge in summer, they immediately felt familiar with it and became interested in buying it, ultimately improving the user order conversion rate.

[0286] Of course, the merchant confirmation step can also be omitted. The above-mentioned product image generation step involves the merchant's participation in order to obtain the merchant's confirmation right to modify the image.

[0287] Furthermore, the technical solution provided by this application can also be extended to another specific scenario. For example, many applications will have multiple regional versions, such as domestic versions and overseas versions. If the merchant's products are sold both domestically and overseas. The merchant needs to upload the original image of the product on the domestic version application, and then the server corresponding to the domestic version application will process the original image (that is, based on at least one decorative material and the original image, the product image displayed on the domestic version application will be generated); the merchant also needs to upload the original image of the product on the overseas version application, and the server corresponding to the overseas version application will process the original image to generate the product image, which is cumbersome. To this end, based on the technical solution provided by this application, a tool can be provided to merchants, which merchants can call to generate product images suitable for different regional versions. Alternatively, based on the technical solution provided by this application, an interface for uploading product images of multiple regional versions is provided to merchants, and merchants can complete the upload operation of multiple regional versions through this one interface. Specifically, this application also provides an embodiment of a picture display method, comprising the following steps:

[0288] 701. Determine the regional version of the target application;

[0289] 702. Determine, based on the region version coverage area, at least one decoration material suitable for the target object and having characteristics of the covered region;

[0290] 703. Generate a second picture of the target object based on the first picture of the target object and at least one decoration material;

[0291] The second image is used to be displayed when a user using the regional version application accesses the target object.

[0292] For example, the regional version mentioned above can be a domestic version or an overseas version, etc. Overseas versions can also be divided into: European and American versions, East Asian versions, etc.

[0293] The characteristics of the coverage area are related to the preferences, customs, and regional characteristics of consumers in the area.

[0294] Several embodiments of the present application provide apparatuses corresponding to the above method embodiments provided from the perspective of the target object being a commodity. Specifically,

[0295] Figure 11 shows a block diagram of the image display device provided in one embodiment of the present application. As shown in Figure 11, the image display device includes an acquisition module 21 and a display module 22. Acquisition module 21 is configured to, in response to a user's operation, acquire a product image of a product that is relevant to the user. The product image is generated based on at least one decorative material and an original image of the product, the at least one decorative material being relevant to the user. Display module 22 is configured to display the product image on a client interface.

[0296] Furthermore, a product is associated with multiple product images. Each product image has an image tag. Accordingly, the acquisition module 21 is specifically configured to: determine a keyword based on the user's relevant information; and search for a product image with an image tag that matches the keyword among the multiple product images; wherein the image tag of the product image is determined by at least one decorative material on which it is based.

[0297] Alternatively, the acquisition module 21 is specifically configured to: determine the at least one decoration material according to the relevant information of the user; and generate the product image based on the at least one decoration material and the original image of the product.

[0298] It should be noted that the product image display device provided in the above embodiment can implement the technical solutions described in the above corresponding method embodiments, and the corresponding contents in the principle method embodiments for the specific implementation of each module or unit will not be repeated here.

[0299] FIG12 shows a block diagram of the structure of an image processing device provided by another embodiment of the present application. As shown in FIG12 , the image processing device includes: an acquisition module 31, a determination module 32, a generation module 33, and an association module 34. The acquisition module 31 is used to acquire the original image of a product. The determination module 32 is used to determine at least one decorative material suitable for the product. The generation module 33 is used to generate a product image based on the at least one decorative material and the original image. The association module 34 is used to associate the product image with the product so that it is displayed when a user who has a correlation with the at least one decorative material visits the product.

[0300] Furthermore, when determining at least one decorative material suitable for the product, the determining module 32 is specifically configured to:

[0301] Determine the at least one decorative material based on the product information and the target market information of the product; wherein the target market information includes at least one of: a sales area and a target population; and / or

[0302] The at least one decoration material is determined according to the material configuration information set by the original image provider.

[0303] Furthermore, when determining the at least one decorative material based on the product information and the target market information of the product, the determination module 32 is specifically configured to:

[0304] A preset analysis model is triggered so that the preset analysis model feeds back the at least one decoration material based on the commodity information and the target market information.

[0305] Furthermore, the generating module 33 is specifically configured to:

[0306] Separating the product body from the original image; splicing the at least one decorative material as a background of the product body with the separated product body to obtain the product image; or

[0307] The product image is generated by using the original image, the area information of the product main area in the original image, and the at least one decorative material as drawing materials of a preset drawing model.

[0308] It should be noted here that the product image processing device provided in the above embodiment can implement the technical solution described in the above corresponding method embodiment. The specific implementation principles of the above modules or units can be found in the contents of the above corresponding method embodiment, which will not be repeated here.

[0309] Another embodiment of the present application provides a product image processing device comprising: an acquisition module, a determination module, and a generation module. The acquisition module is configured to acquire the sales region of a product. The determination module is configured to determine, based on the sales region, background material suitable for the product and reflecting the characteristics of the sales region. The generation module is configured to generate, based on the original product image and the background material, a product image displaying the product in a scene corresponding to the background material. The product image is displayed on a webpage or application page corresponding to the sales region.

[0310] It should be noted here that the product image processing device provided in the above embodiment can implement the technical solutions described in the above corresponding method embodiments. The specific implementation principles of the above modules or units can be found in the contents of the above corresponding method embodiments and will not be repeated here.

[0311] Another embodiment of the present application provides an image upload device comprising: an acquisition module, a determination module, a generation module, and a display module. The acquisition module is configured to acquire the original image of a product in response to a product image upload request. The determination module is configured to determine at least one decorative material suitable for the product. The generation module is configured to generate a product image based on the at least one decorative material and the original image. The display module is configured to display the product image so that the uploader can review and confirm whether to upload it. The product image is configured to be displayed when a user associated with the at least one decorative material visits the product.

[0312] It should be noted here that the product image uploading device provided in the above embodiment can implement the technical solution described in the above corresponding method embodiment. The specific implementation principles of the above modules or units can be found in the contents of the above corresponding method embodiment, which will not be repeated here.

[0313] Figure 13 shows a block diagram of the image generation device provided in one embodiment of the present application. As shown in Figure 13, the product image generation device includes a trigger module 41 and a generation module 42. The trigger module 41 is configured to utilize product information of a product to trigger a preset analysis model to determine at least one decorative material suitable for the product. The generation module 42 is configured to use the product's original image and the at least one decorative material as drawing materials for a preset drawing model to generate a product image of the product. The product image is displayed when a user associated with the at least one decorative material visits the product.

[0314] Furthermore, the preset analysis model is a natural language processing model. Accordingly, the trigger module 41 is specifically configured to: generate a consultation question based on the product information; and use the consultation question to trigger the natural language processing model to feedback at least one decorative material suitable for the product.

[0315] Furthermore, the device provided in this embodiment further includes an acquisition module. The acquisition module is used to:

[0316] Obtaining target market information of the product, so as to utilize the product information and the target market information when the trigger module 41 triggers the preset analysis model; wherein the target market information includes at least one of: sales area and target population; and / or

[0317] Acquire area information of a commodity main area in the original image, and use the area information, the original image, and the at least one decorative material as drawing materials of the preset drawing model.

[0318] It should be noted here that the product image generation device provided in the above embodiment can implement the technical solution described in the above corresponding method embodiment. The specific implementation principles of the above modules or units can be found in the contents of the above corresponding method embodiment, which will not be repeated here.

[0319] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0320] Figure 14 shows a schematic diagram of the principle structure of an electronic device provided in one embodiment of the present application. The electronic device includes a processor 62 and a memory 61. The memory 61 is used to store one or more computer programs; the processor 62 is coupled to the memory 61 and is used to execute the at least one or more computer programs to implement the steps of the methods provided in various embodiments of the present application.

[0321] The above-mentioned memory 61 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0322] Furthermore, as shown in Figure 14, the electronic device further includes other components such as a communication component 63, a power component 64, and an audio component 65. Figure 14 only schematically illustrates some components, which does not mean that the electronic device only includes the components shown in Figure 14.

[0323] Accordingly, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a computer, it can implement the method steps or functions provided in the above-mentioned embodiments of the present application.

[0324] The method in the present application can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. Therefore, the present application also provides a computer program product. The computer program product includes a computer program / instructions, and when the computer program / instructions are executed by a processor such as the processor 62 shown in Figure 14, the steps or functions of the methods provided in the various embodiments of the present application can be performed in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, a core network device, an OAM or other programmable device.

[0325] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, or of course, by means of hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or certain parts of the embodiments.

[0326] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for displaying an image, characterized in that: include: In response to the user's operation, a second picture related to the user is acquired; wherein the second picture is generated based on at least one decorative material and the first picture of the target object, and the at least one decorative material is related to the user; The second picture is displayed on the client interface.

2. The method according to claim 1, characterized in that The target object is associated with multiple pictures, and the pictures have corresponding picture labels; Acquiring a second picture that is relevant to the user, including: Determining keywords based on the relevant information of the user; Among the plurality of pictures, query at least one second picture whose picture label is adapted to the keyword; The image label of the second image is determined by the at least one decorative material on which it is based.

3. The method according to claim 1, characterized in that Acquiring a second picture that is relevant to the user, including: Determining the at least one decoration material according to the relevant information of the user; The second picture is generated based on the at least one decoration material and the first picture of the target object.

4. The method according to any one of claims 1 to 3, characterized in that The decorative material includes at least one of the following: a picture background material, a material displayed in combination with the target object, and a model type displaying the target object.

5. The method according to any one of claims 1 to 3, characterized in that The target object is a product on an e-commerce platform; the first picture is a picture uploaded by a merchant.

6. A method for processing an image, characterized in that: include: Get a first picture of the target object; determining at least one decoration material suitable for the target object; generating a second picture based on the at least one decorative material and the first picture; The second picture is associated with the target object so as to be displayed when a user who is related to the at least one decorative material visits the target object.

7. The method according to claim 6, characterized in that Determining at least one decoration material suitable for the target object includes: Determine the at least one device according to the target object information and the target market information of the target object. Decoration material; wherein the target market information includes: at least one of the sales area and the target population; and / or The at least one decoration material is determined according to the material configuration information set by the first picture provider.

8. The method according to claim 7, characterized in that Determining the at least one decoration material according to the object information of the target object and the target market information of the target object includes: The preset analysis model is triggered so that the preset analysis model feeds back the at least one decoration material based on the object information and the target market information.

9. The method according to any one of claims 6 to 8, characterized in that Generating a second picture based on the at least one decoration material and the first picture includes: Separate the main body of the target object from the first picture; use the at least one decorative material as the background of the main body of the target object and splice it with the separated main body of the target object to obtain the second picture; or The first picture, the area information of the main area of ​​the target object in the first picture, and the at least one decorative material are used as drawing materials of a preset drawing model to generate the second picture.

10. A method for uploading a picture, characterized in that: include: In response to the image upload request, obtaining a first image of the target object; determining at least one decoration material suitable for the target object; generating a second picture based on the at least one decorative material and the first picture; Displaying the second picture so that the uploader can review and confirm whether to upload it; The second picture is used for display when a user who is related to the at least one decorative material visits the target object.

11. A method for generating an image, characterized in that: include: Using the object information of the target object, triggering a preset analysis model to determine at least one decoration material suitable for the target object; Using the first picture of the target object and the at least one decorative material as drawing materials of a preset drawing model to generate a second picture of the target object; The second picture is used for display when a user who is related to the at least one decorative material visits the target object.

12. The method according to claim 11, characterized in that The preset analysis model is a natural language processing model, and Using the object information of the target object, triggering a preset analysis model to determine the at least one decoration material includes: Generate consulting questions based on the object information; The consultation question is used to trigger the natural language processing model to feedback at least one decoration material suitable for the target object.

13. The method according to claim 11 or 12, characterized in that: Also includes: Acquire target market information of the target object, so as to utilize the object information and the target market information when triggering the preset analysis model; wherein the target market information includes: at least one of the sales area and the target population; and / or The region information of the main region of the target object in the first picture is obtained, so as to use the region information, the first picture and the at least one decoration material as drawing materials of the preset drawing model.

14. A method for displaying a product image, characterized in that: include: In response to the user's operation, determining a target address; Based on the target address, a product image of the product is obtained; wherein the product image is generated based on the original image of the product and background material, and the background material is related to the characteristics of the region to which the target address belongs and the characteristics of the product itself; Displaying a product image of the product on a web page or application page corresponding to the region to which the target address belongs; The target address is selected by the user or located by the user client.

15. A method for processing a product image, characterized in that: include: Get the sales area of ​​the product; According to the sales region, determining background material suitable for the product and having characteristics of the sales region; Based on the original image of the product and the background material, generating a product image in which the product is displayed in a scene corresponding to the background material; The product image is used to be displayed on a web page or application page corresponding to the sales area.

16. A method for displaying a picture, characterized in that: include: Determine the regional version of the target application; Based on the area covered by the regional version, determining at least one decoration material suitable for the target object and having characteristics of the covered area; generating a second picture of the target object according to the first picture of the target object and the at least one decoration material; The second picture is used for display when a user using the regional version application accesses the target object.

17. A picture display system, characterized in that: include: The first client is used to respond to the user's operation and request the server to obtain the second image of the target object; The server is used to obtain a second picture related to the user according to the relevant information of the user, and send the second picture to the first client; wherein the second picture is based on at least one decorative material and the The at least one decoration material is generated by the first picture of the target object, and there is a correlation between the at least one decoration material and the user; The first client is further used to display the second image on the client interface.

18. A picture processing system, characterized in that: include: The second client is used to respond to the image upload request and send a first image of the target object to the server; The server is configured to determine at least one decorative material suitable for the target object, and generate a second image based on the at least one decorative material and the first image; The second client is used to display the second image so that the uploader can review and confirm whether to upload it; The second picture is used for display when a user who is related to the at least one decorative material visits the target object.

19. An electronic device, characterized in that: include: A memory and a processor, wherein The memory is used to store computer programs; The processor is coupled to the memory, and is used to execute the computer program stored in the memory, so as to implement the steps in the image display method described in any one of claims 1 to 5, or to implement the steps in the image processing method described in any one of claims 6 to 9, or to implement the steps in the image uploading method described in claim 10, or to implement the steps in the image generating method described in any one of claims 11 to 13, or to implement the steps in the product image display method described in claim 14, or to implement the steps in the product image processing method described in claim 15, or to implement the steps in the image display method described in claim 16.

Images