Content filling interaction method, commodity information publishing method and electronic equipment

By generating follow-up content following the mouse pointer in the content filling interface, users can efficiently fill AI-generated content into multiple form projects, solving the problem of AI-generated content not matching the project, improving operational efficiency and personalized sorting convenience.

CN118981268APending Publication Date: 2024-11-19HANGZHOU ALIBABA INT INTERNET IND CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410842345.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-06-26
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

During the product release process, there are difficulties in how to efficiently fill multiple form items after AI generates content, especially when the number of content generated by AI does not match the number of items that need to be filled, users need to manually select and sort, resulting in operation Inefficient.

Method used

Provides a content filling interface. After the user clicks the "Apply" option, he generates follow-up content following the mouse pointer. The user moves the mouse pointer to the target item and clicks to automatically fill it. After filling, it automatically switches to the next content, providing shortcut key switching Functions to facilitate content selection.

Benefits of technology

Improves the efficiency and flexibility of filling content generated by AI. Users can automatically determine the arrangement and ranking of contents without repeated dragging operations to meet the needs of personalized sorting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118981268A_ABST
    Figure CN118981268A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a content filling interaction method, a commodity information publishing method and electronic equipment, and the method comprises the steps: displaying a content filling interface, and after AI generation content is generated according to an artificial intelligence AI generation request initiated by a user, providing an AI generation content preview area in the content filling interface, the content filling interface comprises a plurality of items to be filled, and an operation option used for applying the AI generation content is provided in the preview area, and the content filling interface comprises a plurality of items to be filled; in response to a click operation on the operation option, generating following content moving along with a mouse pointer according to the AI generation content; and after detecting that the mouse pointer is moved to a target item and a click operation is executed, filling the target item with the following content of the following mouse pointer. According to the embodiment of the invention, content filling can be completed more efficiently and flexibly.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of information processing technology, and in particular to a method and electronic device for content filling interaction and publishing product information. Background Art

[0002] With the continuous development of AI (artificial intelligence) technology, AI technology is being used in more and more scenarios for content generation. Among them, in scenarios where content needs to be filled into some forms, the required content can also be generated by AI generation, and then filled into the form. For example, in the commodity information service system, when a merchant publishes a commodity, he needs to fill in the commodity main picture, title text, attributes and other contents in the form provided by the commodity publishing interface. In the traditional way, merchants are usually required to prepare pictures or videos that can be used as the main picture of the commodity in advance, save them locally on the terminal device, and then upload pictures, videos, etc. through the main picture upload option in the commodity publishing interface; in addition, the text content that can be used as the title can be edited in advance and entered into the title input box corresponding to the commodity publishing interface, etc. Among them, the production of related materials such as the main picture of the commodity may be difficult for some merchants, especially when some scene pictures need to be provided, which requires merchants to spend a lot of time, manpower, material resources and other costs to complete the production of high-quality scene pictures. However, after the emergence of AI generation technology, AI generation technology can be used to help users generate content. For example, in the above-mentioned product release interface, an operation option for initiating AI generation can be provided. When users fill out the form through the above-mentioned product release interface, they can use the above-mentioned operation option to call up the "AI assistant" and enter their own content generation needs. For example, after entering two basic white background pictures of the product, let AI help generate multiple scene pictures, etc., thereby reducing the production cost of the main picture of the product.

[0003] However, after AI completes content generation, how to fill it into a specific form is also a problem that needs to be considered. The reason for this problem is that, similar to the forms in scenarios such as product release, there may usually be multiple items that need to be filled in, for example, including the main picture of the product, the title of the product, etc. After AI generates a certain content, if it is automatically filled through the "Apply" button, there may be a problem of not being able to determine which form item the generated content needs to be filled into. In addition, there may be multiple form items of the same type. For example, there may be multiple main pictures of the product, and the number of pictures generated by AI may not completely correspond to the number required to be filled in the form. If the number generated is more than the number required to be filled, the user may also need to choose from them; furthermore, for the above-mentioned situation where there are multiple form items of the same type, the user not only needs to determine which content to use, but also needs to customize the order between each content. For example, if 5 main pictures of the product need to be filled, the user may need to customize the order of each main picture of the product so that it can be displayed to the consumer user in that order, etc.

[0004] In view of the above situation, if the implementation method in the prior art is used, the user may need to select and fill in the corresponding items in the form in turn for each content. For example, select a picture from the preview area of ​​the AI-generated content, drag it into a table item in the form, then select another picture from the preview area, drag it into another option in the form, and so on. This requires the user to repeatedly perform operations such as dragging pictures, which is relatively inefficient. Summary of the invention

[0005] The present application provides a method and electronic device for content filling interaction and publishing product information, which can complete content filling more efficiently and flexibly.

[0006] This application provides the following solutions:

[0007] A content filling interaction method, comprising:

[0008] Displaying a content filling interface, after generating AI-generated content according to an artificial intelligence AI generation request initiated by a user, providing an AI-generated content preview area in the content filling interface, and providing operation options for applying the AI-generated content in the preview area, wherein the content filling interface includes a plurality of items to be filled;

[0009] In response to a click operation on the operation option, generating following content that follows the movement of the mouse pointer according to the AI ​​generated content;

[0010] After detecting that the mouse pointer is moved to the target item and a click operation is performed, the target item is filled with the following content that follows the mouse pointer.

[0011] Wherein, the AI-generated content is in multiple copies;

[0012] The generating of following content that follows the movement of the mouse pointer according to the AI ​​generated content includes:

[0013] In an initial state, generating the following content that follows the movement of the mouse pointer according to one of the multiple AI-generated contents;

[0014] The method further comprises:

[0015] After the current following content is filled into the target item, the following content that follows the movement of the mouse pointer is automatically switched to another AI generated content.

[0016] Wherein, the AI-generated content is in multiple copies;

[0017] The method further comprises:

[0018] After the following content is generated, if an operation of switching the following content is received from the user through a shortcut key, the following content that follows the movement of the mouse pointer is switched to another AI generated content.

[0019] Among them, the following content that follows the movement of the mouse pointer is switched according to the display order of the multiple AI-generated content in the preview area.

[0020] Among them, it also includes:

[0021] Corner mark information is provided in the following content, and the corner mark information is used to express the number of multiple AI-generated contents and the display position of the AI-generated content corresponding to the current following content in the preview area.

[0022] A method for publishing product information, comprising:

[0023] After receiving a product release request initiated by a user, a product information release interface is provided, wherein the interface includes a project display area and a first operation option for initiating an AI generation request, wherein the project display area is used to display a plurality of items to be filled;

[0024] After receiving a request and generating AI-generated content through the first operation option, providing an AI-generated content preview area in the interface, and providing a second operation option for applying the AI-generated content in the preview area; wherein the AI-generated content includes image or text content required in the product release process, and at least one AI-generated content of the same type is generated each time a request is made;

[0025] In response to a click operation on the second operation option, generating following content that follows the movement of the mouse pointer according to the AI ​​generated content;

[0026] After detecting that the mouse pointer is moved to the target item in the item display area and a click operation is performed, the following content following the mouse pointer is filled into the target item, so that the product is released after the content filling of multiple items is completed.

[0027] Wherein, the AI-generated content includes multiple AI-generated contents of the same type;

[0028] The step of generating following content that follows the movement of the mouse pointer according to the AI ​​generated content includes:

[0029] In an initial state, generating the following content that follows the movement of the mouse pointer according to one of the multiple AI-generated contents;

[0030] The method further comprises:

[0031] After the current following content is filled into the target item, the following content that follows the movement of the mouse pointer is automatically switched to another AI generated content.

[0032] A content filling interaction method, comprising:

[0033] Displaying a content filling interface, wherein the content filling interface includes a plurality of items to be filled;

[0034] Identify at least one piece of targeted content;

[0035] generating following content that follows the movement of the mouse pointer according to the at least one target content;

[0036] After detecting that the mouse pointer is moved to the target item and a click operation is performed, the target item is filled with the following content that follows the mouse pointer.

[0037] Wherein, the at least one target content includes:

[0038] After a request is initiated through the operation option for initiating an AI generation request provided in the content filling interface, at least one AI generated content is generated.

[0039] Wherein, the at least one target content includes:

[0040] The content copied to the clipboard comes from a local file or document of the terminal device, or a page opened through a web browser.

[0041] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of any of the methods described above.

[0042] An electronic device, comprising:

[0043] one or more processors; and

[0044] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of any of the methods described above.

[0045] A computer program product comprises a computer program / computer executable instructions, wherein the computer program / computer executable instructions implement the steps of any of the aforementioned methods when executed by a processor in an electronic device.

[0046] According to the specific embodiments provided in this application, this application discloses the following technical effects:

[0047] Through the embodiments of the present application, when it is necessary to apply AI-generated content to a content filling interface, if there are multiple different items to be filled in the interface, an operation option for applying the AI-generated content can be provided in the preview area. After receiving an application request through the operation option, a follow-up content that follows the movement of the mouse pointer can be generated according to the AI-generated content. After detecting that the mouse pointer is moved to a target item in the interface and a click operation is performed, the follow-up content that follows the mouse pointer is filled into the target item. In this way, the application of AI-generated content to a specific content filling interface can be achieved more efficiently and flexibly.

[0048] Among them, in the case of multiple copies of AI-generated content, in the initial state after the user clicks the "Apply" option with the mouse, the following content that follows the movement of the mouse pointer can be generated according to one of the multiple copies of AI-generated content. Afterwards, after the user fills the following content into a certain project, the following content of the mouse pointer will automatically switch to another copy of AI-generated content (without the need for the user to re-click or select in the preview area), and the user directly moves the mouse pointer to other projects and re-clicks to fill the new following content into the other projects. Compared with traditional methods such as mouse dragging, this method can more efficiently complete the filling of multiple copies of AI-generated content into multiple different projects, and since which content is filled into which project is determined by the user, and there are ranking attributes between different projects, after a specific content is filled into a certain project, the ranking attribute of the project can be directly assigned to this content, so the ranking of the specific content can be automatically determined during the filling process, thereby meeting the user's needs for personalized selection or sorting during the filling process.

[0049] Of course, any product implementing the present application does not necessarily need to achieve all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0051] Figure 1 It is a schematic diagram of the system architecture provided by the embodiment of the present application;

[0052] Figure 2 is a flow chart of the first method provided in an embodiment of the present application;

[0053] Figure 3 is a schematic diagram of an interface provided by an embodiment of the present application;

[0054] Figure 4 is a flow chart of the second method provided in an embodiment of the present application;

[0055] Figure 5 is a flowchart of the third method provided in an embodiment of the present application;

[0056] Figure 6 It is a schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0058] In order to facilitate the understanding of the solution provided by the embodiment of the present application, it is first necessary to explain that in many applications, the filling of forms is involved, wherein the forms described in the embodiment of the present application include explicit forms, that is, the interface can draw table lines arranged in a regular manner in multiple rows and columns, such as the interface provided by some electronic spreadsheet tools, etc.; or, it can also include non-explicit forms, that is, there is at least one item in the application interface that needs to be filled with information, but there may not be regularly arranged table lines. For the latter, it can generally refer to a scenario where a certain function needs to be completed on a web page. For example, in a commodity information service system, when a merchant is publishing a commodity, it is necessary to provide a commodity publishing interface to the merchant. The commodity publishing interface may include multiple items to be filled, including the main picture of the commodity, title text, attributes, etc. These items may be scattered in multiple locations in the interface, and each item may correspond to controls such as input boxes, and these items and the corresponding input boxes may constitute a non-explicit form. In short, whether it is an explicit form or a non-explicit form, it involves content filling, so the corresponding interface can be collectively referred to as a content filling interface.

[0059] Among them, for the scenarios where content filling is combined with AI-generated content, in some cases, there is only one item to be filled in the interface. At this time, the AI-generated content can be automatically filled, or the user only needs to perform simple operations to apply the AI-generated content to the project in the specific interface. For example, assuming that there is only one copy of the generated AI-generated content, at this time, the user can directly click the "Apply" option in the preview area to fill the AI-generated content into the project in the interface. Alternatively, if there are multiple copies of the AI-generated content, you can also select one of them in the preview area, and then click the "Apply" option to fill it into the project.

[0060] However, the embodiments of the present application are directed to scenarios where a specific content filling interface includes multiple different items to be filled in, and some interfaces even include multiple items to be filled in for filling different content types. For example, as described in the background technology section, in a product information service system, a merchant user needs to fill in a form in a product release interface during the product release process, which includes items for entering content such as a product main image and a product title. There can be multiple product main images, so there will also be multiple image-type items to be filled in; a product title may also be divided into a main title and a subtitle, so there may also be multiple text-type items to be filled in, and so on.

[0061] For this kind of content filling interface, even if the AI ​​assistant can help users generate AI-generated content, in the process of applying this AI-generated content to the above-mentioned content filling interface, automatic filling cannot be achieved, but the user may be required to perform multiple steps. For example, taking the form in the above-mentioned product publishing interface as an example, assuming that the form includes 6 items to be filled in the main picture category of the product, after the user uploads two white-bottom pictures of specific products, the AI ​​assistant generates multiple related scene pictures for filling in the remaining 4 items of the main picture category of the product. Among them, if the user does not specify a specific number of generation, the AI-generated scene pictures may be more than 4, and the user needs to select 4 from them and fill them into the corresponding items. Even if the user specifies the number of generation, for example, the number of AI-generated scene pictures is also 4, but there is still a problem that the AI-generated content cannot be applied to the form with "one click".

[0062] This is because, first of all, when users fill multiple AI-generated content into specific projects, they may also need to customize the order of each content. For example, for the main picture of a product, since multiple different main pictures of a product may usually share the same main picture resource position in the product details page, they will be displayed in sequence in a carousel. Usually, merchants may want to give priority to showing the main picture that can better express the characteristics of the product to consumers. For example, for clothing products, it may be necessary to give priority to showing the model's upper body picture, and then show detailed pictures from various different perspectives, and so on. Obviously, it is difficult to predict the order in which the merchant wants to sort the various AI-generated content. Even if the various AI-generated content is determined according to a certain rule, there is a high probability that it will not meet the needs of the merchant's users. At this time, the merchant's users still need to manually re-sort them.

[0063] Another problem is that there may be many different types of items in the content filling interface. For example, in the above example, the form in the product release interface may have an item for uploading the main picture of the product, an item for entering the product title, and so on. After AI generates specific content, it is difficult to automatically identify which item the generated content needs to be filled into. In other words, it is difficult to achieve the correspondence between content and items.

[0064] Due to the above problems, after AI generates specific content, the process of applying the AI-generated content to the items in the content filling interface usually still requires manual operation by the user. In the prior art, the user may need to perform multiple manual operations. For example, in the above example, assuming that AI has 6 pictures, which need to be filled into the items related to the main picture of the product in the form, since it is necessary to select pictures and determine the order of each picture, the "mouse drag" method in the traditional technology is a more suitable method. In this way, the user may need to select four from the 6 pictures and drag them from the preview area to the corresponding items in the form in turn. Each time you drag, you need to move the mouse pointer to a certain AI-generated content in the preview area, hold down the left mouse button, move the mouse pointer to a target item in the form, and release the left mouse button. After that, move the mouse pointer to another AI-generated content in the preview area and repeat the above process. In this process, it is possible to select AI-generated content while determining the order of each AI-generated content. For example, drag the first AI-generated image to the item of the third product main image category, drag the third AI-generated image to the item of the fourth product main image category, and so on. The user needs to perform at least four drag operations to apply the AI-generated content to the specific content filling interface.

[0065] Although the above method can realize the application of AI-generated content and support the personalized selection or sorting needs of merchants and other users, the implementation efficiency is relatively low, and the user needs to perform multiple steps of mouse dragging operations to complete the filling of each item.

[0066] In order to improve the user's operating efficiency, the embodiment of the present application provides a corresponding solution. In this solution, for the case where there are multiple items in the content filling interface, after obtaining the AI-generated content, a preview area can be provided, and the AI-generated content can be displayed in the preview area, and an "apply" operation option can be provided. The user only needs to click the operation option to generate the follow-up content that follows the movement of the mouse pointer according to the AI-generated content. That is, after the user clicks "Apply" with the mouse, the specific AI-generated content (specifically, it can exist in the form of a thumbnail with a relatively small area) will be displayed at the lower right side of the mouse pointer, etc. The content will move with the movement of the mouse pointer, and therefore, it is called the follow-up content of the mouse pointer. Afterwards, when the user moves the mouse pointer to the position of an item in the interface, if the mouse click operation is performed again, the current follow-up content can be filled into the item.

[0067] Among them, in the case where there are multiple copies of specific AI-generated content, in the initial state after the user clicks the "Apply" option with the mouse, the following content that follows the movement of the mouse pointer can be generated according to one of the multiple copies of AI-generated content. For example, the AI-generated content that is ranked first in the preview area can be used as the following content of the mouse pointer by default. Afterwards, after the user fills the following content into a certain project, the following content of the mouse pointer will automatically switch to another copy of the AI-generated content (without the need for the user to re-go to the preview area to perform clicks or selections, etc.), and the user can directly move the mouse pointer to other projects and re-perform the click operation to fill the new following content into the other projects, and so on.

[0068] For example, in the initial state, the first AI-generated content becomes the following content of the mouse pointer, and the user can determine which project it is suitable to fill it into through the following content. For example, if the first AI-generated content is suitable for the fourth project, the mouse pointer can be moved to the fourth project, and then the click operation is performed again to fill the first AI-generated content into the fourth project. After that, the second AI-generated content will automatically become the new following content, and the mouse pointer can be moved directly to other projects to complete the filling. In addition, since the user selects the project during the filling process, and the project has the ranking information in the display interface, therefore, when the following content is filled into a certain project, the ranking of the project can be determined as the ranking of the following content, that is, the custom sorting of each content can be completed at the same time during the filling process. It can be seen that in the case of multiple AI-generated content, the advantages of the solution of content following the mouse pointer provided in the embodiment of the present application will be more prominent.

[0069] Of course, in the case of a copy of AI-generated content, this mouse pointer following method also has advantages over the mouse dragging method, mainly manifested in: after generating the mouse pointer following content, the mouse pointer can be moved freely, and during this period, the mouse wheel can be scrolled up and down in the item filling area to scroll the interface within the window, which is more flexible. In the case of mouse dragging, after the user clicks on a certain AI-generated content from the preview area, the left mouse button cannot be released until it is dragged to a certain item. During this period, if the required item is not in the visible area of ​​the window, it is difficult to scroll the interface while the left mouse button is pressed. Therefore, the operation is not flexible enough.

[0070] In addition, in the case where there are multiple copies of the above-mentioned AI-generated content, there may be a situation where the number of AI-generated content is greater than the number of projects. At this time, since the user only needs to click the "Apply" option in the preview area, and it does not involve the selection of AI-generated content in the preview area, it may be the case that the current follow-up content may not be the content that the user wants. In response to the above situation, a function of switching follow-up content through shortcut keys can also be provided. For example, in the initial state, the first AI-generated content becomes the follow-up content, but the user believes that this content does not meet his needs, then the follow-up content can be manually switched by pressing the shortcut key. Of course, during the manual switching process, the next follow-up content can also be determined according to the display order of each AI-generated content in the preview area, and so on.

[0071] Of course, since the follow-up content usually exists in the form of thumbnails, the display area is usually relatively small, and there may be situations where it is impossible to accurately judge the content based on such thumbnails. In view of this situation, in a preferred embodiment, superscript information can also be provided in the follow-up content. This superscript information can be used to express the number of multiple AI-generated content and the display position of the AI-generated content corresponding to the current follow-up content in the preview area. For example, assuming that there are 6 copies of AI-generated content and the current follow-up content is the first one, "1 / 6" can be displayed in the upper right corner of the follow-up content, so that the user can know that the current follow-up content is the first AI-generated content in the preview area. If the specific image details cannot be seen clearly from the follow-up content, the corresponding AI-generated content can be found in the preview area for viewing based on the specific superscript information.

[0072] The main scheme provided by the embodiment of the present application is introduced above. It should be noted that, in actual application, the above-mentioned implementation scheme of completing form filling by generating the following content of the mouse pointer may not only be limited to the content generated by AI, but also other content. For example, it may be the content copied from the file or document locally saved by the terminal device, or the content copied from the web page opened by the browser, and so on. For example, if the user needs to upload several pictures locally saved by the terminal device as the main picture of the product, these pictures can be selected and copied first; or, if the user needs to publish the content in a web page as the main picture of the product, the content in the web page can also be selected and copied; after that, after opening the content filling interface, the interface code can detect that there is the most recently copied content in the clipboard of the terminal device. At this time, the user can also be asked whether to fill the currently copied content into the current content filling interface through a pop-up window or the like. If so, the following content of the mouse pointer can be generated according to the copied content, and the user can fill the following content into the item by moving the mouse pointer to a certain item to be filled and performing a click operation. After that, the content followed by the mouse pointer will automatically switch to the next content in the clipboard. The user can continue to move the mouse pointer to the location of other items and click to complete the filling of the next item without repeatedly switching between different windows (between the window where the local folder is located and the window where the content filling interface is located) or dragging the mouse.

[0073] From the perspective of system architecture, see Figure 1 , the embodiment of the present application can provide a corresponding solution in content filling related applications or web pages (for example, product release pages), in which the specific content (including content generated by AI after initiating a request in the current content filling interface, or content temporarily stored in the clipboard after copying through an online browser, copying a local folder or document, etc.) can be filled into the form more quickly and efficiently by generating the content that follows the mouse pointer, and the user can select the content and sort it in a personalized way during the filling process. In specific implementation, if there are multiple copies of the content, the content can be grouped into objects, and then the content that follows the mouse pointer can be generated in units of objects, and the objects can be filled into the corresponding items in a queue.

[0074] The specific implementation methods of the embodiments of the present application are introduced below.

[0075] Embodiment 1

[0076] First, this embodiment provides a content filling interaction method for a scenario in which a request is initiated in a content filling interface and AI generated content is generated and then applied to a form. Figure 2 , the method may include:

[0077] S201: Displaying a content filling interface. After generating AI generated content according to an artificial intelligence (AI) generation request initiated by a user, providing an AI generated content preview area in the content filling interface, and providing operation options for applying the AI ​​generated content in the preview area, wherein the content filling interface includes a plurality of items to be filled.

[0078] Among them, there can be multiple content filling interfaces, and different forms can be displayed according to the needs of different application scenarios, for example, the form used to fill in the main picture of the product, the product title and other contents in the product release scenario in the aforementioned example, and so on. Among them, a specific content filling interface may include multiple items to be filled. In an embodiment of the present application, an operation option for initiating an AI generation request can also be provided in the content filling interface. The user can use this option to call up functions such as an AI assistant and enter his own generation requirements. After that, the AI ​​assistant can generate AI-generated content that meets the user's needs through the AI ​​model.

[0079] For example, Figure 3 As shown in the figure, it shows a product release interface in an example, where the left side is the project filling area. After the user calls up the AI ​​assistant, the area for interacting with the AI ​​can be displayed through the sidebar on the right, etc. In this area, the user can enter specific generation requirements. Figure 3 In the example shown in FIG. 31 , the user has uploaded two white-background images and needs AI to generate two scene images. The user can call up the AI ​​assistant through the corresponding operation options (not shown in the figure) and Figure 3 As shown in 32 of , enter "Help me generate two scene graphs". After that, the AI-generated content can be displayed as follows Figure 3 In addition, the preview area shown in 33 of FIG. Figure 3 The "Apply" operation option shown at 34 in FIG. If the user believes that the currently generated scene graph meets his needs, the user can click the "Apply" option.

[0080] It should be noted here that the specific method of generating AI-generated content is not the focus of the embodiments of this application, so it will not be described in detail here.

[0081] S202: In response to a click operation on the operation option, generating following content that follows the movement of the mouse pointer according to the AI ​​generated content.

[0082] After obtaining the AI-generated content, although there may be a many-to-many relationship between the AI-generated content and the items to be filled in the interface, and in the process of applying such AI-generated content, the user also needs to make personalized selections and sorting, etc., but in the embodiment of the present application, the user is not required to perform single-selection or multiple-selection selection operations on the AI-generated content, and it does not involve setting the order in the process of selecting AI-generated content (when publishing content in scenarios such as social networking systems, users may need to select some pictures from the local album for publishing. In the selection process, multiple selections can be made, and the sequence numbers of each picture can be automatically generated and filled into a specific form, but the embodiment of the present application does not adopt this method). Instead, after the user clicks the "Apply" option, the follow-up content that follows the movement of the mouse pointer can be generated according to the AI-generated content. Among them, if there is only one copy of the AI-generated content, the content can be directly used as the follow-up content. If there are multiple copies of the AI-generated content, one of them can be used as the follow-up content. For example, the AI-generated content ranked first can be used as the initial follow-up content according to the display order in the preview area, and so on.

[0083] The specific follow-up content may be a thumbnail of AI-generated content, and its area may be smaller than the thumbnail displayed in the preview area. From a visual perspective, after the user clicks the "Apply" option, a small thumbnail will be displayed at the lower right corner of the mouse pointer, etc. The thumbnail corresponds to a certain AI-generated content, and the small thumbnail will move with the movement of the mouse pointer. For example, Figure 3 In the figure, 35 is a mouse pointer, and 36 is a following content.

[0084] It should be noted here that since only one copy of the follow-up content is generated each time, if there are multiple copies of AI-generated content, a corner mark can be added in the upper right corner of the follow-up content, etc. This corner mark can show the total number of copies of AI-generated content and the display position of the current follow-up content in the preview area. For example, Figure 3 In the example shown, the current follow content is the first scene graph displayed in the preview area. Figure 3 As shown at 37 in the figure, the prompt information at the superscript of the following content may be "1 / 2", which is used to indicate that there are two copies of AI generated content, and the one currently following the movement of the mouse pointer is the first one.

[0085] S203: After detecting that the mouse pointer is moved to the target item and a click operation is performed, filling the target item with the following content that follows the mouse pointer.

[0086] After the following content of the mouse pointer is generated, the user can move the mouse pointer to a certain item to be filled in the item filling area and click it. At this time, the following content will be filled into the item. Figure 3 As shown in the example, assuming that the mouse pointer is moved to the item shown in 38 and a click operation is performed, the current follow-up content can be filled into the item.

[0087] Among them, if there are multiple copies of AI generated content, in the initial state, the following content that follows the movement of the mouse pointer can be generated according to one of the multiple copies of AI generated content. After the current following content is filled into the target item, the following content that follows the movement of the mouse pointer can be automatically switched to another copy of AI generated content.

[0088] For example, suppose in Figure 3 In the example shown, after the mouse pointer is moved to the item shown in 38, by clicking the mouse, the following content is filled into the item, and the following content of the mouse pointer can be automatically switched to the second scene graph, and the prompt information on the corner mark can be updated to "2 / 2". The user directly moves the mouse pointer to other items to be filled in the project display area, and clicks again to fill the second scene graph into the corresponding project. It can be seen that compared with the "mouse dragging" method, the solution provided by the embodiment of the present application has a higher implementation efficiency, does not need to move the mouse pointer back and forth between the project filling area and the preview area multiple times, and the implementation form is also more novel, which is conducive to improving the user experience.

[0089] In addition, when there are multiple copies of AI-generated content, especially when the number of AI-generated content may be greater than the number of items to be filled, the selection of AI-generated content may be involved. However, in the embodiment of the present application, the user is still not required to select the AI-generated content in the preview area, but the following method is adopted to achieve it: Even if it is necessary to make a choice of AI-generated content, you can also directly click the "Apply" option to directly generate the following content of the mouse pointer. However, after generating the following content, if the user does not want to use this content, you can switch it by means of shortcut keys. That is to say, after receiving the operation of switching the following content executed by the user through the shortcut key, the following content of the mouse pointer can be switched to another copy of AI-generated content. Among them, shortcut keys can be defined in a variety of ways, for example, the "→" key can be used as a shortcut key, or it can also be implemented by means of a combination of keys, and so on.

[0090] Among them, whether it is the switching of the following content triggered by the user completing the filling of an item, or the switching of the following content triggered by the shortcut key, in the specific implementation, the following content that follows the movement of the mouse pointer can be switched according to the display order of the multiple AI-generated contents in the preview area. For example, in the initial state, the AI-generated content ranked first can be used as the following content by default, and when switching, it switches to the second, then to the third, and so on. Of course, in the specific implementation, there can also be other implementation methods. For example, the matching degree between each AI-generated content of the user and the user's needs can be predicted, and then the following content of the mouse pointer can be generated in order of matching degree, and so on.

[0091] In summary, through the embodiments of the present application, when it is necessary to apply AI-generated content to a content filling interface, if there are multiple different items to be filled in the interface, an operation option for applying the AI-generated content can be provided in the preview area. After receiving an application request through the operation option, a follow-up content that follows the movement of the mouse pointer can be generated according to the AI-generated content. After detecting that the mouse pointer is moved to a target item in the interface and a click operation is performed, the follow-up content that follows the mouse pointer is filled into the target item. In this way, the application of AI-generated content to a specific content filling interface can be achieved more efficiently and flexibly.

[0092] Among them, in the case of multiple copies of AI-generated content, in the initial state after the user clicks the "Apply" option with the mouse, the following content that follows the movement of the mouse pointer can be generated according to one of the multiple copies of AI-generated content. Afterwards, after the user fills the following content into a certain project, the following content of the mouse pointer will automatically switch to another copy of AI-generated content (without the need for the user to re-click or select in the preview area), and the user directly moves the mouse pointer to other projects and re-clicks to fill the new following content into the other projects. Compared with traditional methods such as mouse dragging, this method can more efficiently complete the filling of multiple copies of AI-generated content into multiple different projects, and since which content is filled into which project is determined by the user, and there are ranking attributes between different projects, after a specific content is filled into a certain project, the ranking attribute of the project can be directly assigned to this content, so the ranking of the specific content can be automatically determined during the filling process, thereby meeting the user's needs for personalized selection or sorting during the filling process.

[0093] Embodiment 2

[0094] This second embodiment provides a method for publishing product information from the perspective of a specific product publishing application scenario. Figure 4 , the method may include:

[0095] S401: After receiving a product release request initiated by a user, providing a product information release interface, the interface including a project display area and a first operation option for initiating an AI generation request, the project display area being used to display a plurality of items to be filled;

[0096] S402: After receiving a request and generating AI-generated content through the first operation option, providing an AI-generated content preview area in the interface, and providing a second operation option for applying the AI-generated content in the preview area; wherein the AI-generated content includes image or text content required in the product release process, and at least one AI-generated content of the same type is generated each time a request is made;

[0097] S403: in response to a click operation on the second operation option, generating following content that follows the movement of the mouse pointer according to the AI ​​generated content;

[0098] S404: After detecting that the mouse pointer is moved to a target item in the item display area and a click operation is performed, the target item is filled with the following content of the mouse pointer, so that the product is released after the content filling of multiple items is completed.

[0099] Among them, the AI ​​generated content includes multiple AI generated content of the same type. At this time, in the initial state, the following content that follows the movement of the mouse pointer is generated according to one of the multiple AI generated content; thereafter, after the current following content is filled into the target item, the following content that follows the movement of the mouse pointer is automatically switched to another AI generated content.

[0100] Embodiment 3

[0101] As described above, in the embodiment of the present application, the content used to fill in the content filling interface can be not only the content generated by AI after initiating a request in the content filling interface, but also the content of the local file or document of the terminal device copied and temporarily stored in the system clipboard, or the content of the web page opened in the web browser copied and temporarily stored in the clipboard, etc. Therefore, in this embodiment three, another content filling interaction method is also provided, see Figure 5 , the method may include:

[0102] S501: displaying a content filling interface, wherein the content filling interface includes a plurality of items to be filled;

[0103] S502: Determine at least one target content;

[0104] S503: Generate following content that follows the movement of the mouse pointer according to the at least one target content;

[0105] S504: After detecting that the mouse pointer is moved to the target item and a click operation is performed, filling the target item with the following content that follows the mouse pointer.

[0106] The at least one target content includes: at least one AI generated content generated after initiating a request through the operation option for initiating an AI generation request provided in the content filling interface. Alternatively, the at least one target content includes: content copied to the clipboard, and the content copied to the clipboard comes from a local file or document of the terminal device, or a page opened through a web browser.

[0107] For the parts not described in detail in the above-mentioned embodiments 2 and 3, please refer to the records of the above-mentioned embodiment 1 and other parts of this specification, and will not be repeated here.

[0108] It should be noted that the embodiments of the present application may involve the use of user data. In actual applications, user-specific personal data can be used in the scheme described herein within the scope permitted by applicable laws and regulations, subject to the requirements of applicable laws and regulations of the country where the user is located (for example, with the user's explicit consent, effective notification to the user, etc.).

[0109] Corresponding to the first embodiment, the embodiment of the present application further provides a content filling interaction device, which may include:

[0110] An interface display unit, used to display a content filling interface, after generating AI generated content according to an artificial intelligence AI generation request initiated by a user, providing an AI generated content preview area in the content filling interface, and providing operation options for applying the AI ​​generated content in the preview area, wherein the content filling interface includes a plurality of items to be filled;

[0111] A mouse following content generating unit, configured to generate following content following the movement of a mouse pointer according to the AI ​​generated content in response to a click operation on the operation option;

[0112] The filling unit is used to fill the following content of the mouse pointer into the target item after detecting that the mouse pointer is moved to the target item and a click operation is performed.

[0113] Wherein, the AI-generated content is in multiple copies;

[0114] The mouse following content generating unit can be specifically used for:

[0115] In an initial state, generating the following content that follows the movement of the mouse pointer according to one of the multiple AI-generated contents;

[0116] The device also includes:

[0117] The first switching unit is used to automatically switch the following content that follows the movement of the mouse pointer to another AI generated content after the current following content is filled into the target item.

[0118] If the AI-generated content is in multiple copies, the device may further include:

[0119] The second switching unit is used to switch the following content that follows the movement of the mouse pointer to another AI generated content if an operation of switching the following content is received by the user through a shortcut key after the following content is generated.

[0120] Among them, the following content that follows the movement of the mouse pointer can be switched according to the display order of multiple AI-generated content in the preview area.

[0121] In addition, the device may also include:

[0122] The superscript information display unit is used to provide superscript information in the following content, and the superscript information is used to express the number of multiple AI generated contents and the display position of the AI ​​generated content corresponding to the current following content in the preview area.

[0123] Corresponding to the second embodiment, the embodiment of the present application further provides a device for publishing product information, which may include:

[0124] An interface providing unit, configured to provide a product information publishing interface after receiving a product publishing request initiated by a user, wherein the interface includes a project display area and a first operation option for initiating an AI generation request, wherein the project display area is used to display a plurality of items to be filled;

[0125] A preview area providing unit, configured to provide an AI-generated content preview area in the interface after receiving a request and generating AI-generated content through the first operation option, and provide a second operation option for applying the AI-generated content in the preview area; wherein the AI-generated content includes image or text content required in the product release process, and at least one AI-generated content of the same type is generated each time a request is made;

[0126] a mouse following content generating unit, configured to generate following content following the movement of the mouse pointer according to the AI ​​generated content in response to a click operation on the second operation option;

[0127] The filling unit is used to fill the following content of the mouse pointer into the target item after detecting that the mouse pointer is moved to the target item in the item display area and a click operation is performed, so as to publish the product after completing the content filling of multiple items.

[0128] Wherein, the AI-generated content includes multiple AI-generated contents of the same type;

[0129] The mouse following content generating unit may be specifically configured to: in an initial state, generate the following content following the movement of the mouse pointer according to one of the plurality of AI generated contents;

[0130] The device also includes:

[0131] A switching unit is used to automatically switch the following content that follows the movement of the mouse pointer to another AI-generated content after the current following content is filled into the target item.

[0132] Corresponding to the third embodiment, the embodiment of the present application further provides a content filling interaction device, which may include:

[0133] An interface display unit, used to display a content filling interface, wherein the content filling interface includes a plurality of items to be filled;

[0134] A content determination unit, configured to determine at least one target content;

[0135] A mouse following content generating unit, configured to generate following content following the movement of a mouse pointer according to the at least one target content;

[0136] The filling unit is used to fill the following content of the mouse pointer into the target item after detecting that the mouse pointer is moved to the target item and a click operation is performed.

[0137] Wherein, the at least one target content includes:

[0138] After a request is initiated through the operation option for initiating an AI generation request provided in the content filling interface, at least one AI generated content is generated.

[0139] Alternatively, the at least one target content includes:

[0140] The content copied to the clipboard comes from a local file or document of the terminal device, or a page opened through a web browser.

[0141] In addition, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any one of the methods in the aforementioned method embodiments are implemented.

[0142] And an electronic device, comprising:

[0143] one or more processors; and

[0144] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of the method described in any one of the aforementioned method embodiments.

[0145] A computer program product includes a computer program / computer executable instructions, which, when executed by a processor in an electronic device, implement the steps of the method described in the aforementioned method embodiment.

[0146] in, Figure 6 The architecture of the electronic device is shown as an example, which may include a processor 610, a video display adapter 611, a disk drive 612, an input / output interface 613, a network interface 614, and a memory 620. The processor 610, the video display adapter 611, the disk drive 612, the input / output interface 613, the network interface 614, and the memory 620 may be communicatively connected via a communication bus 630.

[0147] Among them, the processor 610 can be implemented by a general-purpose CPU (Central Processing Unit, processor), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, etc., to execute relevant programs to implement the technical solution provided in this application.

[0148] The memory 620 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 620 can store an operating system 621 for controlling the operation of the electronic device 600, and a basic input and output system (BIOS) for controlling the low-level operation of the electronic device 600. In addition, a web browser 623, a data storage management system 624, and a content filling interactive processing system 625, etc. can also be stored. The above-mentioned content filling interactive processing system 625 can be an application program that specifically implements the operations of the aforementioned steps in the embodiment of the present application. In short, when the technical solution provided by the present application is implemented by software or firmware, the relevant program code is stored in the memory 620 and is called and executed by the processor 610.

[0149] The input / output interface 613 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0150] The network interface 614 is used to connect to a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).

[0151] The bus 630 comprises a pathway for transmitting information between the various components of the device (eg, the processor 610, the video display adapter 611, the disk drive 612, the input / output interface 613, the network interface 614, and the memory 620).

[0152] It should be noted that, although the above device only shows a processor 610, a video display adapter 611, a disk drive 612, an input / output interface 613, a network interface 614, a memory 620, a bus 630, etc., in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include components necessary for implementing the solution of the present application, and does not necessarily include all the components shown in the figure.

[0153] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly contributed to the prior art in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0154] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without creative work.

[0155] The above is a detailed introduction to the content filling interaction and product information publishing method and electronic device provided by this application. This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core ideas of this application. At the same time, for those skilled in the art, according to the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A content filling interaction method, characterized in that: include: Displaying a content filling interface, after generating AI-generated content according to an artificial intelligence AI generation request initiated by a user, providing an AI-generated content preview area in the content filling interface, and providing operation options for applying the AI-generated content in the preview area, wherein the content filling interface includes a plurality of items to be filled; In response to a click operation on the operation option, generating following content that follows the movement of the mouse pointer according to the AI ​​generated content; After detecting that the mouse pointer is moved to the target item and a click operation is performed, the target item is filled with the following content that follows the mouse pointer.

2. The method according to claim 1, characterized in that The AI-generated content is in multiple copies; The step of generating following content that follows the movement of the mouse pointer according to the AI ​​generated content includes: In an initial state, generating the following content that follows the movement of the mouse pointer according to one of the multiple AI-generated contents; The method further comprises: After the current following content is filled into the target item, the following content that follows the movement of the mouse pointer is automatically switched to another AI generated content.

3. The method according to claim 1, characterized in that The AI-generated content is in multiple copies; The method further comprises: After the following content is generated, if an operation of switching the following content is received from the user through a shortcut key, the following content that follows the movement of the mouse pointer is switched to another AI generated content.

4. The method according to claim 2 or 3, characterized in that: According to the display order of the multiple AI generated contents in the preview area, the following content that follows the movement of the mouse pointer is switched.

5. The method according to claim 2 or 3, characterized in that: Also includes: Corner mark information is provided in the following content, and the corner mark information is used to express the number of multiple AI-generated contents and the display position of the AI-generated content corresponding to the current following content in the preview area.

6. A method for publishing product information, characterized in that: include: After receiving a product release request initiated by a user, a product information release interface is provided, wherein the interface includes a project display area and a first operation option for initiating an AI generation request, wherein the project display area is used to display a plurality of items to be filled; After receiving a request and generating AI-generated content through the first operation option, providing an AI-generated content preview area in the interface, and providing a second operation option for applying the AI-generated content in the preview area; wherein the AI-generated content includes image or text content required in the product release process, and at least one AI-generated content of the same type is generated each time a request is made; In response to a click operation on the second operation option, generating following content that follows the movement of the mouse pointer according to the AI ​​generated content; After detecting that the mouse pointer is moved to the target item in the item display area and a click operation is performed, the following content following the mouse pointer is filled into the target item, so that the product is released after the content filling of multiple items is completed.

7. The method according to claim 6, characterized in that The AI-generated content includes multiple AI-generated content of the same type; The step of generating following content that follows the movement of the mouse pointer according to the AI ​​generated content includes: In an initial state, generating the following content that follows the movement of the mouse pointer according to one of the multiple AI-generated contents; The method further comprises: After the current following content is filled into the target item, the following content that follows the movement of the mouse pointer is automatically switched to another AI generated content.

8. A content filling interaction method, characterized in that: include: Displaying a content filling interface, wherein the content filling interface includes a plurality of items to be filled; Identify at least one piece of targeted content; generating following content that follows the movement of the mouse pointer according to the at least one target content; After detecting that the mouse pointer is moved to the target item and a click operation is performed, the target item is filled with the following content that follows the mouse pointer.

9. The method according to claim 8, characterized in that The at least one target content includes: After a request is initiated through the operation option for initiating an AI generation request provided in the content filling interface, at least one AI generated content is generated.

10. The method according to claim 8, characterized in that The at least one target content includes: The content copied to the clipboard comes from a local file or document of the terminal device, or a page opened through a web browser.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method described in any one of claims 1 to 10 are implemented.

12. An electronic device, characterized in that: include: one or more processors; as well as A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of the method described in any one of claims 1 to 10.

13. A computer program product comprising a computer program / computer executable instructions, characterized in that: When the computer program / computer executable instructions are executed by a processor in an electronic device, the steps of the method according to any one of claims 1 to 10 are implemented.

Citation Information

Cited By

  • Content filling interaction method, commodity information publishing method, and electronic device

    WO2026001352A1