An interaction method and related apparatus

Abstract

The application discloses an interaction method and related device, and relates to the technical field of artificial intelligence, and comprises the following steps: obtaining a session request; inputting the session request into a model to obtain generated content output by the model; determining display parameters of the generated content in an interaction interface, and outputting the display of the generated content based on the display parameters; wherein the interaction interface can display a plurality of generated contents, wherein the plurality of generated contents comprise a plurality of generated contents output by the model in the same round of session interaction and / or a plurality of generated contents output in different rounds of session interaction, and the plurality of generated contents have a first display relationship; the first display relationship is different from a second display relationship, and the second display relationship depends on the generation time sequence of the corresponding generated content.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, and in particular to an interaction method and related apparatus. Background Technology

[0002] Currently, artificial intelligence (AI) technology has been widely applied in scenarios such as content generation, intelligent question answering, and task assistance. User interaction with AI systems typically takes the form of a linear conversation window. Users submit conversation requests through input boxes, and the AI ​​system generates corresponding content based on these requests, displaying the generated content sequentially in the conversation window according to chronological order. Summary of the Invention

[0003] In view of the above problems, this application provides an interaction method and related apparatus, the specific solution of which is as follows:

[0004] The first aspect of this application provides an interaction method, including:

[0005] Get the session request;

[0006] Input the session request into the model to obtain the generated content output by the model;

[0007] Determine the display parameters of the generated content on the interactive interface, and output and display the generated content based on the display parameters;

[0008] The interactive interface can display multiple generated content, which includes multiple generated content output by the model in the same round of conversation interaction and / or multiple generated content output in different rounds of conversation interaction, and the multiple generated content has a first display relationship; the first display relationship is different from the second display relationship, which depends on the generation time order of the corresponding generated content.

[0009] In one possible implementation, the generated content is displayed based on the display parameters, including:

[0010] According to the display parameters, an interactive unit carrying the generated content is displayed; the interactive unit is a visual presentation carrier of the generated content, providing object-level operations for the generated content;

[0011] The interactive interface can display multiple interactive units, each carrying different generated content and providing object-level operations for that content.

[0012] One possible implementation also includes:

[0013] From the multiple interactive units of the interactive interface, determine the first interactive unit corresponding to the session request;

[0014] Obtain context information; wherein the context information is bound to the first interaction unit or to an associated interaction unit, and the associated interaction unit has an association relationship with the first interaction unit;

[0015] The context information includes the first generated content carried by the first interaction unit, the session process associated with the first generated content, or the generated content carried by the associated interaction unit.

[0016] Input the context information and the session request into the model.

[0017] In one possible implementation, obtaining context information includes at least one of the following:

[0018] In response to a session request for an object-level operation triggered for the first interaction unit, the first generated content is determined as context information;

[0019] In response to a session request, the session process associated with the first generated content is determined as context information for further inquiry into the first generated content.

[0020] In response to the first interactive unit satisfying a spatial layout relationship with other interactive units in the interactive interface, the other interactive units are identified as associated interactive units, and the generated content carried by the associated interactive units is identified as context information.

[0021] In one possible implementation, inputting the context information and the session request into the model includes:

[0022] The context information and the session request are input into the model so that the model can determine the corresponding interaction unit type and generate content corresponding to the interaction unit type; wherein, the interaction unit type includes at least one of task management unit, functional component unit, document unit, table unit or chart unit;

[0023] The interactive unit that displays the generated content includes:

[0024] The generated content is encapsulated into interactive units of the corresponding type for display.

[0025] In one possible implementation, the display parameters include morphology sub-parameters or layout sub-parameters;

[0026] The morphology sub-parameter is used to determine the display morphology of the interactive unit;

[0027] The layout sub-parameters are used to determine the display position of the interactive unit in the interactive interface.

[0028] One possible implementation also includes:

[0029] In response to the existence of associated interactive units in the interactive interface that are related to the interactive unit, the interactive unit or the associated interactive unit is displayed according to the spatial layout relationship; the display parameters include layout sub-parameters, which are used to determine the spatial layout relationship between the interactive unit and the associated interactive unit.

[0030] Displaying the interactive unit or the associated interactive unit according to spatial layout relationships includes at least one of the following:

[0031] The interactive unit and the associated interactive unit are displayed in an attached manner;

[0032] The interactive unit is displayed as a subordinate unit attached to the associated interactive unit;

[0033] The associated interactive unit can be collapsed and displayed as a side label, thumbnail, or entry label of the interactive unit;

[0034] The interactive units and their associated interactive units are aggregated into groups, and multiple interactive units in the group are displayed in the form of group-level identifiers or group themes.

[0035] One possible implementation also includes:

[0036] In response to a selection operation on the second interactive unit, the display state of the second interactive unit is associated, such that the second interactive unit and the associated interactive unit satisfy a spatial layout relationship; the second interactive unit and the associated interactive unit are associated.

[0037] The second interactive unit is any one of the multiple interactive units of the interactive interface.

[0038] In one possible implementation, the association includes at least one of the following:

[0039] The content carried by the interactive units is semantically similar;

[0040] The content carried by the interactive unit belongs to different generated content within the same session;

[0041] The content carried by the interaction unit corresponds to different stages in the same generation chain, and there are generation dependencies;

[0042] Interactive units belong to the same workspace and share the same workspace context.

[0043] A second aspect of this application provides an electronic device, comprising at least one processor, a memory connected to the processor, and a screen, wherein:

[0044] The memory is used to store computer programs;

[0045] The processor is used to execute the computer program to enable the electronic device to perform:

[0046] Get the session request;

[0047] Input the session request into the model to obtain the generated content output by the model;

[0048] Determine the display parameters of the generated content on the interactive interface, and output and display the generated content based on the display parameters;

[0049] The screen has the interactive interface and can display multiple generated content, wherein the multiple generated content includes multiple generated content output by the model in the same round of conversation interaction and / or multiple generated content output in different rounds of conversation interaction, and the multiple generated content has a first display relationship; the first display relationship is different from the second display relationship, and the second display relationship depends on the generation time order of the corresponding generated content.

[0050] Using the above technical solution, this application provides an interaction method and related apparatus that acquires a session request; inputs the session request into a model to obtain generated content output by the model; determines the display parameters of the generated content on the interactive interface, and outputs and displays the generated content based on the display parameters; wherein the interactive interface can display multiple generated contents, wherein the multiple generated contents include multiple generated contents output by the model in the same round of session interaction and / or multiple generated contents output in different rounds of session interaction, and the multiple generated contents have a first display relationship; the first display relationship is different from a second display relationship, the second display relationship depending on the generation time order of the corresponding generated contents. Attached Figure Description

[0051] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0052] Figure 1 A flowchart illustrating an interaction method provided in an embodiment of this application;

[0053] Figure 2 A schematic diagram of an interactive interface provided in an embodiment of this application;

[0054] Figure 3 A schematic diagram illustrating yet another interactive interface provided in an embodiment of this application;

[0055] Figure 4A schematic diagram illustrating the relationship between interactive units provided in an embodiment of this application;

[0056] Figures 5a to 5e A schematic diagram showing different types of interactive units provided in the embodiments of this application;

[0057] Figures 6a to 6d A schematic diagram of the layout of the multiple interactive units provided in an embodiment of this application;

[0058] Figures 7a to 7c A schematic diagram illustrating the re-layout provided in an embodiment of this application;

[0059] Figure 8 This is a schematic diagram of the structure of an interactive device provided in an embodiment of this application;

[0060] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0061] The embodiments of this application are described below with reference to the accompanying drawings. The terminology used in the implementation section of this application is for explaining specific embodiments only and is not intended to limit the scope of this application.

[0062] As will be known to those skilled in the art, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0063] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such terms are interchangeable where appropriate; this is merely a way of distinguishing objects with the same attributes in the embodiments of this application. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, so that a process, method, system, product, or apparatus that comprises a series of elements is not necessarily limited to those elements, but may include other elements not explicitly listed or inherent to those processes, methods, products, or apparatuses.

[0064] In AI interaction technology, user interaction with AI systems typically takes the form of a linear session window. Furthermore, within the same session, the AI ​​system may output multiple generated content pieces, which are arranged sequentially within the session window according to their generation time. In other words, the display relationships between session windows and among multiple generated content pieces depend on their respective generation time order.

[0065] In view of this, embodiments of this application provide an interaction method and related apparatus that upgrades artificial intelligence (AI) interaction from linear conversational interaction to spatial interaction. Figure 1 This is a flowchart illustrating an interaction method provided in an embodiment of this application, as shown below. Figure 1 As shown, an interactive method provided in this application embodiment may include steps S101 to S103, which will be described in detail below.

[0066] S101, Obtain session request.

[0067] In this embodiment, a session request includes an interactive instruction initiated by the user to the artificial intelligence system. Specifically, a session request includes a text prompt entered by the user, a voice command entered via voice, and a selection operation on content already displayed in the interactive interface. For example, a session request can be initiated through at least one of the following: selecting one or more interactive units and then entering a text prompt as a session request; directly clicking an operation button on the interactive unit to initiate a session request; or entering text in an input box on the interactive interface and then submitting it as a session request.

[0068] S102. Input the session request into the model and obtain the generated content output by the model.

[0069] In this embodiment, the model is used to infer and output generated content based on the input session request and / or context information. The model can be a large language model, a multimodal model, an image generation model, a video generation model, an audio generation model, or other artificial intelligence models with content generation capabilities; this application does not specifically limit this. It should be noted that the model can be deployed internally within the intelligent interaction system as a built-in inference engine, invoked locally by the system, or it can be deployed on a server, with the intelligent interaction system calling external model services through a network interface.

[0070] In this embodiment, when a session request is input into the model, the session request can be input to a model with corresponding generation capabilities based on the type of content to be generated in the session request. After receiving the session request, the model performs inference based on the prompts and / or context information in the session request and outputs the corresponding generated content. The type of generated content is related to the session request and the model's capabilities. Specifically, the types of generated content include at least one of the following: text, image, audio, video, document, table, chart, task list, and schedule.

[0071] In one optional embodiment, the session request includes a prompt input by the user, "Please help me generate a summary about project A." After the prompt is input into the model, the model receives the session request, outputs a text summary about project A, and obtains the text summary as the generated content.

[0072] In another optional embodiment, the session request includes the user selecting an image card and inputting the prompt "Please convert this image into a text description". After inputting the prompt and the image content corresponding to the image card into the model, the model receives the prompt and the image content, outputs the text describing the image content, and obtains the text as the generated content.

[0073] S103. Determine the display parameters of the generated content on the interactive interface, and output the generated content based on the display parameters.

[0074] In this embodiment, the interactive interface can display multiple generated content items. These multiple generated content items include those output by the model in the same round of conversational interaction and / or those output in different rounds of conversational interaction. The multiple generated content items have a first display relationship, which differs from a second display relationship, where the second display relationship depends on the generation time order of the corresponding generated content. That is, the arrangement of the multiple generated content items in the interactive interface does not depend on their respective generation time order, but is determined based on other factors, such as semantic relationships between content items, user editing operations on the content, or spatial layout determined according to content characteristics.

[0075] In one optional embodiment, the interactive interface includes a workspace in the form of an infinite canvas. The interactive interface can display multiple generated contents simultaneously. The generated contents are displayed on the interactive interface through a visual presentation carrier, wherein the visual presentation carrier is used to carry various types of generated contents such as text, images, audio, video, and documents.

[0076] Figure 2 This is a schematic diagram of an interactive interface provided in an embodiment of this application, such as... Figure 2 As shown, the interactive interface under the travel topic displays multiple generated content items, including:

[0077] The model outputs multiple generated content items in the same round of dialogue interaction: multiple generated content items from the first round of dialogue, multiple generated content items from the second round of dialogue, and multiple generated content items from the third round of dialogue. The generated content items from the first and second rounds of dialogue are both image types and belong to the same topic, exhibiting partial overlap. The generated content items from the third round of dialogue include both image and text types, and have low similarity to the topics of other rounds of dialogue, appearing at a greater distance from the generated content items from the first and second rounds of dialogue. In summary, the visualization results are as follows: Multiple groups of image-based interactive units are distributed within the infinite canvas interactive interface for a travel theme. The upper left area tightly clusters hotel, car, and lobby image cards generated from the first and second rounds of dialogue, with these two types of cards spatially overlapping and adjacent. The far right side of the canvas separately places a combination of map and text cards generated from the third round of dialogue. The generated content from the three rounds of dialogue is spatially arranged only based on semantic proximity, not linearly ordered by generation time.

[0078] In this embodiment, the display parameters are used to determine how the generated content is displayed in the interactive interface. After the display parameters are determined, the generated content is output and displayed at the corresponding position in the interactive interface according to the display parameters.

[0079] For example, a first session request, "Please generate a project plan," is received. This request is input into the model, and the project plan text output by the model is used as the first generated content. The display parameters for this first generated content on the interactive interface are determined, and based on these parameters, a visual representation of the project plan text is displayed on the interactive interface. Next, a second session request, "Please generate a budget table for this project," is received. This request is input into the model, and the budget table output by the model is used as the second generated content. The display parameters for this second generated content on the interactive interface are determined, and based on these parameters, a visual representation of the budget table is displayed adjacent to the display position of the first generated content on the interactive interface. Therefore, the display positions of the second and first generated content are spatially adjacent, and the two generated content items are displayed side-by-side on the interactive interface, facilitating parallel viewing and comparison of these two related generated content items by the user.

[0080] As can be seen from the above technical solutions, the interaction method provided in this application obtains generated content by acquiring a session request and inputting a model, determines the display parameters of the generated content on the interactive interface, and outputs and displays the generated content based on the display parameters. The interactive interface can display multiple generated contents output in the same round and / or different rounds of session interaction, and the multiple generated contents have a first display relationship independent of the generation time order. Therefore, this solution differs from the traditional linear session window that arranges content in chronological order, enabling multiple generated contents to be organized and displayed in a spatial, non-temporally ordered manner. It establishes a content spatial relationship independent of the time dimension in the interactive interface, realizing the active controllability and flexible adaptability of the generated content layout.

[0081] Understandably, by displaying generated content based on the first display relationship, users can intuitively perceive the relationship between different generated content through spatial location, thereby achieving an interactive experience of multi-task parallelism, multi-object combination and spatial clustering, improving the efficiency of complex task processing and the flexibility of content management.

[0082] In one optional embodiment, the specific method for outputting and displaying generated content based on display parameters includes: displaying an interactive unit carrying the generated content according to the display parameters.

[0083] In this embodiment, the interaction unit serves as a visual presentation carrier for the generated content, providing object-level operations on the generated content. These object-level operations instruct the interaction unit to perform corresponding processing on the generated content it carries. For example, object-level operations include editing, translation, rewriting, expansion, format conversion, deletion, and copying operations.

[0084] In one alternative embodiment, the user can trigger an object-level operation by clicking the corresponding operation button on the interaction unit, or by selecting the interaction unit and entering a command in the input box.

[0085] Figure 3 This is a schematic diagram illustrating another interactive interface provided in an embodiment of this application, such as... Figure 3 As shown, the interactive interface displays multiple interactive units, which are presented in the form of cards, including travel plan cards, Shanghai travel plan cards, etc., and each card carries different types of generated content.

[0086] The interactive interface can display multiple operation buttons, each corresponding to a different object-level operation type, such as... Figure 3As shown, the operation buttons are divided into two categories: The bottom of the interface features an adaptive operation button bar displaying the first category of operation buttons, providing object-level operations related to the content type of the currently selected interactive unit. For example, selecting a text card displays buttons for translation, rewriting, and summarizing. A custom operation panel pops up on the right, displaying the second category of operation buttons, providing object-level operations such as text generation, translation, summarizing, and drawing. These are applicable to all types of interactive units, including common operations like delete, copy, and favorite. For example, selecting an image card displays buttons for style conversion and generating text descriptions. Users can click any operation button to initiate the corresponding object-level operation on the content generated by that card.

[0087] like Figure 3 As shown, an input box is also provided at the bottom of the interactive interface. After selecting an interactive unit, users can enter the prompt word "rewrite" in the input box of the interactive interface to initiate a corresponding rewrite operation on the generated content carried by that interactive unit.

[0088] In this embodiment, the interactive interface can display multiple interactive units, each carrying different generated content and providing object-level operations for that content. Specifically, when the interactive interface displays multiple interactive units, each unit has an operation button area at its bottom. Users can initiate object-level operations on the generated content carried by any interactive unit by clicking the corresponding operation button. The set of operation buttons for different interactive units can be the same, or they can be configured differently based on the type of content carried by the interactive unit. Interactive units carrying text content can be configured with operation buttons such as rewrite, translate, and summarize; interactive units carrying image content can be configured with operation buttons such as style conversion and generating text descriptions; and interactive units carrying task lists can be configured with operation buttons such as adding tasks and marking tasks as completed.

[0089] It should be noted that different interactive units are configured with different sets of operation buttons according to the type of content they carry, so that the operation options are accurately matched with the content type, reducing the length of the user's operation path and cognitive burden, and improving the efficiency and accuracy of interaction.

[0090] As can be seen from the above technical solutions, the interactive method provided in this application uses interactive units as a visual presentation carrier of generated content, and provides object-level operations for each interactive unit for the content it carries, so that users can directly operate on the generated content in an object-oriented manner without having to repeatedly input or re-upload the content to trigger further processing.

[0091] In one optional embodiment, the interaction method provided in this application further includes:

[0092] From the multiple interactive units of the interactive interface, determine the first interactive unit corresponding to the session request, obtain the context information, and input the context information and the session request into the model.

[0093] In this embodiment, the context information is bound to the first interaction unit or to an associated interaction unit. The associated interaction unit and the first interaction unit are related. The context information includes the first generated content carried by the first interaction unit, the session process associated with the first generated content, or the generated content carried by the associated interaction unit.

[0094] Figure 4 This is a schematic diagram illustrating the relationship between interactive units as provided in an embodiment of this application. Figure 4 As shown, the interactive interface displays multiple interactive units. The first interactive unit corresponding to the session request is determined from the multiple interactive units. The interactive units associated with the first interactive unit include the second interactive unit and the third interactive unit from the same session.

[0095] The context information is bound to the first interaction unit, specifically including: the first generated content carried by the first interaction unit, the complete session process associated with the first generated content, the generated content carried by the second interaction unit, and the generated content carried by the third interaction unit. In this step, the above context information and session request are input into the model together.

[0096] In summary, this embodiment determines the first interaction unit corresponding to the session request, obtains the context information bound to the first interaction unit or associated interaction units, and inputs the context information and session request into the model together, enabling the model to perform inference based on the interaction unit currently operated by the user and its associated content, thereby realizing context-aware interaction and improving the relevance of generated content to the operation object.

[0097] It should be noted that, since different scenarios require different context granularities, the appropriate context granularity is dynamically selected based on the type of session request and the interaction scenario. Therefore, in one optional embodiment, obtaining context information includes at least one of the following:

[0098] 1. In response to a session request, an object-level operation triggered for the first interaction unit is used to determine the first generated content as context information.

[0099] Taking the first interactive unit carrying text content as an example, after the user clicks the "Translate" button corresponding to the first interactive unit, the first session request is received. The first session request is used for the translation operation triggered by the first interactive unit, and the text content carried by the first interactive unit is used as context information.

[0100] 2. In response to a session request, the session process associated with the first generated content is used to ask follow-up questions and determine the context information.

[0101] Taking the first interactive unit carrying text content as an example, after the user selects the first interactive unit, they enter "Please provide further details" in the input box and receive a second session request. The second session request is used to perform extended operations on the text content carried by the first interactive unit, and the complete session process of generating the text content is used as context information.

[0102] 3. In response to the first interactive unit satisfying the spatial layout relationship with other interactive units in the interactive interface, the other interactive units are identified as associated interactive units, and the generated content carried by the associated interactive units is identified as context information.

[0103] Taking the first interactive unit and the second interactive unit as an example where they are spatially adjacent and form a topic cluster, after the user selects the first interactive unit, they enter "Please generate a summary based on this content" in the input box and receive a third session request. The third session request is used to comprehensively process the first interactive unit and the related interactive units that satisfy the spatial layout relationship with it. The generated content carried by the first interactive unit and the generated content carried by the second interactive unit are used together as context information.

[0104] In summary, by dynamically selecting the appropriate granularity from multiple context acquisition methods based on the type of session request and the interaction scenario, the acquisition of context information can adapt to the differentiated needs of different scenarios.

[0105] In one optional embodiment, the specific method for inputting context information and session requests into the model includes: inputting context information and session requests into the model so that the model determines the corresponding interaction unit type and generates content corresponding to the interaction unit type.

[0106] In this embodiment, the interaction unit type includes at least one of the following: task management unit, functional component unit, document unit, table unit, or chart unit. The task management unit is used to hold content with task management attributes, such as task lists and to-do items. The functional component unit is used to hold small components with specific functions, such as weather components, calendar components, or timer components. The document unit is used to hold document-type content such as text, presentations, and reports. The table unit is used to hold structured data tables. The chart unit is used to hold data visualization charts.

[0107] Based on this, specific methods for displaying interactive units that carry generated content include: encapsulating the generated content into interactive units of the corresponding type for display.

[0108] In this embodiment, different types of interactive units have different visual styles and interactive functions. Figures 5a to 5e These are all schematic diagrams showing different types of interactive units provided in the embodiments of this application, wherein... Figures 5a to 5e The diagram shows the display of different types of interactive units.

[0109] The task management unit displays a list of tasks, with each task potentially preceded by a checkbox and buttons at the bottom for actions such as adding a task and marking it as complete. Figure 5a As shown, based on multiple different types of interactive units, namely the Beijing Zoo travel guide document interactive unit and the park map chart interactive unit, the two are used together as context to trigger the generation of the Beijing Zoo travel checklist task management unit, which is presented in the form of a list with checkboxes in front of the task items.

[0110] The functional component unit displays the functional components in card format. Taking a clock widget as an example, for instance... Figure 5b As shown, the interactive unit of the Pomodoro Technique introduction document and the interactive unit of the to-do list are selected and used together as the context to trigger the generation of the Pomodoro timer function component unit. This Pomodoro component unit provides multiple duration options and is equipped with start and reset interactive controls.

[0111] Document units display text content in a document preview format and may include buttons for editing, exporting, and other operations. For example... Figure 5c As shown, the image interaction unit carrying the bracelet material is selected as the context, triggering the generation of an exquisite bracelet display document interaction unit. This document unit presents the text description content corresponding to the image and has text editing related operation controls.

[0112] Table cells display structured data in a tabular format and may include row and column operation buttons. For example... Figure 5d As shown, the interactive units of the Beijing Zoo visitor guide document and the park map chart are selected together as the context to trigger the generation of a table unit. The table unit displays structured data of the tour route in tabular form and is equipped with row and column editing controls.

[0113] Chart units display data visualization results in chart form and may include data filtering and sorting functions. For example... Figure 5e As shown, the document interaction unit titled "A Deep Look Back on Lost Youth" is selected as the context, and the text-to-image operation is performed to trigger the generation of an image-based chart unit that matches the mood of the text.

[0114] As can be seen from the above technical solutions, the interaction method provided in this application provides that by inputting context information and session requests into the model, the model determines the corresponding interaction unit type and generates corresponding content, and encapsulates the generated content into the corresponding type of interaction unit for display. This makes the form and function of the interaction unit accurately match the type of content it carries, providing users with more targeted operation tools and visual experience, and improving interaction efficiency and user experience.

[0115] It should be noted that, according to the display parameters, when displaying the interactive unit carrying the generated content, the display parameters are used to present the generated content in the interactive interface with an appropriate visual form and spatial position. In an optional embodiment, the display parameters include morphological sub-parameters or layout sub-parameters.

[0116] In this embodiment, the morphological sub-parameter is used to determine the display form of the interactive unit. Optionally, the morphological sub-parameter includes at least one visual attribute such as the size, shape, color, font, border style, background style, and transparency of the interactive unit.

[0117] In this embodiment, the layout sub-parameter is used to determine the display position of the interactive unit in the interactive interface. Optionally, the layout sub-parameter includes at least one spatial attribute such as the coordinate position of the interactive unit on the canvas, the relative position between the interactive unit and other interactive units, and the group affiliation.

[0118] Specifically, the form sub-parameters and layout sub-parameters can be determined based on the content type of the generated content, the type of interactive unit, and user preference settings. The placement position of the new interactive unit can also be automatically calculated based on the existing layout of interactive units in the interactive interface to avoid occlusion and overlap.

[0119] For example, for text-based content, the morphological sub-parameters can be determined to include a width of 400 pixels, an adaptive height, a light gray background color, and a corner radius of 8 pixels. For image-based content, the morphological sub-parameters can be determined to include a width of 300 pixels, a height of 300 pixels, maintaining the original aspect ratio, and a 1-pixel solid border. Furthermore, in response to the positional distribution of existing and related interactive units in the current interactive interface, the placement position of the new interactive unit can be determined as (200, 150), maintaining a 10-pixel spacing between it and adjacent interactive units.

[0120] As can be seen from the above technical solutions, the interaction method provided in this application, by determining the morphological sub-parameters and layout sub-parameters for the interaction unit, enables the interaction unit to be presented in the interaction interface with diverse visual forms and flexible spatial layout, thereby improving the readability and visual effect of the interaction interface.

[0121] In one optional embodiment, the interaction method provided in this application further includes: in response to the existence of associated interaction units in the interaction interface that are related to the interaction unit, displaying the interaction unit or associated interaction unit according to the spatial layout relationship.

[0122] In this embodiment, the display parameters include layout sub-parameters, which are used to determine the spatial layout relationship between the interactive unit and the associated interactive unit.

[0123] In this embodiment, after determining the interactive unit corresponding to the generated content, it checks whether there are related interactive units in the interactive interface that are associated with that interactive unit. If so, the interactive unit or related interactive units are displayed according to the spatial layout relationship determined by the layout sub-parameters. It should be noted that this corresponds to the automatic layout after content generation, that is, when the model generates new content and displays it as an interactive unit, the association relationship is automatically detected and displayed according to the spatial layout relationship.

[0124] Based on this, interactive units or related interactive units are displayed according to spatial layout relationships. As an example, Figures 6a to 6d This is a schematic diagram of the layout of the multiple interactive units provided in the embodiments of this application. Figures 6a to 6d This illustrates various forms of displaying interactive units or related interactive units according to spatial layout relationships, see reference. Figures 6a to 6d Displaying interactive units or related interactive units according to spatial layout includes at least one of the following:

[0125] Display interactive units and related interactive units in an attached manner, that is, the related interactive units are attached to the current interactive unit.

[0126] In this embodiment, the attachment methods include, but are not limited to, attachment methods based on scene, location, and text layout, such as... Figure 6a As shown in Figure 6a, the model identifies the thematic relationships between multiple text and image interactive units within the interactive interface. It arranges each interactive unit using a text layout attachment method. Multiple interactive units are mutually attracted and arranged to form the layout of the text "Beijing". Based on the attachment arrangement method of the text shape, it intuitively reflects that all interactive units belong to the same theme.

[0127] The interactive unit is displayed as a subordinate unit attached to the associated interactive unit, that is, the current interactive unit is displayed as a subordinate unit around the associated interactive unit, forming a hierarchical structure.

[0128] like Figure 6bAs shown in Figure 6b, when the model generates a travel guide document interactive unit, the interactive interface contains interactive units related to the travel guide document interactive unit, such as photo interactive units, scenic area map interactive units, and to-do list interactive units. These related interactive units are arranged as subordinate units around the main interactive unit, which intuitively reflects the relationship hierarchy between the main content and the auxiliary materials.

[0129] Collapse related interactive units to display them as side labels, thumbnails, or entry icons for the interactive units.

[0130] like Figure 6c As shown, when the model generates a travel guide document interactive unit, there are multiple related interactive units in the interactive interface that are associated with the travel guide document interactive unit, namely the to-do list interactive unit, the scenic map interactive unit, and the material classification interactive unit. Each related interactive unit is folded into a side label and displayed on the side of the main interactive unit as an expansion entry.

[0131] Group interactive units and related interactive units together, and display multiple interactive units in the group in the form of group-level identifiers or group topics.

[0132] like Figure 6d As shown, when the model generates an outfit image interaction unit, there are multiple outfit image interaction units in the interaction interface. Based on the seasonal dimension, the relationship between interaction units is identified, and interaction units belonging to the same seasonal category are aggregated into card groups and labeled with group themes. Interaction units within the same group are arranged in a concentrated manner, and the similar relationship between interaction units is presented intuitively by relying on the group layout.

[0133] As can be seen from the above technical solutions, the interaction method provided in this application displays interactive units with related relationships according to spatial layout, enabling users to intuitively perceive the relationship between content through spatial location, realizing spatial and semantic association, and improving the efficiency and intuitiveness of content management.

[0134] In one optional embodiment, the interaction method provided in this application further includes: in response to a selection operation on a second interaction unit, associating the second interaction unit with a display state, such that the second interaction unit and the associated interaction unit satisfy a spatial layout relationship.

[0135] In this embodiment, the second interactive unit is associated with the associated interactive unit. The second interactive unit is any one of the multiple interactive units in the interactive interface.

[0136] In one optional embodiment, the user can select any interactive unit in the interactive interface as a second interactive unit by clicking, selecting, or using a selection box. After the user selects the second interactive unit, the second interactive unit is switched to an associated display state, so that the second interactive unit and its associated interactive units are displayed according to their spatial layout relationship.

[0137] In summary, this corresponds to a user-initiated re-layout operation, where the user selects an existing second interaction unit, and the spatial layout is reorganized based on the relationship between the second interaction unit and its associated interaction units. Figure 7a is a schematic diagram of a re-layout interface provided in an embodiment of this application. Figure 7a As shown, when a user clicks on the second interactive unit, namely card A, it is detected that card A is associated with cards B and C. In response to the selection operation, card A is switched to the associated display state, and cards B and C are displayed around card A in an attached manner.

[0138] It should be noted that the associated display state has a dynamic switching feature. When the user clicks on another card D, the associated display state of card A is canceled, and card D and its associated interactive units are displayed according to their spatial layout, allowing the user to switch between different associated groups through a selection operation.

[0139] It should be further noted that the layout of interactive units is not limited to the above forms. When a target interactive unit is selected to trigger a re-layout, a differentiated visual arrangement method based on relevance can also be used.

[0140] Figure 7b is a schematic diagram of another re-layout interface provided in an embodiment of this application. As shown in Figure 7b, after the user selects an interactive unit, the interactive unit with a higher correlation to that interactive unit is enlarged in size, and the remaining interactive units are gradually reduced in size according to their correlation with each other using parallax scrolling. The lower the correlation, the smaller the size of the corresponding interactive unit. All interactive units are visually presented as a multi-level distribution along the Z-axis. Subjectively, the interactive unit closer to the viewing angle corresponds to a higher correlation, and the interactive unit farther away from the viewing angle corresponds to a lower correlation.

[0141] Figure 7c is a schematic diagram of another re-layout interface provided in an embodiment of this application. As shown in Figure 7c, the user-selected interactive unit is used as the layout center. Distance parameters (e.g., Euclidean distance) are calculated based on the correlation and priority between each interactive unit and the central interactive unit, and converted into visible spacing on the canvas. The greater the canvas distance between interactive units, the weaker the correlation between them. Interactive units can be arranged radially or spirally, and the correlation and priority between interactive units are intuitively and explicitly represented by the planar visible distance.

[0142] As can be seen from the above technical solutions, the interaction method provided in this application switches the second interaction unit to an associated display state in response to the selection operation of the second interaction unit. This allows the user to actively trigger the spatial layout rearrangement of the associated interaction units through a click operation, realizing user-driven spatial association display. This makes it easier for users to view and organize related content as needed, and improves the efficiency of content discovery and management.

[0143] In one alternative embodiment, the association includes at least one of the following:

[0144] The content carried by the interactive units has similar semantics.

[0145] Specifically, the content carried by two or more interactive units is semantically similar. For example, two text cards describe different aspects of the same topic. Natural language processing technology can be used to calculate the semantic similarity between the content, and when the similarity exceeds a preset threshold, it is determined that the two are related.

[0146] The content carried by the interactive unit belongs to different generated content of the same session.

[0147] Specifically, two or more interactive units are generated during the same session interaction process, and they share the same session context. For example, a user generates multiple cards in a session, and these cards are all different generated content of the same session and are related to each other.

[0148] The content carried by the interaction unit corresponds to different stages in the same generation chain, and there are generation dependencies.

[0149] Specifically, the content of one interactive unit is generated based on the content of another interactive unit, and there is a generation dependency chain between them. For example, summary cards are generated based on original document cards, to-do task cards are generated based on summary cards, and schedule cards are generated based on to-do task cards. These cards are at different stages in the same generation chain and are related to each other.

[0150] Interactive units belong to the same workspace and share the same workspace context.

[0151] Specifically, multiple interactive units reside in the same workspace or project and share the same project context. For example, in a patent application workspace, there are multiple interactive units such as prior art cards, distinguishing feature cards, and technical effect cards. These interactive units belong to the same workspace and are related to each other.

[0152] As can be seen from the above technical solutions, the interaction method provided in this application embodiment, by defining multiple association relationship types, enables the system to identify the association between interaction units from multiple dimensions such as content semantics, session affiliation, generation link, and workspace, thereby improving the system's intelligence level and user experience.

[0153] The above describes an interaction method provided by an embodiment of this application. The following will describe the apparatus for performing the above interaction method.

[0154] Please see Figure 8 , Figure 8 This is a schematic diagram of the structure of an interactive device provided in an embodiment of this application. Figure 8 As shown, the interactive device 800 includes:

[0155] The request receiving unit 801 is used to obtain session requests;

[0156] The content generation unit 802 is used to input the session request into the model and obtain the generated content output by the model;

[0157] Display unit 803 is used to determine the display parameters of the generated content on the interactive interface, and output and display the generated content based on the display parameters;

[0158] The interactive interface can display multiple generated content, which includes multiple generated content output by the model in the same round of conversation interaction and / or multiple generated content output in different rounds of conversation interaction, and the multiple generated content has a first display relationship; the first display relationship is different from the second display relationship, which depends on the generation time order of the corresponding generated content.

[0159] The specific functions and implementations of each functional unit can be found in the above embodiments. An electronic device is also provided in this application. (See reference...) Figure 9 The diagram illustrates a structural schematic of an electronic device suitable for implementing the interaction method in the embodiments of this application. The electronic device in the embodiments of this application may include, but is not limited to, fixed terminals such as mobile phones, laptops, PDAs (personal digital assistants), PADs (tablet computers), desktop computers, etc. Figure 9 The electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0160] like Figure 9As shown, the electronic device may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. When the electronic device is powered on, the RAM 903 also stores various programs and data required for the operation of the electronic device. The processing unit 901, ROM 902, and RAM 903 are interconnected via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0161] Typically, the following devices can be connected to I / O interface 905: input devices 906 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 907 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 908 including, for example, memory cards, hard drives, etc.; and communication devices 909. Communication device 909 allows electronic devices to exchange data via wireless or wired communication with other devices. Although Figure 9 Electronic devices with various devices are shown, but it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have instead.

[0162] This application also provides a computer program product, including computer-readable instructions, which, when executed on an electronic device, cause the electronic device to implement any of the interaction methods provided in this application.

[0163] This application also provides a computer-readable storage medium that carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any of the interaction methods provided in this application.

[0164] It should also be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. In addition, in the device embodiment drawings provided in this application, the connection relationship between modules indicates that they have a communication connection, which can be implemented as one or more communication buses or signal lines.

[0165] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware, or it can be implemented by special-purpose hardware including application-specific integrated circuits, special-purpose CPUs, special-purpose memory, special-purpose components, etc. Generally, any function performed by a computer program can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be diverse, such as analog circuits, digital circuits, or special-purpose circuits. However, for this application, software program implementation is more often the preferred implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk, or optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, training equipment, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0166] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product.

[0167] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, training device, or data center to another website, computer, training device, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives (SSDs)).

Claims

1. An interaction method, comprising: Get the session request; Input the session request into the model to obtain the generated content output by the model; Determine the display parameters of the generated content on the interactive interface, and output and display the generated content based on the display parameters; The interactive interface can display multiple generated content, which includes multiple generated content output by the model in the same round of conversation interaction and / or multiple generated content output in different rounds of conversation interaction, and the multiple generated content has a first display relationship; the first display relationship is different from the second display relationship, which depends on the generation time order of the corresponding generated content.

2. The interaction method according to claim 1, wherein the generated content is displayed based on the display parameters, comprising: Based on the display parameters, display the interactive unit that carries the generated content; The interactive unit serves as a visual representation of the generated content, providing object-level operations for the generated content; The interactive interface can display multiple interactive units, each carrying different generated content and providing object-level operations for that content.

3. The interaction method according to claim 2 further includes: From the multiple interactive units of the interactive interface, determine the first interactive unit corresponding to the session request; Obtain context information; wherein the context information is bound to the first interaction unit or to an associated interaction unit, and the associated interaction unit has an association relationship with the first interaction unit; The context information includes the first generated content carried by the first interaction unit, the session process associated with the first generated content, or the generated content carried by the associated interaction unit. Input the context information and the session request into the model.

4. The interaction method according to claim 3, wherein obtaining context information includes at least one of the following: In response to a session request for an object-level operation triggered for the first interaction unit, the first generated content is determined as context information; In response to a session request, the session process associated with the first generated content is determined as context information for further inquiry into the first generated content. In response to the first interactive unit satisfying a spatial layout relationship with other interactive units in the interactive interface, the other interactive units are identified as associated interactive units, and the generated content carried by the associated interactive units is identified as context information.

5. The interaction method according to claim 3, wherein the context information and the session request are input into the model, comprising: The context information and the session request are input into the model so that the model can determine the corresponding interaction unit type and generate content corresponding to the interaction unit type; wherein, the interaction unit type includes at least one of task management unit, functional component unit, document unit, table unit or chart unit; The interactive unit that displays the generated content includes: The generated content is encapsulated into interactive units of the corresponding type for display.

6. The interaction method according to claim 2, wherein the display parameters include morphological sub-parameters or layout sub-parameters; The morphology sub-parameter is used to determine the display morphology of the interactive unit; The layout sub-parameters are used to determine the display position of the interactive unit in the interactive interface.

7. The interaction method according to claim 2, further comprising: In response to the existence of associated interactive units in the interactive interface that are related to the interactive unit, the interactive unit or the associated interactive unit is displayed according to the spatial layout relationship; the display parameters include layout sub-parameters, which are used to determine the spatial layout relationship between the interactive unit and the associated interactive unit. Displaying the interactive unit or the associated interactive unit according to spatial layout relationships includes at least one of the following: The interactive unit and the associated interactive unit are displayed in an attached manner; The interactive unit is displayed as a subordinate unit attached to the associated interactive unit; The associated interactive unit can be collapsed and displayed as a side label, thumbnail, or entry label of the interactive unit; The interactive units and their associated interactive units are aggregated into groups, and multiple interactive units in the group are displayed in the form of group-level identifiers or group themes.

8. The interaction method according to claim 2, further comprising: In response to a selection operation on the second interactive unit, the display state of the second interactive unit is associated, so that the second interactive unit and the associated interactive unit satisfy a spatial layout relationship; The second interactive unit is associated with the associated interactive unit; The second interactive unit is any one of the multiple interactive units of the interactive interface.

9. The interaction method according to any one of claims 3, 7, or 8, wherein the association relationship includes at least one of the following: The content carried by the interactive units is semantically similar; The content carried by the interactive unit belongs to different generated content within the same session; The content carried by the interaction unit corresponds to different stages in the same generation chain, and there are generation dependencies; Interactive units belong to the same workspace and share the same workspace context.

10. An electronic device comprising at least one processor, a memory connected to the processor, and a screen, wherein: The memory is used to store computer programs; The processor is used to execute the computer program to enable the electronic device to perform: Get the session request; Input the session request into the model to obtain the generated content output by the model; Determine the display parameters of the generated content on the interactive interface, and output and display the generated content based on the display parameters; The screen has the interactive interface and can display multiple generated content, wherein the multiple generated content includes multiple generated content output by the model in the same round of conversation interaction and / or multiple generated content output in different rounds of conversation interaction, and the multiple generated content has a first display relationship; the first display relationship is different from the second display relationship, and the second display relationship depends on the generation time order of the corresponding generated content.

Images