Information determination method, device and equipment and computer readable storage medium
By generating and operating element layout structure trees, the problem of low user interface design efficiency caused by low code readability in the prior art is solved, and intuitive interface design and personalized modification are realized.
Patent Information
- Application Number
- CN202311532037.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-16
- Publication Date
- 2025-05-16
AI Technical Summary
In the prior art, a large amount of code is required to be written when designing a user interface, resulting in low readability of the code and thus reducing design efficiency.
By obtaining the nested relationship between the target interface elements, an element layout structure tree is generated, and user operation information is received. Based on this information, the layout structure tree is operated to generate the target structure tree.
Improve the efficiency of user interface design, and personalize the target interface by intuitively modifying the element layout structure tree without modifying the code.
Smart Images
Figure CN120012718A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of Internet technology, and in particular to an information determination method, device, equipment and computer-readable storage medium. Background Art
[0002] A user interface (UI) is a visual interface for users to interact with software, applications, websites or other digital products. In the prior art, users are usually required to design a UI layout by writing a large amount of code. However, during the implementation process, the inventors found that the prior art has at least the following problems: since professional knowledge is required to understand the code, the readability of the code is low, which reduces the efficiency of designing the user interface. Summary of the invention
[0003] To solve the above technical problems, the embodiments of the present application hope to provide an information determination method, apparatus, device and computer-readable storage medium, which can solve the problem of low readability of codes in related technologies, resulting in reduced efficiency in designing user interfaces.
[0004] The technical solution of this application is implemented as follows:
[0005] A method for determining information, the method comprising:
[0006] Get the nested relationship between elements used to generate the target interface;
[0007] Based on the nested relationship, generating an element layout structure tree for the element;
[0008] The operation information of the user on the element layout structure tree is received, and the element layout structure tree is operated based on the operation information to generate a target structure tree.
[0009] In the above solution, generating an element layout structure tree for the element based on the nested relationship includes:
[0010] Determine a first corresponding relationship between the target interface and the root node, and determine a second corresponding relationship between the element and the child node;
[0011] Determine a hierarchical relationship between the second corresponding relationships based on the nested relationship;
[0012] The element layout structure tree is constructed based on the hierarchical relationship, the first corresponding relationship, and the second corresponding relationship.
[0013] In the above scheme, the receiving of the user's operation information on the element layout structure tree, and operating the layout structure tree based on the operation information to generate a target structure tree includes:
[0014] receiving first operation information for the element layout structure tree input by the user in a first input mode; wherein the first input mode is a mode of inputting through an input component; and the operation information includes the first operation information;
[0015] A language processing model is used to operate the element layout structure tree based on the first operation information to generate the target structure tree.
[0016] In the above solution, the language processing model is used to operate the element layout structure tree based on the first operation information to generate the target structure tree, including:
[0017] The first operation information is processed using a target text generation model to generate an operation instruction for the element layout structure tree; wherein the language processing model includes the target text generation model;
[0018] The element layout structure tree is operated based on the operation instruction to generate the target structure tree.
[0019] In the above solution, the target text generation model is used to process the first operation information to generate an operation instruction for the element layout structure tree, including:
[0020] Using the target text generation model, the first operation information is parsed to obtain a first operation element and a first operation to be performed for the first operation element;
[0021] Using the target text generation model, based on the first operation to be executed, determine a target instruction template matching the first operation to be executed from a plurality of instruction templates;
[0022] The target text generation model is adopted to generate the operation instruction based on the first operation element, the first operation to be performed and the target instruction template.
[0023] In the above scheme, the receiving of the user's operation information on the element layout structure tree, and operating the element layout structure tree based on the operation information to generate a target structure tree includes:
[0024] receiving second operation information for the element layout structure tree input by the user in a second input mode; wherein the operation information includes the second operation information;
[0025] The element layout structure tree is operated based on the second operation information to generate the target structure tree.
[0026] In the above solution, the step of operating the element layout structure tree based on the second operation information to generate the target structure tree includes:
[0027] Identify the second operation information to obtain a second operation element and a second operation to be performed for the second operation element;
[0028] The second operation element is operated based on the second operation to be performed to generate the target structure tree.
[0029] In the above solution, the step of operating the second operation element based on the second operation to be performed to generate the target structure tree includes:
[0030] operating the second operation element based on the second operation to be performed;
[0031] generating a preview image of the element layout structure tree after the operation is performed on the second operation element, and outputting the preview image;
[0032] receiving feedback information from the user regarding the preview image;
[0033] The target structure tree is generated based on the feedback information and the element layout structure tree after the operation.
[0034] In the above solution, the information determination method further includes:
[0035] Parsing the target structure tree to obtain the layout of the elements in the target structure tree;
[0036] Based on the layout of the elements, programming information describing the layout of the elements is generated.
[0037] An information determination device, the device comprising:
[0038] An acquisition unit, used for acquiring the nested relationship between elements used to generate a target interface;
[0039] A generating unit, configured to generate an element layout structure tree for the element based on the nested relationship;
[0040] The processing unit is used to receive operation information of the user on the element layout structure tree, and operate the element layout structure tree based on the operation information to generate a target structure tree.
[0041] An information determination device, the device comprising: a processor, a memory, and a communication bus;
[0042] The communication bus is used to realize the communication connection between the processor and the memory;
[0043] The processor is used to execute the information determination program stored in the memory to implement the steps of the above-mentioned information determination method.
[0044] A computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the information determination method as described above.
[0045] Because the nested relationship between the elements used to generate the target interface is obtained, and then the element layout structure tree for the elements is generated based on the nested relationship, so that the layout structure of the elements in the target interface can be clearly and intuitively understood, and the element layout structure tree is generated according to the nested relationship between the elements, rather than being implemented by writing code; then the user's operation information on the element layout structure tree is received, and the element layout structure tree is operated based on the operation information to generate a target structure tree, so that the element layout structure tree can be personalized according to the user's different operation information to achieve personalized design of the target structure tree, and at the same time, the target interface is modified by intuitively modifying the element layout structure tree instead of modifying the target interface by modifying the code, thereby improving the efficiency of personalized design of the target interface. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Figure 1 A flowchart of an information determination method provided in an embodiment of the present application;
[0047] Figure 2 A flowchart of another information determination method provided in an embodiment of the present application;
[0048] Figure 3 A flowchart of another information determination method provided in an embodiment of the present application;
[0049] Figure 4 A schematic diagram of the structure of an information determination device provided in an embodiment of the present application;
[0050] Figure 5 A schematic diagram of the structure of an information determination device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0051] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.
[0052] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0053] The present application embodiment provides an information determination method, which can be applied to an information determination device, referring to Figure 1As shown, the method comprises the following steps:
[0054] Step 101: Obtain the nested relationship between elements used to generate a target interface.
[0055] In an embodiment of the present application, the target interface may be composed of multiple different elements; the links between multiple elements represent the nested relationship between the elements; the elements used to generate the target interface and the nested relationship between the elements may be obtained through the interface design module; in a feasible implementation method, the target interface may refer to a UI interface, and the element may refer to a module or control for generating the target interface.
[0056] Step 102: Generate an element layout structure tree for the element based on the nested relationship.
[0057] In an embodiment of the present application, the element layout structure tree may refer to a structure that represents the layout between elements in the generated target interface in a tree-like form; the root node and the child nodes may be determined first, and then the hierarchical relationship between the child nodes may be determined based on the nested relationship, and then the element layout structure tree for the element may be constructed based on the hierarchical relationship, the root node and the child nodes; in a feasible implementation method, the element layout structure tree may refer to a tree structure with a mind map of elements.
[0058] Step 103: Receive operation information of the user on the element layout structure tree, and operate the element layout structure tree based on the operation information to generate a target structure tree.
[0059] In an embodiment of the present application, operation information may refer to information for modifying an element layout structure tree, a target structure tree may refer to information obtained after modifying the element layout structure tree based on the user's operation information, and operating the element layout structure tree based on the operation information may refer to operating an element in the element layout structure tree based on the operation information; a user may input operation information through a first input method or through a second input method, that is, operation information for the element layout structure tree input by a user through different input methods may be received, and after receiving the operation information input by the user, the operation information may be analyzed to determine the operation element and the operation to be performed on the operation element, and the operation element may be operated based on the operation to be performed, thereby updating the element layout structure tree to obtain the target structure tree.
[0060] The information determination method provided in the embodiment of the present application generates an element layout structure tree for the elements of the target interface, so the layout structure of the elements in the target interface can be clearly and intuitively understood, and the element layout structure tree is generated based on the nested relationship between the elements, and is not implemented based on the written code. At the same time, the element layout structure tree can be personalized and modified according to the different operation information of the user to achieve personalized design, and the target interface is modified by directly modifying the element layout structure tree instead of modifying the target interface by modifying the written code, thereby improving the efficiency of personalized design of the target interface.
[0061] Based on the above embodiments, the present application provides an information determination method, referring to Figure 2 As shown, the method comprises the following steps:
[0062] Step 201: The information determination device obtains the nested relationship between elements used to generate the target interface.
[0063] Step 202: The information determination device determines a first corresponding relationship between the target interface and the root node, and determines a second corresponding relationship between the element and the child node.
[0064] In an embodiment of the present application, the first corresponding relationship refers to the corresponding relationship between the target interface and the root node, and the second corresponding relationship refers to the corresponding relationship between the element and the child node; and the root node represents the entire target interface, the child node represents the element (ie, module or control), and one element corresponds to one child node, that is, each child node represents an element.
[0065] Step 203: The information determination device determines the hierarchical relationship between the second corresponding relationships based on the nested relationship.
[0066] In an embodiment of the present application, the hierarchical relationship may refer to the connection relationship between sub-nodes corresponding to multiple second corresponding relationships; the nested relationship between the elements generating the target interface may be analyzed to determine the hierarchical relationship between the sub-nodes (i.e., elements); specifically, in the case of two layers of nested relationships, the sub-nodes (i.e., elements) located in the first layer of the nested relationship are the first layer, and the sub-nodes located in the second layer of the nested relationship are the second layer, thereby determining the hierarchical relationship between the sub-nodes in turn.
[0067] Step 204: The information determination device constructs an element layout structure tree based on the hierarchical relationship, the first corresponding relationship, and the second corresponding relationship.
[0068] In the embodiment of the present application, the hierarchical relationship may be used as the edge of the element layout structure tree, and then combined with the first corresponding relationship and the second corresponding relationship to construct the element layout structure tree.
[0069] It should be noted that after step 204, steps 205 to 206 may be performed, or steps 207 to 208 may be performed;
[0070] Step 205: The information determination device receives first operation information for the element layout structure tree input by the user in a first input manner.
[0071] Among them, the first input method is a method of inputting through an input component; and the operation information includes first operation information.
[0072] In an embodiment of the present application, the input component may refer to a component for inputting first operation information; the first operation information may refer to operation information input by the user through the input component, and the first operation information may represent the user's modification requirements for the element layout structure tree, and the first operation information may include the first operation element and the operation to be performed for the first operation element; the first operation information for the element layout structure tree input by the user using the input component can be received in real time through the chat robot module, so that through the chat robot module, the user can directly input his own needs in the conversation, thereby providing an intuitive and natural way of interaction between the user and the machine, simplifying the UI design process.
[0073] In a feasible implementation, the input component may refer to a text input component, or may refer to a voice input component, that is, the user may input the first operation information by voice through the voice input component, or may input the first operation information by text through the text input component; the first operation information may refer to information for adding or deleting a node, or may refer to information for modifying relevant description information of the node. Specifically, the user may input "add a white background color (i.e., the first operation information) to a subnode marked as a "Submit" button" through the text input component.
[0074] Step 206: The information determination device uses a language processing model to operate the element layout structure tree based on the first operation information to generate a target structure tree.
[0075] In an embodiment of the present application, a language processing model can be set in a chat robot module, and the language processing model can refer to a model in the field of natural language processing that can implement natural language processing tasks; the language processing model can first be used to generate operation instructions for operating an element layout structure tree based on first operation information, and then the element layout structure tree is operated based on the operation instructions to generate a target structure tree.
[0076] It should be noted that step 206 can be implemented in the following ways:
[0077] Step 206a1: The information determination device processes the first operation information using a target text generation model to generate an operation instruction for the element layout structure tree.
[0078] Among them, the language processing model includes a target text generation model.
[0079] In an embodiment of the present application, the first operation information provided by the user is parsed by the target text generation model, and an instruction template matching the first operation information is determined from multiple instruction templates based on the parsing result, and then an operation instruction for the element layout structure tree is generated based on the instruction template and the first operation information.
[0080] In a feasible implementation, the target text generation model may refer to a generative pre-trained Transformer model (GPT), and the target text generation model may specifically be GPT-1, GPT-2, GPT-3, or GPT-4.
[0081] Step 206a2: The information determination device operates the element layout structure tree based on the operation instruction to generate a target structure tree.
[0082] In the embodiment of the present application, the element layout structure tree can be automatically operated based on the operation instruction, so as to achieve the required modification of the layout of the UI interface, thereby generating a target structure tree adapted to its own needs.
[0083] Step 207: The information determination device receives second operation information for the element layout structure tree input by the user in a second input manner.
[0084] The operation information includes second operation information.
[0085] In an embodiment of the present application, the second operation information is information input using a second input method; and the second input method may be a method in which a user directly inputs information after performing an operation on a user operation interface; in a feasible implementation method, a user may input operation information through gesture operations such as dragging, zooming, etc. on the user operation interface; in a feasible implementation method, the second operation information may refer to information for modifying the position of a node in an element layout structure tree.
[0086] Step 208: The information determination device operates the element layout structure tree based on the second operation information to generate a target structure tree.
[0087] In the embodiment of the present application, the element layout structure tree can be operated based on the second operation information through the identification module and the processing module to generate a target structure tree.
[0088] It should be noted that step 208 can be implemented in the following ways:
[0089] Step 208b1: The information determination device identifies the second operation information to obtain a second operation element and a second operation to be performed for the second operation element.
[0090] In an embodiment of the present application, an identification module can be used to identify the second operation information input by the user to identify the operation element that the user wants to operate and the operation to be performed on the operation element; in a feasible implementation method, when the user performs gesture operations such as dragging, zooming, etc. on the user operation interface, the user's gesture operation can be identified to determine the operation element that the user wants to operate and the operation to be performed on the operation element.
[0091] Step 208b2: The information determination device operates the second operation element based on the second operation to be performed to generate a target structure tree.
[0092] In an embodiment of the present application, the processing module can perform a second operation to be executed on the second operation element, that is, the processing module responds to the user's gesture operations such as dragging, zooming, etc. on the user operation interface, and adjusts the nodes in the element layout structure tree in real time, thereby automatically modifying the UI layout.
[0093] In a feasible implementation, if you need to create a UI interface with a dialog box on the left and a product distribution display on the right through the second input method, you can use a mind map to design it according to the following steps: 1. Create a root node (i.e., UI interface) of the mind map; 2. Create two sub-nodes under the root node, representing the dialog box on the left and the product display on the right; 3. Under the sub-node of the dialog box on the left, further add nodes (for example, chat history, input box, and send button) to represent different dialog modules. And each node can set more detailed information (such as font style, position, etc.). 4. Under the sub-node of the product display on the right, further add nodes (such as product pictures, titles, prices, etc.) to represent the display modules of each product; 5. Through the mind map, you can clearly see the structure of the UI interface, and you can intuitively modify and adjust the position, style, and interaction of each module, and you can use the gesture drag function to adjust the node in the mind map to the desired position, and it can be reflected in real time on the UI interface.
[0094] The information determination method provided in the embodiment of the present application generates an element layout structure tree for the elements of the target interface, so the layout structure of the elements in the target interface can be clearly and intuitively understood, and the element layout structure tree is generated based on the nested relationship between the elements, and is not implemented based on the written code. At the same time, the element layout structure tree can be personalized and modified according to the different operation information of the user to achieve personalized design, and the target interface is modified by directly modifying the element layout structure tree instead of modifying the target interface by modifying the written code, thereby improving the efficiency of personalized design of the target interface.
[0095] Based on the above embodiments, the present application provides an information determination method, referring to Figure 3 As shown, the method comprises the following steps:
[0096] Step 301: The information determination device obtains the nested relationship between elements used to generate a target interface.
[0097] Step 302: The information determination device determines a first corresponding relationship between the target interface and the root node, and determines a second corresponding relationship between the element and the child node.
[0098] Step 303: The information determination device determines the hierarchical relationship between the second corresponding relationships based on the nested relationship.
[0099] Step 304: The information determination device constructs an element layout structure tree based on the hierarchical relationship, the first corresponding relationship, and the second corresponding relationship.
[0100] It should be noted that after step 304, steps 305 to 309 may be performed, or steps 310 to 315 may be performed;
[0101] Step 305: The information determination device receives first operation information for the element layout structure tree input by the user in a first input manner.
[0102] Among them, the first input method is a method of inputting through an input component; and the operation information includes first operation information.
[0103] Step 306: The information determination device uses the target text generation model to parse the first operation information to obtain a first operation element and a first operation to be performed for the first operation element.
[0104] In an embodiment of the present application, the first operation element refers to the operation element included in the first operation information, and the first to-be-performed operation refers to the to-be-performed operation for the first operation element included in the first operation information; the target text generation model can be used to obtain the first operation element and the first to-be-performed operation for the first operation element from the first operation information; in a feasible implementation method, when the first operation information is "add a white background color to a child node of a "submit button"", and the target text generation model is GPT, then GPT can be used to determine that the first operation element is the "submit button" and the first to-be-performed operation is "add a white background color".
[0105] It should be noted that before the user interacts with GPT, the user can pre-set some pre-content, such as the name and identity (ID) of each button, the color value corresponding to each color, and a list of instruction templates; specifically, the user can set the button name to "Submit button" and the corresponding ID to "submit_button", set the white color value to "#FFFFFF", and set the red color value to "#FF0000", multiple instruction templates can be [Template 1, Template 2, Template 3], and the functions corresponding to multiple instruction templates are [Function 1, Function 2, Function 3].
[0106] Step 307: The information determination device adopts a target text generation model to determine a target instruction template matching the first operation to be executed from multiple instruction templates based on the first operation to be executed.
[0107] In an embodiment of the present application, the target instruction template may refer to a template that can implement the function of the first operation to be executed; different instruction templates correspond to different functions, that is, different instruction templates can implement different functions. Therefore, the target text generation model can be used to parse the first operation to be executed, determine the function to be implemented by the first operation to be executed, and then select the target instruction template that matches the first operation to be executed from multiple instruction templates.
[0108] In a feasible implementation, when the first operation to be executed is "adding a white background color" and Template 2 is a template that can implement a color function, the target instruction template can be determined as Template 2 from the instruction template list through the target text generation model.
[0109] Step 308: The information determination device uses a target text generation model to generate an operation instruction based on the first operation element, the first operation to be performed, and the target instruction template.
[0110] In an embodiment of the present application, a target text generation model may be used to fill the first operation element and the first operation to be performed into a target instruction template to generate an operation instruction.
[0111] In a feasible implementation method, the target text generation model (i.e., chatbot technology) generates operation instructions according to the target instruction template, and then finds the button name of the node corresponding to the mind map as "Submit button" according to the operation instructions, and automatically sets the background color of the Submit button to white. The white color value can then be filled in the description file of the UI interface so that the Submit button has the required style and function.
[0112] Step 309: The information determination device operates the element layout structure tree based on the operation instruction to generate a target structure tree.
[0113] Step 310: The information determination device receives second operation information for the element layout structure tree input by the user using a second input method.
[0114] The operation information includes second operation information.
[0115] Step 311: The information determination device identifies the second operation information to obtain a second operation element and a second operation to be performed for the second operation element.
[0116] Step 312: The information determination device operates the second operation element based on the second operation to be performed.
[0117] Step 313: The information determination device generates a preview image of the element layout structure tree after the operation is performed on the second operation element, and outputs the preview image.
[0118] In an embodiment of the present application, after operating the second operation element based on the second operation to be executed, a preview image of the element layout structure tree after the operation obtained after the operation on the second operation element in the element layout structure tree can be generated, and after the preview image of the element layout structure tree after the operation is generated, the preview image can be output and displayed to the user in real time, so that the user can determine the element layout structure tree after the operation displayed in the preview image. In this way, the function of reflecting UI layout changes in real time is realized.
[0119] Step 314: The information determination device receives user feedback information regarding the preview image.
[0120] In an embodiment of the present application, feedback information may refer to the user's reply information to the preview image; when the preview image is consistent with the user's needs (i.e., the second operation information), the user can directly click "Confirm"; when the preview image is inconsistent with the user's needs (i.e., the second operation information), the user can click "Re-modify".
[0121] Step 315: The information determination device generates a target structure tree based on the feedback information and the element layout structure tree after the operation.
[0122] In an embodiment of the present application, when the received feedback information is "confirmation", the element layout structure tree after the operation corresponding to the preview image can be directly determined as the target structure tree; when the received feedback information is "re-modification", the first operation information input by the user using the first input method can be re-received to update the element layout structure tree after the operation according to the first operation information to generate a target structure tree.
[0123] It should be noted that the above embodiment may further include the following steps:
[0124] Step 316: The information determination device parses the target structure tree to obtain the layout of the elements in the target structure tree.
[0125] In the embodiment of the present application, a code conversion tool may be used to parse the target structure tree to obtain the layout of elements in the target structure tree.
[0126] Step 317: The information determination device generates programming information describing the layout of the elements based on the layout of the elements.
[0127] In an embodiment of the present application, after obtaining the layout of the elements in the target structure tree, a conversion tool can be used to automatically convert the modified element layout structure tree into corresponding programming information (i.e., code), and the programming information includes at least Hyper Text Markup Language (HTML), Cascading Style Sheets (CSS) and scripting language (i.e., JavaScript), so that the generated UI layout code has high readability and maintainability.
[0128] The information determination method provided in the embodiment of the present application generates an element layout structure tree for the elements of the target interface, so the layout structure of the elements in the target interface can be clearly and intuitively understood, and the element layout structure tree is generated based on the nested relationship between the elements, and is not implemented based on the written code. At the same time, the element layout structure tree can be personalized and modified according to the different operation information of the user to achieve personalized design, and the target interface is modified by directly modifying the element layout structure tree instead of modifying the target interface by modifying the written code, thereby improving the efficiency of personalized design of the target interface.
[0129] Based on the above embodiments, the embodiments of the present application provide an information determination device, which can be applied to Figure 1 , Figure 2 and Figure 3 In the information determination method provided in the corresponding embodiment, refer to Figure 4As shown, the information determination device 4 may include: an acquisition unit 41, a generation unit 42 and a processing unit 43, wherein:
[0130] An acquisition unit 41 is used to acquire the nested relationship between elements used to generate a target interface;
[0131] A generating unit 42, configured to generate an element layout structure tree for the element based on the nested relationship;
[0132] The processing unit 43 is used to receive operation information of the user on the element layout structure tree, and operate the element layout structure tree based on the operation information to generate a target structure tree.
[0133] In other embodiments of the present application, the generating unit 42 is further configured to perform the following steps:
[0134] Determine a first correspondence between the target interface and the root node, and determine a second correspondence between the element and the child node;
[0135] Determine the hierarchical relationship between the second corresponding relationships based on the nested relationship;
[0136] Based on the hierarchical relationship, the first correspondence relationship and the second correspondence relationship, an element layout structure tree is constructed.
[0137] In other embodiments of the present application, the processing unit 43 is further configured to perform the following steps:
[0138] Receiving first operation information for the element layout structure tree input by a user using a first input method; wherein the first input method is a method of inputting through an input component; and the operation information includes the first operation information;
[0139] The language processing model is used to operate the element layout structure tree based on the first operation information to generate a target structure tree.
[0140] In other embodiments of the present application, the processing unit 43 is further configured to perform the following steps:
[0141] The first operation information is processed using a target text generation model to generate an operation instruction for the element layout structure tree; wherein the language processing model includes a target text generation model;
[0142] The element layout structure tree is operated based on the operation instruction to generate a target structure tree.
[0143] In other embodiments of the present application, the processing unit 43 is further configured to perform the following steps:
[0144] Using a target text generation model, the first operation information is parsed to obtain a first operation element and a first operation to be performed for the first operation element;
[0145] Using a target text generation model, based on the first operation to be executed, determine a target instruction template matching the first operation to be executed from a plurality of instruction templates;
[0146] A target text generation model is adopted to generate an operation instruction based on the first operation element, the first operation to be performed and the target instruction template.
[0147] In other embodiments of the present application, the processing unit 43 is further configured to perform the following steps:
[0148] Receiving second operation information for the element layout structure tree input by the user using a second input method; wherein the operation information includes the second operation information;
[0149] The element layout structure tree is operated based on the second operation information to generate a target structure tree.
[0150] In other embodiments of the present application, the processing unit 43 is further configured to perform the following steps:
[0151] Identify the second operation information to obtain a second operation element and a second operation to be performed for the second operation element;
[0152] The second operation element is operated based on the second operation to be performed to generate a target structure tree.
[0153] In other embodiments of the present application, the processing unit 43 is further configured to perform the following steps:
[0154] operating the second operation element based on the second operation to be performed;
[0155] generating a preview image of the element layout structure tree after the operation is performed on the second operation element, and outputting the preview image;
[0156] receiving user feedback information regarding the preview image;
[0157] Generate a target structure tree based on the feedback information and the element layout structure tree after the operation.
[0158] In other embodiments of the present application, the processing unit 43 is further configured to perform the following steps:
[0159] Parse the target structure tree to obtain the layout of elements in the target structure tree;
[0160] Based on the layout of the elements, programming information describing the layout of the elements is generated.
[0161] It should be noted that the specific implementation process of the steps performed by each unit in this embodiment can refer to Figure 1 , Figure 2 and Figure 3The implementation process of the information determination method provided in the corresponding embodiment will not be repeated here.
[0162] The information determination device provided in the embodiment of the present application generates an element layout structure tree for the elements of the target interface, so the layout structure of the elements in the target interface can be clearly and intuitively understood, and the element layout structure tree is generated based on the nested relationship between the elements, and is not implemented based on the written code. At the same time, the element layout structure tree can be personalized and modified according to the different operation information of the user to achieve personalized design, and the target interface is modified by directly modifying the element layout structure tree instead of modifying the target interface by modifying the written code, thereby improving the efficiency of personalized design of the target interface.
[0163] Based on the above embodiments, the embodiments of the present application provide an information determination device, which can be applied to Figure 1 , Figure 2 and Figure 3 The information determination method provided in the corresponding embodiment is referred to Figure 5 As shown, the information determination device 5 may include a processor 51, a memory 52 and a communication bus 53;
[0164] The communication bus 53 is used to realize the communication connection between the processor 51 and the memory 52;
[0165] The processor 51 is used to execute the information determination program stored in the memory 52 to implement the following steps:
[0166] Get the nested relationship between elements used to generate the target interface;
[0167] Generate an element layout structure tree for the element based on the nested relationship;
[0168] Receive user operation information on the element layout structure tree, and operate the element layout structure tree based on the operation information to generate a target structure tree.
[0169] In other embodiments of the present application, the processor 51 is used to execute the memory 52 to generate an element layout structure tree for the element based on the nested relationship, so as to implement the following steps:
[0170] Determine a first correspondence between the target interface and the root node, and determine a second correspondence between the element and the child node;
[0171] Determine the hierarchical relationship between the second corresponding relationships based on the nested relationship;
[0172] Based on the hierarchical relationship, the first correspondence relationship and the second correspondence relationship, an element layout structure tree is constructed.
[0173] In other embodiments of the present application, the processor 51 is used to execute the memory 52 to receive the user's operation information on the element layout structure tree, and operate the layout structure tree based on the operation information to generate a target structure tree, so as to implement the following steps:
[0174] Receiving first operation information for the element layout structure tree input by a user using a first input method; wherein the first input method is a method of inputting through an input component; and the operation information includes the first operation information;
[0175] The language processing model is used to operate the element layout structure tree based on the first operation information to generate a target structure tree.
[0176] In other embodiments of the present application, the processor 51 is used to execute the language processing model in the memory 52, operate the element layout structure tree based on the first operation information, and generate a target structure tree to implement the following steps:
[0177] The first operation information is processed using a target text generation model to generate an operation instruction for the element layout structure tree; wherein the language processing model includes a target text generation model;
[0178] The element layout structure tree is operated based on the operation instruction to generate a target structure tree.
[0179] In other embodiments of the present application, the processor 51 is used to execute the process of using the target text generation model in the memory 52 to process the first operation information and generate an operation instruction for the element layout structure tree to implement the following steps:
[0180] Using a target text generation model, the first operation information is parsed to obtain a first operation element and a first operation to be performed for the first operation element;
[0181] Using a target text generation model, based on the first operation to be executed, determine a target instruction template matching the first operation to be executed from a plurality of instruction templates;
[0182] A target text generation model is adopted to generate an operation instruction based on the first operation element, the first operation to be performed and the target instruction template.
[0183] In other embodiments of the present application, the processor 51 is used to execute the memory 52 to receive the user's operation information on the element layout structure tree, and operate the element layout structure tree based on the operation information to generate a target structure tree, so as to implement the following steps:
[0184] Receiving second operation information for the element layout structure tree input by the user using a second input method; wherein the operation information includes the second operation information;
[0185] The element layout structure tree is operated based on the second operation information to generate a target structure tree.
[0186] In other embodiments of the present application, the processor 51 is used to execute the operation on the element layout structure tree based on the second operation information in the memory 52 to generate a target structure tree, so as to implement the following steps:
[0187] Identify the second operation information to obtain a second operation element and a second operation to be performed for the second operation element;
[0188] The second operation element is operated based on the second operation to be performed to generate a target structure tree.
[0189] In other embodiments of the present application, the processor 51 is used to execute the operation on the second operation element based on the second operation to be performed in the memory 52 to generate a target structure tree, so as to implement the following steps:
[0190] operating the second operation element based on the second operation to be performed;
[0191] generating a preview image of the element layout structure tree after the operation is performed on the second operation element, and outputting the preview image;
[0192] receiving user feedback information regarding the preview image;
[0193] Generate a target structure tree based on the feedback information and the element layout structure tree after the operation.
[0194] In other embodiments of the present application, the processor 51 is used to execute the information determination program stored in the memory 52 to implement the following steps:
[0195] Parse the target structure tree to obtain the layout of elements in the target structure tree;
[0196] Based on the layout of the elements, programming information describing the layout of the elements is generated.
[0197] It should be noted that the specific implementation process of the steps executed by the processor in this embodiment can refer to Figure 1 , Figure 2 and Figure 3 The implementation process of the information determination method provided in the corresponding embodiment will not be repeated here.
[0198] The information determination device provided in the embodiment of the present application generates an element layout structure tree for the elements of the target interface, so the layout structure of the elements in the target interface can be clearly and intuitively understood, and the element layout structure tree is generated based on the nested relationship between the elements, and is not implemented based on the written code. At the same time, the element layout structure tree can be personalized and modified according to the different operation information of the user to achieve personalized design, and the target interface is modified by directly modifying the element layout structure tree instead of modifying the target interface by modifying the written code, thereby improving the efficiency of personalized design of the target interface.
[0199] Based on the foregoing embodiments, the embodiments of the present application provide a computer-readable storage medium, which stores one or more programs, and the one or more programs can be executed by one or more processors to implement Figure 1 , Figure 2 and Figure 3 The corresponding embodiments provide information to determine the steps in the method.
[0200] It should be noted that the above-mentioned computer-readable storage medium can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM) and other memories; it can also be various electronic devices including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.
[0201] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.
[0202] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0203] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0204] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products of the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0205] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0206] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0207] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A method for determining information, characterized in that: The method comprises: Get the nested relationship between elements used to generate the target interface; Based on the nested relationship, generating an element layout structure tree for the element; The operation information of the user on the element layout structure tree is received, and the element layout structure tree is operated based on the operation information to generate a target structure tree.
2. The method according to claim 1, characterized in that The step of generating an element layout structure tree for the element based on the nested relationship includes: Determine a first corresponding relationship between the target interface and the root node, and determine a second corresponding relationship between the element and the child node; Determine a hierarchical relationship between the second corresponding relationships based on the nested relationship; The element layout structure tree is constructed based on the hierarchical relationship, the first corresponding relationship, and the second corresponding relationship.
3. The method according to claim 1, characterized in that The receiving operation information of the user on the element layout structure tree, and operating the layout structure tree based on the operation information to generate a target structure tree includes: receiving first operation information for the element layout structure tree input by the user in a first input mode; wherein the first input mode is a mode of inputting through an input component; and the operation information includes the first operation information; A language processing model is used to operate the element layout structure tree based on the first operation information to generate the target structure tree.
4. The method according to claim 3, characterized in that The adopting the language processing model to operate the element layout structure tree based on the first operation information to generate the target structure tree includes: The first operation information is processed using a target text generation model to generate an operation instruction for the element layout structure tree; wherein the language processing model includes the target text generation model; The element layout structure tree is operated based on the operation instruction to generate the target structure tree.
5. The method according to claim 4, characterized in that The adopting the target text generation model to process the first operation information to generate an operation instruction for the element layout structure tree includes: Using the target text generation model, the first operation information is parsed to obtain a first operation element and a first operation to be performed for the first operation element; Using the target text generation model, based on the first operation to be executed, determine a target instruction template matching the first operation to be executed from a plurality of instruction templates; The target text generation model is adopted to generate the operation instruction based on the first operation element, the first operation to be performed and the target instruction template.
6. The method according to claim 1, characterized in that The receiving operation information of the user on the element layout structure tree, and operating the element layout structure tree based on the operation information to generate a target structure tree includes: receiving second operation information for the element layout structure tree input by the user in a second input mode; wherein the operation information includes the second operation information; The element layout structure tree is operated based on the second operation information to generate the target structure tree.
7. The method according to claim 6, characterized in that The operating the element layout structure tree based on the second operation information to generate the target structure tree includes: Identify the second operation information to obtain a second operation element and a second operation to be performed for the second operation element; The second operation element is operated based on the second operation to be performed to generate the target structure tree.
8. The method according to claim 7, characterized in that The step of operating the second operation element based on the second operation to be performed to generate the target structure tree includes: operating the second operation element based on the second operation to be performed; generating a preview image of the element layout structure tree after the operation is performed on the second operation element, and outputting the preview image; receiving feedback information from the user regarding the preview image; The target structure tree is generated based on the feedback information and the element layout structure tree after the operation.
9. The method according to claim 1, characterized in that: The method further comprises: Parsing the target structure tree to obtain the layout of the elements in the target structure tree; Based on the layout of the elements, programming information describing the layout of the elements is generated.
10. An information determination device, characterized in that: The device comprises: An acquisition unit, used for acquiring the nested relationship between elements used to generate a target interface; A generating unit, configured to generate an element layout structure tree for the element based on the nested relationship; The processing unit is used to receive operation information of the user on the element layout structure tree, and operate the element layout structure tree based on the operation information to generate a target structure tree.
11. An information determination device, characterized in that: The device comprises: a processor, a memory and a communication bus; The communication bus is used to realize the communication connection between the processor and the memory; The processor is used to execute the information determination program stored in the memory to implement the steps of the information determination method according to any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the information determination method according to any one of claims 1 to 9.