Model generation method and apparatus, electronic device, and storage medium
Through the dragged WYSIWYG model generation method, the component library is used for assembled modeling, which solves the high threshold problem based on code modeling, and improves the ease of use and efficiency of machine learning modeling.
Patent Information
- Application Number
- PCT/CN2024/093183
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-27
- Filing Date
- 2024-05-14
- Publication Date
- 2025-01-02
AI Technical Summary
Code-based machine learning modeling has a high modeling technology barrier, and cannot meet the needs of fast and efficient modeling, which hinders the application of machine learning in fields such as intelligent manufacturing.
The drag-type WYSIWYG model generation method is adopted. Through a preset component library, modelers can perform assembled modeling based on configurable rich components, and generate target models in response to component drag and connection instructions.
It greatly improves the ease of use of machine learning modeling human-computer interaction, lowers the technical threshold, and improves modeling efficiency and convenience.
Smart Images

Figure CN2024093183_02012025_PF_FP_ABST
Abstract
Description
Model generation method, device, electronic device and storage medium Technical Field
[0001] The present disclosure relates to the field of artificial intelligence technology, in particular to the field of machine learning and front-end technology, and specifically to a model generation method, device, electronic device and storage medium. Background Art
[0002] With the rapid development of machine learning technology, machine learning models have been widely applied in various fields of life and production. In particular, they have played a vital role in intelligent manufacturing. However, code-based machine learning modeling approaches have high technical requirements and cannot meet the requirements for fast and efficient modeling, which has significantly hindered the industry application of machine learning.
[0003] Summary of the Invention
[0004] In view of this, the present disclosure provides a model generation method, apparatus, electronic device, readable storage medium, and computer program product.
[0005] One aspect of the present disclosure provides a model generation method, comprising: in response to a component dragging instruction, obtaining a functional text block of each of a plurality of model components related to the component dragging instruction; in response to a component connection instruction, generating a plurality of connection text blocks, wherein the connection text blocks represent a connection relationship between at least two of the model components; and generating a target model based on the plurality of functional text blocks and the plurality of connection text blocks.
[0006] Another aspect of the present disclosure provides a model generation device, including: an acquisition module, used to obtain, in response to a component drag instruction, a functional text block of each of multiple model components related to the above-mentioned component drag instruction; a first generation module, used to generate, in response to a component connection instruction, a plurality of connection text blocks, wherein the above-mentioned connection text blocks represent the connection relationship between at least two of the above-mentioned model components; and a second generation module, used to generate a target model based on the above-mentioned plurality of functional text blocks and the above-mentioned plurality of connection text blocks.
[0007] Another aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more instructions, wherein when the one or more instructions are executed by the one or more processors, the one or more processors implement the method described above.
[0008] Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the above method when executed.
[0009] Another aspect of the present disclosure provides a computer program product, which includes computer-executable instructions. When the instructions are executed, they are used to implement the method described above.
[0010] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:
[0012] FIG1 schematically shows an exemplary system architecture to which the model generation method and apparatus according to an embodiment of the present disclosure can be applied.
[0013] FIG2 schematically shows a flow chart of a model generation method according to an embodiment of the present disclosure.
[0014] FIG3 schematically shows a schematic diagram of a main interface according to an embodiment of the present disclosure.
[0015] FIG4 schematically shows a flow chart of generating a component pattern on a main interface according to an embodiment of the present disclosure.
[0016] FIG5 schematically shows a schematic diagram of a configuration sub-interface according to an embodiment of the present disclosure.
[0017] FIG6 schematically shows a schematic diagram of a process of generating directed edges between component patterns on a main interface according to an embodiment of the present disclosure.
[0018] FIG7 schematically shows a diagram of a computing interface according to an embodiment of the present disclosure.
[0019] FIG8 schematically shows a block diagram of a model generation device according to an embodiment of the present disclosure.
[0020] FIG9 schematically shows a block diagram of an electronic device suitable for implementing a model generation method according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0021] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are merely exemplary and are not intended to limit the scope of the present disclosure. In the detailed description below, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.
[0022] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise," "include," etc. used herein indicate the presence of the features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.
[0023] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.
[0024] When expressions such as "at least one of A, B and C, etc." are used, they should generally be interpreted in accordance with the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).
[0025] With the rapid development of machine learning technology, machine learning models have been widely applied to various fields of life and production. In particular, machine learning models have played an important role in the field of intelligent manufacturing.
[0026] In related technologies, machine learning modeling uses a code-based development approach. However, this code-based machine learning modeling approach has a high modeling technical threshold and cannot meet the needs of fast and efficient modeling, which has brought significant obstacles to the industry application of machine learning.
[0027] In view of this, the embodiments of the present disclosure provide a model generation method, device, electronic device and storage medium. The model generation method adopts a drag-and-drop WYSIWYG method for modeling. Based on a preset component library, it allows modelers to perform assembly-style modeling based on configurable rich components, greatly improving the usability of human-computer interaction in machine learning modeling. Specifically, the model generation method includes: in response to a component drag instruction, obtaining a functional text block of each of multiple model components related to the component drag instruction; in response to a component connection instruction, generating a plurality of connection text blocks, wherein the connection text block represents a connection relationship between at least two model components; and generating a target model based on the plurality of functional text blocks and the plurality of connection text blocks.
[0028] In the embodiments of the present disclosure, the collection, updating, analysis, processing, use, transmission, provision, disclosure, and storage of the data involved (for example, including but not limited to user personal information) all comply with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. In particular, necessary measures are taken with respect to user personal information to prevent unauthorized access to user personal information data and to maintain the security of user personal information, network security, and national security.
[0029] In the embodiments of the present disclosure, the user's authorization or consent is obtained before obtaining or collecting the user's personal information.
[0030] Figure 1 schematically illustrates an exemplary system architecture to which the model generation method and apparatus according to an embodiment of the present disclosure can be applied. It should be noted that Figure 1 is merely an example of a system architecture to which the embodiments of the present disclosure can be applied, to help those skilled in the art understand the technical content of the present disclosure, and does not imply that the embodiments of the present disclosure cannot be applied to other devices, systems, environments, or scenarios.
[0031] As shown in FIG. 1 , the system architecture 100 according to this embodiment may include terminal devices 101 , 102 , 103 , a network 104 and a server 105 .
[0032] The terminal devices 101 , 102 , and 103 may be various electronic devices with display screens, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers, etc. Users can perform human-computer interaction through the terminal devices 101 , 102 , and 103 .
[0033] The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired and / or wireless communication links, etc.
[0034] The server 105 can be a server that provides various services, or a cloud server, etc., which is not limited here.
[0035] It should be noted that the model generation method provided in the embodiment of the present disclosure can generally be executed by the terminal devices 101, 102, and 103. Accordingly, the model generation device provided in the embodiment of the present disclosure can generally be set in the terminal devices 101, 102, and 103.
[0036] For example, the human-computer interaction operations performed by the user on the terminal devices 101, 102, 103 can be translated into computer instructions by the terminal devices 101, 102, 103, and the terminal devices 101, 102, 103 can generate the target model by executing the computer instructions.
[0037] Alternatively, the model generation method provided in the embodiment of the present disclosure may also be executed by the server 105 . Accordingly, the model generation device provided in the embodiment of the present disclosure may generally be provided in the server 105 .
[0038] For another example, the human-computer interaction operations performed by the user on the terminal devices 101, 102, and 103 can be translated into computer instructions by the terminal devices 101, 102, and 103. The computer instructions can be sent by the terminal devices 101, 102, and 103 to the server 105, and the server 105 executes the computer instructions to generate a target model.
[0039] It should be understood that the number of terminal devices, networks, and servers in Figure 1 is merely illustrative and any number of terminal devices, networks, and servers may be provided as required.
[0040] FIG2 schematically shows a flow chart of a model generation method according to an embodiment of the present disclosure.
[0041] As shown in FIG. 2 , the method includes operations S201 to S203 .
[0042] In operation S201 , in response to a component dragging instruction, function text blocks of respective model components related to the component dragging instruction are acquired.
[0043] In operation S202 , a plurality of connection text blocks are generated in response to the component connection instruction.
[0044] In operation S203 , a target model is generated based on the plurality of function text blocks and the plurality of connection text blocks.
[0045] According to an embodiment of the present disclosure, an electronic device may have a display that can display a main interface to a user. The electronic device may also be configured with information input devices such as a mouse and a keyboard. The electronic device may generate device instructions such as component drag instructions and component connection instructions in response to input operations performed by the user using a mouse, keyboard, etc. For example, a user may perform the following drag operation: hold down the left mouse button and move from one position on the main interface to another position, and the electronic device may generate a component drag instruction in response to the operation. For another example, a user may perform the following connection operation: call a connection tool, hold down the left mouse button and move from one pattern on the main interface to another pattern, and the electronic device may generate a component connection instruction in response to the operation.
[0046] According to an embodiment of the present disclosure, a function text block may represent program code that implements the function of the model component. The function text block may be written in different programming languages, including C, JAVA, PYTHON, etc., which are not limited here. The input and output formats of the data in the function text block are not limited here. For example, the output data of the function text block may be in the format of a KV key-value pair, a JSON string, a binary file, etc.
[0047] According to an embodiment of the present disclosure, the multiple model components associated with the component dragging instruction may refer to multiple model components determined by the user from the component library through a dragging operation. When developing a model component, the developer can configure the functional text block of the model component and write it into the resource library. Therefore, after determining the multiple model components, the functional text blocks of the multiple model components can be determined from the resource library. Alternatively, as an optional implementation, the user can also configure the functional text block of the model component by himself. Specifically, the program code input by the user can be injected into the model component by calling the injection instruction related to the model component to use the program code to replace the original functional text block of the model component.
[0048] According to embodiments of the present disclosure, a connection text block may be program code representing a connection relationship. Connection relationships may include input-output relationships, "AND" logical relationships, "OR" logical relationships, and the like, without limitation herein. The connection text block may be written in various programming languages, including C, JAVA, and PYTHON, without limitation herein.
[0049] According to embodiments of the present disclosure, multiple functional text blocks and multiple connection text blocks can be assembled and spliced to generate text blocks of a target model, that is, to obtain a target model. The obtained target model can be output as a text block to facilitate porting to other devices or platforms for model training or application.
[0050] According to the embodiments of the present disclosure, by integrating the various functional modules of the model into model components, when generating the model, the user can select the functional modules to be used by dragging the model components, and then connect multiple model components to determine the logical relationship between the various functional modules, thereby generating the target model. The drag-and-drop and assembly-based model modeling method based on model components can effectively lower the technical threshold of machine learning modeling and improve the efficiency and convenience of machine learning modeling.
[0051] 3 to 7 , the method shown in FIG. 2 will be further described in conjunction with specific embodiments.
[0052] FIG3 schematically shows a schematic diagram of a main interface according to an embodiment of the present disclosure.
[0053] As shown in Figure 3, the main interface can be divided into a first sub-interface 310 and a second sub-interface 320 according to functional areas. The first sub-interface 310 can be the user's operation area, used to display elements such as the pattern of the model component and the connection lines between the model components. The second sub-interface 320 can be a display area for the component library. The component pattern of the model component in the component library and the name and description of the component can be displayed on the second sub-interface 320. For example, the name of the first model component in the component library can be CSV reader, and its description can be reading CSV files. The second sub-interface 320 can also be configured with a component search control, and the user can enter the name or description of the component to be used in the component search control to determine the model component from the component library.
[0054] According to an embodiment of the present disclosure, a component drag instruction may include drag sub-instructions for multiple model components. Each drag sub-instruction may include at least cursor initial position information. The cursor initial position information may refer to the position information of the mouse cursor on the second sub-interface 320. Each model component displayed on the second sub-interface 320 may have a specific selection area. When the point represented by the cursor initial position information falls into the selection area, the model component corresponding to the drag sub-instruction may be determined to be the model component corresponding to the selection area.
[0055] According to an embodiment of the present disclosure, in response to a component dragging instruction, obtaining the functional text blocks of each of the plurality of model components related to the component dragging instruction may include the following operations:
[0056] In response to the component dragging instruction, multiple model components are determined from the component library based on the cursor initial position information included in the component dragging instruction, and functional text blocks of the multiple model components are obtained from the resource library.
[0057] According to an embodiment of the present disclosure, the cursor initial position information included in the component drag instruction may be a collection of cursor initial position information respectively included in a plurality of drag sub-instructions included in the component drag instruction.
[0058] According to an embodiment of the present disclosure, after a model component is determined, a functional text block of the model component may be acquired from a resource library based on information such as the name and description of the model component.
[0059] According to an embodiment of the present disclosure, in response to a component dragging instruction, component patterns related to respective ones of the multiple model components may be rendered and generated on the main interface.
[0060] According to an embodiment of the present disclosure, each drag sub-command may further include at least cursor stop position information, which may refer to the position information of the mouse cursor on the first interface 310 .
[0061] According to an embodiment of the present disclosure, for each model component, a first target area can be determined on the main interface in response to a drag sub-command associated with the model component based on cursor position information carried by the drag sub-command. A component pattern associated with the model component is rendered and generated at the first target area.
[0062] According to an embodiment of the present disclosure, based on the cursor position information, a coordinate point on the first interface 310 can be determined, and a first target area can be determined with the coordinate point as the center. Specifically, the first target area can be determined based on the shape and size of the component pattern of the model component.
[0063] FIG4 schematically shows a flow chart of generating a component pattern on a main interface according to an embodiment of the present disclosure.
[0064] As shown in Figure 4, for each drag sub-instruction, the electronic device can generate the drag sub-instruction in response to the following user operation: the user controls the cursor to move to the first position 401 and selects a model component from the component library. After determining the model component, the user can control the cursor to move to the second position 402. The position information of the first position 401 can be represented as the initial position information of the cursor. After determining the model component, the electronic device can convert the component pattern of the model component into a page element. The position information of the second position 402 can be represented as the cursor stop position information. Based on the second position 402, the first target area can be determined, and the electronic device can render the converted page element at the first target area, so that the component pattern of the model component can be generated at the first target area.
[0065] According to an embodiment of the present disclosure, as an optional implementation, the component pattern of the model component can also be used as the control appearance, and a clickable control can be generated at the first target area to achieve rendering and generating a component pattern related to the model component at the first target area. The clickable control can be used to achieve page jump. For example, the clickable control can display a third target component pattern. The user can trigger the electronic device to generate a selection instruction for the third target component pattern included in multiple component images by clicking on the clickable control. In response to the selection instruction for the third target component pattern included in the multiple component images, a configuration sub-interface can be rendered on the main interface.
[0066] FIG5 schematically shows a schematic diagram of a configuration sub-interface according to an embodiment of the present disclosure.
[0067] As shown in Figure 5, the configuration sub-interface of the model component may include one or more control elements, which may include selection control elements, input box control elements, switch control elements, etc. Users can configure the model component by selecting, inputting, clicking, and other operations on one or more control elements.
[0068] According to an embodiment of the present disclosure, the configuration sub-interfaces of different model components may be configured with different control elements.
[0069] According to an embodiment of the present disclosure, in some embodiments, the control elements included in the configuration sub-interface of the model component may also include an input box control element related to the source code of the model component. The user can enter program code in the input box control element to replace the original functional text block of the model component with the text block formed by the input program code.
[0070] According to an embodiment of the present disclosure, a user's selection, input, or click operations on one or more control elements can be displayed in real time on the configuration sub-interface. Specifically, in response to a component configuration instruction, a second target area can be determined from the configuration sub-interface based on a configuration item identifier included in the component configuration instruction. The configuration information included in the component configuration instruction is rendered and displayed in the second target area.
[0071] According to an embodiment of the present disclosure, the configuration item identifier may correspond to a control element. Based on the configuration item identifier, the second target area determined from the configuration sub-interface may be the area where the control element corresponding to the configuration item identifier is located.
[0072] According to an embodiment of the present disclosure, the configuration information may be information generated by a user selecting, inputting, or clicking on a control element. Rendering the configuration information included in the display component configuration instruction in the second target area may be displaying the configuration information using the corresponding control element.
[0073] According to an embodiment of the present disclosure, after a user completes an operation such as selecting, inputting, or clicking a control element, i.e., after a component configuration instruction is generated, the functional text block associated with the third target component pattern can be updated based on the configuration item identifier and configuration information in response to the component configuration instruction. In other words, the user's configuration change information for the model component can be synchronized to the backend service in real time, and the backend service can use this configuration change information to update the functional text block of the model component associated with the third target component pattern.
[0074] According to an embodiment of the present disclosure, after generating two or more component patterns on the main interface in response to a drag sub-instruction, the connection relationship between the two or more component patterns can be determined in response to a component connection instruction to generate a connection text block.
[0075] According to an embodiment of the present disclosure, in response to a component connection instruction, generating multiple connection text blocks may include the following operations:
[0076] In response to the connection instruction, multiple directed edges are rendered and generated between multiple component patterns included in the main interface. For each directed edge, a connection text block is generated based on the directed edge and the component pattern associated with the directed edge.
[0077] According to an embodiment of the present disclosure, a component connection instruction includes multiple connection sub-instructions. In response to each connection sub-instruction, a directed edge may be generated between two component patterns among the multiple component patterns included in the main interface. Specifically, in response to the connection instruction, rendering and generating multiple directed edges between the multiple component patterns included in the main interface may include the following operations:
[0078] In response to the connect sub-command, a first target component pattern is determined from the component patterns of the plurality of model components based on the cursor initial position information included in the connect sub-command. A second target component pattern is determined from the component patterns of the plurality of model components based on the cursor rest position information included in the connect sub-command. A directed edge is rendered between the first target component pattern and the second target component pattern, with one end of the first target component pattern as a starting point and one end of the second target component pattern as an end point.
[0079] According to an embodiment of the present disclosure, the coordinate point represented by the cursor initial position information included in the connection sub-instruction can be located within the area where the first target component pattern is located, and the coordinate point represented by the cursor stop position information included in the connection instruction can be located within the area where the second target component pattern is located.
[0080] According to an embodiment of the present disclosure, the component patterns associated with the directed edge are the first target component image and the second target component pattern.
[0081] FIG6 schematically shows a schematic diagram of a process of generating directed edges between component patterns on a main interface according to an embodiment of the present disclosure.
[0082] As shown in Figure 6, for each connection sub-command, the electronic device can generate the connection sub-command in response to the following user operation: the user controls the cursor to move to the third position 601 to select the first target component pattern, and then controls the cursor to move to the fourth position 602 to select the second target component pattern. After the selection is completed, the electronic device can render and generate a directed edge 603 between the first target component pattern and the second target component pattern on the main interface.
[0083] According to an embodiment of the present disclosure, the third position 601 may be any position within the region where the first target component pattern is located, and the fourth position 602 may be any position within the region where the second target component pattern is located.
[0084] According to an embodiment of the present disclosure, during the generation of directed edge 603, a pattern representing the starting point of the data flow can be generated in the first target component pattern according to the direction of directed edge 603, and a pattern representing the end point of the data flow can be generated in the second target component pattern.
[0085] According to an embodiment of the present disclosure, after generating a target model, the text block of the target model can be exported and the text block can be imported into other electronic devices so as to train the model or apply the model in the other electronic devices. Alternatively, the model training or the model application can be performed directly on the original electronic device. Specifically, a first form can be generated in response to a data input instruction based on the data to be processed included in the data input instruction. The first form is rendered and displayed in the first area of the operation interface.
[0086] According to an embodiment of the present disclosure, upon receiving a data input instruction, the display interface of the electronic device may switch from the main interface to the operation interface. The operation interface may be configured with a button-like control element, and the user can control the display interface to switch from the operation interface to the main interface by clicking the control element.
[0087] According to an embodiment of the present disclosure, the number of rows and columns of the first table can be generated according to the data to be processed, which is not limited here.
[0088] According to an embodiment of the present disclosure, after receiving the data to be processed, the data to be processed can be input into a target model in response to a data processing instruction to obtain model output data. A second form is generated based on the model output data. The second form is rendered and displayed in a second area of the operation interface.
[0089] According to an embodiment of the present disclosure, another button-type control element may be further configured on the operation interface. When the electronic device detects that the user clicks on the other button-type control element, it may generate a data processing instruction.
[0090] According to an embodiment of the present disclosure, inputting the data to be processed into the target model may be taking the data to be processed as an input parameter and inputting the data to be processed into a text block of the target model, and the output parameter of the text block is the model output data.
[0091] According to an embodiment of the present disclosure, the model output data may be represented as a matrix, and the number of rows and columns of the second table may be determined based on the number of rows and columns of the matrix.
[0092] FIG7 schematically shows a diagram of a computing interface according to an embodiment of the present disclosure.
[0093] As shown in Figure 7, the operation interface may include a first area 710 and a second area 720. In response to a data input instruction, a first form may be generated based on the to-be-processed data included in the data input instruction, and the first form may be rendered and displayed in the first area 710. In response to the data processing instruction, after performing a model operation on the to-be-processed data, the resulting model data may be used to generate a second form, and the second form may be rendered and displayed in the second area 720.
[0094] According to an embodiment of the present disclosure, the operation interface may further include a third area 730 , and the third area 730 may be used to display a text block of the target model.
[0095] According to an embodiment of the present disclosure, as an optional implementation, each model component can also perform model operations independently. Specifically, the data to be processed included in the data input instruction can be the data to be processed of the model component. In response to the data processing instruction, the data to be processed can be input as an input parameter into the function text block of the model component, and the output parameter of the function text block can be used as the output data, and a second form can be generated and displayed based on the output data.
[0096] According to an embodiment of the present disclosure, the input data or output data of each model component may have different data format requirements. A preset multimodal component exchange data format can be used to implement data exchange between various model components with different data format requirements. Specifically, for the first component data of the first target model component included in the target model, based on the data format requirements of the second target model component, the first component data is converted into the data format using the multimodal component exchange data format to obtain the second component data. The second component data is input into the second target model component.
[0097] According to an embodiment of the present disclosure, the second target model component is a downstream model component of the first target model component.
[0098] According to embodiments of the present disclosure, the multimodal component exchange data format can support the transmission of at least three types of information: KV key-value pairs representing attributes; JSON strings for transmitting data such as data and data frames; and binary files for transmitting binary format data such as files and models.
[0099] FIG8 schematically shows a block diagram of a model generation device according to an embodiment of the present disclosure.
[0100] As shown in FIG8 , the model generation device 800 includes an acquisition module 810 , a first generation module 820 and a second generation module 830 .
[0101] The acquisition module 810 is configured to acquire, in response to a component dragging instruction, respective function text blocks of a plurality of model components related to the component dragging instruction.
[0102] The first generating module 820 is configured to generate a plurality of connection text blocks in response to a component connection instruction, wherein the connection text blocks represent a connection relationship between at least two model components.
[0103] The second generating module 830 is used to generate a target model based on multiple function text blocks and multiple connection text blocks.
[0104] According to an embodiment of the present disclosure, the acquisition module 810 includes a first acquisition unit and a second acquisition unit.
[0105] The first acquiring unit is configured to determine a plurality of model components from a component library in response to a component dragging instruction and based on cursor initial position information included in the component dragging instruction.
[0106] The second acquisition unit is used to acquire the functional text blocks of the multiple model components from the resource library.
[0107] According to an embodiment of the present disclosure, the model generating apparatus 800 further includes a third generating module.
[0108] The third generating module is used to render and generate component patterns related to each of the multiple model components on the main interface in response to a component dragging instruction.
[0109] According to an embodiment of the present disclosure, a component dragging instruction includes dragging sub-instructions respectively related to a plurality of model components.
[0110] According to an embodiment of the present disclosure, the third generation module includes a first generation unit and a second generation unit.
[0111] The first generating unit is configured to determine, for each model component, a first target area on the main interface in response to a drag sub-instruction related to the model component and based on cursor stop position information carried in the drag sub-request.
[0112] The second generating unit is configured to render and generate a component pattern related to the model component at the first target area.
[0113] According to an embodiment of the present disclosure, the first generating module 820 includes a third generating unit and a fourth generating unit.
[0114] The third generating unit is configured to render and generate a plurality of directed edges between a plurality of component patterns included in the main interface in response to the connection instruction.
[0115] The fourth generating unit is configured to generate, for each directed edge, a connected text block based on the directed edge and a component pattern associated with the directed edge.
[0116] According to an embodiment of the present disclosure, a component connection instruction includes a plurality of connection sub-instructions.
[0117] According to an embodiment of the present disclosure, the third generation unit includes a first generation sub-unit, a second generation sub-unit, and a third generation sub-unit.
[0118] The first generating subunit is configured to determine, in response to the connecting sub-instruction and based on the cursor initial position information included in the connecting sub-instruction, a first target component pattern from respective component patterns of a plurality of model components.
[0119] The second generating subunit is configured to determine a second target component pattern from respective component patterns of a plurality of model components based on cursor stop position information included in the connecting subinstruction.
[0120] The third generating subunit is configured to render and generate a directed edge between the first target component pattern and the second target component pattern, with one end of the first target component pattern as a starting point and one end of the second target component pattern as an end point.
[0121] According to an embodiment of the present disclosure, the model generating apparatus 800 further includes a fourth generating module.
[0122] The fourth generating module is configured to render a generation configuration sub-interface on the main interface in response to a selection instruction for a third target component pattern included in the plurality of component patterns.
[0123] According to an embodiment of the present disclosure, the model generation device 800 further includes a determination module and a first display module.
[0124] The determining module is configured to determine a second target area from the configuration sub-interface in response to the component configuration instruction and based on the configuration item identifier included in the component configuration instruction.
[0125] The first display module is configured to render the configuration information included in the display component configuration instruction in the second target area.
[0126] According to an embodiment of the present disclosure, the model generating apparatus 800 further includes an updating module.
[0127] An updating module is configured to update a function text block associated with a third target component pattern based on a configuration item identifier and configuration information in response to a component configuration instruction.
[0128] According to an embodiment of the present disclosure, the model generating apparatus 800 further includes a fifth generating module and a second display module.
[0129] The fifth generating module is configured to generate a first form in response to the data input instruction and based on the data to be processed included in the data input instruction.
[0130] The second display module is used to render and display the first form in the first area of the calculation interface.
[0131] According to an embodiment of the present disclosure, the model generation device 800 further includes an input module, a sixth generation module and a third display module.
[0132] The input module is used to input the data to be processed into the target model in response to the data processing instruction to obtain model output data.
[0133] The sixth generating module is used to generate a second form based on the model output data.
[0134] The third display module is used to render and display the second form in the second area of the calculation interface.
[0135] According to an embodiment of the present disclosure, the input module includes a first input unit and a second input unit.
[0136] The first input unit is used to convert the first component data of the first target model component included in the target model into the second component data by using the multimodal component exchange data format based on the data format requirements of the second target model component, wherein the second target model component is a downstream model component of the first target model component.
[0137] The second input unit is used to input the second component data into the second target model component.
[0138] According to the modules, submodules, units, and subunits of the embodiments of the present invention, any multiple or at least part of the functions of any multiple thereof can be implemented in one module. According to the modules, submodules, units, and subunits of the embodiments of the present invention, any one or more thereof can be split into multiple modules for implementation. According to the modules, submodules, units, and subunits of the embodiments of the present invention, any one or more thereof can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware of any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation modes of software, hardware, and firmware or in an appropriate combination of any of them. Alternatively, according to the modules, submodules, units, and subunits of the embodiments of the present invention, one or more thereof can be at least partially implemented as a computer program module, which can perform the corresponding function when the computer program module is run.
[0139] For example, any multiple of the acquisition module 810, the first generation module 820, and the second generation module 830 can be combined into one module / unit / sub-unit for implementation, or any one of the modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present disclosure, at least one of the acquisition module 810, the first generation module 820, and the second generation module 830 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation modes of software, hardware, and firmware, or in an appropriate combination of any of them. Alternatively, at least one of the acquisition module 810 , the first generation module 820 , and the second generation module 830 may be at least partially implemented as a computer program module, and when the computer program module is executed, the corresponding function may be executed.
[0140] It should be noted that the model generation device part in the embodiment of the present disclosure corresponds to the model generation method part in the embodiment of the present disclosure. The description of the model generation device part specifically refers to the model generation method part and will not be repeated here.
[0141] Figure 9 schematically shows a block diagram of an electronic device suitable for implementing the model generation method according to an embodiment of the present disclosure. The electronic device shown in Figure 9 is only an example and should not bring any limitation to the functions and scope of use of the embodiment of the present disclosure.
[0142] As shown in Figure 9, the computer electronic device 900 according to an embodiment of the present disclosure includes a processor 901, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 902 or the program loaded from the storage part 908 into the random access memory (RAM) 903. The processor 901 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (such as an application-specific integrated circuit (ASIC)), etc. The processor 901 may also include onboard memory for caching purposes. The processor 901 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.
[0143] The RAM 903 stores various programs and data required for the operation of the electronic device 900. The processor 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. The processor 901 executes the programs in the ROM 902 and / or the RAM 903 to perform various operations of the method flow according to the embodiment of the present disclosure. It should be noted that the programs may also be stored in one or more memories other than the ROM 902 and the RAM 903. The processor 901 may also execute the programs stored in the one or more memories to perform various operations of the method flow according to the embodiment of the present disclosure.
[0144] According to an embodiment of the present disclosure, the electronic device 900 may further include an input / output (I / O) interface 905, which is also connected to the bus 904. The electronic device 900 may further include one or more of the following components connected to the I / O interface 905: an input portion 906 including a keyboard, a mouse, etc.; an output portion 907 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker; a storage portion 908 including a hard disk; and a communication portion 909 including a network interface card such as a LAN card or a modem. The communication portion 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed in the drive 910 as needed, so that computer programs read therefrom can be installed into the storage portion 908 as needed.
[0145] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 909, and / or installed from the removable medium 911. When the computer program is executed by the processor 901, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.
[0146] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments, or may exist independently and not be incorporated into the device / apparatus / system. The computer-readable storage medium carries one or more programs, and when executed, implements the method according to the embodiments of the present disclosure.
[0147] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium. For example, it may include, but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
[0148] For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 902 and / or the RAM 903 described above and / or one or more memories other than the ROM 902 and the RAM 903 .
[0149] An embodiment of the present disclosure also includes a computer program product, which includes a computer program, which contains program code for executing the method provided by the embodiment of the present disclosure. When the computer program product runs on an electronic device, the program code is used to enable the electronic device to implement the model generation method provided by the embodiment of the present disclosure.
[0150] When the computer program is executed by the processor 901, the above functions defined in the system / device of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.
[0151] In one embodiment, the computer program may be stored on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may be transmitted and distributed in the form of a signal on a network medium, downloaded and installed via the communication portion 909, and / or installed from a removable medium 911. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to wireless, wired, or any suitable combination thereof.
[0152] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computer programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages include, but are not limited to, languages such as Java, C++, python, "C" or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect via the Internet).
[0153] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of the systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, program segment, or portion of code, which contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the boxes may occur in an order different from that marked in the accompanying drawings. For example, two boxes shown in succession may actually be executed substantially in parallel, or they may sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, as well as the combination of boxes in the block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or may be implemented using a combination of dedicated hardware and computer instructions. It will be understood by those skilled in the art that the features described in the various embodiments and / or claims of the present disclosure may be combined and / or coupled in various ways, even if such combinations or couplings are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or coupled in various ways, and all such combinations and / or couplings fall within the scope of the present disclosure.
[0154] The embodiments of the present disclosure are described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although each embodiment has been described separately above, this does not mean that the measures in each embodiment cannot be used in combination to advantage. The scope of the present disclosure is defined by the appended claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present disclosure.
Claims
1. A model generation method, comprising: In response to a component dragging instruction, obtaining a functional text block of each of a plurality of model components related to the component dragging instruction; In response to the component connection instruction, a plurality of connection text blocks are generated, wherein the connection text blocks represent the connection relationship between at least two of the model components; as well as Based on the plurality of function text blocks and the plurality of connection text blocks, a target model is generated.
2. The method according to claim 1, wherein: The step of obtaining, in response to a component dragging instruction, respective function text blocks of a plurality of model components related to the component dragging instruction comprises: In response to the component dragging instruction, based on the cursor initial position information included in the component dragging instruction, determining the plurality of model components from a component library; and The functional text blocks of each of the multiple model components are obtained from the resource library.
3. The method according to claim 1, further comprising: In response to the component dragging instruction, component patterns related to each of the plurality of model components are rendered and generated on the main interface.
4. The method according to claim 3, wherein: The component dragging instruction includes dragging sub-instructions related to each of the plurality of model components; The step of rendering and generating component patterns related to each of the plurality of model components on the main interface in response to the component dragging instruction includes: For each of the model components, in response to a drag sub-command associated with the model component, determining a first target area on the main interface based on cursor stop position information carried by the drag sub-request; and A component pattern related to the model component is rendered and generated at a first target area.
5. The method according to claim 3, wherein: In response to the component connection instruction, a plurality of connection text blocks are generated, including: In response to the connection instruction, rendering and generating a plurality of directed edges between a plurality of component patterns included in the main interface; and For each of the directed edges, the connected text block is generated based on the directed edge and the component pattern associated with the directed edge.
6. The method according to claim 5, wherein: The component connection instruction includes a plurality of connection sub-instructions; Wherein, in response to the connection instruction, rendering a generated image between the plurality of component patterns included in the main interface Into multiple directed edges, including: In response to the connection sub-instruction, based on the cursor initial position information included in the connection sub-instruction, determine a first target component pattern from the component patterns of the plurality of model components; Determining a second target component pattern from component patterns of each of the plurality of model components based on the cursor stop position information included in the connection sub-instruction; and The directed edge between the first target component pattern and the second target component pattern is generated by rendering with one end of the first target component pattern as a starting point and one end of the second target component pattern as an end point.
7. The method according to claim 3, further comprising: In response to a selection instruction for a third target component pattern included in the plurality of component patterns, a configuration sub-interface is rendered on the main interface.
8. The method according to claim 7, further comprising: In response to the component configuration instruction, based on the configuration item identifier included in the component configuration instruction, determine a second target area from the configuration sub-interface; as well as The configuration information included in the component configuration instruction is rendered and displayed in the second target area.
9. The method according to claim 8, further comprising: In response to the component configuration instruction, a functional text block associated with the third target component pattern is updated based on the configuration item identifier and the configuration information.
10. The method according to claim 1, further comprising: In response to the data input instruction, generating a first form based on the data to be processed included in the data input instruction; as well as The first form is rendered and displayed in a first area of the operation interface.
11. The method according to claim 10, further comprising: In response to the data processing instruction, the data to be processed is input into the target model to obtain model output data; generating a second form based on the model output data; as well as The second form is rendered and displayed in a second area of the computing interface.
12. The method according to claim 11, wherein: The step of inputting the data to be processed into the target model to obtain model output data comprises: For the first component data of the first target model component included in the target model, based on the data format requirement of the second target model component, the first component data is converted into the second component data using the multimodal component exchange data format, wherein the second target model component is the first target model component Downstream model components of ; and The second component data is input into the second object model component.
13. A model generation device, comprising: An acquisition module, used for acquiring, in response to a component dragging instruction, respective function text blocks of a plurality of model components related to the component dragging instruction; A first generating module, configured to generate a plurality of connection text blocks in response to a component connection instruction, wherein the connection text blocks represent a connection relationship between at least two of the model components; as well as The second generating module is used to generate a target model based on the multiple functional text blocks and the multiple connection text blocks.
14. An electronic device comprising: one or more processors; a memory for storing one or more instructions, Wherein, when the one or more instructions are executed by the one or more processors, the one or more processors are enabled to implement the method according to any one of claims 1 to 12.
15. A computer-readable storage medium having executable instructions stored thereon, wherein when the executable instructions are executed by a processor, the processor is enabled to implement the method according to any one of claims 1 to 12.
16. A computer program product, comprising computer executable instructions, which are used to implement the method of any one of claims 1 to 12 when executed.
Citation Information
Patent Citations
System and method for establishing enterprise-level AI application in dragging manner
CN110058985A
Draggable service orchestration method, system and method of use
CN111949257A
Configurable dragging type digital industrial model construction method
CN112417704A
Machine learning model visual modeling method and device, equipment and storage medium
CN113110833A
Model generation method and device, electronic equipment and storage medium
CN117093123A
