A browser-based drag-and-drop data model visual modeling system and method

Abstract

The application discloses a browser-based drag-type data model visual modeling system and method, and the system comprises a data source module, a data modeling engine and a visual operation module.The data source module is used for providing a database constructed from a physical model to a logical model, and simultaneously generating a physical model from a logical model according to a processing result of the data modeling engine.The data modeling engine is used for realizing construction from a physical model to a logical model based on the data source module.The visual operation module is used for editing a logical model through visual operation, outputting the logical model to the data modeling engine and generating a physical model from the logical model.The application avoids strong dependence of a traditional C / S architecture visual modeling tool on an underlying operating system and a hardware architecture, solves problems of lack of support for a database, poor compatibility of Chinese annotation content of tables and fields in the database and association of data modeling and data standards in other visual modeling tools.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of computer modeling technology, and particularly relates to a browser-based drag-type data model visual modeling system and method. BACKGROUND

[0002] Data modeling is a process of discovering, analyzing and determining data requirements, expressing and transferring these data requirements in a precise form called data model, and is an important part of data management. The modeling process requires the organization to discover and record the way of data combination. The data model is an abstraction of data characteristics, which describes the static characteristics, dynamic behavior and constraint conditions of the system from the abstraction level, provides an abstract framework for information representation and operation of the database system, integrates data of various source systems, and finally forms a unified, standardized and easy-to-use data warehouse, and further provides upper-layer services including data mart, data mining, report display, ad hoc query, etc.

[0003] The data model can promote effective communication between business and technology, form a unified understanding of the main business definition and terminology, has the characteristics of cross-department and neutrality, can express and cover all businesses, and both operational database and data warehouse need data model to organize data composition and guide data table design. The data modeling process requires professional modeling personnel, business personnel and potential information system users to work closely together. Data modeling is a process of understanding data, and the data model is the output of data modeling. There are many ways of data modeling, and it involves personnel from multiple departments within an enterprise or organization, and the process is complex, so professional data modeling software is needed to complete such tasks.

[0004] The current popular visualization data modeling tools are PowerDesigner and Erwi. PowerDesigner is a CASE tool set of Sybase Company, which is a graphical and easy-to-use enterprise modeling environment. It can be used to conveniently analyze and design management information systems, and it almost includes the whole process of database model design. Using PowerDesigner, data flow diagrams, conceptual data models, physical data models can be made, and application programs of various client development tools can be generated, and structure models for data warehouses can also be made, and team design models can also be controlled. Using PowerDesigner, software analysis and design can be conveniently performed, business process diagrams, conceptual data models, physical data models, and object-oriented models can be made, and structure models for databases can also be made. Erwi is a data modeling tool of erwin Company, which supports various mainstream database systems. Erwi provides database structure visualization, a simple and easy-to-use management interface, and visual graphical display of complex data structures. Erwi provides unique flexibility to create multiple model layers from logical, physical, and even higher-level models. Users can create completely separate logical and physical models, or create associated logical and physical models, and you can choose the most suitable style to meet your needs. Erwi supports Windows operating system and supports MySQL, Oracle, SQL Server and other database environments.

[0005] At present, software visualization data modeling has the following defects:

[0006] (1) The existing software product does not support CPU and operating system well, because the architecture of the current mainstream product is based on the traditional C / S architecture, and it mainly supports x86 CPU architecture and Windows operating system, and it is not easy to migrate and adapt to other architectures of CPU and operating system, resulting in strong dependence of traditional C / S architecture visualization modeling tools on underlying operating system and hardware architecture.

[0007] (2) Because the architecture of the software is based on the traditional C / S architecture, it cannot meet the current user's mainstream operation habit based on the browser, and the deployment of C / S architecture software is troublesome, which requires installing various dependent environments on each client, and compared with B / S architecture, part of the processing work of C / S architecture is placed on the client, which requires high performance of the client. In addition, the C / S architecture software is not easy to realize distributed collaborative design.

[0008] (3) The existing software product does not have strong integration of data governance concept, and when building data models, it cannot be combined with existing data standards in the data governance process, so it cannot meet the unified and standardized description of entities, attributes and relationships.

[0009] (4) Database reverse engineering and forward database building operation lacks support for databases, and the database data storage mode is not unified, which cannot meet the requirements of independent controllability.

[0010] (5) The content of the table and field annotation is not friendly to Chinese content, and the compatibility of the Chinese annotation content of the table and field in the database is poor. SUMMARY

[0011] The application provides a browser-based drag-type data model visualization modeling system and method, which avoids the strong dependence of traditional C / S architecture visualization modeling tools on underlying operating systems and hardware architectures, solves the problems of lack of support for databases in other visualization modeling tools, poor compatibility of Chinese annotation content of tables and fields in databases, and association of data modeling and data standards.

[0012] The application provides a browser-based drag-type data model visualization modeling system, which comprises:

[0013] A data source module is configured to provide a database constructed from a physical model to a logical model, and to complete the generation of a physical model from a logical model according to the processing result of a data modeling engine;

[0014] The data modeling engine comprises a data standard management component, a database connection adapter, a database metadata extraction engine, a data model change acquisition component, a data type mapping component, and a database DDL construction engine, wherein: the data standard management component is configured to maintain or call relevant data standards; the database connection adapter is configured to configure a data source; the database metadata extraction engine and the data model change acquisition component are configured to respectively perform metadata extraction and data model change acquisition, and to perform reverse engineering from a data source to realize the conversion from a physical model to a logical model; the data type mapping component is configured to perform data type mapping on a logical model parsed by a visualization operation module; and the database DDL construction engine is configured to construct a DDL statement matched with a currently connected data source, and to pass the DDL statement to a database for execution through the database connection adapter;

[0015] The visual operation module comprises a canvas editor, a data table component, an attribute editor, an entity relationship component, a component manager, an attribute component, a standard selection component and a model analysis engine, wherein: the canvas editor is used to realize at least drawing, interactive response, open component management and extension of the visual operation; the component manager is used to manage components in the visual operation process; the data table component is used to newly create a data table or edit a data table generated through reverse engineering; the attribute component is used to add a new attribute or select an attribute obtained from reverse engineering; the standard selection component is used to receive a standard obtained from a data standard management component and associate the standard with an attribute; the attribute editor is used to edit and modify an attribute; the entity relationship component is used to create one-to-many or many-to-many relationships between entities; and the model analysis engine is used to analyze an edited logical model and then submit the logical model to a data modeling engine.

[0016] Further, the database metadata extraction engine abstracts four interfaces of data table list acquisition, single table information acquisition, field information acquisition and relationship information acquisition, wherein:

[0017] The data table list acquisition interface is used to realize acquisition of data tables in each database.

[0018] The single table information acquisition interface is used to realize content acquisition of at least remark information and storage information corresponding to a specific data table.

[0019] The field information acquisition interface is used to realize acquisition of data field information contained in a data table, at least including field annotation, field code, field type and constraint information.

[0020] The relationship information acquisition interface is used to acquire association information between data tables.

[0021] Further, the database DDL construction engine generates a DDL statement of a corresponding database by analyzing instance information carried by a data table.

[0022] Further, the canvas editor extends graphical components related to model display based on an mxGraph framework.

[0023] Further, the data standard management component provides a structured interface to the visual operation interface and is bound to attributes of entities in data modeling, and the data standard is embodied in aspects of data elements and data dictionaries.

[0024] The application further provides a browser-based drag-type data model visual modeling method, comprising the following steps:

[0025] The data source is configured by using the database connection adapter, reverse engineering is performed from the data source by using the database metadata extraction engine and the data model change acquisition component, and conversion from a physical model to a logical model is realized;

[0026] The user performs visual operations on the canvas editor, first uses a data table component to newly create a data table or edit a data table generated through reverse engineering, then uses an attribute component to add a new attribute or select an attribute obtained from reverse engineering, uses a standard selection component to receive a standard obtained from a data standard management component and associate the standard with the attribute, uses an attribute editor to edit and modify the attribute, and uses an entity relationship component to create a one-to-many or many-to-many relationship between entities;

[0027] When the user operates the logical model to generate a physical model, the model analysis engine analyzes the edited logical model, then submits the logical model to the data modeling engine and performs data type mapping through the data type mapping component, the database DDL construction engine constructs a DDL statement matching the currently connected data source according to the operation result, and finally submits the DDL statement to the database for execution through the database connection adapter, thereby finally completing generation of the logical model to the physical model.

[0028] Further, the database metadata extraction engine abstracts four interfaces of data table list acquisition, single table information acquisition, field information acquisition, and relationship information acquisition, wherein:

[0029] The data table list acquisition interface realizes acquisition of data tables in each database;

[0030] The single table information acquisition interface realizes acquisition of at least remark information and storage information corresponding to a specific data table;

[0031] The field information acquisition interface realizes acquisition of data field information contained in a data table, at least including field annotation, field code, field type, and constraint information;

[0032] The relationship information acquisition interface acquires association information between data tables.

[0033] Further, the database DDL construction engine generates a DDL statement of a corresponding database by analyzing instance information carried by a data table.

[0034] Further, the canvas editor is based on an mxGraph framework and extends graphical components related to model display.

[0035] Further, the data standard management component provides a structured way to a visual operation interface and is bound to attributes of entities in data modeling, and the data standard is embodied in aspects of data elements and data dictionaries.

[0036] The above at least one technical solution adopted by the present application can achieve the following beneficial effects:

[0037] 1. The present application is based on the browser-based visual operation technology, according to the dragging movement of the mouse, quickly creates a logical model and the association relationship between the models, and deeply combines with the data standard management module to quickly add standardized entity attributes to the logical model.

[0038] 2. The database DDL construction engine of the present application can provide extensive compatibility for DDL statements of various databases, and realize that the same logical model is materialized into physical models in different databases.

[0039] 3. The present application solves the problem of non-uniform data storage mode of different databases through the database metadata extraction engine, according to the configuration information of the data source, identifies different database types, and adopts different metadata extraction strategies. BRIEF DESCRIPTION OF DRAWINGS

[0040] The drawings described herein are used to provide a further understanding of the present application, and form a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application, and do not constitute an improper limitation on the present application. In the drawings:

[0041] Figure 1 A browser-based drag-type data model visual modeling system architecture diagram of the present application. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical scheme and advantages of the present application more clear, the technical scheme of the present application will be described in detail below in combination with specific embodiments of the present application and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0043] The technical scheme provided by each embodiment of the present application will be described in detail below in combination with the drawings.

[0044] The present application is a browser-based drag-type data model visual modeling system and method, which aims to develop a browser-based, lightweight, database-friendly, drag-type data model visual modeling tool.

[0045] The application adopts B / S architecture design, as long as one of the servers is installed and deployed, the client installs the browser meeting the requirements, the use of multiple users in the local area network can be met, the deployment difficulty of the traditional C / S architecture product is solved, and the multi-user collaboration problem is solved. The back end of the product is developed based on the spring boot framework, so that the product runs in jre, the isolation of the software product and the underlying hardware is realized by using jvm, which is beneficial to quickly compatible with different operating systems and different architecture processors. Specifically, after the java language programming of the application is realized, the bytecode of the class file is formed after compiling, the jvm reads the bytecode, and then converts it into the machine code of the corresponding hardware platform. In the environment of the mainstream CPU and operating system, the jre compatible with them has been built in the big operating system, so the compiled class file can be directly run, realizing the strong compatibility of one compilation and multiple running.

[0046] For the association problem of data model and data standard, the application designs a data standard management module, maintains or calls relevant data standards such as national standards, military standards and industry standards, and provides them to the operation interface in a structured way, and binds them to the properties of entities in data modeling. The data standard is bound to the data standard in one step from logical model modeling to logical model materialization. Specifically, the data standard mainly embodies data elements and data dictionary in use, and a table is used to store these standards. In the design stage of the logical model, two fields are provided for each entity property to store the primary keys of the data elements and data dictionary, so as to realize the association of the data elements and data dictionary. When the user operates in the browser interface, the user is presented with a tree structure, the user can search according to the name of the data element and the data dictionary, and the page is automatically filled with the attribute name, attribute type, length and other information after the user selects the data element or data dictionary.

[0047] For the compatibility problem of the database, the application extracts database physical model data table, data field and corresponding annotation content and other metadata by using the jdbc driver provided by the database manufacturer, customizing the database operation adapter and the metadata extraction engine. Specifically, the application embeds the jdbc driver provided by the mainstream database manufacturers therein, and when the user adds a data source, sets the data source type, can automatically select the corresponding jdbc driver to connect the database. In the metadata collection stage, because the metadata organization methods of different databases are different, the application adopts different collection methods for different databases, and finally realizes the extraction of data table, data field and corresponding annotation content and other metadata. In terms of data source, the application supports a variety of relational databases, and is particularly adapted to a variety of databases, such as the Renmin University of China Golden Warehouse database, the Nanda General Database, the Dream Database, the God State General Database, the Haigao Database, and the like. In addition, the application also provides good support for traditional, widely used open source and closed source databases, such as mysql, postgresql, Microsoft sqlserver, Oracle.

[0048] As shown in Figure 1 After the user configures the data source by using the database connection adapter, the application can perform reverse engineering from the data source by using the database metadata extraction engine and the data model change acquisition component, and realize the conversion from the physical model to the logical model. The user can operate on the canvas by using the visual operation technology, first use the data table component to newly create a data table (which can also be called a logical model), or edit the data table generated by reverse engineering. Then use the attribute component to add a new attribute, or select the attribute obtained from the reverse engineering, use the standard selection component to receive the standard obtained from the data standard management component, and associate the standard with the attribute. Use the attribute editor to edit and modify the attribute more complexly. Use the entity relationship component to create relationships between entities (also called logical models), such as one-to-many, many-to-many and the like. When the user operates the logical model to generate the physical model, the model analysis engine analyzes the edited logical model, and then submits it to the data modeling engine, and performs data type mapping. The database DDL construction engine constructs the DDL statement matched with the currently connected data source according to the operation result, and finally submits the DDL statement to the database through the connection adapter for execution, and finally completes the generation of the logical model to the physical model.

[0049] The main technical scheme of the application can be summarized as follows:

[0050] (1) Browser-based visual operation technology

[0051] The core of the browser visualization operation technology is a visualization editor, which mainly includes a canvas / editor, an attribute editor, and a component manager. The canvas / editor realizes browser-based drawing functions, an interactive response environment, open component management, and expansion capabilities. The editor technology is based on the mxGraph framework, extends the model-related display components, and enables users to flexibly drag and drop process component units in the browser page to realize the visualization arrangement of data tables (entities) and field (attribute) relationships. The corresponding graphical components include data table components, attribute components, and relationship components, which provide graphical display and corresponding data display, editing, and storage operations.

[0052] (2) Database modeling engine based on data standards

[0053] The database modeling engine mainly includes a database connection adapter, a metadata extraction engine, a ddl construction engine, data model change acquisition, data type mapping, and standard management technology.

[0054] The database connection adapter is designed using a factory design method, abstracts the corresponding read-write operation interface, and implements the corresponding database read-write operation adapter for specific database types, facilitating the expansion of data source types in the later stage.

[0055] The database metadata extraction engine abstracts four interfaces, namely data table list acquisition, single table information acquisition, field information acquisition, and relationship information acquisition, and various databases implement corresponding methods. The data table list acquisition interface is used to acquire data tables in each database; the single table information acquisition interface is used to acquire the note information and storage information of a specific data table; the field information acquisition interface is used to acquire the data field information in the data table, including field annotations, field codes, field types, and constraint information; and the relationship information acquisition is used to acquire the association information between data tables. When implementing the corresponding interfaces, each type of database uses a search method to acquire corresponding data from the metadata information storage table of the respective database.

[0056] The database ddl construction engine generates the DDL statement of the corresponding database by parsing the instance information carried by the data table (including the field). Each database has its own DDL statement format, so when implementing, the interfaces for creating, updating, field creation, updating, field annotation creation and updating, field constraint creation and updating of data tables are abstracted, and each type of database is implemented accordingly.

[0057] The above only describes the embodiments of the present application and is not intended to limit the present application. For those skilled in the art, the present application can have various changes and variations. Any modification, equivalent replacement, improvement, etc. within the spirit and principles of the present application shall be included in the scope of the claims of the present application.

Claims

1. A browser-based drag-and-drop data model visual modeling system, characterized in that, The application comprises: a data source module for providing a database constructed from a physical model to a logical model, and completing the generation of a logical model to a physical model according to the processing result of a data modeling engine; a data modeling engine comprising a data standard management component, a database connection adapter, a database metadata extraction engine, a data model change acquisition component, a data type mapping component, and a database DDL construction engine, wherein: the data standard management component is used for maintaining or calling relevant data standards; the database connection adapter is used for configuring a data source; the database metadata extraction engine and the data model change acquisition component are used for respectively performing metadata extraction and data model change acquisition, and performing reverse engineering from a data source to realize the conversion from a physical model to a logical model; the data type mapping component is used for mapping the data type of a logical model parsed by a visual operation module; and the database DDL construction engine is used for constructing a DDL statement matched with the currently connected data source, and submitting the DDL statement to a database through the database connection adapter for execution; the database metadata extraction engine abstracts four interfaces of data table list acquisition, single table information acquisition, field information acquisition, and relationship information acquisition, wherein: the data table list acquisition interface is used for realizing the acquisition of data tables in each database; the single table information acquisition interface is used for realizing the content acquisition of at least remark information and storage information corresponding to a specific data table; the field information acquisition interface is used for realizing the acquisition of data field information contained in a data table, and at least includes field annotation, field code, field type, and constraint information; the relationship information acquisition interface is used for acquiring the association information between data tables; a visual operation module comprising a canvas editor, a data table component, an attribute editor, an entity relationship component, a component manager, an attribute component, a standard selection component, and a model parsing engine, wherein: the canvas editor is used for realizing at least visual operation of drawing, interactive response, open component management, and extension; the component manager is used for managing the components in the visual operation process; the data table component is used for newly creating a data table or editing a data table generated through reverse engineering; the attribute component is used for adding a new attribute or selecting an attribute obtained from reverse engineering; the standard selection component is used for receiving a standard obtained from the data standard management component, and associating the standard with an attribute; the attribute editor is used for editing and modifying an attribute; the entity relationship component is used for creating a one-to-many or many-to-many relationship between entities; and the model parsing engine is used for parsing an edited logical model, and then submitting the logical model to the data modeling engine.

2. The browser-based drag-and-drop data model visualization modeling system of claim 1, wherein, The database DDL construction engine generates a DDL statement of a corresponding database by parsing instance information carried by a data table.

3. The browser-based drag-and-drop data model visualization modeling system of claim 1, wherein, The canvas editor extends the graphical components related to the display of the model based on the mxGraph framework.

4. The browser-based drag-and-drop data model visualization modeling system of claim 1, wherein, The data standard management component provides a structured interface to the visual operation interface, and binds to the attributes of entities in the data modeling, wherein the data standard is embodied in the aspects of data elements and data dictionaries.

5. A browser-based drag-and-drop data model visualization modeling method using the browser-based drag-and-drop data model visualization modeling system according to any one of claims 1 to 4, characterized in that, The application comprises the following steps: The data source is configured by using the database connection adapter, reverse engineering is performed from the data source by using a database metadata extraction engine and a data model change acquisition component, and conversion from a physical model to a logical model is realized; The user performs visual operation on the canvas editor, first uses a data table component to newly create a data table or edit a data table generated through reverse engineering, and then uses an attribute component to add a new attribute or select an attribute obtained through reverse engineering; A standard selection component is used to receive standards obtained from a data standard management component and associate the standards to attributes, an attribute editor is used to edit and modify the attributes, and an entity relationship component is used to create one-to-many or many-to-many relationships between entities; When the user operates the logical model to generate the physical model, a model analysis engine analyzes the edited logical model, and then submits the logical model to a data modeling engine and performs data type mapping through a data type mapping component; a database DDL construction engine constructs a DDL statement matched with the currently connected data source according to the operation result, and finally submits the DDL statement to a database for execution through a database connection adapter, so as to finally complete generation of the logical model to the physical model.

6. The browser-based drag-and-drop data model visualization modeling method of claim 5, wherein, The database metadata extraction engine abstracts four interfaces of data table list acquisition, single table information acquisition, field information acquisition and relationship information acquisition, wherein: The data table list acquisition interface realizes acquisition of data tables in each database; The single table information acquisition interface realizes acquisition of at least remark information and storage information corresponding to a specific data table; The field information acquisition interface realizes acquisition of data field information contained in a data table, at least including field annotation, field code, field type and constraint information; The relationship information acquisition interface acquires association information between data tables.

7. The browser-based drag-and-drop data model visualization modeling method of claim 5, wherein, The database DDL construction engine generates a DDL statement of a corresponding database by analyzing instance information carried by a data table.

8. The browser-based drag-and-drop data model visualization modeling method of claim 5, wherein, The canvas editor is based on an mxGraph framework and extends graphical components related to model display.

9. The browser-based drag-and-drop data model visualization modeling method of claim 5, wherein, The data standard management component provides a visual operation interface in a structured manner and is bound to attributes of entities in data modeling, and the data standard is embodied in aspects of data elements and data dictionaries.

Images