Low-code data visualization and analysis platform and development method

Abstract

The invention discloses a low-code data visualization and analysis platform and method. The method comprises the following steps: S1, extracting data information required for constructing an application menu by multiple data sources; s2, maintaining data information extracted by customizing query, and supplementing data attributes through dictionary and data table management; s3, expanding a business scene of the created application to carry out data query and interaction scenes; and S4, constructing a visual data component library, and configuring an expected data visual effect through a dragging operation. According to the method, post-configuration is used as a new entry point, and the timeliness and flexibility of data function development are improved for data analysts with SQL development capability.

Description

Technical Field

[0001] The present invention belongs to the technical field of low-code development platforms, and specifically relates to a low-code data visualization and analysis platform and a development method. Background Art

[0002] Componentization and frameworkization are the mainstream modes for current developers. Front-end componentization packages HTML tags, JS control logic and CSS styles. By reusing components, it greatly reduces the amount of repeated development by developers and improves development efficiency. Similarly, frameworks such as Springboot and Mybatis also borrow the idea of ​​reuse to divide the backend logic development into business layer, control layer and CURD data persistence operations. With the help of componentization and framework development ideas, the actual data function development and visualization development process have become repetitive and single. New data function development always revolves around the adjustment of parameters such as field maintenance and query conditions, and gradually evolves into a simple pile of development and code. There is no substantial new logic development, and it cannot meet the immediate data needs.

[0003] From a business perspective, the low-code platform lowers the development threshold by "componentizing" the logic of common business functions in disguised form, and using visual drag-and-drop editing. Even business personnel can configure data functions that meet business needs without any development capabilities. In addition, in order to cope with various business data usage scenarios, the low-code platform is equipped with a rich component library. By combining different components, the expected functions can be configured, which improves the flexibility and diversity of the low-code platform.

[0004] Although low-code platforms have lowered the development threshold, with the enrichment of component libraries and the continuous increase in configuration parameters, the configuration learning cost of low-code platforms has also continued to increase; and the mainstream low-code development products on the market all adopt a pre-configuration mode, which cannot intuitively display data functions before the parameters are set, greatly reducing the user experience. The data function development logic itself is closer to the data. For scientific and technological personnel with data analysis capabilities, the efficiency of the configuration and component-based development model is much lower than that of script processing models based on SQL and other scripts. Therefore, in order to improve the instant data service capabilities, there is an urgent need for a low-code data visualization and analysis platform solution for scientific and technological personnel with post-configuration parameters. Summary of the invention

[0005] The purpose of the present invention is to provide a low-code data visualization and analysis platform and development method.

[0006] In order to achieve the above object, one of the technical solutions adopted by the present invention is:

[0007] A low-code data visualization and analysis platform development method is provided, comprising the following steps: S1, extracting data information required for building an application menu from multiple data sources; S2, maintaining the data information extracted by custom queries, and supplementing data attributes through dictionary and data table management; S3, expanding the business scenarios of creating applications to query and interact with data; S4, building a visualization data component library, and configuring the expected data visualization effect through drag and drop operations.

[0008] In a feasible implementation, the multiple data sources in S1 include relational and non-relational databases such as MySQL, Oracle, Gbase, TDSql, HBase, ck, and Gauss, and support various data source driver dependency packages in advance through JDBC connection and combined with ORM and ODM.

[0009] In a feasible implementation, the data information in S1 includes field information obtained by parsing data content.

[0010] In a feasible implementation, S2 uses a temporary key, digital signature and base64 encoding technology to encrypt and verify the SQL sensitive data in the customized query message to ensure data security.

[0011] The second technical solution adopted by the present invention is:

[0012] A low-code data visualization and analysis platform is provided, including a multi-data source support module, a customized query module, a field maintenance module, a data collision module and a data vision module, wherein: the multi-data source support module is used for multi-data source management, through the JDBC connection method and combined with ORM and ODM, the supported data sources include relational and non-relational databases; the customized query module is used to parse SQL logic and preliminarily build applications; the field maintenance module is used to maintain field attribute information extracted by customized queries; the data collision module is used to expand the business scenarios of creating applications; the data vision module is used to build data visualization applications.

[0013] In one feasible implementation, a low-code data visualization and analysis platform also includes a functional statistics module for counting application usage.

[0014] In a feasible implementation, the multiple data source support module includes a data source online configuration submodule, a multiple data source driver submodule, and a data source dynamic switching submodule, wherein the data source online configuration submodule is used to adjust the data source connection information online, the multiple data source driver submodule is used to support various types of data source driver dependency packages, and the data source dynamic switching submodule is used to dynamically create and destroy the data source management engine during the data source switching process.

[0015] In a feasible implementation, the customized query module includes an SQL precompilation submodule, an SQL statement parsing submodule, an application construction submodule, a table display customization submodule, and a sensitive mode switching submodule, wherein the SQL precompilation submodule processes the SQL statement into a precompiled template, the SQL statement parsing module extracts the data information required for the data model from the connected data source, including data field information, SQL query results, etc., the application construction submodule automatically sets reasonable default values ​​for the application construction properties in combination with the parsed field information, thereby completing the preliminary construction of the application, the table display customization submodule is used to realize user query and download customization in the data display stage, and improve the user experience; the sensitive mode switching submodule is used for data desensitization and desensitization mode switching functions, in the desensitization mode, the original data of a single record can be viewed, and in the non-desensitization mode, all original data can be directly viewed.

[0016] In a feasible implementation, the field maintenance module includes a field attribute maintenance submodule, a dictionary management submodule, and a data table management submodule, wherein:

[0017] The field attribute maintenance submodule customizes the field-level style, filtering, and functions according to the needs of data display and use, including width, sorting, fuzzy query, encryption, display, etc.

[0018] Dictionary management: by editing or uploading dictionary tables online, different business codes in the data can be translated and displayed;

[0019] Data table management reduces the cost of maintaining fields in duplicate data tables during data function development by maintaining the data table structure, including the Chinese name of the field, field type, etc.

[0020] In a feasible implementation, the data collision module includes an optional field pool submodule, a query field pool submodule, and an output field pool submodule, wherein:

[0021] The optional field pool module quickly parses the field information in the collided data table and displays it in the optional field submodule;

[0022] In the query field pool submodule, users can drag the field information to be uploaded from the optional field pool to the query field pool. The fields in the query field pool will be used as the associated fields for the joint table query.

[0023] In the output field pool submodule, users can drag the required result data fields from the optional field pool to the output field pool, and use them as the header information of the output file.

[0024] In a feasible implementation, the data view module includes a multimedia file display submodule, a file display submodule, and a real-time data large screen submodule, wherein:

[0025] The multimedia file display submodule guides customers to better use data analysis tools by supporting the display and text editing of content in formats such as videos and images;

[0026] The file display submodule provides users with a practical data tool sharing channel by supporting the display of files in formats such as pdf, wps, and exe;

[0027] The real-time data large screen submodule can quickly configure and display the real-time data large screen through the drag-and-drop operation of the componentized tool and the configuration of real-time data;

[0028] In a feasible implementation, the function statistics function includes a function usage ranking submodule, a user access ranking submodule, a function usage statistics submodule and a user access statistics submodule, wherein:

[0029] Function usage ranking submodule supports ranking of data function access and lists ranking information of different dimensions such as the number of top N function accesses;

[0030] The user access ranking submodule supports the ranking of users' access to the platform, listing the top N users' access times, function usage frequency and other ranking information in different dimensions;

[0031] Function usage statistics submodule supports statistics on data function access, statistics on the number of times a function is accessed, and other different dimensional information;

[0032] The user access statistics submodule supports statistics on user access to the platform, including statistics on different dimensions such as the number of user visits and frequency of function usage.

[0033] Beneficial effects of the present invention:

[0034] The customized query of the present invention adopts temporary secret keys, digital signatures and base64 encoding technology, and encrypts and verifies sensitive data such as SQL in the customized query message to ensure the security of the data; S2 introduces a data dictionary to uniformly manage the business codes of various data scenarios, reducing the repetitive workload of translating the same business code; S2 innovates data table management, and the system automatically reads and parses the structural information of the data table, thereby achieving the purpose of maintaining data assets; S3 forms a feature component library of this platform by componentizing various query boxes, buttons, etc. Users only need to select suitable components according to their needs to complete the construction of applications in different scenarios; S4 integrates a low-code visualization component library, which configures data and display components in the form of drag-and-drop operations, lowering the threshold for building visualization pages.

[0035] The present invention takes post-configuration as a new entry point and is aimed at data analysts with SQL development capabilities to improve the timeliness and flexibility of data function development. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 The figure is a flowchart of the method of the present invention. DETAILED DESCRIPTION

[0037] See also Figure 1 In order to achieve the above-mentioned purpose, one of the technical solutions adopted by the present invention is:

[0038] A low-code data visualization and analysis platform development method is provided, comprising the following steps: S1, extracting data information required for building an application menu from multiple data sources; S2, maintaining the data information extracted by custom queries, and supplementing data attributes through dictionary and data table management; S3, expanding the business scenarios of creating applications to query and interact with data; S4, building a visualization data component library, and configuring the expected data visualization effect through drag and drop operations.

[0039] The multiple data sources in S1 described in this embodiment include relational and non-relational databases such as MySQL, Oracle, Gbase, TDSq l, HBase, ck, and Gauss. Through the JDBC connection method and combined with ORM and ODM, various data source driver dependency packages are pre-supported.

[0040] The data information in S1 of this embodiment includes field information obtained by parsing the data content.

[0041] The customized query described in this embodiment uses a temporary key, digital signature and base64 encoding technology to encrypt and verify sensitive data such as SQL in the customized query message to ensure data security.

[0042] In this embodiment S2, a data dictionary is introduced to uniformly manage the business codes of various data scenarios, thereby reducing the repetitive workload of translating the same business code.

[0043] In this embodiment S2, through data table management, the system automatically reads and parses the structural information of the data table, thereby achieving the purpose of maintaining data assets.

[0044] In this embodiment S3, various query boxes, buttons, etc. are componentized to form a special component library of this platform. Users only need to select suitable components according to their needs to complete the construction of applications in different scenarios. S4 integrates a low-code visualization component library, which configures data and display components in the form of drag-and-drop operations, thereby lowering the threshold for building visualization pages.

[0045] The second technical solution adopted by the present invention is:

[0046] A low-code data visualization and analysis platform is provided, including a multi-data source support module, a customized query module, a field maintenance module, a data collision module and a data vision module, wherein: the multi-data source support module is used for multi-data source management, through the JDBC connection method and combined with ORM and ODM, the supported data sources include relational and non-relational databases; the customized query module is used to parse SQL logic and preliminarily build applications; the field maintenance module is used to maintain field attribute information extracted by customized queries; the data collision module is used to expand the business scenarios of creating applications; the data vision module is used to build data visualization applications.

[0047] A low-code data visualization and analysis platform in this embodiment also includes a function statistics module for counting application usage.

[0048] The multi-data source support module described in this embodiment includes a data source online configuration submodule, a multi-data source driver submodule, and a data source dynamic switching submodule, wherein the data source online configuration submodule is used to adjust the data source connection information online, the multi-data source driver submodule is used to support various types of data source driver dependency packages, and the data source dynamic switching submodule is used to dynamically create and destroy the data source management engine during the data source switching process.

[0049] The customized query module described in this embodiment includes an SQL pre-compilation submodule, an SQL statement parsing submodule, an application construction submodule, a table display customization submodule, and a sensitive mode switching submodule, wherein the SQL pre-compilation submodule processes the SQL statement into a pre-compiled template, the SQL statement parsing module extracts the data information required for the data model from the connected data source, including data field information, SQL query results, etc., the application construction submodule automatically sets reasonable default values ​​for the application construction properties based on the parsed field information, thereby completing the preliminary construction of the application, the table display customization submodule is used to realize user query and download customization in the data display stage, and improve the user experience; the sensitive mode switching submodule is used for data desensitization and desensitization mode switching functions, in the desensitization mode, the original data of a single record can be viewed, and in the non-desensitization mode, all original data can be directly viewed.

[0050] The field maintenance module of this embodiment includes a field attribute maintenance submodule, a dictionary management submodule, and a data table management submodule, wherein:

[0051] The field attribute maintenance submodule customizes the field-level style, filtering, and functions according to the needs of data display and use, including width, sorting, fuzzy query, encryption, display, etc.

[0052] Dictionary management: by editing or uploading dictionary tables online, different business codes in the data can be translated and displayed;

[0053] Data table management reduces the field maintenance costs of duplicate data tables during data function development by maintaining the data table structure, including the Chinese name of the field, field type, etc.

[0054] The data collision module in this embodiment includes an optional field pool submodule, a query field pool submodule, and an output field pool submodule, wherein:

[0055] The optional field pool module quickly parses the field information in the collided data table and displays it in the optional field submodule;

[0056] In the query field pool submodule, users can drag the field information to be uploaded from the optional field pool to the query field pool. The fields in the query field pool will be used as the associated fields for the joint table query.

[0057] In the output field pool submodule, users can drag the required result data fields from the optional field pool to the output field pool, and use them as the header information of the output file.

[0058] The data vision module of this embodiment includes a multimedia file display submodule, a file display submodule, and a real-time data large screen submodule, wherein:

[0059] The multimedia file display submodule guides customers to better use data analysis tools by supporting the display and text editing of content in formats such as videos and images;

[0060] The file display submodule provides users with a practical data tool sharing channel by supporting the display of files in formats such as pdf, wps, and exe;

[0061] The real-time data large screen submodule can quickly configure and display the real-time data large screen through the drag-and-drop operation of the componentized tool and the configuration of real-time data;

[0062] The function statistics function described in this embodiment includes a function usage ranking submodule, a user access ranking submodule, a function usage statistics submodule, and a user access statistics submodule, wherein:

[0063] Function usage ranking submodule supports ranking of data function access and lists ranking information of different dimensions such as the number of top N function accesses;

[0064] The user access ranking submodule supports the ranking of users' access to the platform, listing the top N users' access times, function usage frequency and other ranking information in different dimensions;

[0065] Function usage statistics submodule supports statistics on data function access, statistics on the number of times a function is accessed, and other different dimensional information;

[0066] The user access statistics submodule supports statistics on user access to the platform, including statistics on different dimensions such as the number of user visits and frequency of function usage.

[0067] See also Figure 1 According to development requirements, the platform framework is divided into data layer, logic layer and application layer: in the data layer, it includes multi-data source support module, which is mainly used for multi-data source management; in the logic layer, it includes custom query module, field maintenance module, data collision module, data vision module, data dictionary and timetable management. The custom query module adopts SQL processing logic, which mainly processes requests and responses to the underlying data layer; in the application layer, it is mainly the operation interface that realizes system functions when users interact with the system.

[0068] The present invention takes post-configuration as a new entry point, and is aimed at data analysts with SQL development capabilities, to improve the timeliness and flexibility of data function development. Post-configuration enables configuration supplementary attributes to have corresponding default values ​​in advance, and users can instantly obtain the display effect of the application based on the SQL query statement, so as to make timely adjustments, avoiding undesirable application effects caused by failure to discover unreasonable configuration in time, improving user experience, and reducing the cost of repeated modification of application configuration.

[0069] On the other hand, the present invention also inherits the characteristics of low-code platforms, such as low development workload, low threshold, and configuration, which directly avoids program development work. In addition, the present invention is aimed at data analysts with SQL development capabilities, which lowers the threshold for application development and makes application development closer to the data layer of the development essence, truly meeting the requirements of instant data services.

[0070] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for developing a low-code data visualization and analysis platform, characterized in that: The following steps are involved: S1, extract the data information required to build the application menu from multiple data sources; S2, maintain the data information extracted from the customized query, and supplement the data attributes through dictionary and data table management; S3, expand the business scenarios of creating applications to query and interact with data; S4, build a visual data component library, and configure the expected data visualization effects through drag and drop operations.

2. The low-code data visualization and analysis platform development method according to claim 1, characterized in that: The multiple data sources in S1 include relational and non-relational databases such as MySQL, Oracle, Gbase, TDSql, HBase, ck, and Gauss. Through JDBC connection and combined with ORM and ODM, various data source driver dependency packages are pre-supported.

3. The low-code data visualization and analysis platform development method according to claim 1 is characterized in that: The data information in S1 includes field information obtained by parsing the data content.

4. The low-code data visualization and analysis platform development method according to claim 1, characterized in that: In S2, the customized query message including SQL sensitive data is encrypted and signed by using a temporary key, digital signature and base64 encoding technology.

5. A low-code data visualization and analysis platform, characterized in that: It includes a multi-data source support module, a customized query module, a field maintenance module, a data collision module and a data vision module, among which: the multi-data source support module is used for multi-data source management, through the JDBC connection method and combined with ORM and ODM, the supported data sources include relational and non-relational databases; the customized query module is used to parse SQL logic and preliminarily build applications; the field maintenance module is used to maintain the field attribute information extracted by customized queries; the data collision module is used to expand the business scenarios of creating applications; the data vision module is used to build data visualization applications.

6. A low-code data visualization and analysis platform according to claim 5, characterized in that: It also includes a function statistics module for counting application usage.

7. The low-code data visualization and analysis platform according to claim 6, characterized in that: The multiple data source support module includes a data source online configuration submodule, a multiple data source driver submodule, and a data source dynamic switching submodule, wherein the data source online configuration submodule is used to adjust the data source connection information online, the multiple data source driver submodule is used to support various types of data source driver dependency packages, and the data source dynamic switching submodule is used to dynamically create and destroy the data source management engine during the data source switching process.

8. The low-code data visualization and analysis platform according to claim 7, characterized in that: The customized query module includes an SQL pre-compilation submodule, an SQL statement parsing submodule, an application construction submodule, a table display customization submodule, and a sensitive mode switching submodule, wherein the SQL pre-compilation submodule processes the SQL statement into a pre-compiled template, the SQL statement parsing module extracts the data information required for the data model from the connected data source, including data field information, SQL query results, etc., the application construction submodule automatically sets reasonable default values ​​for the application construction properties in combination with the parsed field information, thereby completing the preliminary construction of the application, the table display customization submodule is used to realize user query and download customization in the data display stage; the sensitive mode switching submodule is used for data desensitization and desensitization mode switching functions, and the original data of a single record can be viewed in the desensitization mode, while all original data can be directly viewed in the non-desensitization mode.

9. The low-code data visualization and analysis platform according to claim 8, characterized in that: The field maintenance module includes a field attribute maintenance submodule, a dictionary management submodule, and a data table management submodule, wherein: the field attribute maintenance submodule customizes the style, screening, and functions of the field level according to the needs of data display and use, including width, sorting, fuzzy query, encryption, and display; Dictionary management, through online editing or uploading of dictionary tables, translates and displays different business codes in the data; the data table management submodule maintains the data table structure, including the Chinese name of the field, field type, etc.

10. The low-code data visualization and analysis platform according to claim 9, characterized in that: The data collision module includes an optional field pool submodule, a query field pool submodule, and an output field pool submodule, wherein: The optional field pool module quickly parses the field information in the collided data table and displays it in the optional field submodule; In the query field pool submodule, users can drag the field information to be uploaded from the optional field pool to the query field pool. The fields in the query field pool will be used as the associated fields for the joint table query. In the output field pool submodule, users can drag the required result data fields from the optional field pool to the output field pool, and use them as the header information of the output file.

11. The low-code data visualization and analysis platform according to claim 10, characterized in that: The data vision module includes a multimedia file display submodule, a file display submodule, and a real-time data large screen submodule, wherein: The multimedia file display submodule supports the display and text editing of video and image format content, and guides customers to use data analysis tools; The file display submodule provides users with a data tool sharing channel by supporting the display of pdf, wps, and exe format files; The real-time data large screen sub-module can quickly configure and display the real-time data large screen through the drag and drop operation of the componentized tool and the configuration of real-time data.

12. The low-code data visualization and analysis platform according to claim 11, characterized in that: The function statistics function includes a function usage ranking submodule, a user access ranking submodule, a function usage statistics submodule and a user access statistics submodule, wherein: Function usage ranking submodule supports ranking of data function access, including listing ranking information of top N function access times in different dimensions; The user access ranking submodule supports the ranking of users' access to the platform, including the ranking information of top N users' access times and function usage frequency in different dimensions; Function usage statistics submodule supports statistics on the access of data functions, including information on the number of times functions are accessed in different dimensions; The user access statistics submodule supports statistics on user access to the platform, including statistics on different dimensions of user access times and function usage frequency.

Images