Data management method and data management device for multi-dimensional table

Abstract

The invention provides a data management method and device for a multi-dimensional table, and the method comprises the steps: carrying out the data parameter configuration of a data connector according to the configuration information of target data based on the demand information of the expected synchronization of the target data to the multi-dimensional table; based on the configuration information, determining a unique identifier and accessible user information corresponding to the target data by using a data connector, so as to synchronize the whole target data into a multi-dimensional table and set an access permission; and based on the historical data stored by the connector, performing incremental inspection for the target data on the multi-dimensional table according to the data synchronization period to obtain an incremental inspection result, and based on the incremental inspection result, performing first incremental synchronization on the target data in the multi-dimensional table by using the data connector. By means of the method, the data management efficiency and flexibility of the multi-dimensional table are improved, and then the operation experience of data management of a user is guaranteed.

Description

Technical Field

[0001] The present application relates to the technical field of data management, and in particular to a data management method and a data management device for a multidimensional table. Background Art

[0002] Multidimensional tables are online databases in the form of tables. They can be used as a basic functional suite in office software to store and manage data. In the data synchronization function provided by multidimensional tables, supported data sources may include office software, relational databases, third-party applications, and custom applications. In custom applications, you can customize the data service interface in the multidimensional table to enable the multidimensional table to pull data.

[0003] Currently, when managing data in multidimensional tables, administrators are required to perform operations such as manually synchronizing data or modifying synchronization configurations. The synchronized data content cannot be adjusted as needed, and access control permissions for rows and columns cannot be set for data. Administrators are required to perform manual configuration, which reduces the data management efficiency and flexibility of multidimensional tables and makes the user experience of data management poor. Summary of the invention

[0004] In view of this, the purpose of the present application is to provide a data management method and a data management device for a multidimensional table. According to the acquired demand information for synchronizing the target data to the multidimensional table, the data parameters of the preset data connector are configured, and the unique identifier and accessible user information corresponding to the target data are determined through the data connector to synchronize the target data in full to the multidimensional table. At the same time, the access rights corresponding to the target data are set, and the target data in the multidimensional table are incrementally synchronized according to the data synchronization cycle, thereby improving the data management efficiency and flexibility of the multidimensional table, thereby ensuring the user's operational experience in data management.

[0005] The present application provides a data management method for a multidimensional table, the data management method comprising:

[0006] In response to obtaining demand information for synchronizing target data to a multidimensional table, determining configuration information of the target data based on the demand information, and configuring data parameters of a preset data connector according to the configuration information;

[0007] Based on the configuration information, the data connector is used to determine the unique identifier and accessible user information corresponding to the target data, so as to synchronize the target data in full to the multidimensional table and set the access rights corresponding to the target data;

[0008] Based on the historical data stored in the connector, the multidimensional table is incrementally checked for the target data according to the data synchronization period included in the configuration information to obtain an incremental check result, and based on the incremental check result, the data connector is used to perform a first incremental synchronization on the target data in the multidimensional table.

[0009] Further, based on the configuration information, using the data connector to determine the unique identifier and accessible user information corresponding to the target data, so as to synchronize the entire target data to the multidimensional table and set the access rights corresponding to the target data, includes:

[0010] Based on the dimension column information included in the configuration information, using the data connector to determine a unique identifier corresponding to each row of data in the target data, so as to ensure the uniqueness of the target data;

[0011] Based on the permission column information included in the configuration information, using the data connector to determine the accessible user information in the target data to set the access permission corresponding to the target data;

[0012] In response to both the unique identifier and the accessible user information being determined, the target data is fully synchronized to the multidimensional table.

[0013] Further, based on the dimension column information included in the configuration information, using the data connector to determine the unique identifier corresponding to each row of data in the target data to ensure the uniqueness of the target data includes:

[0014] Based on the dimension column information included in the configuration information, determining the dimension field value corresponding to each row of data in the target data;

[0015] Based on the dimension field value, a hash value corresponding to each row of data is calculated, and the hash value is determined as a unique identifier corresponding to each row of data, so as to generate a unique column consisting of the unique identifier in the target data;

[0016] Determine whether there is duplicate data in the unique column;

[0017] If duplicate data exists in the unique column, the duplicate data is deduplicated to ensure the uniqueness of the target data.

[0018] Further, based on the permission column information included in the configuration information, using the data connector to determine the accessible user information in the target data to set the access rights corresponding to the target data includes:

[0019] Based on the permission column information included in the configuration information, determine the target user who can access the target data, and determine the target user field value corresponding to each row of data in the target data;

[0020] Based on the target user field value, determine the serial number value corresponding to the target user, and convert the serial number value into a target serial number value according to a preset platform rule to determine the accessible user information;

[0021] An accessible user column consisting of the accessible user information is generated in the target data to set access rights corresponding to the target data.

[0022] Further, based on the historical data stored in the connector, the multidimensional table is subjected to an incremental check on the target data according to the data synchronization cycle included in the configuration information to obtain an incremental check result, including:

[0023] Based on the target data in the multidimensional table, calculating a first dimension column hash value and a first indicator column hash value corresponding to the target data;

[0024] The first dimension column hash value and the first indicator column hash value are respectively compared with the second dimension column hash value and the second indicator column hash value in the historical data stored in the connector to perform an incremental check on the target data in the multidimensional table to obtain an incremental check result that represents the data difference between the target data and the historical data.

[0025] Further, based on the incremental check result, using the data connector to perform a first incremental synchronization on the target data in the multidimensional table includes:

[0026] Determine target incremental data and data operations corresponding to the target incremental data based on the incremental check result;

[0027] Based on the target incremental data, the data connector is used to perform a first incremental synchronization on the target data in the multidimensional table according to the data operation.

[0028] Furthermore, the data management method further includes:

[0029] In response to an externally triggered incremental synchronization operation, based on data management information corresponding to the incremental synchronization operation, the data in the multidimensional table is synchronized with the data connector for a second incremental synchronization.

[0030] The present application also provides a data management device for a multidimensional table, the data management device comprising:

[0031] A parameter configuration module, for, in response to obtaining demand information for synchronizing target data to a multidimensional table, determining configuration information of the target data based on the demand information, and performing data parameter configuration on a preset data connector according to the configuration information;

[0032] A full synchronization module, used to determine the unique identifier and accessible user information corresponding to the target data using the data connector based on the configuration information, so as to synchronize the target data in full to the multidimensional table and set access rights corresponding to the target data;

[0033] An incremental synchronization module is used to perform an incremental check on the target data in the multidimensional table based on the historical data stored in the connector and according to the data synchronization cycle included in the configuration information, to obtain an incremental check result, and based on the incremental check result, to perform a first incremental synchronization on the target data in the multidimensional table using the data connector.

[0034] Further, when the full synchronization module is used to determine the unique identifier and accessible user information corresponding to the target data using the data connector based on the configuration information, so as to synchronize the target data in full to the multidimensional table and set the access rights corresponding to the target data, the full synchronization module is used to:

[0035] Based on the dimension column information included in the configuration information, using the data connector to determine a unique identifier corresponding to each row of data in the target data, so as to ensure the uniqueness of the target data;

[0036] Based on the permission column information included in the configuration information, using the data connector to determine the accessible user information in the target data to set the access permission corresponding to the target data;

[0037] In response to both the unique identifier and the accessible user information being determined, the target data is fully synchronized to the multidimensional table.

[0038] Further, when the full synchronization module is used to determine the unique identifier corresponding to each row of data in the target data by using the data connector based on the dimension column information included in the configuration information to ensure the uniqueness of the target data, the full synchronization module is used to:

[0039] Based on the dimension column information included in the configuration information, determining the dimension field value corresponding to each row of data in the target data;

[0040] Based on the dimension field value, a hash value corresponding to each row of data is calculated, and the hash value is determined as a unique identifier corresponding to each row of data, so as to generate a unique column consisting of the unique identifier in the target data;

[0041] Determine whether there is duplicate data in the unique column;

[0042] If duplicate data exists in the unique column, the duplicate data is deduplicated to ensure the uniqueness of the target data.

[0043] Further, when the full synchronization module is used to determine the accessible user information in the target data using the data connector based on the permission column information included in the configuration information to set the access rights corresponding to the target data, the full synchronization module is used to:

[0044] Based on the permission column information included in the configuration information, determine the target user who can access the target data, and determine the target user field value corresponding to each row of data in the target data;

[0045] Based on the target user field value, determine the serial number value corresponding to the target user, and convert the serial number value into a target serial number value according to a preset platform rule to determine the accessible user information;

[0046] An accessible user column consisting of the accessible user information is generated in the target data to set access rights corresponding to the target data.

[0047] Further, when the incremental synchronization module is used to perform an incremental check on the target data on the multidimensional table based on the historical data stored by the connector according to the data synchronization cycle included in the configuration information and obtain an incremental check result, the incremental synchronization module is used to:

[0048] Based on the target data in the multidimensional table, calculating a first dimension column hash value and a first indicator column hash value corresponding to the target data;

[0049] The first dimension column hash value and the first indicator column hash value are respectively compared with the second dimension column hash value and the second indicator column hash value in the historical data stored in the connector to perform an incremental check on the target data in the multidimensional table to obtain an incremental check result that represents the data difference between the target data and the historical data.

[0050] Further, when the incremental synchronization module is used to perform a first incremental synchronization on the target data in the multidimensional table using the data connector based on the incremental check result, the incremental synchronization module is used to:

[0051] Determine target incremental data and data operations corresponding to the target incremental data based on the incremental check result;

[0052] Based on the target incremental data, the data connector is used to perform a first incremental synchronization on the target data in the multidimensional table according to the data operation.

[0053] Furthermore, the data management device further includes an external incremental synchronization module, and the external incremental synchronization module is used to:

[0054] In response to an externally triggered incremental synchronization operation, based on data management information corresponding to the incremental synchronization operation, the data in the multidimensional table is synchronized with the data connector for a second incremental synchronization.

[0055] An embodiment of the present application also provides an electronic device, including: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the steps of the multidimensional table data management method as described above are performed.

[0056] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the multi-dimensional table data management method as described above are executed.

[0057] The data management method and data management device for a multidimensional table provided in an embodiment of the present application, the data management method comprising: in response to obtaining demand information for synchronizing target data to a multidimensional table, determining configuration information of the target data based on the demand information, and configuring data parameters of a preset data connector according to the configuration information; based on the configuration information, determining a unique identifier and accessible user information corresponding to the target data using the data connector, so as to synchronize the target data in full to the multidimensional table and set access rights corresponding to the target data; based on historical data stored in the connector, performing an incremental check on the target data in the multidimensional table according to the data synchronization period included in the configuration information, obtaining an incremental check result, and based on the incremental check result, performing a first incremental synchronization on the target data in the multidimensional table using the data connector.

[0058] Compared with the method in the prior art in which the administrator performs manual data synchronization or modifies synchronization configuration and manually configures access control permissions for rows and columns, the data parameters of the preset data connector are configured according to the demand information obtained for synchronizing the target data to the multidimensional table, and the unique identifier and accessible user information corresponding to the target data are determined through the data connector to synchronize the target data in full to the multidimensional table. At the same time, the access permissions corresponding to the target data are set, and the target data in the multidimensional table is incrementally synchronized according to the data synchronization cycle, thereby improving the data management efficiency and flexibility of the multidimensional table, thereby ensuring the user's operational experience in data management.

[0059] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0061] Figure 1 One of the flow charts of a multidimensional table data management method provided in an embodiment of the present application;

[0062] Figure 2 A schematic diagram of data parameter configuration of a data connector provided in an embodiment of the present application;

[0063] Figure 3 A schematic diagram of user rights for a multidimensional table provided in an embodiment of the present application;

[0064] Figure 4 The second flowchart of a multidimensional table data management method provided in an embodiment of the present application;

[0065] Figure 5 One of the structural schematic diagrams of a multidimensional table data management device provided in an embodiment of the present application;

[0066] Figure 6 The second structural diagram of a multidimensional table data management device provided in an embodiment of the present application;

[0067] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0068] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, each other embodiment obtained by those skilled in the art without making creative work belongs to the scope of protection of the present application.

[0069] Research has found that as various industries gradually realize the online and digitalization of the entire process, they will accumulate rich data and information, making analysis, insight and sharing of various types of data a high-frequency demand. Among them, data can be managed and analyzed through management tools such as Excel-based data analysis tools, customized development of scenario-based data analysis systems, and self-developed BI analysis platforms or commercial BI products. However, these tools are not lightweight and have poor versatility, which increases the investment in R&D costs.

[0070] To address the above issues, a multidimensional table is an online database in the form of a table. It can be used as a basic functional suite in office software to store and manage data. Multidimensional tables can realize real-time synchronization and annotation discussion among multiple editors, and can trace historical records with one click, making data collaboration more convenient. It provides a wealth of fields, views, dashboards, and plug-in capabilities, and can flexibly build customized business systems based on business needs to achieve personalized business management of data. In addition, it can quickly synchronize project progress and set fine-grained permissions for rows and columns as needed to improve work efficiency and ensure data security.

[0071] In the data synchronization function provided by the multidimensional table, supported data sources may include office software, relational databases, third-party applications, and custom applications. In custom applications, the data service interface can be customized in the multidimensional table to enable the multidimensional table to pull data.

[0072] Currently, when managing data in multidimensional tables, administrators are required to perform operations such as manually synchronizing data or modifying synchronization configurations. The synchronized data content cannot be adjusted as needed, and access control permissions for rows and columns cannot be set for data. Administrators are required to perform manual configuration, which reduces the data management efficiency and flexibility of multidimensional tables and makes the user experience of data management poor.

[0073] Based on this, an embodiment of the present application provides a data management method for a multidimensional table. According to the demand information obtained for synchronizing the target data to the multidimensional table, the data parameters of the preset data connector are configured, and the unique identifier and accessible user information corresponding to the target data are determined through the data connector to synchronize the target data in full to the multidimensional table. At the same time, the access rights corresponding to the target data are set, and the target data in the multidimensional table is incrementally synchronized according to the data synchronization cycle, thereby improving the data management efficiency and flexibility of the multidimensional table, thereby ensuring the user's operational experience in data management.

[0074] See also Figure 1 , Figure 1 This is one of the flow charts of a multidimensional table data management method provided in an embodiment of the present application. Figure 1 As shown in , the data management method of the multidimensional table provided in the embodiment of the present application includes:

[0075] S101. In response to obtaining demand information for synchronizing target data to a multidimensional table, based on the demand information, determining configuration information of the target data, and configuring data parameters of a preset data connector according to the configuration information.

[0076] It should be noted that when the user expects to synchronize the target data to a multidimensional table, the demand information will be sent to the preset data connector; wherein, the demand information may include but is not limited to the data source interface and the target data under the data source interface, the dimension column information and permission column information corresponding to the target data, the sub-table parameters corresponding to the target data, the display field information and the data synchronization cycle, etc.

[0077] Here, the configuration information refers to information converted according to the configuration requirements of the data connector based on the demand information. The configuration information corresponds to the demand information, that is, the configuration information may include but is not limited to the data source interface and the target data under the data source interface, the dimension column information and permission column information corresponding to the target data, the sub-table parameters corresponding to the target data, the display field information and the data synchronization cycle, etc.

[0078] For example, see Figure 2 , Figure 2 This is a schematic diagram of data parameter configuration of a data connector provided by an embodiment of the present application. Figure 2As shown in , based on the acquired demand information for synchronizing the target data to the multidimensional table, the configuration information for configuring the data parameters of the data connector may include a data source interface, dimension columns, permission columns, table partitioning parameters, designated fields, and data synchronization cycles, etc.; wherein the table partitioning parameters are used to filter multiple data subsets under the data source interface to determine the subset of the target data under the data source interface; the designated fields are used to determine the fields in the target data for visual display.

[0079] In this step, during the specific implementation, first, the multidimensional table, data connector and office software are initialized and configured, including operations such as logging in, starting up and self-building; then, a target data table for storing target data is established in the multidimensional table; thereafter, in response to the demand information sent by the user to synchronize the target data to the multidimensional table, the configuration information of the target data is determined; finally, the data parameters of the data connector are configured according to the configuration information.

[0080] In the embodiment of the present application, since the multidimensional table can provide a variety of plug-in functions, the data connector can be pre-constructed and set based on the plug-in functions.

[0081] S102. Based on the configuration information, use the data connector to determine the unique identifier and accessible user information corresponding to the target data, so as to synchronize the entire target data to the multidimensional table and set access rights corresponding to the target data.

[0082] In this step, after configuring the data parameters of the data connector according to the configuration information, the data connector is used to determine the unique identifier corresponding to the target data, so as to set the column information of the target data in the multidimensional table and write the row data, so as to push the full target data to the multidimensional table; then, in the process of synchronizing the full amount of the target data, the permission rules are managed based on the permission column information in the configuration information, and the data connector is used to determine the accessible user information corresponding to the target data, so as to set the access rights corresponding to the target data.

[0083] In one implementation of the present application, during specific implementation, step S102 may include:

[0084] S1021. Based on the dimension column information included in the configuration information, use the data connector to determine a unique identifier corresponding to each row of data in the target data to ensure the uniqueness of the target data.

[0085] It should be noted that since the data source interface provided to the data connector may include the data service interface of the big data platform, other service interfaces, and database table interfaces, most of these data source interfaces are used for statistics and analysis of data and do not have a unique identifier for the data. After the data is written into the multidimensional table, the uniqueness of the data needs to be guaranteed. Therefore, it is necessary to use the data connector to generate a unique identifier for each target data.

[0086] In an embodiment of the present application, the fields of multiple columns of data included in the target data can be divided into two categories: one is the dimension field, and the other is the indicator field; wherein the dimension field is an identifier used to describe the basic information of the object, generally discrete enumerable data; and the indicator field is used to quantify the information of the object, and may include various numerical values.

[0087] Here, after configuring the data source interface, the data connector will display all fields of the target data under the data source interface, that is, the dimension fields in the target data can be determined according to the dimension column information included in the configuration information; for example, the dimension field can be equivalent to the "group by" field in the SQL database.

[0088] In one implementation of the present application, during specific implementation, step S1021 may include:

[0089] S10211. Based on the dimension column information included in the configuration information, determine the dimension field value corresponding to each row of data in the target data.

[0090] In this step, the dimension column information included in the configuration information is used to determine the dimension field value corresponding to the intersection of each row of data and the dimension column.

[0091] S10212. Based on the dimension field value, calculate the hash value corresponding to each row of data, and determine the hash value as the unique identifier corresponding to each row of data, so as to generate a unique column consisting of the unique identifier in the target data.

[0092] In this step, during the specific implementation, first, the dimension field value and the dimension field name corresponding to the dimension field value are concatenated with commas, and a hash value corresponding to each row of data is calculated and generated; then, the hash value is determined as the unique identifier corresponding to each row of data; finally, a unique column consisting of the unique identifier is generated at the beginning of each row in the target data to achieve column expansion of the target data.

[0093] In the embodiment of the present application, the hash value may refer to an MD5 value (Message Digest Algorithm 5), which is a cryptographic hash function that can generate a 128-bit (16-byte) hash value or message digest.

[0094] S10213. Determine whether there is duplicate data in the unique column.

[0095] S10214. If duplicate data exists in the unique column, deduplicate the duplicate data to ensure the uniqueness of the target data.

[0096] In this step, during the full synchronization of the target data to the multidimensional table, it is detected whether there is duplicate data in the unique column. When duplicate data exists in the unique column, the full synchronization process is interrupted and an abnormal warning is issued, and the duplicate data is deduplicated to ensure the uniqueness of the target data.

[0097] Furthermore, if there is no duplicate data in the unique column, the full synchronization of the target data to the multidimensional table continues.

[0098] S1022. Based on the permission column information included in the configuration information, use the data connector to determine the accessible user information in the target data to set the access rights corresponding to the target data.

[0099] In an embodiment of the present application, setting access rights corresponding to the target data is a guarantee of data security, so as to simplify the manual configuration workload of the administrator. Since the multidimensional table provides a plug-in for the permission function, comprehensive row and column permission control can be implemented. Therefore, based on the permission column information included in the configuration information, the access rights corresponding to the target data can be set and submitted to the multidimensional table for execution.

[0100] In one implementation of the present application, during specific implementation, step S1022 may include:

[0101] S10221. Determine a target user who can access the target data based on the permission column information included in the configuration information, and determine a target user field value corresponding to each row of data in the target data.

[0102] In this step, based on the permission column information included in the configuration information, the target user specified in the permission column information who can access the target data, that is, the user column in the target data, is determined, and the target user field value corresponding to each row of data is determined in the target data.

[0103] S10222. Determine a serial number value corresponding to the target user based on the target user field value, and convert the serial number value into a target serial number value according to a preset platform rule to determine accessible user information.

[0104] In this step, since the multidimensional table can be applied to a variety of platforms, such as office software platforms, business software platforms, and information maintenance platforms, the serial number value corresponding to the target user is determined based on the target user field value, and the serial number value is converted into a target serial number value according to the platform rules preset by the platform where the multidimensional table is located to determine the accessible user information in the target data.

[0105] The accessible user information may include a second user who can access the target data under the first user corresponding to the target data in the permission column information.

[0106] S10223. Generate an accessible user column consisting of the accessible user information in the target data to set access rights corresponding to the target data.

[0107] In this step, the accessible user information is organized into an accessible user column in the target data and appended to the last column of each row of the target data, which is equivalent to expanding the column of the target data again to set the access rights corresponding to the target data.

[0108] Exemplarily, as an example of setting access permissions corresponding to target data, assume that the dimension fields in the target data may include: "term_id", "class_id", "city", "account_id"; the indicator fields in the target data may include: "user_cnt", "finish_rate", when the demand information indicates that the teacher can only see the data of the class he or she teaches, and the teacher group leader can see the data of all teachers under his or her name, the permission column information is "teacher ID", that is, the target users are teachers and group leaders, and the "account_id" field corresponding to the "teacher ID" in the dimension field is determined; then, based on the value of "account_id" in each row of data in the target data, the connector is used to query the serial number values ​​of "teacher ID" and "group leader ID", and the serial number values ​​of "teacher ID" and "group leader ID" are converted into target serial number values ​​in Feishu (office software) to determine the accessible user information, and generate an accessible user column composed of accessible user information in the target data.

[0109] For further information, see Figure 3 , Figure 3 A schematic diagram of user rights for a multidimensional table provided in an embodiment of the present application. Figure 3As shown in , when the data connector calls the plug-in of the multidimensional table to set the access permissions corresponding to the target data, when the user views the data in the multidimensional table, he can only see the data of the currently logged-in user included in the accessible user column of the current row. The multidimensional table returns and displays the target data visible within the user's access permissions based on the set access permissions corresponding to the target data.

[0110] S1023: In response to both the unique identifier and the accessible user information being determined, synchronize all of the target data into the multidimensional table.

[0111] In this step, after the unique identifier of the target data is determined and the access rights corresponding to the target data are set using the determined accessible user information, the target data is fully synchronized to the multidimensional table.

[0112] In an embodiment of the present application, when the target data is fully synchronized to a multidimensional table, the content details of the newly added target data will be recorded in the local database of the data connector, including the unique column corresponding to each row of data), dimension column information, and hash values ​​of indicator columns, etc.

[0113] Here, the reason why dimension column information is recorded instead of indicator column information is because the number of dimension columns is generally small and the values ​​of dimension columns are enumerable, while the number of indicator columns is relatively large.

[0114] Thus, in the embodiment of the present application, since the preset data connector can realize the unified setting and control of permissions at the data dashboard level, and can flexibly perform automatic adjustments; and for the solution that does not use the data connector, when designing permission control, a "top-down" strategy is adopted, starting from the user, after logging in the user information, first query the user's organizational structure, then query the user's permission scope, and then query the data under the user's permission scope.

[0115] Here, the strategy of the data connector is "bottom-up", starting from the data; first, the data is complete and stored in a multidimensional table. Each row of data is associated with a first-level user. Each first-level user has multiple superiors in his or her organizational structure. From the bottom-level first-level user, the second-level user or third-level user of the first-level user is queried in turn according to the organizational structure to obtain a set of accessible users. All users in this set can access the data.

[0116] S103. Based on the historical data stored in the connector, perform an incremental check on the target data in the multidimensional table according to the data synchronization period included in the configuration information to obtain an incremental check result, and based on the incremental check result, use the data connector to perform a first incremental synchronization on the target data in the multidimensional table.

[0117] In an embodiment of the present application, after completing the data parameter configuration, the data connector will perform a full synchronization of the target data for the multidimensional table. After that, it will perform scheduled automatic synchronization according to the data synchronization cycle included in the configuration information. Specifically, the scheduled automatic synchronization adopts incremental synchronization to improve the synchronization performance of the data connector and the timeliness of the data. Here, the incremental synchronization is performed through the operation of checking the difference in data.

[0118] In one embodiment of the present application, in a specific implementation, in step S103, based on the historical data stored by the connector, the multidimensional table is incrementally checked for the target data according to the data synchronization cycle included in the configuration information, and the step of obtaining the incremental check result may include:

[0119] S1031. Based on the target data in the multidimensional table, calculate a first dimension column hash value and a first indicator column hash value corresponding to the target data.

[0120] In this step, based on the target data to be fully synchronized in the multidimensional table, the first dimension column hash value and the first indicator column hash value corresponding to the target data are calculated respectively.

[0121] Here, the first dimension column hash value corresponds to the hash value of the dimension column of the target data; the first indicator column hash value corresponds to the hash value of the indicator column of the target data.

[0122] S1032. Compare the first dimension column hash value and the first indicator column hash value with the second dimension column hash value and the second indicator column hash value in the historical data stored in the connector, respectively, to perform an incremental check on the target data in the multidimensional table, and obtain an incremental check result that represents the data difference between the target data and the historical data.

[0123] In this step, during the specific implementation, first, determine the second dimension column hash value and the second indicator column hash value in the historical data stored in the connector; then, compare the first dimension column hash value and the first indicator column hash value with the second dimension column hash value and the second indicator column hash value, respectively, to perform an incremental check on the target data in the multidimensional table; finally, obtain an incremental check result that represents the data difference between the target data and the historical data.

[0124] Specifically, the incremental check result may include newly added data, updated data, deleted data, etc., and then the target incremental data for incremental synchronization is determined according to the incremental check result.

[0125] In one embodiment of the present application, in a specific implementation, the step of performing a first incremental synchronization on the target data in the multidimensional table using the data connector based on the incremental check result in step S103 may include:

[0126] S1033. Based on the incremental check result, determine the target incremental data and the data operation corresponding to the target incremental data.

[0127] In an embodiment of the present application, the data operations corresponding to the target incremental data may include adding new data, updating data, and deleting data.

[0128] S1034. Based on the target incremental data, use the data connector to perform a first incremental synchronization on the target data in the multidimensional table according to the data operation.

[0129] In this step, the target incremental data is executed into the target data in the multidimensional table using the data connector according to the data operation corresponding to the target incremental data, so as to perform the first incremental synchronization.

[0130] In the embodiment of the present application, the first incremental synchronization refers to the incremental synchronization performed after all target data is synchronized to the multidimensional table using a data connector.

[0131] Optional, see Figure 4 , Figure 4 This is a second flow chart of a multidimensional table data management method provided in an embodiment of the present application. Figure 4 As shown in, in addition to the multidimensional table data management method provided by steps S101 to S103, the embodiment of the present application also includes step S104. Specifically, step S104 is used to illustrate the incremental synchronization method in response to an incremental synchronization operation triggered by an external trigger to improve the flexibility of data management.

[0132] S104. In response to an externally triggered incremental synchronization operation, based on data management information corresponding to the incremental synchronization operation, use the data connector to perform a second incremental synchronization on the data in the multidimensional table.

[0133] In this step, during the specific implementation, first, an incremental synchronization operation triggered externally by a user is received; then, in response to the incremental synchronization operation, data management information corresponding to the incremental synchronization operation is determined; finally, based on the data management information, a second incremental synchronization is performed on the data in the multidimensional table using a data connector.

[0134] The incremental synchronization operation may include adding new data, updating data, deleting data, etc., and the data management information represents the data object and content of the incremental synchronization operation.

[0135] In the embodiment of the present application, the second incremental synchronization refers to incrementally synchronizing the data management information corresponding to the externally triggered incremental synchronization operation into the multidimensional table using a data connector.

[0136] The data management method for a multidimensional table provided in an embodiment of the present application configures data parameters for a preset data connector based on the acquired demand information for synchronizing target data to the multidimensional table, determines the unique identifier and accessible user information corresponding to the target data through the data connector, and synchronizes the target data in full to the multidimensional table. At the same time, the access rights corresponding to the target data are set, and the target data in the multidimensional table is incrementally synchronized according to the data synchronization cycle, thereby improving the data management efficiency and flexibility of the multidimensional table, thereby ensuring the user's operational experience in data management.

[0137] See also Figure 5 , Figure 6 , Figure 5 This is one of the structural diagrams of a multidimensional table data management device provided in an embodiment of the present application. Figure 6 This is a second structural diagram of a multidimensional table data management device provided in an embodiment of the present application. Figure 5 As shown in , the data management device 500 includes:

[0138] The parameter configuration module 510 is used to determine the configuration information of the target data based on the demand information in response to obtaining the demand information of synchronizing the target data to the multidimensional table, and perform data parameter configuration on the preset data connector according to the configuration information;

[0139] A full synchronization module 520 is used to determine the unique identifier and accessible user information corresponding to the target data using the data connector based on the configuration information, so as to synchronize the target data in full to the multidimensional table and set access rights corresponding to the target data;

[0140] The incremental synchronization module 530 is used to perform an incremental check on the target data in the multidimensional table based on the historical data stored in the connector and according to the data synchronization cycle included in the configuration information, to obtain an incremental check result, and based on the incremental check result, use the data connector to perform a first incremental synchronization on the target data in the multidimensional table.

[0141] Further, when the full synchronization module 520 is used to determine the unique identifier and accessible user information corresponding to the target data based on the configuration information using the data connector to synchronize the target data in full to the multidimensional table and set the access rights corresponding to the target data, the full synchronization module 520 is used to:

[0142] Based on the dimension column information included in the configuration information, using the data connector to determine a unique identifier corresponding to each row of data in the target data, so as to ensure the uniqueness of the target data;

[0143] Based on the permission column information included in the configuration information, using the data connector to determine the accessible user information in the target data to set the access permission corresponding to the target data;

[0144] In response to both the unique identifier and the accessible user information being determined, the target data is fully synchronized to the multidimensional table.

[0145] Further, when the full synchronization module 520 is used to determine the unique identifier corresponding to each row of data in the target data by using the data connector based on the dimension column information included in the configuration information to ensure the uniqueness of the target data, the full synchronization module 520 is used to:

[0146] Based on the dimension column information included in the configuration information, determining the dimension field value corresponding to each row of data in the target data;

[0147] Based on the dimension field value, a hash value corresponding to each row of data is calculated, and the hash value is determined as a unique identifier corresponding to each row of data, so as to generate a unique column consisting of the unique identifier in the target data;

[0148] Determine whether there is duplicate data in the unique column;

[0149] If duplicate data exists in the unique column, the duplicate data is deduplicated to ensure the uniqueness of the target data.

[0150] Further, when the full synchronization module 520 is used to determine the accessible user information in the target data using the data connector based on the permission column information included in the configuration information to set the access rights corresponding to the target data, the full synchronization module 520 is used to:

[0151] Based on the permission column information included in the configuration information, determine the target user who can access the target data, and determine the target user field value corresponding to each row of data in the target data;

[0152] Based on the target user field value, determine the serial number value corresponding to the target user, and convert the serial number value into a target serial number value according to a preset platform rule to determine the accessible user information;

[0153] An accessible user column consisting of the accessible user information is generated in the target data to set access rights corresponding to the target data.

[0154] Further, when the incremental synchronization module 530 is used to perform an incremental check on the target data on the multidimensional table based on the historical data stored by the connector according to the data synchronization cycle included in the configuration information and obtain an incremental check result, the incremental synchronization module 530 is used to:

[0155] Based on the target data in the multidimensional table, calculating a first dimension column hash value and a first indicator column hash value corresponding to the target data;

[0156] The first dimension column hash value and the first indicator column hash value are respectively compared with the second dimension column hash value and the second indicator column hash value in the historical data stored in the connector to perform an incremental check on the target data in the multidimensional table to obtain an incremental check result that represents the data difference between the target data and the historical data.

[0157] Further, when the incremental synchronization module 530 is used to perform a first incremental synchronization on the target data in the multidimensional table using the data connector based on the incremental check result, the incremental synchronization module 530 is used to:

[0158] Determine target incremental data and data operations corresponding to the target incremental data based on the incremental check result;

[0159] Based on the target incremental data, the data connector is used to perform a first incremental synchronization on the target data in the multidimensional table according to the data operation.

[0160] Further, such as Figure 6 As shown in , the data management device 500 further includes an external incremental synchronization module 540, and the external incremental synchronization module 540 is used to:

[0161] In response to an externally triggered incremental synchronization operation, based on data management information corresponding to the incremental synchronization operation, the data in the multidimensional table is synchronized with the data connector for a second incremental synchronization.

[0162] The data management device for a multidimensional table provided in an embodiment of the present application configures data parameters for a preset data connector based on the acquired demand information for synchronizing target data to the multidimensional table, determines the unique identifier and accessible user information corresponding to the target data through the data connector, and synchronizes the target data in full to the multidimensional table. At the same time, the access rights corresponding to the target data are set, and the target data in the multidimensional table is incrementally synchronized according to the data synchronization cycle, thereby improving the data management efficiency and flexibility of the multidimensional table, thereby ensuring the user's operational experience in data management.

[0163] See also Figure 7 , Figure 7 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 7 As shown in , the electronic device 700 includes a processor 710 , a memory 720 and a bus 730 .

[0164] The memory 720 stores machine-readable instructions executable by the processor 710. When the electronic device 700 is running, the processor 710 communicates with the memory 720 via the bus 730. When the machine-readable instructions are executed by the processor 710, the above-mentioned Figure 1 as well as Figure 4 The steps of the multidimensional table data management method in the method embodiment shown, the specific implementation method can be found in the method embodiment, and will not be repeated here.

[0165] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program can execute the above-mentioned Figure 1 as well as Figure 4 The steps of the multidimensional table data management method in the method embodiment shown, the specific implementation method can be found in the method embodiment, and will not be repeated here.

[0166] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0167] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0168] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0169] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0170] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application can essentially be embodied in the form of a software product, or in other words, the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0171] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A data management method for a multidimensional table, characterized in that: The data management method comprises: In response to obtaining demand information for synchronizing target data to a multidimensional table, determining configuration information of the target data based on the demand information, and configuring data parameters of a preset data connector according to the configuration information; Based on the configuration information, the data connector is used to determine the unique identifier and accessible user information corresponding to the target data, so as to synchronize the entire target data to the multidimensional table and set the access rights corresponding to the target data; Based on the historical data stored in the connector, the multidimensional table is incrementally checked for the target data according to the data synchronization period included in the configuration information to obtain an incremental check result, and based on the incremental check result, the data connector is used to perform a first incremental synchronization on the target data in the multidimensional table.

2. The method according to claim 1, characterized in that The method of determining the unique identifier and accessible user information corresponding to the target data by using the data connector based on the configuration information, so as to synchronize the target data in full to the multidimensional table and set the access rights corresponding to the target data, includes: Based on the dimension column information included in the configuration information, using the data connector to determine a unique identifier corresponding to each row of data in the target data, so as to ensure the uniqueness of the target data; Based on the permission column information included in the configuration information, using the data connector to determine the accessible user information in the target data to set the access permission corresponding to the target data; In response to both the unique identifier and the accessible user information being determined, the target data is fully synchronized to the multidimensional table.

3. The method according to claim 2, characterized in that The determining, based on the dimension column information included in the configuration information, a unique identifier corresponding to each row of data in the target data by using the data connector to ensure the uniqueness of the target data includes: Based on the dimension column information included in the configuration information, determining the dimension field value corresponding to each row of data in the target data; Based on the dimension field value, a hash value corresponding to each row of data is calculated, and the hash value is determined as a unique identifier corresponding to each row of data, so as to generate a unique column consisting of the unique identifier in the target data; Determine whether there is duplicate data in the unique column; If duplicate data exists in the unique column, the duplicate data is deduplicated to ensure the uniqueness of the target data.

4. The method according to claim 2, characterized in that: The determining, based on the permission column information included in the configuration information, the accessible user information in the target data by using the data connector to set the access permission corresponding to the target data includes: Based on the permission column information included in the configuration information, determine the target user who can access the target data, and determine the target user field value corresponding to each row of data in the target data; Based on the target user field value, determine the serial number value corresponding to the target user, and convert the serial number value into a target serial number value according to a preset platform rule to determine the accessible user information; An accessible user column consisting of the accessible user information is generated in the target data to set access rights corresponding to the target data.

5. The method according to claim 1, characterized in that The step of performing an incremental check on the target data on the multidimensional table based on the historical data stored in the connector according to the data synchronization period included in the configuration information to obtain an incremental check result includes: Based on the target data in the multidimensional table, calculating a first dimension column hash value and a first indicator column hash value corresponding to the target data; The first dimension column hash value and the first indicator column hash value are respectively compared with the second dimension column hash value and the second indicator column hash value in the historical data stored in the connector to perform an incremental check on the target data in the multidimensional table to obtain an incremental check result that represents the data difference between the target data and the historical data.

6. The method according to claim 5, characterized in that The step of performing a first incremental synchronization on the target data in the multidimensional table by using the data connector based on the incremental check result includes: Determine target incremental data and data operations corresponding to the target incremental data based on the incremental check result; Based on the target incremental data, the data connector is used to perform a first incremental synchronization on the target data in the multidimensional table according to the data operation.

7. The method according to claim 1, characterized in that The data management method further comprises: In response to an externally triggered incremental synchronization operation, based on data management information corresponding to the incremental synchronization operation, the data in the multidimensional table is synchronized with the data connector for a second incremental synchronization.

8. A data management device for a multidimensional table, characterized in that: The data management device comprises: A parameter configuration module, for, in response to obtaining demand information for synchronizing target data to a multidimensional table, determining configuration information of the target data based on the demand information, and performing data parameter configuration on a preset data connector according to the configuration information; A full synchronization module, used to determine the unique identifier and accessible user information corresponding to the target data using the data connector based on the configuration information, so as to synchronize the target data in full to the multidimensional table and set access rights corresponding to the target data; An incremental synchronization module is used to perform an incremental check on the target data in the multidimensional table based on the historical data stored in the connector and according to the data synchronization cycle included in the configuration information, to obtain an incremental check result, and based on the incremental check result, to perform a first incremental synchronization on the target data in the multidimensional table using the data connector.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate through the bus, and the machine-readable instructions are executed by the processor to execute the steps of the multidimensional table data management method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the multidimensional table data management method according to any one of claims 1 to 7 are executed.

Images