Data acquisition method and device, equipment and medium

Abstract

The invention relates to the field of big data, and provides a data acquisition method, device, equipment and medium, the data acquisition method is applied to a server, the server establishes communication connection with a service end to realize data information transmission, and the method comprises the following steps: receiving input initial data, integrating the initial data according to data attributes to obtain a corresponding data wide table; wherein the data attributes comprise data granularity, data dimensions and data indexes; establishing a data blood relationship of the data indexes according to the data wide table; acquiring a data acquisition request from the service end; and acquiring corresponding target data from the data wide table according to the data acquisition request and each data blood relationship. The embodiment of the invention can simplify the development process, reduce the labor cost and improve the data acquisition efficiency.

Description

Technical Field

[0001] The present invention relates to the field of big data, and in particular to a data acquisition method, device, equipment and medium. Background Art

[0002] As the amount of data increases, how to quickly obtain target data from massive data has become an urgent problem to be solved. In the existing technology, most of them are developed by designated teams to support temporary data needs of the business. However, this data acquisition method has the following disadvantages:

[0003] 1. Some collection requirements have high timeliness and are complex, requiring dedicated personnel to handle them, and have high personnel requirements;

[0004] 2. Different businesses have different data collection requirements. A data collection requirement requires a specific team to develop scripts to support it, which results in high labor costs.

[0005] 3. Since the businesses are not interoperable, the developed data acquisition script can only be used once and has low reusability.

[0006] Therefore, the existing data acquisition method has the problem of low acquisition efficiency. Summary of the invention

[0007] The embodiments of the present invention provide a data acquisition method, device, equipment and medium, aiming to solve the problem of low acquisition efficiency in existing data acquisition methods.

[0008] In a first aspect, an embodiment of the present invention provides a data acquisition method, which is applied to a server, wherein the server establishes a communication connection with a service end to realize the transmission of data information, and the method includes:

[0009] Receiving the input initial data, integrating the initial data according to data attributes to obtain a corresponding data wide table; wherein the data attributes include data granularity, data dimension and data index;

[0010] Establishing the data kinship relationship of each of the data indicators according to the data wide table;

[0011] Obtaining a data acquisition request from the business end;

[0012] The corresponding target data is obtained from the data wide table according to the data acquisition request and the data blood relationship.

[0013] In a second aspect, an embodiment of the present invention further provides a data acquisition device, which is configured in a server, and the server establishes a communication connection with a service end to realize the transmission of data information, and the device includes:

[0014] A data integration unit, used to receive the input initial data, integrate the initial data according to data attributes, and obtain a corresponding data wide table; wherein the data attributes include data granularity, data dimension and data index;

[0015] A lineage establishing unit, used for establishing a data lineage relationship of each of the data indicators according to the data wide table;

[0016] A first acquisition unit, used to acquire a data acquisition request from the service end;

[0017] The second acquisition unit is used to acquire corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships.

[0018] In a third aspect, an embodiment of the present invention further provides an electronic device, which includes a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method described in the first aspect is implemented.

[0019] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, wherein the storage medium stores a computer program, wherein the computer program includes program instructions, and wherein the program instructions, when executed by a processor, can implement the method described in the first aspect above.

[0020] The present invention provides a data acquisition method, device, equipment and medium. The data acquisition method is applied to a server, and the server establishes a communication connection with a business end to realize the transmission of data information. The method includes: receiving the input initial data, integrating the initial data according to data attributes, and obtaining a corresponding data wide table; wherein the data attributes include data granularity, data dimension and data index; establishing a data lineage relationship of each of the data indexes according to the data wide table; obtaining a data acquisition request from the business end; and obtaining corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships. The embodiment of the present invention can integrate the initial data according to the data attributes to obtain a corresponding data wide table, and then obtain the corresponding target data from the data wide table according to the obtained data acquisition request. The embodiment of the present invention can simplify the development process, reduce labor costs, and improve data acquisition efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.

[0022] Figure 1 A schematic diagram of a flow chart of a data acquisition method provided by an embodiment of the present invention;

[0023] Figure 2 A schematic block diagram of a data acquisition device provided by an embodiment of the present invention;

[0024] Figure 3 A schematic block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0026] It should be understood that when used in this specification and the appended claims, the terms "include" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0027] It should also be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0028] It should be further understood that the term "and / or" used in the present specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations. The embodiment of the present invention provides a data acquisition method, device, equipment and medium. The data acquisition method can be found in Figure 1 , Figure 1 The data acquisition method is applied to a server, and the server establishes a communication connection with a service end to realize the transmission of data information.

[0029] Figure 1 Schematic diagram of the flow of the data acquisition method provided by the embodiment of the present invention. Figure 1 As shown, the method includes the following steps S110-S140.

[0030] S110, receiving the input initial data, integrating the initial data according to data attributes, and obtaining a corresponding data wide table; wherein the data attributes include data granularity, data dimension, and data index.

[0031] In this embodiment, the initial data may be business data collected by various business systems, and the initial data is integrated according to data attributes to obtain a corresponding wide data table; wherein the data attributes include data granularity, data dimension and data indicator; wherein the data granularity refers to the scope or degree of detail covered by each data element contained in the data set, the data dimension refers to the classification characteristics and attributes of the data, and the data indicator refers to the summary result obtained by analyzing the data; for example, the number of new employees of institution A from January to March; wherein "January to March" is the data dimension, "institution A" is the data granularity, and the number of new employees is the data indicator; the present invention integrates the initial data according to the data granularity, the data dimension and the data indicator to obtain a corresponding wide data table, in which the data dimension / data indicator of the data granularity is unified.

[0032] In one embodiment, after step S110, it further includes: counting the total number of corresponding data indicators according to the data granularity in the data wide table to obtain the market data; and displaying the market data on a preset display interface.

[0033] In this embodiment, the total number of the corresponding data indicators is counted according to the data granularity in the data wide table to obtain the large-scale data; and the large-scale data is displayed on a preset display interface. In this embodiment of the present invention, the large-scale data can be displayed on a preset display interface, so that business personnel can intuitively view the total number of data indicators of each data granularity.

[0034] S120: Establish a data kinship relationship between the data indicators according to the data wide table.

[0035] In this embodiment, the data lineage relationship of each of the data indicators is established according to the data wide table, and the data source of the data indicator is automatically traced according to the data lineage relationship of each of the data indicators, thereby improving data acquisition efficiency.

[0036] In one embodiment, after step S120, it also includes: obtaining at least one indicator to be accessed according to the detected data access request; obtaining the corresponding business owner according to the data lineage relationship of each indicator to be accessed; and sending a corresponding data access request to the corresponding business owner according to the indicator to be accessed.

[0037] In this embodiment, the business personnel can perform corresponding touch / click operations on the business end to trigger corresponding data access requests; specifically, the business personnel can browse the data in the data wide table according to the data acquisition requirements. For example, the business personnel needs to analyze data indicator a, data indicator b, data indicator c, data indicator d, and data indicator e. After browsing the data in the data wide table, the business personnel finds that the data wide table already contains data indicator a, data indicator b, and data indicator c. At this time, the business personnel can issue a corresponding data access request to analyze / access / view the specific data corresponding to data indicator a, data indicator b, and data indicator c; wherein, Specific data includes information such as the calculation logic, statistical scope, and data source of the data indicators; specifically, the corresponding business owner is obtained according to the data lineage relationship of each of the indicators to be accessed (i.e., data indicator a, data indicator b, and data indicator c); a corresponding data access request is sent to the corresponding business owner according to the indicators to be accessed; for example, business A is the business owner of data indicator a, data indicator b, and data indicator c. If business A approves the data access request, the business personnel can access / view data indicator a, data indicator b, and data indicator c; if business A rejects the data access request, the business personnel cannot access / view data indicator a, data indicator b, and data indicator c.

[0038] In one embodiment, after step S120, it also includes: obtaining at least one indicator to be developed according to the detected data development request; obtaining a corresponding development owner according to the data lineage relationship of each indicator to be developed; and sending a corresponding data development request to the corresponding development owner according to the indicator to be developed.

[0039] In this embodiment, business personnel can perform corresponding touch / click operations on the business end to trigger corresponding data development requests; specifically, business personnel can browse the data in the data wide table according to data acquisition requirements. For example, business personnel need to analyze data indicator a, data indicator b, data indicator c, data indicator d, and data indicator e. After browsing the data in the data wide table, the business personnel finds that indicator data f, data indicator g and data indicator d and data indicator e in the data wide table are similar. At this time, the business personnel can issue a corresponding data development request to request the development owner corresponding to indicator data f and data indicator g to develop a script to support the corresponding data acquisition requirements. For example, developer A is the development owner of data indicator d and data indicator e. Because developer A has relevant experience reserves, the development time can be shortened and the development cost can be reduced.

[0040] S130: Obtain a data acquisition request from the business end.

[0041] In this embodiment, the business personnel can perform the corresponding touch / click operation on the business end to trigger the corresponding data acquisition request, and the data acquisition request includes configuration content. The business personnel can configure the configuration content according to the data acquisition requirements. Specifically, the business personnel can configure the indicator field and dimension field in the configuration content. In the embodiment of the present invention, the configurability of data indicators and data dimensions is supported. The business personnel can configure the combination of data indicators and data dimensions according to the data acquisition requirements to generate the corresponding data acquisition request.

[0042] S140: Acquire corresponding target data from the data wide table according to the data acquisition request and the data blood relationship.

[0043] In this embodiment, the configuration content is acquired according to the data acquisition request, and the corresponding target data is acquired from the data wide table according to the data lineage relationship of the data indicators in the configuration content.

[0044] In one embodiment, step S140 includes: obtaining configuration content according to the data acquisition request; obtaining a data table path corresponding to the configuration content according to the data lineage relationship; obtaining initial target data according to the configuration content and the data table path; integrating the initial target data according to the indicator field and dimension field in the configuration content to obtain the target data.

[0045] In this embodiment, configuration content is acquired according to the data acquisition request; corresponding data lineage relationships are acquired according to data indicators and / or data dimensions in the configuration content, and a data table path corresponding to the configuration content is acquired according to the acquired data lineage relationships; initial target data is acquired according to the configuration content and the data table path; the initial target data is integrated according to the indicator fields and dimension fields in the configuration content to obtain the target data; because in the data wide table, the data dimensions / data indicators of the data granularity are unified, the initial target data can be quickly integrated to obtain the target data.

[0046] In one embodiment, after step S140, the method further includes: if the target data is empty data, generating a corresponding data abnormality reminder and feeding back the reminder to the business end.

[0047] In this embodiment, if the data corresponding to the data acquisition request is missing in the data wide table, the target data obtained is empty data. If the target data is empty data, a corresponding data abnormality reminder is generated and fed back to the business end to remind the corresponding business personnel.

[0048] In one embodiment, after step S140, it also includes: obtaining a corresponding new indicator according to the detected indicator addition request; inserting the new indicator into the data wide table according to the data lineage relationship of the new indicator to obtain an updated data wide table.

[0049] In this embodiment, if the data required by the business personnel is not available in the data wide table, the business personnel may issue corresponding data collection requirements on the business end so that a specific team can develop a script based on the data collection requirements; specifically, the data collection requirements are split into multiple data indicators, and the data lineage relationship of each data indicator is configured, and the data lineage relationship includes information such as data source, development owner, and business owner; after the configuration is completed, click "Upload" to trigger the corresponding indicator addition request, and the server can obtain the corresponding new indicator based on the detected indicator addition request; according to the data lineage relationship of the new indicator, the new indicator is inserted into the data wide table to obtain an updated data wide table.

[0050] To sum up, the embodiment of the present invention can integrate the initial data according to data attributes to obtain a corresponding data wide table, and then obtain the corresponding target data from the data wide table according to the obtained data acquisition request. The embodiment of the present invention can simplify the development process, reduce labor costs, and improve data acquisition efficiency.

[0051] Figure 2 Schematic block diagram of a data acquisition device provided by an embodiment of the present invention. Figure 2 As shown, corresponding to the above data acquisition method, the present invention also provides a data acquisition device, in which the server establishes a communication connection with the service end to realize the transmission of data information. Figure 2 , the data acquisition device 700 includes:

[0052] The data integration unit 701 is used to receive the input initial data, integrate the initial data according to data attributes, and obtain a corresponding data wide table; wherein the data attributes include data granularity, data dimension and data index;

[0053] A lineage establishing unit 702, used to establish a data lineage relationship of each of the data indicators according to the data wide table;

[0054] A first acquisition unit 703 is used to acquire a data acquisition request from the service end;

[0055] The second acquisition unit 704 is used to acquire corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships.

[0056] In some embodiments, after receiving the input initial data and integrating the initial data according to data attributes to obtain the corresponding data wide table, the data integration unit 701 is further used to:

[0057] The total number of the corresponding data indicators is counted according to the data granularity in the data wide table to obtain the market data; and the market data is displayed on a preset display interface.

[0058] In some embodiments, after executing the step of establishing the data lineage relationship of each of the data indicators according to the data wide table, the lineage establishing unit 702 is further configured to:

[0059] At least one indicator to be accessed is obtained according to the detected data access request; the corresponding business owner is obtained according to the data lineage relationship of each indicator to be accessed; and the corresponding data access request is sent to the corresponding business owner according to the indicator to be accessed.

[0060] In some embodiments, after executing the step of establishing the data lineage relationship of each of the data indicators according to the data wide table, the lineage establishing unit 702 is further configured to:

[0061] At least one indicator to be developed is obtained according to the detected data development request; a corresponding development owner is obtained according to the data lineage relationship of each indicator to be developed; and a corresponding data development request is sent to the corresponding development owner according to the indicator to be developed.

[0062] In some embodiments, when executing the step of acquiring corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships, the second acquisition unit 704 is specifically configured to:

[0063] Acquire configuration content according to the data acquisition request; acquire a data table path corresponding to the configuration content according to the data lineage relationship; acquire initial target data according to the configuration content and the data table path; integrate the initial target data according to the indicator field and dimension field in the configuration content to obtain the target data.

[0064] In some embodiments, after executing the step of acquiring corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships, the second acquisition unit 704 is further configured to:

[0065] If the target data is empty data, a corresponding data abnormality reminder is generated and fed back to the business end.

[0066] In some embodiments, after executing the step of acquiring corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships, the second acquisition unit 704 is further configured to:

[0067] According to the detected indicator addition request, the corresponding new indicator is obtained; according to the data lineage relationship of the new indicator, the new indicator is inserted into the data wide table to obtain an updated data wide table.

[0068] It should be noted that those skilled in the art can clearly understand that the specific implementation process of the above-mentioned data acquisition device and each unit can refer to the corresponding description in the aforementioned method embodiment, and for the convenience and brevity of description, it will not be repeated here.

[0069] The above data acquisition device can be implemented in the form of a computer program. The computer program can be Figure 3 The electronic device shown is running.

[0070] See also Figure 3 , Figure 3 800 is a schematic block diagram of an electronic device provided by an embodiment of the present invention. The electronic device 800 may be a terminal or a server, wherein the terminal may be an electronic device with a communication function. The server may be an independent server or a server cluster composed of multiple servers.

[0071] See also Figure 3 The electronic device 800 includes a processor 802 , a memory and a network interface 805 connected via a system bus 801 , wherein the memory may include a non-volatile storage medium 803 and an internal memory 804 .

[0072] The non-volatile storage medium 803 may store an operating system 8031 ​​and a computer program 8032. The computer program 8032 includes program instructions, and when the program instructions are executed, the processor 802 may execute a data acquisition method.

[0073] The processor 802 is used to provide computing and control capabilities to support the operation of the entire electronic device 800 .

[0074] The internal memory 804 provides an environment for the operation of the computer program 8032 in the non-volatile storage medium 803. When the computer program 8032 is executed by the processor 802, the processor 802 can execute a data acquisition method.

[0075] The network interface 805 is used to communicate with other devices over the network. Figure 3The structure shown in the figure is merely a block diagram of a partial structure related to the solution of the present invention, and does not constitute a limitation on the electronic device 800 to which the solution of the present invention is applied. The specific electronic device 800 may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0076] The processor 802 is used to run the computer program 8032 stored in the memory to implement the following steps:

[0077] Receive the input initial data, integrate the initial data according to data attributes, and obtain a corresponding data wide table; wherein the data attributes include data granularity, data dimension, and data index; establish a data lineage relationship of each of the data indexes according to the data wide table; obtain a data acquisition request from the business end; and obtain corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships.

[0078] In some embodiments, after receiving the input initial data and integrating the initial data according to data attributes to obtain the corresponding data wide table, the processor 802 is further configured to:

[0079] The total number of the corresponding data indicators is counted according to the data granularity in the data wide table to obtain the market data; and the market data is displayed on a preset display interface.

[0080] In some embodiments, after implementing the step of establishing the data lineage relationship of each of the data indicators according to the data wide table, the processor 802 is further configured to:

[0081] At least one indicator to be accessed is obtained according to the detected data access request; the corresponding business owner is obtained according to the data lineage relationship of each indicator to be accessed; and the corresponding data access request is sent to the corresponding business owner according to the indicator to be accessed.

[0082] In some embodiments, after implementing the step of establishing the data lineage relationship of each of the data indicators according to the data wide table, the processor 802 is further configured to:

[0083] At least one indicator to be developed is obtained according to the detected data development request; a corresponding development owner is obtained according to the data lineage relationship of each indicator to be developed; and a corresponding data development request is sent to the corresponding development owner according to the indicator to be developed.

[0084] In some embodiments, when the processor 802 implements the step of acquiring corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships, it is specifically configured to:

[0085] Acquire configuration content according to the data acquisition request; acquire a data table path corresponding to the configuration content according to the data lineage relationship; acquire initial target data according to the configuration content and the data table path; integrate the initial target data according to the indicator field and dimension field in the configuration content to obtain the target data.

[0086] In some embodiments, after implementing the step of acquiring corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships, the processor 802 is further configured to:

[0087] If the target data is empty data, a corresponding data abnormality reminder is generated and fed back to the business end.

[0088] In some embodiments, after implementing the step of acquiring corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships, the processor 802 is further configured to:

[0089] According to the detected indicator addition request, the corresponding new indicator is obtained; according to the data lineage relationship of the new indicator, the new indicator is inserted into the data wide table to obtain an updated data wide table.

[0090] It should be understood that in the embodiment of the present invention, the processor 802 may be a central processing unit (CPU), and the processor 802 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0091] It can be understood by those skilled in the art that all or part of the processes in the method for implementing the above embodiment can be completed by instructing the relevant hardware through a computer program. The computer program includes program instructions, and the computer program can be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the computer system to implement the process steps of the embodiment of the above method.

[0092] Therefore, the present invention also provides a storage medium. The storage medium may be a computer-readable storage medium. The storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed by a processor, the processor executes the following steps:

[0093] Receive the input initial data, integrate the initial data according to data attributes, and obtain a corresponding data wide table; wherein the data attributes include data granularity, data dimension, and data index; establish a data lineage relationship of each of the data indexes according to the data wide table; obtain a data acquisition request from the business end; and obtain corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships.

[0094] In one embodiment, after the processor executes the program instructions to receive the input initial data and integrates the initial data according to data attributes to obtain the corresponding data wide table, it is further configured to:

[0095] The total number of the corresponding data indicators is counted according to the data granularity in the data wide table to obtain the market data; and the market data is displayed on a preset display interface.

[0096] In one embodiment, after executing the program instructions to implement the step of establishing the data kinship relationship of each of the data indicators according to the data wide table, the processor is further configured to:

[0097] At least one indicator to be accessed is obtained according to the detected data access request; the corresponding business owner is obtained according to the data lineage relationship of each indicator to be accessed; and the corresponding data access request is sent to the corresponding business owner according to the indicator to be accessed.

[0098] In one embodiment, after executing the program instructions to implement the step of establishing the data kinship relationship of each of the data indicators according to the data wide table, the processor is further configured to:

[0099] At least one indicator to be developed is obtained according to the detected data development request; a corresponding development owner is obtained according to the data lineage relationship of each indicator to be developed; and a corresponding data development request is sent to the corresponding development owner according to the indicator to be developed.

[0100] In one embodiment, when the processor executes the program instructions to implement the step of acquiring corresponding target data from the data wide table according to the data acquisition request and each of the data blood relationship, it is specifically used to:

[0101] Acquire configuration content according to the data acquisition request; acquire a data table path corresponding to the configuration content according to the data lineage relationship; acquire initial target data according to the configuration content and the data table path; integrate the initial target data according to the indicator field and dimension field in the configuration content to obtain the target data.

[0102] In one embodiment, after executing the program instructions to implement the step of acquiring corresponding target data from the data wide table according to the data acquisition request and each of the data blood relationship, the processor is further configured to:

[0103] If the target data is empty data, a corresponding data abnormality reminder is generated and fed back to the business end.

[0104] In one embodiment, after executing the program instructions to implement the step of acquiring corresponding target data from the data wide table according to the data acquisition request and each of the data blood relationship, the processor is further configured to:

[0105] According to the detected indicator addition request, the corresponding new indicator is obtained; according to the data lineage relationship of the new indicator, the new indicator is inserted into the data wide table to obtain an updated data wide table.

[0106] The storage medium may be a USB flash drive, a mobile hard disk, a read-only memory (ROM), a magnetic disk, or an optical disk, etc., which are computer-readable storage media that can store program codes.

[0107] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0108] In the several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of each unit is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0109] The steps in the method of the embodiment of the present invention can be adjusted in order, combined and deleted according to actual needs. The units in the device of the embodiment of the present invention can be combined, divided and deleted according to actual needs. In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0110] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling an electronic device (which can be a personal computer, terminal, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention.

[0111] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A data acquisition method, characterized in that: The data acquisition method is applied to a server, and the server establishes a communication connection with a service end to realize the transmission of data information. The method includes: Receiving the input initial data, integrating the initial data according to data attributes to obtain a corresponding data wide table; wherein the data attributes include data granularity, data dimension and data index; Establishing the data kinship relationship of each of the data indicators according to the data wide table; Obtaining a data acquisition request from the business end; The corresponding target data is obtained from the data wide table according to the data acquisition request and the data blood relationship.

2. The data acquisition method according to claim 1, characterized in that: After receiving the input initial data and integrating the initial data according to data attributes to obtain a corresponding data wide table, the method further includes: According to the data granularity in the data wide table, the total number of corresponding data indicators is counted to obtain the market data; The market data is displayed on a preset display interface.

3. The data acquisition method according to claim 1, characterized in that: After the data kinship relationship of each of the data indicators is established according to the data wide table, the method further includes: Obtain at least one indicator to be accessed according to the detected data access request; Acquire the corresponding business owner according to the data lineage relationship of each of the indicators to be accessed; A corresponding data access request is sent to a corresponding business owner according to the to-be-accessed indicator.

4. The data acquisition method according to claim 1, characterized in that: After the data kinship relationship of each of the data indicators is established according to the data wide table, the method further includes: Obtain at least one indicator to be developed according to the detected data development request; Obtaining the corresponding development owner according to the data blood relationship of each of the indicators to be developed; A corresponding data development request is sent to a corresponding development owner according to the indicator to be developed.

5. The data acquisition method according to claim 1, characterized in that: The acquiring corresponding target data from the data wide table according to the data acquisition request and the data blood relationship includes: Acquire configuration content according to the data acquisition request; Acquire a data table path corresponding to the configuration content according to the data lineage relationship; Acquire initial target data according to the configuration content and the data table path; The initial target data is integrated according to the indicator field and the dimension field in the configuration content to obtain the target data.

6. The data acquisition method according to claim 1, characterized in that: After obtaining the corresponding target data from the data wide table according to the data acquisition request and the data blood relationship, the method further includes: If the target data is empty data, a corresponding data abnormality reminder is generated and fed back to the business end.

7. The data acquisition method according to claim 1, characterized in that: After obtaining the corresponding target data from the data wide table according to the data acquisition request and the data blood relationship, the method further includes: According to the detected indicators, a new request is made to obtain the corresponding new indicators; The newly added indicator is inserted into the data wide table according to the data lineage relationship of the newly added indicator to obtain an updated data wide table.

8. A data acquisition device, characterized in that: The device is configured in a server, and the server establishes a communication connection with a service end to realize the transmission of data information. The device includes: A data integration unit, used to receive the input initial data, integrate the initial data according to data attributes, and obtain a corresponding data wide table; wherein the data attributes include data granularity, data dimension and data index; A lineage establishing unit, used for establishing a data lineage relationship of each of the data indicators according to the data wide table; A first acquisition unit, used to acquire a data acquisition request from the service end; The second acquisition unit is used to acquire corresponding target data from the data wide table according to the data acquisition request and each of the data lineage relationships.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the data acquisition method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the processor executes the data acquisition method according to any one of claims 1 to 7.

Images