A data acquisition method, device and medium

Abstract

This application discloses a data acquisition method, device, and medium. The method includes: acquiring data and determining the business units and business elements of the data; storing the business units and business elements in the form of a two-dimensional matrix table to form configuration information; checking the configuration information through a pre-set parsing component to obtain the check result, and determining an SQL statement based on the check result; determining a data table based on the SQL statement, and storing the data based on the data table. This application alleviates the problem of limited scalability during system data acquisition and the limitations of data acquisition from different data sources by configuring the data table to be acquired, forming SQL statements for recording system data based on the configuration information and cache status, and storing the acquired data in the form of a data table. It also provides an integration interface based on cached data and an automatic archiving function for historical system data, facilitating data traceability for users.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data acquisition method, device and medium. Background Technology

[0002] To ensure users can utilize various resources normally, enterprises need to monitor and collect data on resources in real time. For example, the intelligent manufacturing industry cannot function without the support of workshop production data. When errors occur in the workshop system, the collected data can be used to troubleshoot and optimize system performance.

[0003] Currently, the common approach is to record system logs. When a system failure occurs, the recorded log data is retrieved for analysis and repair. However, as system applications become more sophisticated and used for longer periods, the data storage media becomes excessively large, increasing the system's operational burden. Therefore, how to collect useful data without impacting system performance has become a pressing issue. Summary of the Invention

[0004] To address the aforementioned issues, this application proposes a data acquisition method, comprising: acquiring data and determining the business units and business elements of the data; storing the business units and business elements in the form of a two-dimensional matrix table to form configuration information; checking the configuration information using a pre-set parsing component to obtain a check result; determining an SQL statement based on the check result; determining a data table based on the SQL statement; and storing the data based on the data table.

[0005] In one example, the business unit and the business element are stored in the form of a two-dimensional matrix table, specifically including: determining the field information of the two-dimensional matrix table; determining the attribute code and attribute description of the business unit based on the field information of the two-dimensional matrix table; determining the operation mode of the business element based on the field information of the two-dimensional matrix table; and recording the operation mode, the attribute code, and the attribute description in the two-dimensional matrix table.

[0006] In one example, the configuration information is checked by a pre-set parsing component, which specifically includes: determining the operation request selected by the user, invoking the parsing component, and checking the configuration information according to the operation request to determine the operation target, thereby determining the detection result.

[0007] In one example, determining the SQL statement based on the inspection result specifically includes: forming a data window cache based on the operation objective, and determining the SQL statement through the data window cache based on the configuration information.

[0008] In one example, determining the data table based on the SQL statement specifically includes: determining pre-set field information and determining the field attributes of the field information, wherein the field attributes include, but are not limited to, field name, field type, and field description; and establishing the data table based on the field information.

[0009] In one example, the method further includes: determining a pre-set chart type, performing a graphical transformation on the data table according to the chart type to obtain a data chart corresponding to the data table, and displaying the data chart.

[0010] In one example, the method further includes: determining a historical data table based on the data table; receiving a user's query request, querying the historical data table according to the query request to obtain query results, and sending the query results to the user.

[0011] In one example, the business unit includes, but is not limited to, a material dictionary and a supplier dictionary, and the business element includes, but is not limited to, a material number and a supplier code.

[0012] On the other hand, this application also proposes a data acquisition device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the data acquisition device to perform: acquiring data and determining the business units and business elements of the data, storing the business units and business elements in the form of a two-dimensional matrix table to form configuration information; checking the configuration information through a pre-set parsing component to obtain a check result, and determining an SQL statement based on the check result; determining a data table based on the SQL statement, and storing the data based on the data table.

[0013] On the other hand, this application also proposes a non-volatile computer storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to: collect data, determine the business units and business elements of the data, store the business units and business elements in the form of a two-dimensional matrix table to form configuration information; check the configuration information through a pre-set parsing component to obtain the check result, and determine an SQL statement based on the check result; determine a data table based on the SQL statement, and store the data based on the data table.

[0014] This application alleviates the problem of limited scalability during system data collection and the limitations of collecting data from different data sources by configuring data tables that require data collection, generating SQL statements to record system data based on configuration information and cache status, and storing the collected data in the form of data tables. This application provides an integration interface based on cached data and an automatic archiving function for historical system data, facilitating data traceability for users. It fulfills the data collection needs while allowing selective collection of system data based on user configuration, thereby reducing storage space usage and providing a foundation for in-depth data mining. Attached Figure Description

[0015] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0016] Figure 1 This is a flowchart illustrating a data acquisition method according to an embodiment of this application;

[0017] Figure 2 This is a flowchart of data acquisition in an embodiment of this application;

[0018] Figure 3 This is a schematic diagram of a data acquisition device according to an embodiment of this application. Detailed Implementation

[0019] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0020] The technical solutions provided by the various embodiments of this application are described in detail below with reference to the accompanying drawings.

[0021] like Figure 1 As shown, in order to solve the above problems, this application provides a data acquisition method, applied in a data acquisition system, the method comprising:

[0022] S101. Collect data and determine the business units and business elements of the data. Store the business units and business elements in the form of a two-dimensional matrix table to form configuration information.

[0023] The business units that require data collection, along with their related business elements, are stored in a two-dimensional matrix table to form configuration information. The relationships between the business units and business elements that require data collection in the software are stored and categorized in a two-dimensional matrix table, primarily into dictionaries, lists, and documents. The business units that require data collection refer to the frequently used software basic data dictionaries throughout the entire business module, such as material dictionaries and supplier dictionaries; business elements refer to the main information contained in the business unit, such as material numbers and supplier codes.

[0024] In one embodiment, the association between collected business units and business elements is stored in a two-dimensional matrix table. The two-dimensional matrix table records the attribute codes and attribute descriptions of the collected business units, as well as the operation methods for the collected business units, such as adding, modifying, and deleting. During runtime, any content of the two-dimensional matrix can be configured according to user needs. For example, in the sales order table, XSDDMX_WLBH is the attribute code, and the material number is the attribute description; that is, the field in the table is the attribute code, and the field name is the attribute description.

[0025] S102. The configuration information is checked by a pre-set parsing component to obtain the check result, and the SQL statement is determined based on the check result.

[0026] It provides a function to automatically check configuration information and generate SQL statements that record system data based on the data window cache status by calling the parsing component.

[0027] Data operations primarily include INSERT, UPDATE, and DELETE. When a user performs an operation on a specified data table and clicks "Save," the parsing component automatically checks the configuration information and generates an SQL statement to record the system data based on the data window's cache state. If the data table contains data corresponding to the currently operated table, the parsing component automatically generates the SQL statement to record the data.

[0028] In one embodiment, the parsing component is a system interface provided by an encapsulated user object. Data window cache states include NOTMODIFIED, DATAMODIFIED, NEW, NEWMODIFIED, etc. The system determines the user's selected operation request, invokes the parsing component, and checks the configuration information according to the operation request to determine the operation target, thereby determining the detection result. A data window cache is formed based on the operation target, and the SQL statement is determined through the data window cache based on the configuration information. The parsing component is implemented according to a two-dimensional table configuration information. Adjusted configuration information takes effect immediately and does not affect running software. When the data window cache state is modified and the client's data table contains data corresponding to the current operation table, an SQL statement for recording system data is formed based on the configuration information.

[0029] In one embodiment, the system collects data elements required for maintaining the material catalog in the settings window, such as attribute codes, attribute descriptions, and operation methods, and stores them in a two-dimensional matrix table named JSLOGCOLUMN. When a user creates a business document or maintains basic data, if the system detects data in JSLOGCOLUMN corresponding to the current operation table, it calls the parsing component to analyze the configuration information, generate an SQL statement for data collection, and add a timestamp. For example, if the system detects that it needs to collect system data when modifying a material name, it calls the parsing component when creating the data window cache to generate an SQL statement and add a timestamp. The system automatically stores the collected data in a data table named JSLOG based on the generated SQL statement.

[0030] S103. Determine the data table according to the SQL statement, and store the data according to the data table.

[0031] The system stores the collected data in the form of data tables based on the generated SQL statements. First, a two-dimensional matrix table is set up to record the relationship between business units and business elements, as shown in the table below.

[0032]

[0033]

[0034] The system software provides configuration information maintenance functions for the relationship between business units through a wizard-driven intelligent graphical interface, determines the pre-set field information and the field attributes of the field information, and sets up a data table to store the data collection records based on the field information, as shown in the table below.

[0035]

[0036]

[0037] The system uses data tables to record the data collection process. These tables also record key elements of the collected data, such as descriptions, types, primary key settings, and timestamps from the client and server.

[0038] In one embodiment, the system stores pre-defined chart types, and transforms the data table into a graphical representation based on the chart type to obtain the corresponding data chart, which is then displayed. These chart types include pie charts, bar charts, maps, line charts, etc.

[0039] In one embodiment, the system provides query and archiving functions for system-collected data, allowing historical data to be stored in a database as a historical table for user querying. The system receives user query requests, queries the historical data table based on the requests, obtains the query results, and sends the results to the user. This process does not affect the performance of the table's current functionality and provides access to historical data.

[0040] like Figure 2 As shown, when a user accesses data on the system's client, the system asks the user if caching is required. If not, the process ends; if so, the system calls the parsing component to generate SQL statements for data collection, records the collected data into a data table, displays the data in the data table, and archives the cached historical data.

[0041] like Figure 3 As shown in the illustration, this application also provides a data acquisition device, including:

[0042] At least one processor; and,

[0043] A memory communicatively connected to the at least one processor; wherein,

[0044] The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the data acquisition device to perform the following:

[0045] Collect data and determine the business units and business elements of the data. Store the business units and business elements in the form of a two-dimensional matrix table to form configuration information.

[0046] The configuration information is checked by a pre-set parsing component to obtain the check results, and the SQL statement is determined based on the check results.

[0047] The data table is determined based on the SQL statement, and the data is stored based on the data table.

[0048] This application embodiment also provides a non-volatile computer storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured as follows:

[0049] Collect data and determine the business units and business elements of the data. Store the business units and business elements in the form of a two-dimensional matrix table to form configuration information.

[0050] The configuration information is checked by a pre-set parsing component to obtain the check results, and the SQL statement is determined based on the check results.

[0051] The data table is determined based on the SQL statement, and the data is stored based on the data table.

[0052] The various embodiments in this application are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device and medium embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the description of the method embodiments.

[0053] The devices and media provided in this application are one-to-one with the methods. Therefore, the devices and media also have similar beneficial technical effects as their corresponding methods. Since the beneficial technical effects of the methods have been described in detail above, the beneficial technical effects of the devices and media will not be repeated here.

[0054] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0055] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0056] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0057] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0058] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0059] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0060] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0061] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0062] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A data acquisition method, characterized in that, include: Collect data and determine the business units and business elements of the data. Store the business units and business elements in the form of a two-dimensional matrix table to form configuration information. The configuration information is checked by a pre-set parsing component to obtain the check results, and the SQL statement is determined based on the check results. The data table is determined according to the SQL statement, and the data is stored according to the data table; The business units and business elements are stored in the form of a two-dimensional matrix table, specifically including: Determine the field information of the two-dimensional matrix table; The attribute code and attribute description of the business unit are determined based on the field information of the two-dimensional matrix table; The operation method of the business element is determined based on the field information of the two-dimensional matrix table; The operation method, the attribute code, and the attribute description are recorded in the two-dimensional matrix table; The configuration information is checked through a pre-configured parsing component, specifically including: The system determines the user's selected operation request, invokes the parsing component, and checks the configuration information based on the operation request to determine the operation target, thereby determining the detection result. The parsing component is implemented based on the configuration information in the two-dimensional table; The SQL statement is determined based on the inspection results, specifically including: A data window cache is formed based on the operation objective, and the SQL statement is determined through the data window cache based on the configuration information and timestamped.

2. The method according to claim 1, characterized in that, The data table is determined based on the SQL statement, specifically including: Determine the pre-set field information and the field attributes of the field information, wherein the field attributes include field name, field type, and field description; The data table is created based on the field information.

3. The method according to claim 1, characterized in that, The method further includes: Determine the pre-set chart type, perform graphical transformation on the data table according to the chart type to obtain the corresponding data chart, and display the data chart.

4. The method according to claim 1, characterized in that, The method further includes: Determine the historical data table based on the aforementioned data table; The system receives a user's query request, queries the historical data table according to the query request to obtain the query results, and sends the query results to the user.

5. The method according to claim 1, characterized in that, The business unit includes a material dictionary and a supplier dictionary, and the business elements include material number and supplier code.

6. A data acquisition device, characterized in that, include: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the data acquisition device to perform the following: Collect data and determine the business units and business elements of the data. Store the business units and business elements in the form of a two-dimensional matrix table to form configuration information. The configuration information is checked by a pre-set parsing component to obtain the check results, and the SQL statement is determined based on the check results. The data table is determined according to the SQL statement, and the data is stored according to the data table; The business units and business elements are stored in the form of a two-dimensional matrix table, specifically including: Determine the field information of the two-dimensional matrix table; The attribute code and attribute description of the business unit are determined based on the field information of the two-dimensional matrix table; The operation method of the business element is determined based on the field information of the two-dimensional matrix table; The operation method, the attribute code, and the attribute description are recorded in the two-dimensional matrix table; The configuration information is checked through a pre-configured parsing component, specifically including: The system determines the user's selected operation request, invokes the parsing component, and checks the configuration information based on the operation request to determine the operation target, thereby determining the detection result. The parsing component is implemented based on the configuration information in the two-dimensional table; The SQL statement is determined based on the inspection results, specifically including: A data window cache is formed based on the operation objective, and the SQL statement is determined through the data window cache based on the configuration information and timestamped.

7. A non-volatile computer storage medium storing computer-executable instructions, characterized in that, The computer-executable instructions are set as follows: Collect data and determine the business units and business elements of the data. Store the business units and business elements in the form of a two-dimensional matrix table to form configuration information. The configuration information is checked by a pre-set parsing component to obtain the check results, and the SQL statement is determined based on the check results. The data table is determined according to the SQL statement, and the data is stored according to the data table; The business units and business elements are stored in the form of a two-dimensional matrix table, specifically including: Determine the field information of the two-dimensional matrix table; The attribute code and attribute description of the business unit are determined based on the field information of the two-dimensional matrix table; The operation method of the business element is determined based on the field information of the two-dimensional matrix table; The operation method, the attribute code, and the attribute description are recorded in the two-dimensional matrix table; The configuration information is checked through a pre-configured parsing component, specifically including: The system determines the user's selected operation request, invokes the parsing component, and checks the configuration information based on the operation request to determine the operation target, thereby determining the detection result. The parsing component is implemented based on the configuration information in the two-dimensional table; The SQL statement is determined based on the inspection results, specifically including: A data window cache is formed based on the operation objective, and the SQL statement is determined through the data window cache based on the configuration information and timestamped.

Images