Configurable multi-source data acquisition method

Abstract

The invention provides a configurable multi-source data acquisition method. The configurable multi-source data acquisition method comprises the steps of defining acquisition items, forms, form structures and acquisition modes, binding form applicable equipment ranges and issuing form UIs. When a collection task is executed, a released form is selected, form data are filled according to form requirements, and after data are stored, corresponding data are automatically loaded or calculated by a background according to rule configuration of a form collection mode. According to the method, the whole set of definition rules of the multi-source form, association with equipment and mapping of collection item names are self-defined to form the equipment form, the equipment form is manually maintained, and data sources of collection items in the equipment form are automatically obtained in a collection mode configured in a form template or are subsequently manually input. On the basis of the acquisition capability of the data acquisition gateway, the equipment data information is supplemented, and the subsequent analysis and data display capability is enhanced.

Description

Technical Field

[0001] The invention belongs to the technical field of data acquisition, and in particular relates to a configurable multi-source data acquisition method. Background Art

[0002] In the IoT system, the data collection gateway is responsible for collecting device operation data. However, its data collection capabilities are limited by factors such as sensors, device data, and communication protocols, and it is unable to collect additional information. Existing data collection gateways have the following drawbacks:

[0003] 1. For CNC machine tools (CNC for short), the gateway's data collection capabilities for this type of equipment are often judged based on the data items open to the outside world by the CNC control system itself. When the CNC control system lacks the ability to develop key operating information, the data collection gateway will lack the ability to collect this data.

[0004] 2. When the MES-related system is not involved, the equipment itself does not have a work order number, and this item cannot be directly obtained through the collection gateway.

[0005] 3. The data collection gateway only has the ability to collect real-time data and cannot query historical data related to the equipment. Summary of the Invention

[0006] In view of this, the present invention aims to overcome the shortcomings of the above-mentioned problems in the prior art and proposes a configurable multi-source data acquisition method. Based on the CAXA data acquisition gateway, additional collection items are collected in the form of custom forms to expand the collection capabilities of the collection gateway itself.

[0007] To achieve the above object, the technical solution of the present invention is achieved as follows:

[0008] A first aspect of the present invention provides a configurable multi-source data acquisition method, the method comprising:

[0009] Define collection items, forms, form structure, collection methods, bind the form to the applicable device range, and publish the form UI;

[0010] When executing a collection task, select the published form and fill in the form data according to the form requirements. After the data is saved, the background will automatically load or calculate the corresponding data according to the rules configured for the form's collection method.

[0011] Furthermore, the defined collection items include:

[0012] A tree structure is used to define collection items, supporting two types of nodes: "Type" and "Parameter". The "Type" node is used to define the classification of collection items, which are classified by application industry or device type. When defined as "Parameter", it indicates a specific collection item.

[0013] Furthermore, the definition form includes:

[0014] Define a menu item for each form and configure the form based on the menu item.

[0015] Furthermore, the definition form structure includes:

[0016] Find the corresponding form menu item and enter the form design mode;

[0017] Build the form data structure by referencing the collected item data and add data columns to the form.

[0018] Furthermore, the defined collection method includes:

[0019] Obtain device collection data through the CAXA collection gateway, obtain real-time device collection data or associate a collection item as an input condition to obtain historical collection data;

[0020] Manually enter parameter values ​​by manually entering data;

[0021] Acquire data through third-party data integration, supporting database and API interfaces;

[0022] Perform an association operation on the collection item, and the operation result is used as the value of the current collection item.

[0023] Furthermore, the scope of the binding form device includes:

[0024] There is a one-to-many relationship between form template instances and devices. Each form template instance can be associated with multiple devices. By default, each device corresponds to the CAXA collection gateway using the collection item number. If the two numbers are different, the collection item name mapping rules are used to establish an association between the collection item names and form a device form corresponding to the device.

[0025] A second aspect of the present invention provides a configurable multi-source data acquisition device, comprising:

[0026] The configuration module is used to define collection items, forms, form structure, collection methods, bind the form to the applicable device range, and publish the form UI;

[0027] The collection module is used to perform collection tasks. When you select a published form, fill in the "manually entered" data according to the form requirements. After the data is saved, the background will automatically load or calculate the corresponding data according to the rules of the form's collection method.

[0028] A third aspect of the present invention provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.

[0029] A fourth aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the above method when executed by a processor.

[0030] A fifth aspect of the present invention provides a computer program product, comprising a computer program, which implements the steps of the above method when executed by a processor.

[0031] Compared with the prior art, the configurable multi-source data acquisition method described in the present invention has the following advantages:

[0032] Based on the acquisition capability of the data acquisition gateway, the present invention supplements the device data information and enhances the subsequent analysis and data display capabilities. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The accompanying drawings, which constitute part of the present invention, are provided to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are provided to explain the present invention and do not constitute an undue limitation of the present invention. In the accompanying drawings:

[0034] Figure 1 Schematic diagram of the overall method of the present invention;

[0035] Figure 2 A schematic diagram of defining collection items in an embodiment of the present invention;

[0036] Figure 3 A schematic diagram of defining a form in an embodiment of the present invention;

[0037] Figure 4 Schematic diagram of form design mode in an embodiment of the present invention;

[0038] Figure 5 A schematic diagram of a form data structure is constructed in an embodiment of the present invention;

[0039] Figure 6 A schematic diagram of a bound form device range in an embodiment of the present invention;

[0040] Figure 7 A schematic diagram of filling in form data in an embodiment of the present invention;

[0041] Figure 8 Schematic diagram of connecting devices for data collection according to the method of the present invention. DETAILED DESCRIPTION

[0042] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0043] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, features defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0044] In the description of the present invention, it should be noted that, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "connected" should be understood in a broad sense. For example, they may refer to fixed connections, detachable connections, or integral connections; mechanical connections or electrical connections; direct connections or indirect connections through an intermediate medium; and internal communication between two components. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on specific circumstances.

[0045] The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0046] like Figure 1 As shown, the present invention provides a configurable multi-source data acquisition method, comprising:

[0047] Define collection items, forms, form structure, collection methods, bind the form to the applicable device range, and publish the form UI;

[0048] When executing a collection task, select the published form and fill in the form data according to the form requirements. After the data is saved, the background will automatically load or calculate the corresponding data according to the rules configured for the form's collection method.

[0049] In the present invention, a tree structure is used to define collection items, supporting two types of nodes: "type" and "parameter". The "type" node is used to define the classification of collection items. Collection items can be classified according to application industries ("processing industry", "heat treatment industry") or equipment types ("CNC industry", "PLC industry"), which is convenient for parameter classification management. When defined as "parameter", it means a specific collection item, such as Figure 2 shown.

[0050] In the present invention, a menu item is defined for each form, and the form is configured based on the menu item, such as Figure 3 shown.

[0051] In the present invention, defining the form structure includes:

[0052] Find the corresponding form menu item and enter the [Form Design] mode, such as Figure 4 shown.

[0053] Add data columns to the form: that is, reference the collection item data of [Define Collection Items] to build the form data structure. Figure 5 shown.

[0054] In this invention, the collection method is defined for the collection item to specify the data source method of the collection item. It is the key to multiple data sources and mainly supports the following collection methods:

[0055] 1. Get gateway data: Supports obtaining device collection data through the CAXA collection gateway. You can obtain real-time device collection data (Redis) or associate a collection item as an input condition to obtain historical collection data (MongoDB).

[0056] 2. Manual entry: Manually enter parameter values ​​by manually entering data.

[0057] 3. Third-party data integration: Supports data acquisition through third-party data integration, supporting both database and API interfaces

[0058] In the present invention, the method of obtaining data from a database includes: first maintaining the database connection information of a third-party database, selecting the configured data connection, writing the corresponding SQL data script, and mapping the output value to the output collection item.

[0059] In the present invention, the method of acquiring data using an API interface includes: calling an API interface provided by a third party, using existing collection items as interface parameters, and mapping the interface return value to the collection item.

[0060] 4. Perform associative operations on collected items: Associative expressions provide a set of four arithmetic operations for multiple acquired data items, and scripts provide a more advanced operation rule based on a scripting language for multiple acquired data items.

[0061] In the present invention, the scope of binding form devices includes: a one-to-many relationship between form template instances and devices, each form template instance can be associated with multiple devices, each device and the CAXA collection gateway use the collection item number corresponding to the default, when the form template instance and the specific device collection item number are different, the collection item name mapping rule is used to establish the association between the collection item names to form the device form corresponding to the device. Figure 6 shown.

[0062] In the present invention, the form has two states: in the "edit" state, the form is being edited and is invisible to the user. After editing is completed, it changes to the "publish" state, which is visible to the user and data can be filled in according to the form.

[0063] When executing a collection task, the user selects a published form and fills in the "manually entered" data according to the form requirements. After the data is saved, the corresponding data processing service in the background automatically loads or calculates the corresponding data according to the rules configured for the collection method of the form. Figure 7 shown.

[0064] When the present invention is actually applied, the process of connecting with the device to realize data collection is as follows: Figure 8 As shown:

[0065] The data acquisition device layer supports various physical devices for data acquisition: it allows devices to be connected through communication methods such as "serial port" and "network card", and can provide other methods to obtain device operation data according to specific analysis protocols or devices.

[0066] The collection gateway of the device data collection layer is responsible for directly collecting device operation information and transmitting the device operation information to the collection platform with the device as the unit and the collection item as the granularity. The collection platform is responsible for managing and storing this data, storing real-time data in Redis, historical data in MongoDB, and configuration information in SQL Server.

[0067] The data supplementation layer provides a manual or semi-automatic reporting mechanism for business data that cannot be collected due to equipment conditions but is important for business analysis. Additional data can be supplemented as needed, such as production task information (production task number, material drawing number, material name, program number, etc.), process data (process version number), equipment downtime description data (tooling fixture, tool replacement, temporary downtime inspection), etc. The following two supplementation methods are mainly supported:

[0068] 1) Direct supplement: Supplement descriptive business data, that is, objective descriptive data of the processing scenario in which the equipment is located.

[0069] Scenario 1: When the equipment is in the processing state, the gateway can collect general equipment data such as equipment operation data (equipment power on / off status, alarm status, etc.) and processing parameter data (set moisture, temperature, etc.). However, production-related task data is not directly available from the equipment: What is the equipment producing? Which process version requirements are the equipment process parameters set based on? Which production task is the number of completed workpieces attributed to, or which operator is recorded? This data is usually not directly available from the equipment, but it is objective data and extremely important for business analysis. If this data cannot be effectively correlated, subsequent process improvements, quality, and cost analysis will be greatly affected. Using this function, you can effectively supplement and correlate this relevant data.

[0070] Typically, production task information is generated and managed by the user's business management system (ERP / MES, etc.). Production equipment primarily focuses on the control system's settings and configuration methods to complete the processing. Without specialized equipment modifications, it's difficult to acquire processing task data.

[0071] 2) Indirect supplementation: Input certain conditional data, combine it with the data collected by existing equipment, and generate new data by configuring certain calculation rules or formulas to supplement the deficiencies in business analysis or scenario applications as needed.

[0072] Scenario 1: Calculate the leakage rate of equipment parameter XX based on production tasks. Leakage rate = (actual value of parameter XX at task end time - actual value of parameter XX at task start time) / actual value at task start time. Manually enter equipment production task information (production task number, material drawing number, start time, end time). Obtain the actual value of parameter XX based on the start and end time of the production task. Configure a formula to automatically calculate the leakage rate value, which can be used to compare the performance of different operators on the same type of processing tasks.

[0073] Since data application scenarios vary and data has diverse characteristics that cannot be exhaustively listed, certain data modeling capabilities are required to cover most scenario applications. Through "collection form definition", the system can have a certain degree of data modeling capabilities.

[0074] When defining collection items, all collection items are unified through collection item codes and names. Each collection parameter has a unique code. This is primarily to unify collection semantics. Because device data originates from the collection gateway, and when configuring collection items, the collection gateway maps the device collection parameters to the collection item address and type, the parameter addresses of the same collection item may differ between different devices. As descriptive information, the same collection item name may also be configured differently on different devices. For example, two devices A and B of the same type can both collect outlet temperature. To facilitate comparison of multiple collection items during analysis, the outlet temperature names are defined as "Device A Temperature" and "Device B Temperature." This makes it impossible to logically extract collection item data between devices, and the collection mapping relationship cannot be found. To avoid inconsistencies during configuration, we pre-define a unified code for each collection item (including all collection items except those for gateway devices) and configure it according to the code during the process. This ensures that each collection item has the same unique identifier on different devices, facilitating unified data processing and data exchange with other third-party systems.

[0075] Based on the collection item dictionary, select multiple collection items according to the actual application scenario, configure the corresponding collection method for each collection item, pre-configure calculation rules for the collection results, and establish a form template instance.

[0076] Another embodiment of the present invention provides a configurable multi-source data acquisition device, comprising:

[0077] The configuration module is used to define collection items, forms, form structure, collection methods, bind the form to the applicable device range, and publish the form UI;

[0078] The collection module is used to perform collection tasks. When you select a published form, fill in the "manually entered" data according to the form requirements. After the data is saved, the background will automatically load or calculate the corresponding data according to the rules of the form's collection method.

[0079] Another embodiment of the present invention provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.

[0080] Another embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the above method when executed by a processor.

[0081] Another embodiment of the present invention provides a computer program product, including a computer program, which implements the steps of the above method when executed by a processor.

[0082] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A configurable multi-source data acquisition method, characterized by: The method comprises: Define collection items, forms, form structure, collection methods, bind the form to the applicable device range, and publish the form UI; When executing a collection task, select the published form and fill in the form data according to the form requirements. After the data is saved, the background will automatically load or calculate the corresponding data according to the rules configured for the form's collection method.

2. The configurable multi-source data acquisition method according to claim 1, characterized in that: The defined collection items include: A tree structure is used to define collection items, supporting two types of nodes: "Type" and "Parameter". The "Type" node is used to define the classification of collection items, which are classified by application industry or device type. When defined as "Parameter", it indicates a specific collection item.

3. The configurable multi-source data acquisition method according to claim 1, characterized in that: The definition form includes: Define a menu item for each form and configure the form based on the menu item.

4. The configurable multi-source data acquisition method according to claim 3, characterized in that: The definition form structure includes: Find the corresponding form menu item and enter the form design mode; Build the form data structure by referencing the collected item data and add data columns to the form.

5. The configurable multi-source data acquisition method according to claim 1, characterized in that: The definition collection method includes: Obtain device collection data through the CAXA collection gateway, obtain real-time device collection data or associate a collection item as an input condition to obtain historical collection data; Manually enter parameter values ​​by manually entering data; Acquire data through third-party data integration, supporting database and API interfaces; Perform an association operation on the collection item, and the operation result is used as the value of the current collection item.

6. The configurable multi-source data acquisition method according to claim 1, characterized in that: The binding form device range includes: There is a one-to-many relationship between form template instances and devices. Each form template instance can be associated with multiple devices. By default, each device corresponds to the CAXA collection gateway using the collection item number. If the two numbers are different, the collection item name mapping rules are used to establish an association between the collection item names and form a device form corresponding to the device.

7. A configurable multi-source data acquisition device, characterized in that: include: The configuration module is used to define collection items, forms, form structure, collection methods, bind the form to the applicable device range, and publish the form UI; The collection module is used to perform collection tasks. When you select a published form, fill in the "manual entry" data according to the form requirements. After the data is saved, the background will automatically load or calculate the corresponding data according to the rules of the form's collection method.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product comprising a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images