Data acquisition method, system and apparatus

By acquiring the initial logs and equipment parameters of industrial equipment, parsing the log files using regular expressions, and collecting log data on demand, the problem of low efficiency and high resource consumption caused by the large amount of log file data is solved, achieving efficient and low-consumption log file collection.

CN116170299BActive Publication Date: 2025-12-12SHANGHAI ZHOUBANG INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310150899.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-02-21
Publication Date
2025-12-12
Estimated Expiration
2043-02-21

AI Technical Summary

Technical Problem

The large volume and variety of log files result in low efficiency and high resource consumption when retrieving them.

Method used

By obtaining the initial logs of industrial equipment and the equipment parameters corresponding to the business type, the log files are parsed using regular expressions. Log files are collected according to multiple parameter information, including production cycle, production interval time, and fault codes, and a status set is constructed to determine the operating status. Log data is collected as needed.

Benefits of technology

It improved the efficiency of log file collection, reduced resource consumption, and ensured the relevance and accuracy of log data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116170299B_ABST
    Figure CN116170299B_ABST
Patent Text Reader

Abstract

The application provides a data collection method, system and device. The method is executed by a data collection control terminal, the data collection control terminal is connected with at least one industrial equipment of the same service type, and the method comprises the following steps: acquiring initial logs of the industrial equipment and equipment parameters corresponding to the service type, wherein the initial logs comprise one or more lines of log data; acquiring a plurality of parameter information from the one or more lines of log data according to the equipment parameters, wherein the equipment parameters are obtained based on operation and / or category division of the plurality of parameter information; and collecting log files of the industrial equipment according to the plurality of parameter information. The technical scheme of the application improves the collection efficiency of the log files and reduces the resource consumption required for collecting the log files.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a data collection method, system and device. BACKGROUND

[0002] Log files can reflect the real situation of information system at any time, so analyzing log files can understand the running status of information system. However, the log file data is large in quantity and various in type, which leads to low efficiency of obtaining log files and further leads to high resource consumption required for obtaining log files.

[0003] Therefore, how to improve the log file collection efficiency while reducing the resource consumption required for collection becomes a technical problem to be solved. SUMMARY

[0004] Therefore, the embodiments of the present application provide a data collection method, system and device, which improve the log file collection efficiency and reduce the resource consumption required for collecting log files.

[0005] In a first aspect, the embodiments of the present application provide a data collection method, which is executed by a data collection control terminal, the data collection control terminal is connected with at least one industrial equipment of the same business type, and the method comprises: obtaining initial log of the industrial equipment and equipment parameters corresponding to the business type, wherein the initial log comprises one or more lines of log data; obtaining a plurality of parameter information from the one or more lines of log data according to the equipment parameters, wherein the equipment parameters are obtained based on operation and / or category division of the plurality of parameter information; and collecting log files of the industrial equipment according to the plurality of parameter information.

[0006] In some embodiments of the present application, the plurality of parameter information comprises first production information of the industrial equipment starting to produce products, second production information of the industrial equipment completing to produce products and fault information, and the equipment parameters comprise production cycle, production distance time and fault code, wherein the method further comprises: calculating the difference between the first production information and the second production information to obtain the production cycle; calculating the difference between two continuous first production information of the industrial equipment to obtain the production distance time; and classifying the fault information to obtain the fault code.

[0007] In some embodiments of the present application, the method further comprises: analyzing the initial log by using a regular expression to obtain the running state of the industrial equipment, wherein the running state comprises production, standby or fault.

[0008] In some embodiments of the present application, the plurality of parameter information includes a plurality of running state information, the running state information being used to represent a running state of the industrial equipment, and the running state of the industrial equipment is obtained by parsing the initial log through the regular expression, including: constructing a state set, the state set including the plurality of running state information; and matching the plurality of running state information with the running state through the regular expression to obtain the running state of the industrial equipment.

[0009] In some embodiments of the present application, before the plurality of parameter information is obtained from the one or more lines of log data according to the equipment parameter, the method further includes: in a case where it is detected that the initial log includes a plurality of preset key attributes, determining that the initial log is complete, and searching for the plurality of parameter information.

[0010] In a second aspect, embodiments of the present application provide a data acquisition system, including a data acquisition control terminal, a terminal manager, a data platform, and at least one industrial equipment, wherein the data acquisition control terminal is configured to execute the data acquisition method of the first aspect, and send the acquired log file of the industrial equipment to the data platform; the terminal manager is configured to obtain equipment information of the at least one industrial equipment to be acquired from the data platform, and generate the data acquisition control terminal.

[0011] In some embodiments of the present application, the data acquisition control terminal includes a protocol parser, wherein the protocol parser is configured to perform format analysis on the log file, and convert a specified transmission protocol when the data acquisition control terminal transmits data with the at least one industrial equipment and the data platform.

[0012] In a third aspect, embodiments of the present application provide a data acquisition device, the data acquisition device being a data acquisition control terminal, the data acquisition control terminal being connected with at least one industrial equipment of the same business type, and the data acquisition control terminal including a first obtaining module, a second obtaining module, and an acquisition module, wherein the first obtaining module is configured to obtain an initial log of the industrial equipment and equipment parameters corresponding to the business type, the initial log including one or more lines of log data; the second obtaining module is configured to obtain a plurality of parameter information from the one or more lines of log data according to the equipment parameters, the equipment parameters being obtained based on operation and / or category division on the plurality of parameter information; and the acquisition module is configured to acquire a log file of the industrial equipment according to the plurality of parameter information.

[0013] In a fourth aspect, embodiments of the present application provide a computer readable storage medium, the storage medium storing a computer program, the computer program being configured to execute the data acquisition method of the first aspect.

[0014] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising: a processor; a memory for storing processor-executable instructions, wherein the processor is configured to execute the data collection method of the first aspect.

[0015] The embodiments of the present application provide a data collection method, system and device. The initial log of the industrial equipment and the device parameters corresponding to the business type of the industrial equipment are obtained, and the multiple parameter information for constructing the device parameters is obtained from the initial log according to the device parameters, so that the data collection control terminal can collect the log files according to the multiple parameter information, the log data included in the log files is more targeted, the log data is collected on demand, and the subsequent accurate acquisition of the device parameters of the industrial equipment is ensured. At the same time, the data amount of the required collected log data is reduced, and the collection efficiency of the log files is improved, and the resource consumption required for collecting the log files is reduced. BRIEF DESCRIPTION OF DRAWINGS

[0016] The accompanying drawings are included to provide a further understanding of the present disclosure and constitute a part of the specification, which together with the embodiments of the present disclosure serve to explain the present disclosure, and do not constitute a limitation of the present disclosure. The above and other features and advantages will become more apparent to those skilled in the art from the detailed description of the specific example embodiments, with reference to the accompanying drawings, in which:

[0017] FIG. 1 is a schematic diagram of a data collection system provided by an example embodiment of the present application.

[0018] FIG. 2 is a flowchart of a data collection method provided by an example embodiment of the present application.

[0019] FIG. 3 is a flowchart of a data collection method provided by another example embodiment of the present application.

[0020] FIG. 4 is a structural diagram of a data collection device provided by an example embodiment of the present application.

[0021] FIG. 5 is a block diagram of an electronic device for data collection provided by an example embodiment of the present application. DETAILED DESCRIPTION

[0022] The technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings of the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0023] Exemplary system

[0024] FIG. 1 is a schematic diagram of a data collection system provided by an example embodiment of the present application. As shown, the data collection system includes a data platform 110, a data collection control terminal 120, at least one industrial device 130, and a terminal manager 140. FIG. 1

[0025] The data platform 110 can be a data platform disposed on a server, which is not specifically limited by embodiments of the present application.

[0026] The terminal manager 140 can be wirelessly connected with the data platform 110 and the data collection control terminal 120. The terminal manager 140 can send heartbeat information to the data platform 110 to ensure normal connection with the data platform 110, wherein the heartbeat information can include a connection time (Connect Time) and a current running status (Status) of the terminal manager. The terminal manager 140 can obtain configuration information of at least one industrial device 130 that needs to be collected from the data platform 110, and generate a corresponding data collection control terminal 120. In addition, when the industrial device 130 does not need to be collected, the terminal manager 140 can destroy the corresponding data collection control terminal 120. That is, the terminal manager 140 can be responsible for managing the life cycle of multiple data collection control terminals 120.

[0027] The data collection control terminal 120 can be wirelessly connected with the data platform 110, at least one industrial device 130, and the terminal manager 140. The data collection control terminal 120 can include a protocol parser (Device Adapter) 121, which can be used to format parse the collected log file, and convert the transmission protocol when data transmission is performed, and the number of protocol parsers 121 can be one or more, which is not specifically limited by embodiments of the present application. For example, referring to FIG. 1 , the data collection control terminal 120 includes N protocol parsers 121.

[0028] In an embodiment, the protocol parser is used to format parse the log file, and convert a specified transmission protocol when the data collection control terminal needs to perform data transmission with at least one industrial device and the data platform.

[0029] ​The data collection control terminal 120 can receive collection and control instructions from the data platform 110, wherein the instructions can include defining which protocol parser 121 to apply to communicate with the industrial equipment 130, defining the transmission protocol of the data (for example, defining which protocol to communicate with the data platform), defining the configuration of the parameter information and equipment parameters to be collected, defining the frequency of data collection, and defining the pre-processing script before data collection, etc. The pre-processing script can be used to convert the log file without format into a file format that the data platform 110 can process, wherein the data collection control terminal 120 can repeatedly execute the call of the pre-processing script through the content defined in the instructions (for example, it can be the defined frequency of data collection). In addition, in the case that the data collection control terminal 120 fails to send the log file, the data collection control terminal 120 can temporarily store the log file to wait for retransmission.

[0030] It should be noted that the data platform 110, the data collection control terminal 120, and the terminal manager 140 can be software.

[0031] The industrial equipment 130 can be a hardware device. The number of industrial equipment 130 can be one or more, and multiple industrial equipment can be industrial equipment of the same business type, that is, industrial equipment in the same business scenario, and the number of industrial equipment is not specifically limited in the embodiments of the present application.

[0032] It should be noted that the embodiments of the present application can be understood as a technical solution of on-demand collection and individualized collection of log files of industrial equipment by a data collection system.

[0033] Exemplary method

[0034] FIG. 2 is a flowchart of a data collection method provided by an exemplary embodiment of the present application. FIG. 2 The method of the present application is executed by a computing device, or a data collection control terminal running on the computing device, wherein the data collection control terminal is connected with at least one industrial equipment of the same business type. As shown in FIG. 2 The data collection method includes the following contents.

[0035] S210: Obtain the initial log of the industrial equipment and the equipment parameters corresponding to the business type.

[0036] In an embodiment, the initial log includes one or more lines of log data. Specifically, the initial log can be one or more lines of log data presented in table form, and the form of the log data is not specifically limited in the embodiments of the present application.

[0037] Specifically, the initial log can be referred to as a Log file, which can be a record file for recording operation events of the industrial equipment. That is, the initial log can be understood as a complete log file collected by the industrial equipment, wherein the initial log can include multiple parameter information. The data collection control terminal can collect the initial log of the industrial equipment from the industrial equipment.

[0038] The equipment parameter can be understood as an important parameter of the industrial equipment when producing a product that needs to be concerned by a user (for example, a worker applying the industrial equipment to produce the product). The equipment parameter can be set by an industrial expert according to business requirements and on-site production requirements, and is pre-stored in a data platform. The data collection control terminal can obtain the equipment parameter from the data platform. For example, in a scenario where the business type is material processing, multiple equipment parameters can include cycle time, takt time, barcode, error code, and the like. The number of equipment parameters can be multiple, that is, multiple equipment parameters, and the number of equipment parameters is not specifically limited in the embodiments of the present application.

[0039] It should be noted that the data collection control terminal can obtain the construction method of the equipment parameter and the multiple parameter information for constructing the equipment parameter while obtaining the equipment parameter, so as to facilitate the data collection control terminal to query the multiple parameter information in the initial log.

[0040] S220: Obtain multiple parameter information from one or more rows of log data according to the equipment parameter.

[0041] In an embodiment, the equipment parameter is obtained based on operation and / or category division of the multiple parameter information.

[0042] Specifically, one or more rows of log data can include multiple parameter information. The data collection control terminal can find the multiple parameter information from one or more rows of log data, thereby obtaining the multiple parameter information. For example, the data collection control terminal can match the parameter information recorded in each row of log data with the multiple parameter information required for constructing the equipment parameter, thereby obtaining the multiple parameter information.

[0043] The operation can be addition and subtraction operation or multiplication and division operation, and the type of operation is not specifically limited in the embodiments of the present application. The equipment parameter can be obtained by performing addition and subtraction operation on the multiple parameter information, or can be obtained by performing category division on the multiple parameter information, and in the case where the equipment parameter is multiple, the multiple equipment parameters can be obtained by performing addition and subtraction operation and category division on the multiple parameter information, and the obtaining process of the equipment parameter is not specifically limited in the embodiments of the present application.

[0044] For example, when the device parameter is a production cycle, the plurality of parameter information includes first production information of the industrial equipment starting to produce a product and second production information of the industrial equipment completing production of the product, and the device parameter can be obtained by subtracting the first production information from the second production information.

[0045] S230: Collect the log file of the industrial equipment according to the plurality of parameter information.

[0046] Specifically, the data collection control terminal can collect the log file of the industrial equipment including only the plurality of parameter information according to the plurality of parameter information, that is, the log file includes only the plurality of parameter information.

[0047] It should be noted that the data collection control terminal can collect in a single-client mode, that is, only responsible for collecting the log file (for example, production data) of a specific industrial equipment, to ensure high timeliness during collection. The data collection control terminal can also collect in a multi-client mode to meet the demand for collecting log files of a plurality of industrial equipment of the same business type, thereby reducing the consumption of data collection resources.

[0048] In an embodiment, after collecting the log file of the industrial equipment according to the plurality of parameter information, the method further includes obtaining the device parameter of the industrial equipment based on the plurality of parameter information included in the log file of the industrial equipment, uploading the obtained device parameter to the data platform, and displaying the log file.

[0049] Therefore, it can be seen that the embodiments of the present application obtain the initial log of the industrial equipment and the device parameter corresponding to the business type of the industrial equipment, and obtain the plurality of parameter information for constructing the device parameter from the initial log according to the device parameter, and then the data collection control terminal can collect the log file according to the plurality of parameter information, so that the log data included in the log file is more targeted, and the log data is collected on demand, which provides a guarantee for subsequent accurate acquisition of the device parameter of the industrial equipment. At the same time, the amount of log data required to be collected is reduced, thereby improving the collection efficiency of the log file and reducing the resource consumption required for collecting the log file.

[0050] In an embodiment of the present application, the plurality of parameter information includes first production information of the industrial equipment starting to produce a product, second production information of the industrial equipment completing production of the product, and fault information, and the device parameter includes a production cycle, a production distance time, and a fault code. The method further includes: calculating the difference between the first production information and the second production information to obtain the production cycle; calculating the difference between two consecutive first production information of the industrial equipment to obtain the production distance time; and classifying the fault information to obtain the fault code.

[0051] Specifically, the data acquisition control terminal can query the plurality of parameter information of the industrial equipment when producing the product in one or more lines of log data. The plurality of parameter information can include first production information of the industrial equipment starting to produce the product, second production information of the industrial equipment completing to produce the product, and fault information, etc., wherein the first production information can be a time point of the industrial equipment starting to produce the product, the second production information can be a time point of the industrial equipment completing to produce, and the fault information can be information of the industrial equipment causing a fault due to a sudden situation in the production process.

[0052] In an embodiment, the production cycle can be a time interval from the product material entering the industrial equipment to the industrial equipment processing the product material. The data acquisition control terminal can take the time difference between the first production information and the second production information as the production cycle.

[0053] In an embodiment, the take time can be a time interval from the product material entering the industrial equipment and processing to the next product material entering the industrial equipment. That is, the data acquisition control terminal can take the time difference between the corresponding two first production information of the industrial equipment as the take time.

[0054] In an embodiment, the fault code can be a number corresponding to the fault, wherein the user can pre-classify the fault information of the industrial equipment according to the actual situation, for example, the power-off corresponds to the number 01, the material jam corresponds to the number 02, and the machine adjustment corresponds to the number 03, etc. The data acquisition control terminal can match the fault information with the fault code to determine the fault code.

[0055] It should be noted that the plurality of equipment parameters can also include a preset ideal production cycle (Ideal Cycle Time) and a preset ideal take time (Ideal Take Time), etc., and the equipment parameters are not limited in the embodiment of the present application. The parameter values of the two equipment parameters of the ideal production cycle and the ideal take time are usually determined according to the industry experience to judge the ideal state of the industrial equipment production, and then manually added as an important index of predictive maintenance.

[0056] Therefore, it can be known that the embodiment of the present application obtains the parameter values of the equipment parameters through the plurality of parameter information, so that the equipment parameters can correctly reflect the running state of the industrial equipment.

[0057] In an embodiment of the present application, the method further includes: analyzing the initial log through a regular expression to obtain a running state of the industrial equipment, wherein the running state includes production, standby, or fault.

[0058] It should be noted that, in addition to parsing the initial log to obtain the device parameters corresponding to the industrial equipment, the embodiment of the present application can also parse the initial log to obtain the running state of the industrial equipment.

[0059] Specifically, the running state can be understood as the running state of the industrial equipment determined by analyzing the initial log of the industrial equipment. The running state includes multiple running states such as production (Running), standby (Idle), shutdown or machine adjustment, and fault, wherein the production state can further include waiting for board in (Wait Board In) and waiting for board out (Wait Board Out), and the machine adjustment or fault can be represented by the word Down. The embodiment of the present application does not make specific limitation on the running state. The waiting for board in can be understood as a stage in which the industrial equipment waits for product materials to enter the industrial equipment during production. The waiting for board out can be understood as a stage in which the industrial equipment is processing product materials and waiting for the product processing to be completed.

[0060] In an embodiment, the data acquisition control terminal can first construct a state set including multiple running state information, and then match the multiple running state information with the running state through a regular expression to obtain the running state corresponding to the state set, wherein the regular expression can also be referred to as a rule expression.

[0061] Therefore, the embodiment of the present application analyzes the multiple parameter information of the industrial equipment to obtain the state information of the industrial equipment, thereby improving the efficiency of the running fault detection.

[0062] In an embodiment of the present application, the multiple parameter information includes multiple running state information, and the running state information is used to represent the running state of the industrial equipment, wherein the running state of at least one industrial equipment is obtained by parsing the initial log through a regular expression, including: constructing a state set including multiple running state information; matching the multiple running state information with the running state through a regular expression to obtain the running state corresponding to the state set.

[0063] Specifically, based on the parameter information (i.e., running state information) in the multiple parameter information for representing the running state of the industrial equipment, a state set is constructed, wherein the state set can be understood as a data set composed of multiple running state information. Then, different running states are represented by different data ranges, i.e., the production state, the standby state, and the fault state have different ranges respectively. Further, the data acquisition control terminal can match the multiple running state information (for example, data) with the running state through a regular expression. In the case that the multiple running state information is matched to the corresponding running state, the matching corresponding running state is taken as the running state of the industrial equipment.

[0064] It should be noted that in most cases, the running state of the industrial equipment cannot be determined by one or two parameter information in the initial log, and therefore the embodiment of the present application determines the running state of the industrial equipment in a classification manner. A plurality of parameter information capable of representing a certain running state of the industrial equipment is placed in a set (i.e., a state set), and then a regular expression is used to match the plurality of parameter information in the state set. When the plurality of parameter information is matched in a data range corresponding to a certain running state, the running state is output as the running state corresponding to the state set, i.e., the running state of the industrial equipment.

[0065] Therefore, the embodiment of the present application determines the running state of the industrial equipment in a classification manner, avoids the problem that the running state cannot be determined by a small amount of parameter information, and improves the convenience of determining the running state.

[0066] In an embodiment of the present application, before the plurality of parameter information is acquired from the one or more rows of log data according to the equipment parameters, the method further includes: in a case where it is detected that the initial log includes a plurality of preset key attributes, determining that the initial log is complete, and searching for the plurality of parameter information.

[0067] Specifically, before the plurality of parameter information is acquired, the data acquisition control terminal can perform integrity evaluation on the acquired initial log. In a case where it is detected that the initial log is complete, the data acquisition control terminal can acquire the plurality of parameter information from the complete initial log.

[0068] For example, referring to FIG. 3 S310: acquiring initial log of the industrial equipment and equipment parameters corresponding to the business type. S320: determining whether the initial log is complete. In a case where the initial log is complete, step S330 is performed; in a case where the initial log is not complete, step S310 is performed. S330: acquiring a plurality of parameter information from the initial log according to the equipment parameters. S340: acquiring log files of the industrial equipment including only the plurality of parameter information. S350: displaying the acquired log files.

[0069] In an embodiment, the integrity evaluation can be performed in a manner of detecting key attributes. Specifically, the data acquisition control terminal can determine whether the initial log includes a plurality of key attributes. In a case where it is detected by the data acquisition control terminal that the initial log includes a plurality of preset key attributes, it is determined that the initial log is complete, otherwise it is determined that the initial log is not complete. It should be noted that the number and content of the key attributes can be set according to different business types, and the embodiment of the present application does not limit the key attributes.

[0070] Therefore, the initial log collected by the embodiment of the present application can contain various state information of the industrial equipment during operation.

[0071] Exemplary apparatus

[0072] FIG. 4 is a structural schematic diagram of a data collection device 400 provided by an exemplary embodiment of the present application. As shown in the figure, the data collection device 400 is a data collection control terminal, which is connected with at least one industrial equipment of the same service type. The data collection control terminal comprises a first acquisition module 410, a second acquisition module 420 and a collection module 430. FIG. 4

[0073] The first acquisition module 410 is configured to acquire an initial log of the industrial equipment and a device parameter corresponding to the service type. The initial log comprises one or more lines of log data. The second acquisition module 420 is configured to acquire a plurality of parameter information from the one or more lines of log data according to the device parameter. The device parameter is obtained based on operation and / or category division of the plurality of parameter information. The collection module 430 is configured to collect a log file of the industrial equipment according to the plurality of parameter information.

[0074] The embodiment of the present application provides a data collection device. The initial log of the industrial equipment and the device parameter corresponding to the service type of the industrial equipment are acquired. The plurality of parameter information used to construct the device parameter is acquired from the initial log according to the device parameter. Then, the data collection control terminal can collect the log file according to the plurality of parameter information, so that the log data included in the log file is more targeted, and the log data is collected on demand, which provides a guarantee for subsequent accurate acquisition of the device parameter of the industrial equipment. Meanwhile, the data amount of the log data required to be collected is reduced, so as to improve the collection efficiency of the log file and reduce the resource consumption required when the log file is collected.

[0075] According to an embodiment of the present application, the plurality of parameter information comprises first production information of the industrial equipment starting to produce a product, second production information of the industrial equipment completing production of the product and fault information. The device parameter comprises a production cycle, a production distance time and a fault code. The first acquisition module 410 can further be configured to perform difference calculation on the first production information and the second production information to acquire the production cycle. Difference calculation is performed on two continuous first production information of the industrial equipment to acquire the production distance time. The fault information is classified to acquire the fault code.

[0076] According to an embodiment of the present application, the second acquisition module 420 is configured to analyze the initial log by using a regular expression to acquire a running state of the industrial equipment. The running state comprises production, standby or fault. ​

[0077] According to an embodiment of the present application, the plurality of parameter information comprises a plurality of running state information, the running state information is used to represent a running state of the industrial equipment, and the second obtaining module 420 is configured to construct a state set, the state set comprising the plurality of running state information; and the plurality of running state information is matched with the running state through a regular expression to obtain the running state of the industrial equipment.

[0078] According to an embodiment of the present application, the second obtaining module 420 is configured to, in a case where it is detected that the initial log comprises a plurality of preset key attributes, determine that the initial log is complete, and search for the plurality of parameter information.

[0079] It should be understood that the specific working process and functions of the first obtaining module 410, the second obtaining module 420 and the collecting module 430 in the above embodiments can refer to the descriptions of the data collection method provided by the above embodiments, and will not be repeated here. FIG. 2 and FIG. 3 The specific working process and functions of the first obtaining module 410, the second obtaining module 420 and the collecting module 430 in the above embodiments can refer to the descriptions of the data collection method provided by the above embodiments, and will not be repeated here.

[0080] Exemplary electronic device and computer-readable storage medium

[0081] FIG. 5 is a block diagram of an electronic device 500 for data collection provided by an exemplary embodiment of the present application.

[0082] Referring to FIG. 5 , the electronic device 500 comprises a processing component 510, which further comprises one or more processors, and a memory resource represented by a memory 520, used to store instructions executable by the processing component 510, such as an application program. The application program stored in the memory 520 can comprise one or more than one module each corresponding to a set of instructions. In addition, the processing component 510 is configured to execute the instructions to perform the above-mentioned data collection method.

[0083] The electronic device 500 can further comprise a power supply component configured to perform power management of the electronic device 500, a wired or wireless network interface configured to connect the electronic device 500 to a network, and an input / output (I / O) interface. The electronic device 500 can be operated based on an operating system stored in the memory 520, such as Windows Server TM , Mac OSX TM , Unix TM , Linux TM , FreeBSD TM or the like.

[0084] A non-transitory computer readable storage medium, when the instructions in the storage medium are executed by a processor of the electronic device 500, enable the electronic device 500 to perform a data collection method, comprising: obtaining an initial log of an industrial device and a device parameter corresponding to a business type, wherein the initial log comprises one or more lines of log data; obtaining a plurality of parameter information from the one or more lines of log data according to the device parameter, wherein the device parameter is obtained based on operation and / or category division on the plurality of parameter information; and collecting a log file of the industrial device according to the plurality of parameter information.

[0085] All the optional technical solutions described above can be combined to form optional embodiments of the present application, which will not be described one by one here.

[0086] Those skilled in the art can appreciate that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solutions. Those skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0087] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.

[0088] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be realized by other ways. For example, the device embodiments described above are only schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0089] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e. can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.

[0090] In addition, each of the functional units in the various embodiments of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit.

[0091] The functions described above can be implemented in the form of a software function unit and sold or used as an independent product if the functions are realized in the form of a software function unit and sold or used as an independent product. Based on such an understanding, the technical solutions of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program check codes.

[0092] It should be noted that, in the description of the present application, the terms "first", "second", "third" and the like are only used for the purpose of description, and cannot be understood as indicating or implying relative importance. In addition, in the description of the present application, unless otherwise specified, the meaning of "a plurality of" is two or more.

[0093] The above only describes the preferred embodiments of the present application and cannot be used to limit the present application. Any modification, equivalent replacement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A data acquisition method, characterized by, The method is executed by a data collection control terminal, the data collection control terminal is connected with at least one industrial equipment of the same service type, and the data collection control terminal is used to collect log files of a plurality of industrial equipment of the same service type, wherein the data collection method for each industrial equipment comprises: obtaining an initial log of an industrial equipment and a device parameter corresponding to the service type, wherein the initial log comprises one or more lines of log data, and the initial log is a complete log file collected by the industrial equipment; in the case where it is detected that the initial log comprises a plurality of preset key attributes, determining that the initial log is complete, and finding and obtaining a plurality of parameter information required for constructing the device parameter from the one or more lines of log data, wherein the device parameter is obtained based on operation and / or category division of the plurality of parameter information; collecting a log file of the industrial equipment comprising only the plurality of parameter information according to the plurality of parameter information.

2. The method of claim 1, wherein, The plurality of parameter information comprises first production information of the industrial equipment starting to produce a product, second production information of the industrial equipment completing production of the product, and fault information, and the device parameter comprises a production cycle, a production distance time, and a fault code, wherein the method further comprises: differentially calculating the first production information and the second production information to obtain the production cycle; differentially calculating two continuous first production information of the industrial equipment to obtain the production distance time; and performing category division on the fault information to obtain the fault code.

3. The method of claim 1, wherein, The method further comprises: parsing the initial log by using a regular expression to obtain a running state of the industrial equipment, wherein the running state comprises production, standby, or fault.

4. The method of claim 3, wherein, The plurality of parameter information comprises a plurality of running state information, and the running state information is used to indicate the running state of the industrial equipment, wherein the parsing of the initial log by using the regular expression to obtain the running state of the industrial equipment comprises: constructing a state set, wherein the state set comprises the plurality of running state information; matching the plurality of running state information with the running state by using the regular expression to obtain the running state of the industrial equipment.

5. A data acquisition system characterized by, The system comprises a data collection control terminal, a terminal manager, a data platform, and at least one industrial equipment, wherein the data collection control terminal is used to execute the data collection method in any one of claims 1 to 4, and send the collected log file of the industrial equipment to the data platform; the terminal manager is used to obtain device information of the at least one industrial equipment to be collected from the data platform, and generate the data collection control terminal.

6. The system of claim 5, wherein, The data collection control terminal comprises a protocol parser, wherein the protocol parser is used to perform format parsing on the log file, and convert a specified transmission protocol when the data collection control terminal performs data transmission with the at least one industrial equipment and the data platform.

7. A data acquisition device, characterized by The data collection device is a data collection control terminal, the data collection control terminal is connected with at least one industrial equipment of the same service type, the data collection control terminal is used for collecting log files of a plurality of industrial equipment of the same service type, and the data collection control terminal comprises a first acquisition module, a second acquisition module and an acquisition module, The first acquisition module is used for acquiring initial logs of the industrial equipment and equipment parameters corresponding to the service type, wherein the initial logs comprise one or more lines of log data, and the initial logs are complete log files collected by the industrial equipment. The second acquisition module is used for determining that the initial logs are complete when it is detected that the initial logs comprise a plurality of preset key attributes, and searching and acquiring a plurality of parameter information required for constructing the equipment parameters from the one or more lines of log data, wherein the equipment parameters are obtained based on operation and / or category division of the plurality of parameter information. The acquisition module is used for collecting log files of the industrial equipment comprising only the plurality of parameter information according to the plurality of parameter information.

8. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, and the computer program is used for executing the data collection method in any one of claims 1 to 4.

9. An electronic device, comprising: Comprise: A processor; A memory for storing instructions executable by the processor, The processor is used for executing the data collection method in any one of claims 1 to 4.

Citation Information

Patent Citations

  • Operation and maintenance method and device of base station

    CN108882263A

  • Log information analysis method and device, computer equipment and storage medium

    CN111475324A