Device data collection configuration processing method, device and electronic equipment
By obtaining the cloud platform operation information and the number of devices to be collected, and optimizing the configuration of the acquisition and forwarding program, the problem of low data collection and forwarding efficiency of equipment is solved, and more efficient data transmission and resource utilization are achieved.
Patent Information
- Application Number
- CN202210221605.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-09
- Publication Date
- 2025-03-25
- Estimated Expiration
- 2042-03-09
AI Technical Summary
The efficiency of existing equipment data collection and forwarding to cloud platforms is low.
By obtaining the operating information of the cloud platform and the number of devices to be collected, the maximum number of connections to the forwarding program and the target number of collection programs are determined, and according to the maximum value of the connection packet of the forwarding program, the corresponding several collection programs are determined from the collection program to maximize the transmission of the total data.
It improves the work efficiency of device data collection and forwarding to the cloud platform, and maximizes server resource utilization and device data collection.
Smart Images

Figure CN114579314B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of industrial data acquisition, and in particular to a method, a device and an electronic device for processing equipment data acquisition configuration. Background Art
[0002] At present, with the rise of industrial Internet, more and more factory equipment needs to be connected to the Internet, but there are many types of equipment, and each type of access is different. At present, no company can connect all types of equipment to the Internet, because there are many collection software on the market, which can support the collection of equipment of certain brand companies and provide data to the cloud platform. However, in the existing technical route of collecting equipment data and forwarding it to the cloud platform, the efficiency of equipment data collection and forwarding to the cloud platform is low. Summary of the invention
[0003] The purpose of the present invention is to provide a method, device and electronic device for processing device data collection configuration to alleviate the technical problem of low efficiency in the existing collection of device data and forwarding it to a cloud platform.
[0004] In a first aspect, an embodiment of the present application provides a method for processing device data collection configuration, the method comprising:
[0005] Obtaining operation information of the cloud platform, and determining the maximum number of connections of the cloud platform accessing the forwarding program and the maximum value of the connection packets corresponding to each forwarding program based on the operation information;
[0006] Acquire the number of devices to be collected of the devices to be collected, and determine the target number of the collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program; wherein the collection program is used to collect data from the devices to be collected;
[0007] For each of the forwarding programs with the maximum number of connections, based on the maximum value of the connection packet of the forwarding program, several collection programs corresponding to each forwarding program are determined from the target number of collection programs, so that the maximum total amount of data collected by the several collection programs corresponding to each forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0008] In a possible implementation, before the step of determining the target number of acquisition programs based on the number of devices to be acquired and the maximum number of designated acquisition devices corresponding to each acquisition program, the step further includes:
[0009] Performance data of the acquisition program is obtained, and a maximum number of designated acquisition devices corresponding to the acquisition program is determined according to the performance data.
[0010] In a possible implementation, the step of determining, based on the maximum value of the connection packet of the forwarding program, a number of the collection programs corresponding to each of the forwarding programs from the target number of the collection programs, so that the maximum value of the total amount of data collected by the number of the collection programs corresponding to each of the forwarding programs does not exceed the maximum value of the connection packet of the forwarding program, includes:
[0011] In the target number of acquisition programs, according to the maximum number of designated acquisition devices corresponding to the acquisition program and the amount of data to be collected by each of the data collection devices, the maximum value of the total amount of data collected by the acquisition program is determined;
[0012] Based on the maximum value of the connection packet of the forwarding program and the maximum value of the total amount of data collected by each of the collection programs, a number of collection programs corresponding to each of the forwarding program are determined from the target number of collection programs, so that the maximum value of the total amount of data collected by the several collection programs corresponding to each of the forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0013] In a possible implementation, the step of determining a number of acquisition programs corresponding to each forwarding program from the target number of acquisition programs based on the maximum value of the connection packets of the forwarding program and the maximum value of the total amount of data collected by each acquisition program, so that the maximum value of the total amount of data collected by the number of acquisition programs corresponding to each forwarding program does not exceed the maximum value of the connection packets of the forwarding program, includes:
[0014] Based on the maximum value of the connection packet of the forwarding program and the maximum value of the total amount of data collected by each of the collection programs, the target number of collection programs are grouped, and the number of collection programs included in each group and the forwarding programs corresponding to each group are determined, so that the maximum value of the total amount of data collected by the number of collection programs in each group corresponding to the forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0015] In a possible implementation, after the step of determining, for each of the forwarding programs in the maximum number of connections, a number of acquisition programs corresponding to each forwarding program from the target number of acquisition programs based on the maximum value of the connection packets of the forwarding program, so that the maximum value of the total amount of data collected by the number of acquisition programs corresponding to each forwarding program does not exceed the maximum value of the connection packets of the forwarding program, the step further includes:
[0016] Based on the maximum number of connected forwarding programs, the target number of collection programs, and the corresponding relationship between the forwarding programs and the collection programs, device data is collected for the number of devices to be collected, so that the collected device data is transmitted to the cloud platform through several collection programs and several forwarding programs.
[0017] In a possible implementation, the operation information of the cloud platform includes any one or more of the following:
[0018] The performance, data transmission speed, and platform configuration of the cloud platform.
[0019] In a possible implementation, the operation information of the cloud platform includes the maximum number of platform devices for device data collection; and also includes:
[0020] If the number of devices to be collected is less than or equal to the maximum number of platform devices, then performing a step of determining a target number of collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program;
[0021] If the number of devices to be collected is greater than the maximum number of platform devices, the target number of the collection programs is determined based on the maximum number of platform devices and the maximum number of designated collection devices corresponding to each collection program.
[0022] In a second aspect, a device for processing device data collection configuration is provided, comprising:
[0023] A first determination module is used to obtain the operation information of the cloud platform, and determine the maximum number of connections of the cloud platform accessing the forwarding program and the maximum value of the connection packets corresponding to each forwarding program based on the operation information;
[0024] A second determination module is used to obtain the number of devices to be collected of the devices to be collected, and determine the target number of the collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program; wherein the collection program is used to collect data from the devices to be collected;
[0025] The third determination module is used to determine, for each of the forwarding programs with the maximum number of connections, a number of acquisition programs corresponding to each forwarding program from the target number of acquisition programs based on the maximum value of the connection packet of the forwarding program, so that the maximum total amount of data collected by the number of acquisition programs corresponding to each forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0026] In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program that can be executed on the processor, and when the processor executes the computer program, the method described in the first aspect is implemented.
[0027] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to execute the method described in the first aspect above.
[0028] The embodiments of the present application bring the following beneficial effects:
[0029] The embodiment of the present application provides a method, device and electronic device for processing device data collection configuration, which can obtain the operation information of the cloud platform, and determine the maximum number of connections of the cloud platform to access the forwarding program and the maximum value of the connection packet corresponding to each forwarding program based on the operation information, obtain the number of devices to be collected of the devices to be collected, and determine the target number of collection programs based on the number of devices to be collected and the maximum value of the number of designated collection devices corresponding to each collection program, wherein the collection program is used to collect data of the devices to be collected, and for each forwarding program in the maximum number of forwarding programs, based on the maximum value of the connection packet of the forwarding program, a number of collection programs corresponding to each forwarding program is determined from the target number of collection programs, so that the maximum value of the total amount of data collected by the number of collection programs corresponding to each forwarding program does not exceed the maximum value of the connection packet of the forwarding program. In this solution, by calculating how many forwarding programs are needed and how many collection programs each forwarding program corresponds to according to the specific operation information of the cloud platform (transmission speed and performance, etc.), it is possible to automatically calculate how many forwarding programs are needed according to the data access size of the cloud platform for a single forwarding program and the data of the factory production equipment to be collected, so as to achieve the best performance, so as to maximize the use of server resources and maximize the collection of the most device data and push it to the cloud platform, thereby improving the work efficiency of device data collection and forwarding to the cloud platform.
[0030] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0032] Figure 1 A schematic diagram of the configuration process for the existing acquisition device data;
[0033] Figure 2 Another schematic diagram of the flow chart for configuring the existing data acquisition device;
[0034] Figure 3 Another schematic diagram of the flow chart for configuring the existing data acquisition device;
[0035] Figure 4 A flowchart of a method for processing device data acquisition configuration provided in an embodiment of the present application;
[0036] Figure 5 Another flowchart of a method for processing device data collection configuration provided in an embodiment of the present application;
[0037] Figure 6 Another flowchart of a method for processing device data collection configuration provided in an embodiment of the present application;
[0038] Figure 7 A schematic diagram of the structure of a processing device for device data acquisition configuration provided in an embodiment of the present application;
[0039] Figure 8 A schematic structural diagram of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION
[0040] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.
[0041] The terms "including" and "having" and any variations thereof mentioned in the embodiments of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.
[0042] At present, with the rise of industrial Internet, more and more factory equipment needs to be connected to the Internet, but there are many types of equipment, and each type of access is different. No company can connect all types of equipment to the Internet, because there are many acquisition software on the market, such as Xuansi, Lexin, Advantech, Delta, etc., which can support the acquisition of equipment from certain brand companies and provide data to the cloud. The current industrial equipment acquisition technology on the market is basically based on the following three types:
[0043] One is the hardware form, i.e., the acquisition gateway, such as Figure 1 As shown, one acquisition gateway can only support the acquisition of several or dozens of devices, and then a management software needs to be developed to manage all the acquisition gateways. The implementation cost, hardware cost and development cost are high.
[0044] The second is that a server has multiple collection programs collecting data from multiple devices, such as Figure 2 As shown in the figure, all data is forwarded to a forwarding program, which then forwards it to the cloud platform. In this way, the forwarding program will become a bottleneck. If there are 100 collection programs, each of which collects data from 100 devices, and each device has 1,000 points, the forwarding program cannot forward all the collected device data immediately.
[0045] Third, there are multiple collection programs on the server, such as Figure 3 As shown, one collection program corresponds to one forwarding program, which will waste a lot of machine performance, because one forwarding program only carries one collection program and a lot of resources are not used but occupied.
[0046] However, in the above existing technical routes of collecting device data and forwarding it to the cloud platform, the efficiency of collecting device data and forwarding it to the cloud platform is low.
[0047] Based on this, the embodiments of the present application provide a method, apparatus and electronic device for processing device data collection configuration, by which the technical problem of low efficiency in collecting device data and forwarding it to a cloud platform can be alleviated.
[0048] The embodiments of the present invention are further described below in conjunction with the accompanying drawings.
[0049] Figure 4 The present invention provides a flow chart of a method for processing device data acquisition configuration according to an embodiment of the present invention. The method can be applied to a data processing device running a data acquisition platform. Figure 4 As shown, the method includes:
[0050] Step S110, obtaining the operation information of the cloud platform, and determining the maximum number of connections for the cloud platform to access the forwarding program and the maximum value of the connection packets corresponding to each forwarding program based on the operation information.
[0051] For example, Figure 5 and Figure 6 As shown, the data acquisition platform finds out the maximum number of connections that the cloud platform can access to a single data acquisition platform and the maximum packet size of each connection. The maximum number of connections and the maximum packet size here can be obtained based on the configuration of the cloud platform, such as automatically calculating how many forwarding programs are needed and the maximum value of the connection packet corresponding to each forwarding program based on the specific transmission speed and performance to the cloud. For example, the number of forwarding programs that only support a single acquisition platform connected to the cloud is only three, and the maximum value of the connection packet corresponding to each single forwarding program is only 3M.
[0052] In actual applications, the maximum number of connections to the forwarding program and the maximum value of the connection packets corresponding to each forwarding program can also be configured on the cloud platform.
[0053] Step S120, obtaining the number of devices to be collected of the devices to be collected data, and determining the target number of collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program.
[0054] The collection program is used to collect data from the equipment to be collected. In this step, the number of factory production equipment can be obtained first. A certain number of collection programs are required to collect all the factory equipment, so as to determine the number of collection programs to start. For example, Figure 5 As shown in the figure, each acquisition program is 100 devices, and the total number of devices divided by 100 equals the number of acquisition programs. For example, a collection program can only collect data from 100 devices at most, and there are 1,000 devices in the factory. A data acquisition platform only supports data collection from 2,000 devices at most. In this case, 10 acquisition programs need to be opened to collect device data.
[0055] In actual applications, each device has a unique device code. For example, to acquire data from 200 devices, the acquisition program opens 200 threads, and each thread reads the data of one device. For example, 200 devices form a list, and each item in the list is a device, which contains the device code, device status, and the name, timestamp, and value of each point in JSON format.
[0056] Step S130, for each forwarding program in the maximum number of connected forwarding programs, based on the maximum value of the connection packet of the forwarding program, determine a number of collection programs corresponding to each forwarding program from the target number of collection programs, so that the maximum total amount of data collected by the several collection programs corresponding to each forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0057] In this step, for example, Figure 5 and Figure 6 As shown, the data acquisition platform determines which acquisition programs are grouped according to the maximum value of a single connection packet of the cloud platform (such as the above 3M), and finally generates a number of groups, each group corresponds to a forwarding program, that is, a number of forwarding programs. If there are exactly 200 devices, each device has 100 points, and each point has data in the three fields of name, timestamp, and value, and then these data are combined in json format to be nearly 3M, then a group cannot exceed 200 devices at most.
[0058] The processing method for the device data acquisition configuration provided in the embodiment of the present application can be used as a method for maximizing the data acquisition and uploading to the cloud for a single industrial data acquisition platform. In the embodiment of the present application, there are also multiple acquisition programs corresponding to a cloud platform. By calculating how many forwarding programs are needed based on the specific operation information of the cloud platform (transmission speed and performance, etc.), and how many acquisition programs each forwarding program corresponds to, it is possible to automatically calculate how many forwarding programs are needed based on the data access size of the cloud platform for a single forwarding program and the data of the factory production equipment to be collected to achieve the best performance. In this way, the server resources are maximized and the most device data is collected and pushed to the cloud platform, which improves the work efficiency of device data collection and forwarding to the cloud platform.
[0059] In actual applications, the processing method for device data collection configuration provided in the embodiment of the present application can enable a single server to collect factory equipment with a hardware and implementation cost that is more than 60% lower than the first type on the market; the data on the cloud platform is expanded by about 2 times compared to the second type; and the number of collected devices is about 1 times more than the third type.
[0060] The above steps are described in detail below.
[0061] In some embodiments, before step S120, the method may further include the following steps:
[0062] Step a), obtaining performance data of the acquisition program, and determining the maximum number of designated acquisition devices corresponding to the acquisition program according to the performance data.
[0063] By determining the maximum value of the number of designated acquisition devices corresponding to the acquisition program according to the performance data of the acquisition program, the determined maximum value of the number of acquisition devices can be made more accurate and in line with the actual situation of the acquisition program.
[0064] In some embodiments, the above step S130 may include the following steps:
[0065] Step b), in the target number of acquisition programs, according to the maximum number of designated acquisition devices corresponding to the acquisition program and the amount of data to be collected by each data acquisition device, determining the maximum total amount of data collected by the acquisition program;
[0066] Step c), based on the maximum value of the connection packet of the forwarding program and the maximum value of the total amount of data collected by each collection program, determine a number of collection programs corresponding to each forwarding program from the target number of collection programs, so that the maximum value of the total amount of data collected by the several collection programs corresponding to each forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0067] like Figure 5 and Figure 6 As shown, the maximum total amount of data collected by the collection program is determined by the maximum number of designated collection devices corresponding to the collection program and the amount of data to be collected by each data collection device, which can make the determined maximum total amount of data collected by the collection program more accurate and in line with actual conditions.
[0068] Based on the above steps b) and c), the above step c) may include the following steps:
[0069] Step d), based on the maximum value of the connection packet of the forwarding program and the maximum value of the total amount of data collected by each collection program, the target number of collection programs are grouped, and the number of collection programs included in each group and the forwarding programs corresponding to each group are determined, so that the maximum value of the total amount of data collected by the several collection programs in the group corresponding to each forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0070] like Figure 6 As shown, by grouping the target number of collection programs, the corresponding relationship between the collection programs and the forwarding programs can be determined more efficiently, and the maximum total amount of data collected by several collection programs in each forwarding program corresponding group is ensured not to exceed the maximum value of the connection packets of the forwarding program.
[0071] In some embodiments, after step S130, the method may further include the following steps:
[0072] Step e), based on the maximum number of connected forwarding programs, the target number of collection programs and the corresponding relationship between the forwarding programs and the collection programs, device data is collected for the number of devices to be collected, so as to transmit the collected device data to the cloud platform through several collection programs and several forwarding programs.
[0073] like Figure 5 and Figure 6 As shown, device data can be collected for the number of devices to be collected according to the maximum number of forwarding programs, the target number of collection programs, and the corresponding relationship between the forwarding programs and the collection programs determined in the above process, thereby making the process of transmitting the collected device data to the cloud platform through several collection programs and several forwarding programs more efficient.
[0074] In some embodiments, the operation information of the cloud platform includes any one or more of the following: the performance of the cloud platform, the data transmission speed, and the platform configuration. In practical applications, the number of forwarding programs required and the maximum value of the connection packet corresponding to each forwarding program can be automatically calculated based on the specific transmission speed and performance to the cloud. By determining the maximum number of connections for the cloud platform to access the forwarding program and the maximum value of the connection packet corresponding to each forwarding program through the performance of the cloud platform, the data transmission speed, the platform configuration and other data, the maximum number of connections and the maximum value of the connection packet determined can be made more accurate and more in line with the actual situation of the cloud platform.
[0075] In some embodiments, the operation information of the cloud platform includes the maximum number of platform devices for device data collection; the method may also include the following steps:
[0076] Step f), if the number of devices to be collected is less than or equal to the maximum number of platform devices, then executing the step of determining the target number of collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program;
[0077] Step g), if the number of devices to be collected is greater than the maximum number of platform devices, determine the target number of collection programs based on the maximum number of platform devices and the maximum number of designated collection devices corresponding to each collection program.
[0078] For example, a data acquisition program can only collect data from 100 devices at most, and there are 1,000 devices in the factory. A data acquisition platform can only support data acquisition from 2,000 devices at most. In this case, 10 data acquisition programs need to be started to collect device data. By judging whether the number of devices to be collected is greater than the maximum number of platform devices, and then taking different data acquisition and forwarding processes accordingly, the normal operation of the cloud platform can be guaranteed and the overload of the cloud platform can be avoided.
[0079] Figure 7 A schematic diagram of a processing device for equipment data acquisition configuration is provided. The device can be applied to data processing equipment. Figure 7 As shown, the processing device 700 of the device data collection configuration includes:
[0080] The first determination module 701 is used to obtain the operation information of the cloud platform, and determine the maximum number of connections of the cloud platform accessing the forwarding program and the maximum value of the connection packets corresponding to each forwarding program based on the operation information;
[0081] The second determination module 702 is used to obtain the number of devices to be collected of the devices to be collected, and determine the target number of the collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program; wherein the collection program is used to collect data from the devices to be collected;
[0082] The third determination module 703 is used to determine, for each of the forwarding programs in the maximum number of connections, a number of acquisition programs corresponding to each forwarding program from the target number of acquisition programs based on the maximum value of the connection packet of the forwarding program, so that the maximum total amount of data collected by the number of acquisition programs corresponding to each forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0083] In some embodiments, the apparatus further comprises:
[0084] The fourth determination module is used to obtain performance data of the acquisition program and determine the maximum number of designated acquisition devices corresponding to the acquisition program according to the performance data.
[0085] In some embodiments, the third determination module is specifically configured to:
[0086] In the target number of acquisition programs, according to the maximum number of designated acquisition devices corresponding to the acquisition program and the amount of data to be collected by each of the data collection devices, the maximum value of the total amount of data collected by the acquisition program is determined;
[0087] Based on the maximum value of the connection packet of the forwarding program and the maximum value of the total amount of data collected by each of the collection programs, a number of collection programs corresponding to each of the forwarding program are determined from the target number of collection programs, so that the maximum value of the total amount of data collected by the several collection programs corresponding to each of the forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0088] In some embodiments, the third determination module is further configured to:
[0089] Based on the maximum value of the connection packet of the forwarding program and the maximum value of the total amount of data collected by each of the collection programs, the target number of collection programs are grouped, and the number of collection programs included in each group and the forwarding programs corresponding to each group are determined, so that the maximum value of the total amount of data collected by the number of collection programs in each group corresponding to the forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
[0090] In some embodiments, the apparatus further comprises:
[0091] The collection module is used to collect device data for the number of devices to be collected based on the maximum number of forwarding programs, the target number of collection programs, and the corresponding relationship between the forwarding program and the collection program, so as to transmit the collected device data to the cloud platform through several collection programs and several forwarding programs.
[0092] In some embodiments, the operation information of the cloud platform includes any one or more of the following:
[0093] The performance, data transmission speed, and platform configuration of the cloud platform.
[0094] In some embodiments, the operation information of the cloud platform includes the maximum number of platform devices for device data collection; the device also includes:
[0095] an execution module, configured to, if the number of devices to be collected is less than or equal to the maximum number of platform devices, execute a step of determining a target number of the collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program;
[0096] The fifth determination module is used to determine the target number of the acquisition programs based on the maximum number of platform devices and the maximum number of designated acquisition devices corresponding to each acquisition program if the number of devices to be acquired is greater than the maximum number of platform devices.
[0097] The device for processing equipment data collection configuration provided in the embodiment of the present application has the same technical features as the method for processing equipment data collection configuration provided in the above embodiment, so it can also solve the same technical problems and achieve the same technical effects.
[0098] An electronic device provided in an embodiment of the present application is Figure 8 As shown, the electronic device 800 includes a processor 802 and a memory 801, wherein the memory stores a computer program that can be run on the processor, and the processor implements the steps of the method provided in the above embodiment when executing the computer program.
[0099] See also Figure 8 The electronic device further includes: a bus 803 and a communication interface 804, a processor 802, a communication interface 804 and a memory 801 are connected via the bus 803; the processor 802 is used to execute an executable module stored in the memory 801, such as a computer program.
[0100] The memory 801 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 804 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used.
[0101] The bus 803 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0102] Among them, the memory 801 is used to store programs, and the processor 802 executes the program after receiving the execution instruction. The method executed by the device defined by the process disclosed in any embodiment of the present application can be applied to the processor 802 or implemented by the processor 802.
[0103] The processor 802 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 802. The above processor 802 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module may be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 801, and the processor 802 reads the information in the memory 801 and completes the steps of the above method in combination with its hardware.
[0104] Corresponding to the processing method of the above-mentioned device data acquisition configuration, an embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by the processor, the computer-executable instructions prompt the processor to execute the steps of the processing method of the above-mentioned device data acquisition configuration.
[0105] The processing device of the device data acquisition configuration provided in the embodiment of the present application can be specific hardware on the device or software or firmware installed on the device. The device provided in the embodiment of the present application, its implementation principle and the technical effect produced are the same as those in the aforementioned method embodiment. For the sake of brief description, the parts not mentioned in the device embodiment can refer to the corresponding contents in the aforementioned method embodiment. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can all refer to the corresponding processes in the aforementioned method embodiment, and will not be repeated here.
[0106] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.
[0107] For another example, the flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the device, method and computer program product according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of the boxes in the block diagram and / or the flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.
[0108] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0109] In addition, each functional unit in the embodiments provided in the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0110] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the processing method for the device data acquisition configuration described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.
[0111] It should be noted that similar numbers and letters represent similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. In addition, the terms "first", "second", "third", etc. are only used to distinguish the description and are not to be understood as indicating or implying relative importance.
[0112] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solution of the present application, rather than to limit it. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the aforementioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solution recorded in the aforementioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solution deviate from the scope of the technical solution of the embodiment of the present application. They should all be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.
Claims
1. A method for processing device data collection configuration, characterized in that: The method comprises: Obtaining operation information of the cloud platform, and determining the maximum number of connections of the cloud platform accessing the forwarding program and the maximum value of the connection packets corresponding to each forwarding program based on the operation information; Acquire the number of devices to be collected of the devices to be collected, and determine the target number of the collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program; wherein the collection program is used to collect data from the devices to be collected; For each of the forwarding programs of the maximum number of connections, based on the maximum value of the connection packet of the forwarding program, determining a number of the collection programs corresponding to each of the forwarding programs from the target number of collection programs, so that the maximum value of the total amount of data collected by the number of the collection programs corresponding to each of the forwarding programs does not exceed the maximum value of the connection packet of the forwarding program, including: In the target number of acquisition programs, according to the maximum number of designated acquisition devices corresponding to the acquisition program and the amount of data to be collected by each of the data collection devices, the maximum value of the total amount of data collected by the acquisition program is determined; Based on the maximum value of the connection packet of the forwarding program and the maximum value of the total amount of data collected by each of the collection programs, a number of collection programs corresponding to each of the forwarding program are determined from the target number of collection programs, so that the maximum value of the total amount of data collected by the several collection programs corresponding to each of the forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
2. The method according to claim 1, characterized in that Before the step of determining the target number of the acquisition programs based on the number of the devices to be acquired and the maximum number of designated acquisition devices corresponding to each acquisition program, the step further includes: Performance data of the acquisition program is obtained, and a maximum number of designated acquisition devices corresponding to the acquisition program is determined according to the performance data.
3. The method according to claim 1, characterized in that The step of determining a number of acquisition programs corresponding to each forwarding program from the target number of acquisition programs based on the maximum value of the connection packets of the forwarding program and the maximum value of the total amount of data collected by each acquisition program, so that the maximum value of the total amount of data collected by the number of acquisition programs corresponding to each forwarding program does not exceed the maximum value of the connection packets of the forwarding program, includes: Based on the maximum value of the connection packet of the forwarding program and the maximum value of the total amount of data collected by each of the collection programs, the target number of collection programs are grouped, and the number of collection programs included in each group and the forwarding programs corresponding to each group are determined, so that the maximum value of the total amount of data collected by the number of collection programs in each group corresponding to the forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
4. The method according to claim 1, characterized in that: After the step of determining, for each of the forwarding programs of the maximum number of connections, a number of acquisition programs corresponding to each of the forwarding programs from the target number of acquisition programs based on the maximum value of the connection packets of the forwarding program, so that the maximum value of the total amount of data collected by the number of acquisition programs corresponding to each of the forwarding programs does not exceed the maximum value of the connection packets of the forwarding program, the method further includes: Based on the maximum number of connected forwarding programs, the target number of collection programs, and the corresponding relationship between the forwarding programs and the collection programs, device data is collected for the number of devices to be collected, so that the collected device data is transmitted to the cloud platform through several collection programs and several forwarding programs.
5. The method according to claim 1, characterized in that The operation information of the cloud platform includes any one or more of the following: The performance, data transmission speed, and platform configuration of the cloud platform.
6. The method according to claim 1, characterized in that The operation information of the cloud platform includes the maximum number of platform devices for device data collection; and also includes: If the number of devices to be collected is less than or equal to the maximum number of platform devices, then performing a step of determining a target number of collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program; If the number of devices to be collected is greater than the maximum number of platform devices, the target number of the collection programs is determined based on the maximum number of platform devices and the maximum number of designated collection devices corresponding to each collection program.
7. A device for processing equipment data collection configuration, characterized in that: include: A first determination module is used to obtain the operation information of the cloud platform, and determine the maximum number of connections of the cloud platform accessing the forwarding program and the maximum value of the connection packets corresponding to each forwarding program based on the operation information; A second determination module is used to obtain the number of devices to be collected of the devices to be collected, and determine the target number of the collection programs based on the number of devices to be collected and the maximum number of designated collection devices corresponding to each collection program; wherein the collection program is used to collect data from the devices to be collected; The third determination module is used to determine, for each of the forwarding programs in the maximum number of connections, a number of acquisition programs corresponding to each of the forwarding programs from the target number of acquisition programs based on the maximum value of the connection packet of the forwarding program, so that the maximum value of the total amount of data collected by the number of acquisition programs corresponding to each of the forwarding programs does not exceed the maximum value of the connection packet of the forwarding program, including: In the target number of acquisition programs, according to the maximum number of designated acquisition devices corresponding to the acquisition program and the amount of data to be collected by each of the data collection devices, the maximum value of the total amount of data collected by the acquisition program is determined; Based on the maximum value of the connection packet of the forwarding program and the maximum value of the total amount of data collected by each of the collection programs, a number of collection programs corresponding to each of the forwarding program are determined from the target number of collection programs, so that the maximum value of the total amount of data collected by the several collection programs corresponding to each of the forwarding program does not exceed the maximum value of the connection packet of the forwarding program.
8. An electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to execute the method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Service data acquisition method and device and electronic equipment
CN112261139A
Log data processing method and device based on cloud platform and server equipment
CN112866029A