A network physical resource collection method and apparatus

Abstract

The application discloses a network physical resource collection method, which comprises the following steps: a collection device receives a physical resource data collection request sent by a data consumer; a storage address of physical resource data is obtained from a target data provider; a physical resource data change notification message template defined in advance by the data provider is configured to obtain a physical resource data change notification; a physical resource data collection model is defined in advance, the model is configured, and a physical resource data collection task is created; a resource resolution template is defined in advance, a physical resource data file is obtained after the physical resource collection task is executed, a corresponding resource resolution template is loaded, physical resource data is obtained by resolving the physical resource data file, and a database of the data consumer is updated. The application further discloses a network resource collection device. The application can realize full-amount and automatic collection of physical resource data in an NFV network.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of computer software, in particular to a kind of collection technology of NFV network physical resource. BACKGROUND

[0002] NFV is network function virtualization, through X86 and other general-purpose hardware and virtualization technology, to carry a lot of function software processing, thereby reducing the cost of network expensive equipment. Can be decoupled by software and hardware and function abstraction, network device function is no longer dependent on special hardware, resources can be fully flexible sharing, realize the rapid development and deployment of new business, and based on actual business demand to carry out automatic deployment, elastic scaling, fault isolation and self-healing etc. Among them, NFVO is network function virtualization coordinator, for managing NS (network service) life cycle; VIM is virtual infrastructure manager, for managing virtual devices; PIM is physical infrastructure manager, the tool for centralized management of physical infrastructure equipment (including server, magnetic array, switch, firewall, distributed storage cluster etc., hereinafter referred to as "physical resource" or "device").

[0003] The current NFVO only accesses the virtual resource data provided by VIM, for coordinating the management of VNF (virtualized network function module) life cycle, coordinating the management of various resources of NFVI (network function virtualization infrastructure), to ensure the optimal configuration of various virtual resources and connection required; if the physical resource data of PIM is provided to NVFO, the NFVO can analyze the relationship between physical resources and virtual resources to draw three-layer network topology, and can also share physical resource data with integrated monitoring and other systems. However, due to the non-uniform interface of PIM of each manufacturer, and the provision of physical resource data in different data exchange formats, plus the non-uniform data structure of NFVO database of each user, it is impossible to directly import the physical resource data into the NFVO database. Therefore, an automatic physical resource data collection technology for NFV system is urgently needed. SUMMARY

[0004] The present application discloses a network physical resource collection method, applied to a network physical resource collection system, one of the network physical resource collection system contains a data consumer, a collection device and multiple data providers; the data consumer is directly connected with the collection device, and the data provider is connected with the collection device after registration; the method comprises:

[0005] The collection device receives the physical resource data collection request issued by the data consumer;

[0006] The collection device obtains the storage address of the physical resource data from the target data provider;

[0007] The collection device configures a data provider with a pre-defined physical resource data change notification message template, and obtains a physical resource data change notification;

[0008] The collection device pre-defines a physical resource data collection model, configures the physical resource data collection model, and creates a physical resource data collection task;

[0009] The collection device pre-defines a resource parsing template, obtains a physical resource data file after executing the physical resource collection task, loads the resource parsing template, parses the physical resource data file to obtain physical resource data, and updates the data consumer database.

[0010] Preferably, the method further comprises:

[0011] The collection device listens to the data provider's automatic push physical resource data change notification interface, obtains the physical resource data change notification, and creates a physical resource data collection task.

[0012] Preferably, the method further comprises:

[0013] The collection device pre-defines a task monitoring template, starts a timed query after the physical resource data collection task is created, and configures the task monitoring template with the task log information obtained by the timed query and displays the obtained task monitoring information.

[0014] Specifically:

[0015] The collection device is directly connected to the data consumer, and the identity information of the data consumer is stored in the database. The identity information includes: data consumer ID, data consumer database username, password, and access address;

[0016] The physical resource data collection request includes: data consumer ID, target data provider ID. Each physical resource data collection request is for all physical resource data managed by a target data provider.

[0017] Specifically:

[0018] The data provider is connected to the collection device after successful registration, and the collection device stores the registration information of the data provider in the database. The registration information includes: data provider ID, username, password, access address, and interface specification; the interface specification includes: interface list, parameter interface access method, parameter definition, and message content template;

[0019] The collection device obtains the storage address of the physical resource information from the target data provider by the following method:

[0020] The collection device queries the registration information of the target data provider from a database, carries a username, a password, and an access address obtained from the target data provider registration information, and requests the access address and access authority of the physical resource pool of the target data provider;

[0021] The collection device calls an interface for querying all physical resource data, and obtains the physical resource data storage addresses of various device types in the physical resource pool of the target data provider;

[0022] The collection device calls an interface for querying a type of physical resource data, and obtains the number of physical resources and the physical resource data storage addresses of each device type in the physical resource pool of the target data provider.

[0023] Specifically, the collection device configures a physical resource data change notification message template defined by the data provider in advance, and the method for obtaining the physical resource data change notification comprises:

[0024] The collection device queries the interface specification carried in the registration information of the target data provider from the database, and obtains the physical resource data change notification message template; the physical resource data change notification message template comprises a data storage address of a physical resource that has changed information and a change type;

[0025] The collection device configures the physical resource data change notification message template, and obtains the physical resource data change notification.

[0026] Specifically, the collection device defines a physical resource data collection model in advance, configures the physical resource data collection model, and creates a physical resource data collection task, and the method comprises:

[0027] The predefined physical resource data collection model is specifically defined as collection task information and auxiliary information;

[0028] The collection task information and the message auxiliary information are configured according to the physical resource data change notification, and a physical resource data collection task is created.

[0029] Specifically, the collection device defines a resource parsing template in advance, obtains a physical resource data file after executing the physical resource collection task, loads the resource parsing template, parses the physical resource data file to obtain physical resource data, and updates the data consumer database, and the method comprises:

[0030] The collection device defines a resource parsing template for each type of physical resource in advance according to the data structure of the data consumer database, and the resource parsing template comprises a parameter name, a parameter definition, and a parameter limit.

[0031] After the collection device obtains a physical resource data file, a corresponding resource analysis template is loaded, the content of the physical resource data file is analyzed, a physical resource data record is obtained, and the physical resource data in the data consumer database is updated according to the type of information change.

[0032] The application further discloses a network physical resource collection device, which comprises:

[0033] A registration unit is configured to process a registration request of a data provider and store obtained registration information into a database.

[0034] A definition unit is configured to predefine a physical resource data collection model and a resource analysis template, and store the model and the template into a database.

[0035] A task management unit is configured to receive a physical resource data collection request sent by a data consumer, obtain a storage address of the physical resource data from a target data provider, configure a physical resource data change notification message template predefined by the data provider, obtain a physical resource data change notification, configure a predefined physical resource data collection model, and create a physical resource data collection task.

[0036] A data processing unit is configured to execute the physical resource collection task, obtain a physical resource data file, load the resource analysis template, analyze the physical resource data file to obtain physical resource data, and update the data consumer database.

[0037] Preferably, the device further comprises:

[0038] An automatic update unit is configured to listen to a physical resource update of a corresponding interface of the data provider, obtain the physical data resource change notification, and create a physical resource data collection task.

[0039] Preferably, the device further comprises:

[0040] A task monitoring unit is configured to predefine a task monitoring template, start a timing query after a physical resource data collection task is created, configure the task monitoring template by using task log information obtained by the timing query, and display obtained task monitoring information.

[0041] Specifically, the definition unit can comprise:

[0042] A collection model definition module is configured to predefine a physical resource data collection model.

[0043] A resource template definition module is configured to predefine a resource analysis template.

[0044] Specifically, the task management unit can comprise:

[0045] The collection request processing module is configured to receive a physical resource data collection request sent by a data consumer.

[0046] The address query module is configured to obtain a storage address of the physical resource data from a target data provider.

[0047] The collection task creation module is configured to configure a physical resource data change notification message template predefined by a data provider, and obtain a physical resource data change notification; configure a predefined physical resource data collection model, and create a physical resource data collection task.

[0048] Specifically, the data processing unit can include:

[0049] The data collection module is configured to execute the physical resource data collection task, and obtain a physical resource data file.

[0050] The data analysis module is configured to load the resource analysis template, analyze the physical resource data file, and obtain physical resource data.

[0051] The data update module is configured to update the physical resource data in the data consumer database.

[0052] Specifically, the automatic update unit can include:

[0053] The listening module is configured to listen to a physical resource update of a corresponding interface of the data provider, and obtain the physical data resource change notification.

[0054] The automatic update task creation module is configured to configure a predefined physical resource collection model, and create a physical resource automatic update data collection task.

[0055] Specifically, the task monitoring unit can include:

[0056] The monitoring management module is configured to predefine a task monitoring template, start a timing query, and use task log information obtained by the timing query to configure the task monitoring template to obtain task monitoring information.

[0057] The display module is configured to display the task monitoring information obtained from the monitoring management module.

[0058] Compared with the prior art, the present application has the following advantages:

[0059] 1. The physical resource data can be fully and automatically collected and stored, improving the efficiency and accuracy of physical resource collection.

[0060] 2. It can be applied to different users to collect physical resource data in different vendor resource pools.

[0061] 3. It automatically adapts to two collection modes of autonomous collection and PIM automatic update.

[0062] 4. The real-time monitoring of the collection process, visual presentation of the user experience. Further, can be prompted to error, in order to trigger the implementation of subsequent corrective measures. BRIEF DESCRIPTION OF DRAWINGS

[0063] In order to more clearly illustrate the technical solutions of the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0064] Figure 1 The flowchart of the network physical resource collection method disclosed by the embodiment of the present application;

[0065] Figure 2 The flowchart of another network physical resource collection method disclosed by the embodiment of the present application;

[0066] Figure 3 The flowchart of another network physical resource collection method disclosed by the embodiment of the present application;

[0067] Figure 4 The structural diagram of the network physical resource collection device disclosed by the embodiment of the present application;

[0068] Figure 5 The structural diagram of another network physical resource collection device disclosed by the embodiment of the present application;

[0069] Figure 6 The structural diagram of another network physical resource collection device disclosed by the embodiment of the present application;

[0070] Figure 7 The detailed structural diagram of another network physical resource collection device disclosed by the embodiment of the present application;

[0071] Figure 8 The detailed structural diagram of another network physical resource collection device disclosed by the embodiment of the present application; Figure 5 The structural diagram of an automatic updating unit in the collection device;

[0072] Figure 9 The structural diagram of an automatic updating unit in the collection device; Figure 6 The structural diagram of a task monitoring unit in the collection device. DETAILED DESCRIPTION

[0073] With reference to the drawings of the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments of the present application, all the other embodiments obtained by a person of ordinary skill in the art without creative effort are within the protection scope of the present application.

[0074] Referring to Figure 1 A flowchart of a network physical resource collection method is shown, and the network physical resource collection method comprises the following steps:

[0075] In the NFV network, a plurality of PIMs are generally built under an NFVO. The NFVO is a network function virtualization coordinator, used for managing the NS (network service) life cycle, and is a physical resource data consumer. Different operators have different NFVO data structures and specifications. The PIM is a physical infrastructure manager, which is a tool for centrally managing physical infrastructure equipment (including servers, magnetic arrays, switches, firewalls, distributed storage clusters, etc., hereinafter referred to as “physical resources” or “equipment”). The PIM is a physical resource data provider, and different manufacturers have different PIM interface specifications. Each PIM generally manages different types of a large number of physical resources, and provides physical resource data to the outside in a data exchange format.

[0076] A collection device is created, and a data consumer, one or more data providers form a network physical resource collection system; the data consumer is directly connected to the collection device, and the data provider is connected to the collection device after registration.

[0077] Step S101: The collection device receives a physical resource data collection request sent by the data consumer.

[0078] The collection device is directly connected to the data consumer, and the identity information of the data consumer is stored in the database. The identity information includes: data consumer ID, data consumer database username, password, access address.

[0079] The physical resource data collection request includes: data consumer ID, target data provider ID. Each of the physical resource data collection requests is for all physical resource data of a target data provider.

[0080] Preferably, the physical resource data collection request can also contain other auxiliary contents, such as: time of demand, name of demand, description, etc. Further, the repetition period and number of times can be set, so that the physical resource data collection request can be sent automatically and regularly.

[0081] Step S102: The collection device acquires the storage address of the physical resource data from the target data provider.

[0082] After the data provider is successfully registered, the data provider is connected with the collection device, and the collection device stores the registration information of the data provider in a database. The registration information includes: data provider ID, user name, password, access address, and interface specification. The data provider ID is the unique identifier of the data provider. The user name, password, and access address are used to request a token, and the token is used to transmit data to ensure data security. The interface specification includes: interface list, parameter interface access method, parameter definition, and message content template. For example, the interface list includes API classification, interface name, description, and the like. The parameter definition includes variable name, type, length, and description.

[0083] It should be noted that all physical resource data managed by a data provider is stored in a physical resource pool, and the storage addresses of the physical resources are stored in a tree structure. The rule is: IP address or host name: port number / resource pool / physical resource device type / single physical resource. For example, 192.168.112.80:9141 / pimCm / Firewalls / 1 represents the data storage address of the firewall with ID 1.

[0084] Therefore, the specific steps for the collection device to acquire the storage address of the physical resource data from the target data provider are as follows:

[0085] Step one, the collection device queries the registration information of the target data provider from the database, carries the user name, password, and access address obtained from the registration information of the target data provider, and requests the access address and access permission of the physical resource pool of the target data provider.

[0086] Step two, the collection device calls an interface for querying all physical resource data managed by the PIM to acquire the storage addresses of the physical resource data of various device types in the physical resource pool of the target data provider; the obtained data is shown in the following data structure:

[0087]

[0088] Step three, the collection device calls an interface for querying a type of physical resource data to acquire the number of physical resources under each device type in the physical resource pool of the target data provider and the storage address of each physical resource data. For example, querying the physical resource data of the firewall type, the obtained data is shown in the following data structure:

[0089]

[0090] It can be known that the PIM co-manages two firewalls and the storage address of data of each firewall. The above operation is performed on each type of physical resource, and the number of each type of physical resource managed by the target PIM and the storage address of all physical resource data can be obtained.

[0091] Step S103: The collection device configures a physical resource data change notification message template defined by the device configuration data provider in advance to obtain the physical resource data change notification.

[0092] The physical resource data change notification message template is defined by the data provider and provided to the collection device with the registration information. The physical resource data change notification message template can include the data storage address and change type of the physical resource that has changed information; the change type is divided into three types of addition, update and deletion.

[0093] For example, a physical resource data change notification message template is as follows:

[0094]

[0095] The template includes:

[0096] Version: interface version number;

[0097] PimId: PIM ID (data provider ID)

[0098] MsgType: message type. When the value is pimCmResChanges, it indicates a PIM physical resource change notification message.

[0099] UpdtRes: updated device list; AddRes added device list; DelRes deleted device list.

[0100] URL: storage address of device information.

[0101] The collection device configures the physical resource data change notification message template using the data storage address of each physical resource obtained in step S102 to obtain the physical resource data change notification. The change type is uniformly set to "update".

[0102] Step S104: The collection device defines a physical resource data collection model in advance, and the specific steps of configuring the physical resource data collection model to create a physical resource data collection task are as follows:

[0103] The collection device defines a physical resource data collection model in advance, and attributes in the model include collection task information and auxiliary information. Some auxiliary information in the model can be added or reduced according to actual conditions, so as to adapt to more requirements. Specifically, the collection task information can include collection task ID, collection data source and collection task source. The collection data source includes physical resource ID as a collection target, change type and data storage address. The collection task source includes active collection and automatic update. The auxiliary information can include the total number of physical resources to be collected, target data provider ID, data consumer ID and task log.

[0104] The above information is configured with specific values according to the physical resource data change notification, and a physical resource data collection task is created. The task source is selected as “active collection”.

[0105] Step S105: The collection device defines a resource parsing template in advance, obtains a physical resource data file after executing the physical resource collection task, loads the resource parsing template, parses the physical resource data file to obtain physical resource data, and updates the specific steps of the data consumer database as follows:

[0106] Step one, the collection device defines a resource parsing template for each type of physical resource in advance according to the data structure of the data consumer database, which is used to map the parameters of the data provider to the parameters of the data consumer. The resource parsing template can include parameter name, parameter definition, parameter limitation condition and mapping method.

[0107] Step two, after the physical resource collection task is started, the collection device starts a subtask for each target to be collected. First, analyze the type of physical resource change of the subtask. If it is “update” or “add”, execute step three, and if it is “delete”, execute step four.

[0108] Step three, the collection device accesses the data storage address of the physical resource to be collected to obtain a data detail file provided in a data exchange format; according to the device type, a corresponding resource parsing template is loaded; the content of the above data detail file is parsed to obtain a physical resource data record;

[0109] Step four, the collection device updates the physical resource data in the data consumer database according to the type of data change; and completes the collection subtask. Specifically, if the data change type is “update”, the record is compared with the data already stored in the database through the physical resource ID, and the updated parameter value is written into the database; if the data change type is “add”, the obtained physical resource data record is written into the database; if the data change type is “delete”, the physical resource ID is found in the database, and the corresponding data is deleted.

[0110] Repeat steps two to four to complete all collection sub-tasks.

[0111] From the above embodiments, the physical resource collection method provided by the application can realize automatic collection and warehousing of all physical resource data in a resource pool, replacing manual operation in the prior art, solving the problem of not being able to collect physical resource data in full and in a timely manner in the prior art, improving the efficiency and accuracy of physical resource collection. The method can be applied to collection of physical resource data in resource pools of different manufacturers by different users, and has strong compatibility. The collection method can also define a resource analysis template in advance, and can be used for data detail files of different data structures provided by different manufacturers, and has high flexibility and rapid response capability, and can further improve data collection efficiency in large data processing.

[0112] As another optional embodiment of the application, referring to Figure 2 Another network physical resource collection method flow diagram is shown. The embodiment mainly describes an extension scheme of the network physical resource collection method described in Embodiment 1. The method can also include:

[0113] Step S106: The collection device listens to the data provider automatic push physical resource data change notification interface, obtains the physical resource data change notification, and creates a specific step of the physical resource data collection task:

[0114] When the PIM adds, removes, or adjusts the physical resource hardware configuration, the data provider will automatically push the physical resource data change notification. The collection device can listen to the corresponding interface and obtain the physical resource data change notification.

[0115] According to the physical resource data change notification, a specific value is configured to the physical resource data collection model, and a physical resource data collection task is created. The task source is selected as "automatic update".

[0116] Then, step 105 is executed to complete the physical resource data collection and warehousing.

[0117] From the embodiment, the dynamic nature and timeliness of the physical resource data update are further ensured through the listening mode. The method can automatically adapt to two working modes of autonomous collection and PIM automatic update collection, expand the use range of the method, increase the integration of the method, and improve the user experience.

[0118] As still another optional embodiment of the application, referring to Figure 3 Another network physical resource collection method flow diagram is shown. The embodiment mainly describes an extension scheme of the network physical resource collection method described in Embodiment 1. The method can also include:

[0119] Step 107: the collection device predefines a task monitoring template, starts a timing query after the physical resource data collection task is created, and uses the task log information obtained by the timing query to configure the task monitoring template and show the specific task monitoring information.

[0120] Step one, the collection device predefines a task monitoring template, and the attributes of the template can include: collection task ID, task name, task start time, task end time, task status, execution, execution progress, total number of collection tasks, collected number, and task description. Among them: the execution refers to the execution of the collection subtask, which can be divided into three categories: to be collected, collection success, and collection failure; the collected number is equal to the number of collection success and collection failure; the execution progress is the collected number divided by the total number of collection tasks.

[0121] Step two, the collection device starts a timing query for each collection task. The collection device collects task-related information, such as: after the collection task is created, the collection device obtains the collection task ID, the total number of physical resources to be collected, and the ID of all physical resources to be collected; after each collection subtask is completed, the collection device obtains the subtask log.

[0122] Step three, use the collected task-related information to configure specific values for the task monitoring template.

[0123] Step four, show the task monitoring information.

[0124] Because a PIM can manage a large number of physical resources, the collection task can take a long time, and monitoring and visualizing the collection task can improve the user experience; further, the user can take timely measures after receiving an error prompt, which is conducive to improving the quality of work.

[0125] Embodiment four of the present application discloses a network physical resource collection device, the structure diagram is as shown in Figure 4 The device comprises:

[0126] The registration unit 1 is used for processing the registration request of the data provider, and stores the obtained registration information in the database.

[0127] The definition unit 2 is used for predefining a physical resource data collection model and a resource analysis template, and storing the model and the template in the database.

[0128] Task management unit 3, for receiving physical resource data collection request issued by data consumer; obtaining storage address of the physical resource data from target data provider; configuring pre-defined physical resource data change notification message template obtained from database, obtaining physical resource data change notification; configuring pre-defined physical resource data collection model obtained from database, creating physical resource data collection task.

[0129] Data processing unit 4, obtaining physical resource data file after executing the physical resource collection task, loading corresponding resource parsing template obtained from database, parsing the physical resource data file to obtain physical resource data, and updating the data consumer database.

[0130] Embodiment five of the present application discloses another network physical resource collection device, and a structural diagram is shown in Figure 5 The device is an extension of the device disclosed in embodiment four, and can further include:

[0131] Automatic updating unit 5, for listening to physical resource update of corresponding interface of data provider, obtaining the physical data resource change notification, and creating physical resource data collection task.

[0132] Embodiment six of the present application discloses another network physical resource collection device, and a structural diagram is shown in Figure 6 The device is another extension structure of the device disclosed in embodiment four, and can further include:

[0133] Task monitoring unit 6, for pre-defining task monitoring template, starting timing query after creating physical resource data collection task, configuring the task monitoring template using task log information obtained by timing query, and displaying obtained task monitoring information.

[0134] In order to describe the structural features of the device disclosed in embodiment four in detail, embodiment seven of the present application is given, as shown in Figure 7 The device includes:

[0135] Registration unit 1, for processing registration request of data provider, and storing obtained registration information to database.

[0136] Definition unit 2, which can further include:

[0137] Collection model definition module 21, for pre-defining physical resource data collection model, and storing the model to database.

[0138] Resource template definition module 22, for pre-defining resource parsing template, and storing the template to database.

[0139] Task management unit 3, which can further include:

[0140] The collection request processing module 31 is configured to receive a physical resource data collection request sent by a data consumer.

[0141] The address query module 32 is configured to, after learning the target data provider from the collection request processing module 31, carry the username, password, access address and interface information in the registration information obtained from the database to obtain the storage address of the target physical resource data to be collected.

[0142] The collection task creation module 33 is configured to use the physical resource data storage address obtained from the address query module 32, configure the physical resource data change notification message template of the target data provider pre-defined and obtained from the database, and obtain the physical resource data change notification. The collection task creation module 33 is further configured to configure the pre-defined physical resource data collection model obtained from the database, and create a physical resource data collection task.

[0143] The data processing unit 4 can further include:

[0144] The data collection module 41 is configured to receive the task created by the collection task creation module 33 and execute the task.

[0145] The data parsing module 42 is configured to receive the physical resource data file obtained after the data collection module 41 executes the physical resource collection task, obtain the resource parsing template from the database, and parse the physical resource data file to obtain the physical resource data.

[0146] The data updating module 43 is configured to use the physical resource data provided by the data parsing module 42 to update the physical resource data in the database of the data consumer.

[0147] Embodiment eight of the present application discloses Figure 5 The structure of an automatic updating unit in a collection device is shown in Figure 8 and includes:

[0148] The automatic updating unit 5 is configured to listen to the occurrence of physical resource updating on the corresponding interface of the data provider, obtain the physical data resource change notification, and create a physical resource data collection task. The automatic updating unit 5 can further include:

[0149] The listening module 51 is configured to listen to the occurrence of physical resource updating on the corresponding interface of the data provider, and obtain the physical data resource change notification.

[0150] The automatic updating task creation module 52 is configured to configure the pre-defined physical resource collection model obtained from the database, and create a physical resource automatic updating data collection task.

[0151] Embodiment nine of the present application discloses Figure 6 The structure of a task monitoring unit in a collection device is shown in Figure 9 and includes:

[0152] The task monitoring unit 6 is configured to define a task monitoring template, start a timing query after a physical resource data collection task is created, configure the task monitoring template using task log information obtained by the timing query, and display task monitoring information obtained.

[0153] The monitoring management module 61 is configured to define a task monitoring template, start a timing query, and configure the task monitoring template using task log information obtained by the timing query from the data processing unit 4 to obtain task monitoring information.

[0154] The display module 62 is configured to display the task monitoring information obtained from the monitoring management module 61.

[0155] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific corresponding working processes of the above-described system, units and units can be referred to the foregoing method steps, which will not be repeated here.

[0156] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to the embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A cyber physical resource harvesting method, characterized by, The application is applied to a network physical resource collection system, which comprises a data consumer, a collection device and a plurality of data providers; the data consumer is directly connected to the collection device, and the data providers are connected to the collection device after registration; The method comprises: The collection device receives a physical resource data collection request sent by the data consumer; The collection device obtains a storage address of the physical resource data from a target data provider; The collection device configures a physical resource data change notification message template defined in advance by the data provider, and obtains a physical resource data change notification; The collection device defines a physical resource data collection model in advance, configures the physical resource data collection model, and creates a physical resource data collection task; The collection device defines a resource parsing template in advance, obtains a physical resource data file after executing the physical resource collection task, loads the resource parsing template, parses the physical resource data file to obtain physical resource data, and updates a database of the data consumer; The collection device is directly connected to the data consumer, and stores identity information of the data consumer in the database, wherein the identity information comprises a data consumer ID, a username, a password and an access address of a database of the data consumer; The physical resource data collection request comprises a data consumer ID and a target data provider ID; each physical resource data collection request is for all physical resource data managed by a target data provider; and The data provider is connected to the collection device after successful registration, and the collection device stores registration information of the data provider in the database, wherein the registration information comprises a data provider ID, a username, a password, an access address and an interface specification; the interface specification comprises an interface list, a parameter interface access method, parameter definition and message content template; The collection device obtains the storage address of the physical resource information from the target data provider by the following method: The collection device queries the registration information of the target data provider from the database, carries the username, password and access address obtained from the registration information of the target data provider, and requests the access address and access authority of the physical resource pool of the target data provider; The collection device calls an interface for querying all physical resource data, and obtains the storage address of the physical resource data of various device types in the physical resource pool of the target data provider; The collection device calls an interface for querying a type of physical resource data, and obtains the number of physical resources and the storage address of each physical resource data under each device type in the physical resource pool of the target data provider.

2. The method of claim 1, wherein, The method further comprises: The collection device listens to a physical resource data change notification interface automatically pushed by the data provider, obtains the physical resource data change notification, and creates a physical resource data collection task.

3. The method of claim 1, wherein, The method further comprises: The collection device predefines a task monitoring template, starts a timing query after a physical resource data collection task is created, configures the task monitoring template with task log information obtained by the timing query, and displays obtained task monitoring information.

4. The method of claim 1, wherein, The collection device configures a physical resource data change notification message template predefined by a data provider, and the method for obtaining the physical resource data change notification comprises the following steps: The collection device queries an interface specification carried in registration information of the target data provider from a database, and obtains the physical resource data change notification message template; the physical resource data change notification message template comprises a data storage address and a change type of a physical resource with changed information; The collection device configures the physical resource data change notification message template, and obtains the physical resource data change notification.

5. The method of claim 4, wherein, The collection device predefines a physical resource data collection model, configures the physical resource data collection model, and creates a physical resource data collection task, and the method comprises the following steps: The predefined physical resource data collection model is specifically defined collection task information and auxiliary information; The collection device configures the collection task information and the message auxiliary information according to the physical resource data change notification, and creates a physical resource data collection task.

6. The method of claim 5, wherein, The collection device predefines a resource analysis template, obtains physical resource data files after executing the physical resource collection task, loads the resource analysis template, analyzes the physical resource data files to obtain physical resource data, and updates a database of the data consumer, and the method comprises the following steps: The collection device predefines a resource analysis template for each type of physical resource according to a data structure of the database of the data consumer, and the resource analysis template comprises a parameter name, a parameter definition, and a parameter limit; After the collection device obtains a physical resource data file, the collection device loads a corresponding resource analysis template, analyzes the content of the physical resource data file to obtain a physical resource data record, and updates physical resource data in the database of the data consumer according to a change type of the information.

7. A cyber physical resource harvesting apparatus, comprising: The collection device comprises: A registration unit configured to process a registration request of a data provider, and store obtained registration information in a database, wherein the registration information comprises a data provider ID, a username, a password, an access address, and an interface specification; the interface specification comprises an interface list, a parameter interface access method, parameter definition, and a message content template; A definition unit configured to predefine a physical resource data collection model and a resource analysis template, and store the model and the template in the database; A task management unit configured to receive a physical resource data collection request sent by a data consumer, obtain a storage address of the physical resource data from a target data provider, configure a physical resource data change notification message template predefined by a data provider to obtain a physical resource data change notification, configure a predefined physical resource data collection model to create a physical resource data collection task; A data processing unit configured to execute the physical resource collection task to obtain physical resource data files, load the resource analysis template, analyze the physical resource data files to obtain physical resource data, and update a database of the data consumer, The collection device is directly connected with the data consumer and stores identity information of the data consumer in a database, and the identity information includes a data consumer ID, a username of a data consumer database, a password, and an access address. The physical resource data collection request includes a data consumer ID and a target data provider ID, and each physical resource data collection request is for all physical resource data managed by a target data provider. The task management unit obtains a storage address of the physical resource information from the target data provider. The collection device queries registration information of the target data provider from the database, carries a username, a password, and an access address obtained from the registration information of the target data provider, and requests an access address and access authority of a physical resource pool of the target data provider. The collection device calls an interface for querying all physical resource data, and obtains storage addresses of physical resource data of various device types in the physical resource pool of the target data provider. The collection device calls an interface for querying a type of physical resource data, and obtains a number of physical resources and storage addresses of physical resource data of each device type in the physical resource pool of the target data provider.

8. The apparatus of claim 7, wherein, The device further includes: An automatic update unit configured to listen to a physical resource update of a corresponding interface of the data provider, obtain a physical resource data change notification, and create a physical resource data collection task.

9. The apparatus of claim 7, wherein, The device further includes: A task monitoring unit configured to define a task monitoring template in advance, start a timing query after the physical resource data collection task is created, configure the task monitoring template using task log information obtained by the timing query, and display obtained task monitoring information.

10. The device of any of claims 7-9, wherein, The definition unit includes: A collection model definition module configured to define a physical resource data collection model in advance; A resource template definition module configured to define a resource parsing template in advance.

11. The apparatus of claim 10, wherein, The task management unit includes: A collection request processing module configured to receive a physical resource data collection request sent by the data consumer; An address query module configured to obtain a storage address of the physical resource data from the target data provider; A collection task creation module configured to configure a physical resource data change notification message template defined in advance by the data provider, obtain a physical resource data change notification, configure the physical resource data collection model defined in advance, and create a physical resource data collection task.

12. The apparatus of claim 11, wherein, The data processing unit includes: A data collection module configured to execute the physical resource data collection task and obtain a physical resource data file; A data parsing module configured to load the resource parsing template, parse the physical resource data file, and obtain physical resource data; A data update module configured to update physical resource data in the data consumer database.

13. The apparatus of claim 8, wherein, The automatic update unit includes: A listening module configured to listen to a physical resource update of a corresponding interface of the data provider, and obtain a physical resource data change notification; An automatic update task creation module configured to configure a physical resource collection model defined in advance, and create a physical resource automatic update data collection task.

14. The apparatus of claim 9, wherein, The task monitoring unit includes: The monitoring management module is configured to predefine a task monitoring template, start a timing query, and configure the task monitoring template with task log information obtained by the timing query to obtain task monitoring information. The display module is configured to display the task monitoring information obtained from the monitoring management module.

Images