Memory topology index system for power grid data

Abstract

The invention discloses a memory topology index system for power grid data, which relates to the technical field of power grids and comprises a central processing unit module, a login module, a storage module, a storage module, a query response module, a coding module, an index management module and a generation module. The central processor module is bidirectionally connected with the login module, the warehousing module, the storage module, the query response module, the index management module and the generation module; the storage module and the coding module are in bidirectional connection, and the output end of the generation module is connected with the input end of the coding module. According to the method, the metadata extraction process for the to-be-stored power grid data is introduced, multiple types of metadata are extracted on the basis of the process for abstract description of related information of the to-be-stored power grid data, and good compatibility of various data assets is achieved.

Description

Technical Field

[0001] The present invention relates to the technical field of power grids, and in particular to a memory topology indexing system for power grid data. Background Art

[0002] With the continuous development of society, the electricity demand of corporate and individual users is gradually increasing, and the types of electricity consumption are becoming more and more diverse. The corresponding power grid scale is constantly expanding. Since the start of the operation monitoring and analysis information system construction, comprehensive monitoring, operation analysis, coordinated control and panoramic display of power grid business based on power data have been carried out. With the digital transformation of State Grid Corporation of China, higher requirements have been put forward for data-based operation monitoring and analysis work. It is necessary to improve the enterprise-level perspective and overall coordination, further optimize the cross-professional and cross-level monitoring and analysis capabilities, strengthen data integration, sharing and application, carry out in-depth mining of data value, reflect the company's business management, safe operation and customer service operations, and provide guidance and early warning. This requires relevant monitoring and analysis personnel and information systems to have a clear understanding of the entire business process and business logic, which poses a great challenge to existing personnel and systems.

[0003] Due to the uneven storage distribution of various data in the existing power grid and the uneven data quality, multiple information islands have been formed, data flow is blocked, and effective unified management cannot be achieved. There are data security risks and it is difficult to classify and manage data. Data resources cannot be effectively and fully utilized, and different needs cannot be met. The service level cannot be improved, so improvements need to be made. Summary of the invention

[0004] In view of the problems existing in the existing memory topology index for power grid data, the present invention is proposed.

[0005] Therefore, the problem to be solved by the present invention is that the storage distribution of various data in the existing power grid is not uniform, the data quality is uneven, a plurality of information islands are formed, and the data flow is blocked.

[0006] In order to solve the above technical problems, the present invention provides the following technical solutions:

[0007] In a first aspect, an embodiment of the present invention provides a memory topology indexing system for power grid data, which includes:

[0008] CPU module, login module, warehousing module, storage module, query response module, encoding module, index management module and generation module;

[0009] The central processing unit module is bidirectionally connected with the login module, the warehousing module, the storage module, the query response module, the index management module, and the generation module;

[0010] The storage module and the encoding module are bidirectionally connected, and the output end of the generation module is connected to the input end of the encoding module.

[0011] As a preferred solution of the memory topology indexing system for power grid data of the present invention, wherein: the index management module includes an acquisition unit, a classification unit and an association unit;

[0012] The encoding module includes a decomposition unit and an allocation unit;

[0013] The generation module is connected to a data acquisition module, and the data acquisition module includes an interaction module, a description module and an assembly module.

[0014] As a preferred solution of the memory topology indexing system for power grid data of the present invention, wherein: the data acquisition module is used to collect the power grid data metadata to be stored in the database, and the generation module sequentially adds the power grid data metadata currently received from the data acquisition module to the data queue;

[0015] The encoding module encodes the data queue to obtain the power grid data directory code.

[0016] As a preferred solution of the memory topology indexing system for power grid data described in the present invention, the warehousing module stores the power grid into the storage module according to the power grid data directory code generated by the encoding module.

[0017] As a preferred solution of the memory topology indexing system for power grid data of the present invention, wherein: the interactive module is used to obtain the power grid data to be stored in the database from multiple external data sources;

[0018] The description module extracts description information from the data to be stored according to a pre-configured description dimension;

[0019] The assembly module is connected to the description module, and the assembly module generates power grid data metadata according to the description information.

[0020] As a preferred solution of the memory topology indexing system for power grid data of the present invention, wherein: the description module includes a first description unit, a second description unit and a third description unit;

[0021] The first description module extracts business definition, data caliber definition, classification information, and data owner from the power grid data to be stored as the description information of the business dimension;

[0022] The second description module extracts structure definition, type, storage medium, and name of the power grid data to be stored as the description information of the technical dimension;

[0023] The third description module extracts access mode, access record, and data processing operation of the power grid data to be stored as the description information of the operation dimension;

[0024] The decomposition unit extracts power grid data information segments from the data queue, each of the power grid data information segments corresponding to metadata of a power grid data to be stored;

[0025] The distribution unit is connected to the decomposition unit and a plurality of directory encoders, and the distribution unit distributes the power grid data information segments to the directory encoders one by one;

[0026] The directory encoder generates a plurality of groups of encoding segments according to the power grid data information segments, and then generates the power grid data directory code based on the encoding segments.

[0027] As a preferred solution of the memory topology indexing system for power grid data of the present invention, wherein: the allocation unit further includes a rule unit, a plug-in unit and a calling unit;

[0028] The rule unit configures generation rules and data sources for multiple coding segments respectively;

[0029] The plug-in unit is connected to the rule unit, and the plug-in unit generates a coding plug-in according to the generated rule and the data source;

[0030] The calling unit is connected to the plug-in unit, and the calling unit calls the coding plug-in respectively according to the input power grid data information segments, and then uses the coding plug-in to generate the coding segments.

[0031] As a preferred solution of the memory topology indexing system for power grid data of the present invention, wherein: the acquisition unit retrieves the power grid data to be managed and a preset data tag group from the storage module, the data tag group includes a plurality of data tags, and numerically processes the data features to obtain the data feature index value T;

[0032] The classification of the classification units is calculated and classified by a preset probability formula. When the merging probability is within the set range, they are merged into the same category. The preset probability formula is:

[0033]

[0034] Among them, T Am and T Bm is the index value of data points A and B on the mth feature, |T Am -T Bm ∣ is the absolute value of the difference between data points A and B on the mth feature; σ mis the normalization factor of the mth feature, used to adjust the impact of eigenvalue differences, and e is the base of the natural logarithm;

[0035] The association unit associates the power grid data with each data tag and establishes an index management system according to the data tag system;

[0036] The query response module is used to query the index structure according to the user's query request to obtain the storage location information of the network traffic data, and return the storage location information to the user, and the user obtains the response data according to the storage location information.

[0037] In a second aspect, an embodiment of the present invention provides a computer device, including a memory and a processor, wherein the memory stores a computer program, wherein: when the processor executes the computer program, it implements any step of the above-mentioned memory topology indexing system for power grid data.

[0038] In a third aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein: when the computer program is executed by a processor, any step of the above-mentioned memory topology indexing system for power grid data is implemented.

[0039] The beneficial effects of the present invention are as follows: a metadata extraction process for power grid data to be stored is introduced, and multiple types of metadata are extracted based on the process to abstractly describe the relevant information of the power grid data to be stored, thereby achieving better compatibility with various data assets; then, in order to meet the processing needs of a large amount of power grid data to be stored, a generation module is also configured, which generates a data queue according to the metadata, and then inputs it into the encoding module for unified encoding, thereby achieving a better continuous encoding process and easier storage and management; and because an index management module is provided, the acquisition unit uniformly retrieves the power grid data to be managed from the storage module, classifies and analyzes the power grid data to obtain the power topology structure and data label system of the power grid data, and the association unit associates the power grid data with the data label system to establish an index management system for data statistical management. The system greatly improves the efficiency of statistics and management of power grid data. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0041] Figure 1 The structural diagram of the memory topology indexing system for power grid data. DETAILED DESCRIPTION

[0042] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without creative work should fall within the scope of protection of the present invention.

[0043] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0044] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.

[0045] The present invention is described in detail with reference to schematic diagrams. When describing the embodiments of the present invention, for the sake of convenience, the cross-sectional diagrams showing the device structure will not be partially enlarged according to the general scale, and the schematic diagrams are only examples, which should not limit the scope of protection of the present invention. In addition, in actual production, the three-dimensional dimensions of length, width and depth should be included.

[0046] At the same time, in the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "upper, lower, inner and outer" are based on the directions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as limiting the present invention. In addition, the terms "first, second or third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0047] In the present invention, unless otherwise clearly specified and limited, the terms "install, connect, connect" should be understood in a broad sense, for example: it can be a fixed connection, a detachable connection or an integral connection; it can also be a mechanical connection, an electrical connection or a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0048] Example 1

[0049] Reference Figure 1 , which is the first embodiment of the present invention, provides a memory topology indexing system for power grid data, including:

[0050] CPU module, login module, warehousing module, storage module, query response module, encoding module, index management module and generation module;

[0051] The central processing unit module is bidirectionally connected with the login module, the warehousing module, the storage module, the query response module, the index management module, and the generation module;

[0052] The storage module and the encoding module are bidirectionally connected, and the output end of the generation module is connected to the input end of the encoding module.

[0053] The generation module is connected to the data acquisition module, which is used to collect metadata of power grid data to be stored. The generation module adds the metadata of power grid data currently received from the data acquisition module to the data queue in turn. The data acquisition module includes an interaction module, a description module and an assembly module. The interaction module is used to obtain power grid data to be stored in multiple external data sources; the description module extracts description information from the data to be stored according to the pre-configured description dimension; the assembly module is connected to the description module, and the assembly module generates power grid data metadata according to the description information.

[0054] The description module includes a first description unit, a second description unit and a third description unit; the first description module extracts business definition, data caliber definition, hierarchical classification information, and data owner from the stored power grid data as descriptive information of the business dimension; the second description module extracts structure definition, type, storage medium, and name from the stored power grid data as descriptive information of the technical dimension; the third description module extracts access method, access record, and data processing operation from the stored power grid data as descriptive information of the operation dimension.

[0055] The encoding module encodes the data queue to obtain the power grid data directory code, and the encoding module includes a decomposition unit and an allocation unit. The decomposition unit extracts power grid data information segments from the data queue, and each power grid data information segment corresponds to a metadata of the power grid data to be stored; the allocation unit connects the decomposition unit and multiple directory encoders, and the allocation unit allocates the power grid data information segments to the directory encoders one by one; the directory encoder generates multiple groups of coding segments according to the power grid data information segments, and then generates the power grid data directory code based on the coding segments.

[0056] Assume that a power company needs to monitor electricity usage across the country in real time in order to optimize power distribution, prevent failures, etc. The company decides to use the above-mentioned power grid data memory topology indexing system to efficiently manage and quickly retrieve large amounts of power grid data.

[0057] The system workflow is:

[0058] 1. Data collection:

[0059] Interaction module: Communicate with power monitoring equipment (such as smart meters) in various places to obtain real-time power usage data, equipment status and other information.

[0060] Description module: First description unit: Analyze the received data and extract business-related information, such as whether the data represents residential or industrial electricity use, as well as the owner of the data. Second description unit: Extract technical details, such as data format, storage type, etc. Third description unit: Determine the operational attributes of the data, such as access rights, processing frequency, etc.

[0061] Assembly module: Based on the above description information, the original data is organized into a standard power grid data metadata format and submitted to the generation module.

[0062] 2. Generate module:

[0063] The assembled power grid data metadata is added to the data queue for subsequent processing.

[0064] 3. Encoding module:

[0065] Decomposition unit: reads the power grid data information from the data queue and divides it into several information segments.

[0066] Distribution Unit: Sends this information in segments to different directory encoders.

[0067] Directory encoder: Generates corresponding coding segments based on the received information segments, and finally synthesizes the power grid data directory code to facilitate subsequent rapid search and management.

[0068] 4. Index management module: Create an index based on the generated power grid data directory code to ensure that specific power grid data can be quickly located.

[0069] 5. Query response module: When the system receives a query request from a user or application, it quickly finds the relevant power grid data through the index and returns the query results.

[0070] 6. Storage module: Store the processed power grid data and its directory codes in the database for long-term preservation and future use.

[0071] 7. Login module: Provides secure user authentication services to ensure that only authorized users can access the power grid data in the system.

[0072] 8. Central Processing Unit Module: Coordinates data exchange and processing tasks between the above modules to ensure efficient operation of the entire system.

[0073] The allocation unit also includes a rule unit, a plug-in unit and a calling unit; the rule unit configures generation rules and data sources for multiple coding segments respectively; the plug-in unit is connected to the rule unit, and the plug-in unit generates a coding plug-in according to the generated rules and data sources; the calling unit is connected to the plug-in unit, and the calling unit calls the coding plug-in according to the input power grid data information segment, and then uses the coding plug-in to generate coding segments.

[0074] The warehousing module stores the power grid into the storage module according to the power grid data directory code generated by the encoding module.

[0075] The index management module includes an acquisition unit, a classification unit and an association unit. The acquisition unit retrieves the power grid data to be managed and a preset data tag group from the storage module. The data tag group includes multiple data tags, and processes the data features numerically to obtain the data feature index value T.

[0076] The classification of the classification units is calculated and classified by a preset probability formula. When the merging probability is within the set range, they are merged into the same category. The preset probability formula is:

[0077]

[0078] Among them, T Am and T Bm is the index value of data points A and B on the mth feature, |T Am -T Bm ∣ is the absolute value of the difference between data points A and B on the mth feature; σ m is the normalization factor of the mth feature, used to adjust the impact of eigenvalue differences, and e is the base of the natural logarithm;

[0079] The association unit associates the power grid data with each data tag and establishes an index management system based on the data tag system; the index management module set up by this system, in which the acquisition unit uniformly retrieves the power grid data to be managed from the storage module, classifies and analyzes the power grid data to obtain the power topology structure and data tag system of the power grid data, and the association unit associates the power grid data with the data tag system to establish an index management system for data statistical management. This system greatly improves the efficiency of statistics and management of power grid data.

[0080] The query response module is used to query the index structure according to the user's query request to obtain the storage location information of the network traffic data, and return the storage location information to the user, and the user obtains the response data according to the storage location information.

[0081] In summary, a metadata extraction process for power grid data to be stored is introduced. Based on this process, multiple types of metadata are extracted to abstractly describe the relevant information of the power grid data to be stored, thereby achieving better compatibility with various data assets; then, in order to meet the processing needs of a large number of power grid data to be stored, a generation module is also configured, which generates a data queue according to the metadata, and then inputs it into the encoding module for unified encoding, thereby achieving a better continuous encoding process and easier storage and management; and because an index management module is provided, the acquisition unit uniformly retrieves the power grid data to be managed from the storage module, classifies and analyzes the power grid data to obtain the power topology structure and data label system of the power grid data, and the association unit associates the power grid data with the data label system to establish an index management system for data statistical management. This system greatly improves the efficiency of statistics and management of power grid data.

[0082] Example 2

[0083] This embodiment also provides a computer device, which is suitable for a memory topology indexing system for power grid data, including a memory and a processor; the memory is used to store computer executable instructions, and the processor is used to execute computer executable instructions to implement the memory topology indexing system for power grid data proposed in the above embodiment.

[0084] The computer device may be a terminal, and the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, NFC (near field communication) or other technologies. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covering the display screen, or a key, trackball or touchpad provided on the housing of the computer device, or an external keyboard, touchpad or mouse, etc.

[0085] This embodiment also provides a storage medium on which a computer program is stored. When the program is executed by a processor, a memory topology indexing system for power grid data as proposed in the above embodiment is implemented.

[0086] The storage medium proposed in this embodiment and the data storage system proposed in the above embodiment belong to the same inventive concept. The technical details not fully described in this embodiment can be found in the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0087] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A memory topology indexing system for power grid data, characterized by: include, CPU module, login module, warehousing module, storage module, query response module, encoding module, index management module and generation module; The central processing unit module is bidirectionally connected with the login module, the warehousing module, the storage module, the query response module, the index management module, and the generation module; The storage module and the encoding module are bidirectionally connected, and the output end of the generation module is connected to the input end of the encoding module.

2. The memory topology indexing system for power grid data according to claim 1, characterized in that: The index management module includes an acquisition unit, a classification unit and an association unit; The encoding module includes a decomposition unit and an allocation unit; The generation module is connected to a data acquisition module, and the data acquisition module includes an interaction module, a description module and an assembly module.

3. The memory topology indexing system for power grid data according to claim 2, characterized in that: The data acquisition module is used to collect the power grid data metadata to be stored, and the generation module sequentially adds the power grid data metadata currently received from the data acquisition module to the data queue; The encoding module encodes the data queue to obtain the power grid data directory code.

4. The memory topology indexing system for power grid data according to claim 3, characterized in that: The warehousing module stores the power grid into the storage module according to the power grid data directory code generated by the encoding module.

5. The memory topology indexing system for power grid data according to claim 4, characterized in that: The interactive module is used to obtain power grid data to be stored in a plurality of external data sources; The description module extracts description information from the data to be stored according to a pre-configured description dimension; The assembly module is connected to the description module, and the assembly module generates power grid data metadata according to the description information.

6. The memory topology indexing system for power grid data according to claim 5, characterized in that: The description module includes a first description unit, a second description unit and a third description unit; The first description module extracts business definition, data caliber definition, classification information, and data owner from the power grid data to be stored as the description information of the business dimension; The second description module extracts structure definition, type, storage medium, and name of the power grid data to be stored as the description information of the technical dimension; The third description module extracts access mode, access record, and data processing operation of the power grid data to be stored as the description information of the operation dimension; The decomposition unit extracts power grid data information segments from the data queue, each of the power grid data information segments corresponding to metadata of a power grid data to be stored; The distribution unit is connected to the decomposition unit and a plurality of directory encoders, and the distribution unit distributes the power grid data information segments to the directory encoders one by one; The directory encoder generates a plurality of groups of encoding segments according to the power grid data information segments, and then generates the power grid data directory code based on the encoding segments.

7. The memory topology indexing system for power grid data according to claim 6, characterized in that: The allocation unit also includes a rule unit, a plug-in unit and a calling unit; The rule unit configures generation rules and data sources for multiple coding segments respectively; The plug-in unit is connected to the rule unit, and the plug-in unit generates a coding plug-in according to the generated rule and the data source; The calling unit is connected to the plug-in unit, and the calling unit calls the coding plug-in respectively according to the input power grid data information segments, and then uses the coding plug-in to generate the coding segments.

8. The memory topology indexing system for power grid data according to claim 7, characterized in that: The acquisition unit retrieves the power grid data to be managed and a preset data tag group from the storage module, wherein the data tag group includes a plurality of data tags, and processes the data features numerically to obtain a data feature index value T; The classification of the classification units is calculated and classified by a preset probability formula. When the merging probability is within the set range, they are merged into the same category. The preset probability formula is: Among them, T Am and T Bm is the index value of data points A and B on the mth feature, |T Am -T Bm ∣ is the absolute value of the difference between data points A and B on the mth feature; σ m is the normalization factor of the mth feature, used to adjust the impact of eigenvalue differences, and e is the base of the natural logarithm; The association unit associates the power grid data with each data tag and establishes an index management system according to the data tag system; The query response module is used to query the index structure according to the user's query request to obtain the storage location information of the network traffic data, and return the storage location information to the user, and the user obtains the response data according to the storage location information.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the memory topology indexing system for power grid data described in any one of claims 1 to 8 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the memory topology indexing system for power grid data described in any one of claims 1 to 8 are implemented.

Images