Design method, system and device for uid of Opentsdb in new energy field and medium

By uniquely encoding equipment and measurement points in the new energy system in Opentsdb, the performance bottlenecks and low query efficiency caused by uid design are solved, efficient and accurate data management and query are achieved, and the stability of the system is enhanced and reliability.

CN118939660APending Publication Date: 2024-11-12BEIJING HUANENG XINRUI CONTROL TECH +2
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411043529.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

In the time series data storage and query in the new energy field, the improper UID design leads to performance bottlenecks and inefficient query efficiency, which cannot meet the high requirements of real-time and accuracy, especially in high concurrency scenarios, blockage and timeouts may occur.

Method used

The equipment and measurement points in the new energy system are uniquely encoded using preset encoding rules. The equipment unique encoding is used as the metric of Opentsdb, and the measurement point unique encoding is used as the tag to ensure the uniqueness of each device and each measurement point in the system. This improves the efficiency and accuracy of data retrieval.

Benefits of technology

通过唯一编码提高了数据的存储和检索效率,确保了数据的准确性和完整性,避免了性能波动,增强了系统的稳定性和可靠性,适应新能源领域的监测需求。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939660A_ABST
    Figure CN118939660A_ABST
Patent Text Reader

Abstract

The invention discloses a new energy field Opentsdb uid design method, system, device and medium, and the method comprises the steps: carrying out the unique coding of a device needing to be monitored in a new energy system, and obtaining the unique code of the device; when the equipment information is input, the unique code of the equipment is used as the metric of the Opentsdb to create uid; the method comprises the following steps: uniquely coding measuring points required to be monitored by equipment in a new energy system to obtain unique codes of the measuring points; when the new energy equipment measuring point is maintained, the unique code of the measuring point is used as the tag of the Opentsdb to create the uid, and the method, the system, the equipment and the medium can improve the efficiency and the accuracy of data retrieval.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of new energy technology and relates to a design method, system, device and medium of the uid of Opentsdb in the field of new energy. Background Art

[0002] With the rapid development of the new energy field, there are a large number of related devices, dense measurement points, and extremely high data reporting frequency, which poses a severe challenge to the data storage and query system. In this context, Opentsdb, as a distributed and scalable time series database based on Hbase, has been widely used in the monitoring field due to its powerful data storage and query capabilities. Opentsdb is particularly suitable for collecting, storing and querying monitoring indicator data of large-scale clusters. It is undoubtedly an ideal choice for the massive time series data generated in the new energy field.

[0003] However, when using the Opentsdb time series database to store time series data in the field of new energy, the design of uid (unique identifier) ​​is particularly critical. As the unique identifier of data in Opentsdb, the rationality of its design directly affects the writing and query performance of Opentsdb. If the uid is not designed properly, it will not only increase the storage redundancy of the data, but also may lead to low query efficiency and fail to meet the high requirements of real-time and accuracy in the field of new energy. Therefore, when applying Opentsdb in the field of new energy, how to reasonably design uid has become a key issue to ensure the efficient operation of Opentsdb.

[0004] In the existing Opentsdb system, in order to ensure the global uniqueness of uid, the system relies on the HBase lock mechanism when generating and writing uid. However, this strategy will lead to obvious performance bottlenecks when faced with the need to create a large number of uid codes. Due to the use of HBase locks, multiple requests to create uids will have to be processed serially and cannot be parallelized, which greatly limits the system's write speed and throughput. In high-concurrency scenarios, this design will lead to longer system response times, and may even cause blocking and timeouts, seriously affecting the overall performance and user experience of the Opentsdb system.

[0005] As an open source time series database based on HBase, the data retrieval performance of Opentsdb is largely affected by the rowkey design in the underlying HBase. In Opentsdb, rowkey is usually composed of metric, timestamp, and tag key-value pairs. However, this design has certain limitations in the setting of rowkey. If the rowkey setting is unreasonable, such as failure to fully consider the common patterns and query hotspots of data retrieval, the physical storage of data in HBase will be dispersed, which will in turn affect the efficiency and performance of data retrieval. Specifically, unreasonable rowkey settings may cause a large amount of data to be dispersed in different regions of HBase, thereby increasing the network I / O overhead and the complexity of cross-region queries during data retrieval, resulting in low efficiency and accuracy of data detection. Summary of the invention

[0006] The purpose of the present invention is to overcome the shortcomings of the above-mentioned prior art and provide a design method, system, device and medium for the uid of Opentsdb in the new energy field. The method, system, device and medium can improve the efficiency and accuracy of data retrieval.

[0007] In order to achieve the above object, the present invention adopts the following technical scheme:

[0008] In one aspect, the present invention provides a method for designing the uid of Opentsdb in the field of new energy, including:

[0009] Uniquely encode the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment;

[0010] When entering device information, use the device's unique code as the Opentsdb metric to create a uid;

[0011] Uniquely encode the measuring points that need to be monitored by the equipment in the new energy system to obtain the unique code of the measuring point;

[0012] When maintaining new energy equipment measurement points, use the unique code of the measurement point as the tag of Opentsdb to create a uid.

[0013] The design method of the uid of Opentsdb in the new energy field of the present invention is further improved in that:

[0014] The unique coding of the equipment to be monitored in the new energy system may further include:

[0015] Different types of equipment in the new energy system are encoded to obtain equipment type codes.

[0016] The process of uniquely coding the equipment to be monitored in the new energy system to obtain the unique code of the equipment is as follows:

[0017] The preset coding rules are used to uniquely code the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment.

[0018] The preset coding rule is:

[0019] The unique code of the device = device type code + device id.

[0020] When maintaining new energy equipment measurement points, the unique code of the measurement point is used as the tag of Opentsdb to create the uid and also includes:

[0021] When querying data, query the Opentsdb database based on the unique code of the device and the unique code of the measuring point.

[0022] In a second aspect of the present invention, the present invention provides a design system for the uid of Opentsdb in the field of new energy, including:

[0023] The first encoding module is used to uniquely encode the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment;

[0024] The first creation module is used to create a uid using the unique code of the device as the metric of Opentsdb when entering device information;

[0025] The second coding module is used to uniquely code the measuring points that need to be monitored by the equipment in the new energy system to obtain the unique code of the measuring point;

[0026] The second creation module is used to create a uid using the unique code of the measurement point as the tag of Opentsdb when maintaining the measurement point of new energy equipment.

[0027] The design system of the uid of Opentsdb in the new energy field of the present invention is further improved in that:

[0028] Also includes:

[0029] The third encoding module is used to encode different types of equipment in the new energy system to obtain equipment type codes.

[0030] Also includes:

[0031] The query module is used to query the Opentsdb database according to the unique code of the device and the unique code of the measuring point when performing data query.

[0032] In the third aspect of the present invention, the present invention provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that when the processor executes the computer program, the steps of the method for designing the uid of Opentsdb in the new energy field are implemented.

[0033] In a fourth aspect of the present invention, the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for designing the uid of Opentsdb in the new energy field are implemented.

[0034] The present invention has the following beneficial effects:

[0035] The design method, system, device and medium of the uid of Opentsdb in the field of new energy described in the present invention uniquely encode the equipment that needs to be monitored in the new energy system during specific operation, which not only ensures the uniqueness of each device in the system, but also provides a basis for subsequent data association and retrieval. In the present invention, the unique code of the device is used as the metric of the Opentsdb database, so that the storage and retrieval of each device in the Opentsdb database are more convenient and efficient. In addition, the present invention uniquely encodes the measuring point, and the measuring point coding can ensure the uniqueness of each measuring point in the system, and also facilitates subsequent data analysis and processing. In the present invention, the unique code of the measuring point is used as the tag of the Opentsdb database, so that the data of each measuring point can be closely associated with the corresponding device data to form a complete data chain, which not only improves the efficiency of data retrieval, but also ensures the accuracy and integrity of the data. In addition, the present invention also has good scalability and flexibility, and can adapt to the ever-changing monitoring needs in the field of new energy. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings constituting a part of the present invention are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the accompanying drawings:

[0037] Figure 1 A schematic diagram of the device type coding rules;

[0038] Figure 2 This is a schematic diagram of the measurement point coding rules;

[0039] Figure 3 This is a schematic diagram of the Opentsdb metric encoding rules;

[0040] Figure 4 A schematic diagram of creating a UID when maintaining basic information. DETAILED DESCRIPTION

[0041] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiment of the present invention. Obviously, the described embodiment is only an embodiment of a part of the present invention, not all embodiments, and is not intended to limit the scope of the present invention. In addition, in the following description, the description of well-known structures and technologies is omitted to avoid unnecessary confusion of the concepts disclosed in the present invention. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work should fall within the scope of protection of the present invention.

[0042] The accompanying drawings show schematic diagrams of structures according to embodiments disclosed in the present invention. These figures are not drawn to scale, and some details are magnified and some details may be omitted for the purpose of clear expression. The shapes of various regions and layers shown in the figures and the relative sizes and positional relationships therebetween are only exemplary, and may deviate in practice due to manufacturing tolerances or technical limitations, and those skilled in the art may additionally design regions / layers with different shapes, sizes, and relative positions according to actual needs.

[0043] Embodiment 1

[0044] refer to Figures 1 to 4 The design method of the uid of Opentsdb in the new energy field of the present invention comprises the following steps:

[0045] 1) Encode different types of equipment in the new energy system to obtain equipment type codes;

[0046] It should be noted that the different types of equipment in the new energy field include wind turbines, photovoltaics, box transformers and combiner boxes, etc. By encoding the equipment, the equipment type code is used to identify the type of equipment to ensure the uniqueness and readability of subsequent coding.

[0047] 2) Uniquely encode the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment;

[0048] It should be noted that when uniquely coding the equipment to be monitored, the coding rule used is: equipment type code + equipment id. Among them, the equipment id is the unique identifier of each equipment in the new energy system. The above coding method can ensure that each equipment has a unique identification in the new energy system, which is convenient for subsequent data management and query.

[0049] 3) When entering device information, use the device's unique code as the Opentsdb metric to create a uid;

[0050] By using the unique code of the device as the metric of Opentsdb, the device information can be associated with the data in the Opentsdb database, providing a basis for subsequent data query and analysis.

[0051] 4) Uniquely encode the measuring points that need to be monitored by the equipment in the new energy system to obtain the unique code of the measuring point;

[0052] Among them, step 4) is similar to the equipment coding in the coding process, but it is necessary to consider the specific attributes and characteristics of the measuring point to ensure that each measuring point has a unique identification in the new energy system.

[0053] 5) When maintaining the measurement points of new energy equipment, use the unique code of the measurement point as the tag of Opentsdb to create the uid.

[0054] It should be noted that by using the unique code of the measuring point as the tag of Opentsdb, the information of the measuring point can be associated with the information of the device and stored in the Opentsdb database. In this way, in subsequent data query and analysis, the corresponding data can be quickly located according to the codes of the device and measuring point.

[0055] In actual applications, detailed coding rules and equipment and measurement point information entry processes can be formulated according to the specific needs of the new energy field. At the same time, the parameters of the Opentsdb database need to be configured to ensure that the system can operate normally and meet actual needs. During data entry and maintenance, it is necessary to strictly follow the coding rules to ensure the accuracy and consistency of the data.

[0056] It should be noted that the present invention has the following characteristics:

[0057] The present invention can significantly improve the efficiency and accuracy of data management of equipment and its measuring points in the field of new energy. Specifically, first, by uniquely encoding the equipment and measuring points, it is ensured that all objects that need to be monitored in the system have unique identification, thereby realizing comprehensive data collection and effectively avoiding data confusion and omission problems. Secondly, the present invention makes full use of the characteristics of hbase's rowkey, and combines the rules of Opentsdb to design the storage mechanism of metric and tag. This design enables the data of the same type of equipment to be stored more centrally in hbase, which not only improves the storage efficiency of the data, but also facilitates subsequent data query and analysis. Finally, the present invention advances the timing of creating uid to the stage of basic information dimension. This innovative measure ensures the stability of data writing and query performance, avoids performance fluctuations caused by frequent creation of uid during data writing, and thus improves the stability and reliability of the entire system.

[0058] In summary, the present invention brings significant beneficial effects in the data management of equipment and its measuring points in the field of new energy. It not only improves the efficiency and accuracy of data management, but also enhances the stability and reliability of the system, providing strong technical support for the development of the field of new energy.

[0059] Embodiment 2

[0060] The present invention provides a design system for the uid of Opentsdb in the field of new energy, including:

[0061] The third encoding module is used to encode different types of equipment in the new energy system to obtain equipment type codes;

[0062] The first encoding module is used to uniquely encode the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment;

[0063] The first creation module is used to create a uid using the unique code of the device as the metric of Opentsdb when entering device information;

[0064] The second coding module is used to uniquely code the measuring points that need to be monitored by the equipment in the new energy system to obtain the unique code of the measuring point;

[0065] The second creation module is used to create a uid using the unique code of the measurement point as the tag of Opentsdb when maintaining the measurement point of new energy equipment;

[0066] The query module is used to query the Opentsdb database according to the unique code of the device and the unique code of the measuring point when performing data query.

[0067] The division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional module in each embodiment of the present application may be integrated into a processor, or may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated modules may be implemented in the form of hardware or in the form of software functional modules.

[0068] Embodiment 3

[0069] The present invention also provides a computer device, comprising: a memory for storing a computer program; and a processor for executing the steps of the method for designing the uid of Opentsdb in the new energy field.

[0070] When the processor executes the computer program, the steps of the above-mentioned method for designing the uid of Opentsdb in the new energy field are implemented, for example: uniquely encode the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment; when entering the equipment information, use the unique code of the equipment as the metric of Opentsdb to create the uid; uniquely encode the measuring points that need to be monitored by the equipment in the new energy system to obtain the unique code of the measuring point; when maintaining the measuring point of the new energy equipment, use the unique code of the measuring point as the tag of Opentsdb to create the uid.

[0071] Alternatively, the processor implements the functions of each module in the above-mentioned system when executing the computer program, for example: a third encoding module is used to encode different types of equipment in the new energy system to obtain equipment type codes; a first encoding module is used to uniquely encode equipment that needs to be monitored in the new energy system to obtain a unique code for the equipment; a first creation module is used to create a uid using the unique code of the equipment as the metric of Opentsdb when entering equipment information; a second encoding module is used to uniquely encode the measuring points that need to be monitored by the equipment in the new energy system to obtain a unique code of the measuring point; a second creation module is used to create a uid using the unique code of the measuring point as the tag of Opentsdb when maintaining the measuring point of the new energy equipment; a query module is used to query the Opentsdb database according to the unique code of the equipment and the unique code of the measuring point when performing data query.

[0072] Exemplarily, the computer program may be divided into one or more modules / units, which are stored in the memory and executed by the processor to implement the present invention. The one or more modules / units may be a series of computer program instruction segments capable of implementing preset functions, and the instruction segments are used to describe the execution process of the computer program in the computer device.

[0073] The computer device may be a computing device such as a desktop computer, a notebook, a PDA, and a cloud server. The computer device may include, but is not limited to, a processor and a memory. Those skilled in the art will appreciate that the above are examples of computer processing devices and do not constitute a limitation on the computer device, which may include more components than the above, or a combination of certain components, or different components. For example, the computer device may also include input and output devices, network access devices, buses, etc.

[0074] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the computer device, and uses various interfaces and lines to connect various parts of the entire computer device.

[0075] The memory may be used to store the computer programs and / or modules, and the processor implements various functions of the computer device by running or executing the computer programs and / or modules stored in the memory and calling the data stored in the memory.

[0076] The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SmartMediaCard, SMC), a secure digital (SecureDigital, SD) card, a flash card (FlashCard), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0077] Embodiment 4

[0078] The present invention also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of the method for designing the uid of Opentsdb in the new energy field are implemented, for example, including: uniquely encoding the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment; when entering the equipment information, using the unique code of the equipment as the metric of Opentsdb to create the uid; uniquely encoding the measuring points that need to be monitored by the equipment in the new energy system to obtain the unique code of the measuring points; when maintaining the measuring points of the new energy equipment, using the unique code of the measuring points as the tag of Opentsdb to create the uid.

[0079] If the module / unit integrated by the design system of the uid of Opentsdb in the new energy field is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.

[0080] Based on this understanding, the present invention implements all or part of the process in the above-mentioned method for designing the uid of Opentsdb in the new energy field, and can also be completed by instructing related hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the method for designing the uid of Opentsdb in the new energy field can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or preset intermediate form, etc.

[0081] The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc.

[0082] It should be noted that the content contained in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable storage media do not include electrical carrier signals and telecommunication signals.

[0083] The above embodiment is only one of the implementation methods that can realize the technical solution of the present invention. The scope of protection claimed by the present invention is not limited only to this embodiment, but also includes changes, replacements and other implementation methods that can be easily thought of by any technician familiar with the technical field within the technical scope disclosed by the present invention.

Claims

1. A design method for the uid of Opentsdb in the field of new energy, characterized in that: include: Uniquely encode the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment; When entering device information, use the device's unique code as the Opentsdb metric to create a uid; Uniquely encode the measuring points that need to be monitored by the equipment in the new energy system to obtain the unique code of the measuring point; When maintaining new energy equipment measurement points, use the unique code of the measurement point as the tag of Opentsdb to create a uid.

2. The design method of uid of Opentsdb in the new energy field according to claim 1 is characterized in that: The unique coding of the equipment to be monitored in the new energy system may further include: Different types of equipment in the new energy system are encoded to obtain equipment type codes.

3. The design method of uid of Opentsdb in the new energy field according to claim 2 is characterized in that: The process of uniquely coding the equipment to be monitored in the new energy system to obtain the unique code of the equipment is as follows: The preset coding rules are used to uniquely code the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment.

4. The design method of uid of Opentsdb in the new energy field according to claim 3 is characterized in that: The preset coding rule is: The unique code of the device = device type code + device id.

5. The design method of uid of Opentsdb in the new energy field according to claim 1 is characterized in that: When maintaining new energy equipment measurement points, the unique code of the measurement point is used as the tag of Opentsdb to create the uid and also includes: When querying data, query the Opentsdb database based on the unique code of the device and the unique code of the measuring point.

6. A design system for the uid of Opentsdb in the field of new energy, characterized in that: include: The first encoding module is used to uniquely encode the equipment that needs to be monitored in the new energy system to obtain the unique code of the equipment; The first creation module is used to create a uid using the unique code of the device as the metric of Opentsdb when entering device information; The second coding module is used to uniquely code the measuring points that need to be monitored by the equipment in the new energy system to obtain the unique code of the measuring point; The second creation module is used to create a uid using the unique code of the measurement point as the tag of Opentsdb when maintaining the measurement point of new energy equipment.

7. The design system of uid of Opentsdb in the new energy field according to claim 6 is characterized in that: Also includes: The third encoding module is used to encode different types of equipment in the new energy system to obtain equipment type codes.

8. The design system of uid of Opentsdb in the new energy field according to claim 6 is characterized in that: Also includes: The query module is used to query the Opentsdb database according to the unique code of the device and the unique code of the measuring point when performing data query.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, it implements the steps of the method for designing the uid of Opentsdb in the new energy field as described in any one of claims 1-5.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method for designing the uid of Opentsdb in the new energy field as described in any one of claims 1 to 5 are implemented.