Method and system for positioning and transmitting continuous recording data

Abstract

The invention provides a continuous recording data positioning and transmission method and system, and belongs to the technical field of power transmission operation inspection, and the method comprises the steps: receiving a query instruction sent by a master station, and analyzing and extracting data information in the query instruction; based on the data information and a configuration file stored at the broadband measurement device, calculating the position of the measurement point data in the continuous recording data within the range of query starting and ending time; based on the position of the measuring point data in the continuous recording data, extracting the measuring point data; preprocessing the measuring point data to generate a message; and sending the message to a master station, so that the master station analyzes the message to generate measuring point data and sends the measuring point data to a client. According to the invention, based on the configuration file information locally stored by the broadband measuring device, the position of the required data in the continuous recording file is accurately positioned and the data is extracted, so that rapid query, accurate positioning and rapid extraction of the recording data in the broadband measuring device are realized, and the data query efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of power transmission operation and inspection, and in particular to a method and system for positioning and transmitting continuous wave recording data. Background Art

[0002] With the rapid development of the power industry, real-time monitoring of the operating status of the power grid and rapid retrieval of historical data are becoming increasingly important. Broadband measuring devices, as core components in power systems, can provide accurate and fast synchronous sampling of electrical quantity data. These data are stored in Comtrade format with a sampling rate of not less than 6.4K to achieve continuous recording storage. When analyzing historical recording data in broadband measuring devices, the entire continuous recording file is usually transferred from the device to the main station server, and then tools are used to parse the file to extract the required data. When this method handles large-scale data extraction and analysis tasks, the centralized transmission of a large amount of data will consume a lot of network bandwidth, and the transmission efficiency is low. At the same time, accompanied by possible network interruptions or data packet loss, the reliability of data transmission is affected and the query efficiency is reduced. Summary of the invention

[0003] The present invention provides a method and system for positioning and transmitting continuous wave recording data, which can improve the reliability and efficiency of data transmission and improve data query efficiency when processing large-scale data extraction and analysis tasks.

[0004] The present invention provides a method for positioning and transmitting continuous wave recording data, which is applied to a broadband measurement device, and comprises: Receiving a query instruction sent by the master station, parsing and extracting data information in the query instruction, the data information including the measuring point name, query start and end time and message format, the query instruction is generated by the master station according to the query request sent by the client; Based on the data information and the configuration file stored in the broadband measurement device, calculating the position of the measurement point data within the range of the query start and end time in the continuous recording data; Extracting the measuring point data based on the position of the measuring point data in the continuous wave recording data; Preprocessing the measurement point data to generate a message; and The message is sent to the master station, so that the master station parses the message to generate the measurement point data and sends the measurement point data to the client.

[0005] In some embodiments, the method further comprises: In the process of sending the message to the master station, when a transmission abnormality feedback sent by the master station is received, the message with the transmission abnormality is resent.

[0006] In some embodiments, the method further comprises: The message is sent to the master station, so that the master station parses the message to generate the measuring point data and stores the measuring point data locally at the master station.

[0007] In some embodiments, the preprocessing includes organizing the data and packaging the data; The organizing data includes organizing the measuring point data according to the time sequence and the measuring point names; and The packaging of data includes packaging data according to the message format, and the message format is a JSON format or a binary format.

[0008] The present invention also provides a method for positioning and transmitting continuous wave recording data, which is applied to a master station and comprises: Converting the query request received from the client into a query instruction including data information, and sending the query instruction to the broadband measurement device, wherein the data information includes the measurement point name, query start and end time, and message format; receiving a message sent by the broadband measurement device; parsing the message to generate measurement point data; and The measuring point data is sent to the client.

[0009] In some embodiments, the method further comprises: When it is detected that no message is received within the specified time or that the message is damaged, a transmission abnormality feedback is sent to the broadband measurement device, so that the broadband measurement device resends the message with the transmission abnormality and re-receives the message with the transmission abnormality.

[0010] In some embodiments, the method further comprises: The measuring point data is stored locally at the master station.

[0011] The present invention also provides a continuous wave recording data positioning and transmission system, comprising: The client module is located in the user workstation and is configured to generate query requests according to user needs; The first query service module, located in the main station, is configured as follows: Converting the query request into a query instruction including data information, wherein the data information includes a measuring point name, a query start and end time, and a message format; sending the query instruction to a second query service module in the broadband measurement device; Receiving the message sent by the second query service module; parsing the message to generate measurement point data; and sending the measurement point data to the client module; and The second query service module is located in the broadband measurement device and is configured to: Parsing and extracting the data information in the query instruction; Based on the data information and the configuration file stored in the broadband measurement device, calculating the position of the measurement point data within the range of the query start and end time in the continuous recording data; Extracting the measuring point data based on the position of the measuring point data in the continuous wave recording data; Preprocessing the measurement point data to generate a message; and The message is sent to the first query service module of the master station.

[0012] In some embodiments, the first query service module is further configured to: when it is detected that no message is received within a specified time or that the message is damaged, send a transmission abnormality feedback to the second query service module, so that the second query service module resends the message with the transmission abnormality and re-receives the message with the transmission abnormality; The second query service module is further configured to: in the process of sending the message to the first query service module, when receiving the transmission abnormality feedback sent by the first query service module, resend the message with the transmission abnormality.

[0013] In some embodiments, the system further comprises a data storage module, the data storage module is located at the main station, and the first query service module is further configured to store the measurement point data in the data storage module.

[0014] The continuous recording data positioning and transmission method and system provided by the present invention accurately locate the position of required data in the continuous recording file and extract the data based on the configuration file information stored locally in the broadband measurement device, and realize the rapid query, precise positioning and efficient and reliable transmission of the recording data in the broadband measurement device through a reliable data transmission protocol and application layer breakpoint resumption, thereby improving the response speed and stability of the system, and reducing the query pressure on back-end equipment such as the broadband measurement device through the local caching mechanism of the master station, thereby improving the data query efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 It is a schematic flow chart of a method for positioning and transmitting continuous wave recording data applied to a broadband measurement device according to an embodiment of the present invention.

[0017] Figure 2 It is a schematic diagram of a data positioning method in a method for positioning and transmitting continuous wave recording data according to an embodiment of the present invention.

[0018] Figure 3 It is a schematic diagram of a data transmission method in a method for positioning and transmitting continuous wave recording data according to an embodiment of the present invention.

[0019] Figure 4 It is a schematic flow chart of a method for positioning and transmitting continuous wave recording data applied to a master station side according to an embodiment of the present invention.

[0020] Figure 5 2 is a schematic diagram of the system architecture of a continuous wave recording data positioning and transmission system according to an embodiment of the present invention.

[0021] Figure 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below in conjunction with the drawings in the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments can be combined with each other in the absence of conflict. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0023] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art of the present invention. The terms used in the specification of the present invention herein are only for the purpose of describing specific embodiments and are not intended to limit the present invention.

[0024] It should be further noted that, in this article, the terms "comprises", "includes" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0025] In the present invention, "at least one" means one or more, and "more" means two or more than two. The terms "first", "second", "third", "fourth", etc. (if any) in the present invention are used to distinguish similar objects, rather than to describe a specific order or sequence.

[0026] In the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present invention should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0027] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0028] The present invention provides a method for positioning and transmitting continuous wave recording data, such as Figure 1 As shown, applied to the broadband measurement device side, the method includes: Step S110, receiving the query instruction sent by the master station, parsing and extracting data information in the query instruction, the data information including the measuring point name, query start and end time and message format, etc. The query instruction is generated by the master station according to the query request sent by the client.

[0029] Specifically, the query instruction is an instruction frame composed of the master station receiving the query request sent by the client, extracting the master station side measurement point name, the master station side measurement point ID, the query start and end time, the query data sampling density and other information in the query request, determining the IP address of the corresponding broadband measurement device according to the master station side measurement point name, and converting the master station side measurement point name and the master station side measurement point ID into the measurement point name at the broadband measurement device, and then organizing the data information including the broadband measurement device IP address, measurement point name, query start and end time, query data sampling density and message format.

[0030] In some embodiments, the measuring point names included in the data information are a name list of target measuring points that are query targets.

[0031] In some embodiments, the data information may further include a request identifier, where the request identifier is used to identify a unique identifier for this request, so as to facilitate matching responses and resuming transmission from breakpoints.

[0032] Step S120, based on the data information and the configuration file stored in the broadband measurement device, calculate the position of the measurement point data within the query start and end time range in the continuous recording data.

[0033] Specifically, the configuration files and data files stored in the broadband measurement device adopt the Comtrade format, and the Comtrade configuration files correspond to the Comtrade data files (i.e., continuous wave recording data files). Since the Comtrade file format has a standardized time series storage method, the broadband measurement device can quickly locate the data of a specific time period and measurement point in the Comtrade data file according to the Comtrade configuration file through a simple offset calculation based on time or sampling point sequence number, without relying on index files or additional search processes.

[0034] As an example, refer to Figure 2 When receiving a query request, the broadband measurement device parses the Comtrade configuration file to obtain information such as the measurement point name, number of measurement points, sampling rate, recording time, and data format related to the stored Comtrade data file. First, based on the stored Comtrade data file, sampling rate, and recording time, combined with the fixed time interval relationship of each data in the Comtrade data file, the data record (for example, data file K) of the time period T1~T2 is directly obtained according to the query start and end time (for example, T1~T2) in the query instruction; then, according to the position of the measurement point name (for example, DataA) in the Comtrade configuration file in the query instruction (for example, serial number 1, that is, in the measurement point name of the Comtrade configuration file, the serial number of DataA is 1), the position of the target measurement point data in the obtained data record (for example, data file K) is calculated (for example, as Figure 2 (the blackened positions in the data file K).

[0035] Step S130: extracting the measuring point data based on the position of the measuring point data in the continuous wave recording data.

[0036] For details, see Figure 2 ,The broadband measurement device directly jumps to the calculated starting position based on the calculated ,position of the measuring point data in the Comtrade data file (i.e., the continuous ,recording data file), and quickly extracts the data of multiple measuring points within the ,specified time range.

[0037] This data positioning and extraction method not only effectively avoids the full scanning of continuous recording data files in traditional methods, improves data extraction efficiency, but also can significantly reduce query response time. It is particularly suitable for large-scale data query needs at multiple measuring points, greatly improves data query performance, and makes the system more efficient when processing high-frequency and large-capacity data.

[0038] Step S140: pre-process the measurement point data to generate a message.

[0039] Specifically, the broadband measurement device preprocesses the measurement point data, including organizing the data and packaging the data. Organizing the data includes organizing the measurement point data according to the time sequence and the measurement point name, including the measurement point name, timestamp and data value. Packaging the data includes packaging the organized data according to the message format specified in the query instruction, packaging the data into a single or multiple small messages, and adding necessary metadata information. As an example, the message format can be a JSON format or a binary format.

[0040] In some embodiments, the metadata information includes at least one of a response type (ResponseType), a request identifier (RequestID), a current data packet sequence number (SequenceNumber), a total number of data packets (TotalSequences), a compression algorithm (CompressionAlgorithm), and a checksum (Checksum), wherein the response type according to an embodiment of the present invention is a data result, the request identifier corresponds to a query request, the current data packet sequence number is used for breakpoint resumption and data reorganization, the total number of data packets is used to determine data transmission integrity, the compression algorithm indicates what type of compression is performed before data transmission, and the checksum indicates the type of check to be used for data verification, such as CRC.

[0041] In some embodiments, preprocessing the measurement point data further includes compressing the data, and the compression algorithm may be any one of zip, gzip, zstd, etc. Specifically, data compression is performed after data organization is completed and before data packaging is performed. Optionally, data compression is performed after data packaging is completed and before data transmission is performed.

[0042] Step S150 , sending the message to the master station, so that the master station parses the message to generate measurement point data and sends the measurement point data to the client.

[0043] Specifically, the broadband measurement device sends the data packaged in the message format specified in the query instruction to the main station, so that the main station parses the message to generate the measurement point data and sends the measurement point data to the client.

[0044] In some embodiments, the method for positioning and transmitting continuous wave recording data further includes: in the process of sending a message to a master station, when transmission abnormality feedback sent by the master station is received, resending the message with the transmission abnormality.

[0045] Specifically, in some embodiments, in order to ensure complete transmission of message data when sending messages, the TCP protocol is used in the data transmission layer.

[0046] Under the TCP protocol, when the message format is in JSON format, examples of the query instruction message format and the query result message format in JSON format are as follows.

[0047] Query command message format (supports querying multiple measurement points, JSON example): { "CommandType": "QueryData", "MeasurementPoints": ["Measurement point name 1", "Measurement point name 2", ...], "StartTime": "Start time", "EndTime": "End time", "SamplingRate": "Sampling density", "CompressionAlgorithm": "Compression algorithm", "ResponseFormat": "JSON or Binary", "RequestID": "Request identifier" } Field Description: CommandType: command type, here is a data query request; MeasurementPoints: the array of measurement point names to be queried; StartTime: the start time of data query, in the format of YYYY-MM-DD HH:MM:SS; EndTime: end time of data query, the format is the same as above; SamplingRate: specifies the sampling density of the data; CompressionAlgorithm: specifies the compression algorithm to be used, such as zip, gzip, zstd, etc.; ResponseFormat: expected response format, JSON or Binary; RequestID: A unique identifier used to identify this request, which facilitates matching responses and resuming downloads.

[0048] Query result message format (JSON example): { "ResponseType": "DataResult", "RequestID": "Request identifier", "Data": [ { "MeasurementPoint": "Measurement point name 1", "Records": [ { "Timestamp": "Timestamp", "Value": "Data value" }, ... ] }, ... ], "SequenceNumber": sequence number, "TotalSequences": total sequence number, "CompressionAlgorithm": "Compression algorithm", "Checksum": "Checksum" } Field Description: ResponseType: response type, here is the data result; RequestID: request identifier corresponding to the query request; Data: contains data of multiple measuring points, each measuring point's data contains an array of timestamp and data value; SequenceNumber: The sequence number of the current data packet, used for breakpoint resuming and data reassembly; TotalSequences: total number of packets; CompressionAlgorithm: the actual compression algorithm used; Checksum: A checksum used for data verification (such as CRC).

[0049] When the message format is binary, in the query result message format (binary example), the message header contains fixed-length metadata fields, such as ResponseType, RequestID, SequenceNumber, TotalSequences, CompressionAlgorithm, Checksum, etc., encoded in a predefined binary format. The data part is compressed binary data, including data records of multiple measurement points.

[0050] The TCP protocol identifies the order of each data packet by a sequence number, and the TCP protocol ensures that lost data packets can be identified and retransmitted. When the network fluctuates or is temporarily interrupted, the TCP protocol can automatically retransmit the lost data packets based on the sequence number mechanism and continue to transmit the data after the connection is restored. This breakpoint-resume function of the transport layer ensures the orderliness and integrity of data transmission, and provides a reliable basic support for the application layer.

[0051] However, when the network is congested, there is a possibility that the TCP link will time out and be disconnected.

[0052] In other embodiments, application layer breakpoint resume transmission is further adopted to meet the continuous recording data transmission requirements of the broadband measurement device, and further enhance the reliability and stability of data transmission.

[0053] Specifically, Figure 3 As shown, in the application layer breakpoint resume, when the broadband measurement device receives a query instruction with a request identifier RID, a measurement point name DataA, and a start and end time range of [T1, T2] sent by the master station, the broadband measurement device queries data according to the data parameters in the query instruction, and performs packaging processing on the queried measurement point data, divides the query result of the large amount of data into multiple ordered data packets, for example, into N frames of messages, and adds SequenceNumber and TotalSequences information, and returns the query result to the master station using the request identifier RID (for example, in reference Figure 1 In the process of sending N frames of messages to the master station, each message sent by the broadband measurement device will be detected by the master station, and when the master station detects that the message is not received within the specified time or detects that the message is damaged (for example, the reception of the k-th frame data fails, and the transmission link is closed), the broadband measurement device will receive feedback of the retransmission query request sent by the master station (for example, retransmission query [k, N]@RID), requesting the broadband measurement device to resend the message of a specific SequenceNumber (for example, the message of the k-th frame and later, that is, the N-k+1 frame message), and the broadband measurement device will retransmit the specific message (for example, the message of the k-th frame and later, that is, the N-k+1 frame message) to the master station (for example, in reference to the feedback of the master station) using the request identifier RID. Figure 1 150 described above).

[0054] The format of the resume query request message in JSON format (JSON example) is as follows: { "CommandType": "DataContinue", "RequestID": "Request identifier", "SequenceNumberBegin":"The starting sequence number of the query data packet for this retransmission", "SequencesCount": "Total number of query data packets for this retransmission", "TotalSequences": "Total sequence number" } Field Description: CommandType: command type, here it is a resume query request; RequestID: request identifier corresponding to the query request; SequenceNumberBegin: the starting sequence number of the query data packet for this retransmission; SequencesCount: the total number of query data packets in this retransmission; TotalSequences: The total number of packets.

[0055] Application layer breakpoint resume transmission additionally includes the application layer SequenceNumber and TotalSequences fields in the data message to clearly mark the location of the current data segment and the total number of packets. After receiving each data packet, the master station marks the list of received packet sequence numbers. Optionally, a checksum can be added to each data message to verify the integrity and correctness of the data after the data packet transmission is completed. When a transmission anomaly occurs during the transmission of a data packet, that is, when an abnormal situation such as transmission interruption or data packet damage occurs, the master station will send transmission anomaly feedback such as a resume query request to the broadband measurement device, and the latter will only retransmit the data packet with the transmission anomaly.

[0056] This application layer breakpoint resume allows the transmission progress to be accurately restored under the control of the upper layer protocol even when reconnecting after a long interruption. In addition, the application layer breakpoint resume also provides fine-grained resume control and error detection capabilities, which not only improves the utilization efficiency of network bandwidth, but also reduces the delay and computing resource consumption during data transmission. Through the dual protection of the use of the transport layer TCP protocol and the application layer breakpoint resume, the present invention realizes an efficient and stable broadband measurement device data transmission system to ensure the continuity and integrity of data transmission.

[0057] In some embodiments, the method for positioning and transmitting continuous wave recording data further includes: sending a message to a master station, so that the master station parses the message to generate measurement point data and stores the measurement point data locally at the master station.

[0058] Specifically, after the broadband measurement device transmits the data completely to the main station, the main station can not only send the data to the client, but also store the data in the time series database or other data storage module or device that is existing locally at the main station or is set based on the present invention, for rapid response to subsequent identical queries. Taking the time series database as an example, the local storage of data at the main station brings about many optimization effects: first, for subsequent identical queries, the main station can directly extract the required data from the local database without having to issue a request to the broadband measurement device again, reducing the query pressure on back-end devices such as broadband measurement devices; second, the local cache mechanism of the main station reduces the frequency of data transmission in the network, optimizes bandwidth occupancy, and improves the utilization rate of network resources. In addition, through the partition management and time period archiving of the local database, the cached data can be efficiently managed to ensure a good balance between storage space and query speed, further improving the overall operation efficiency of the system.

[0059] The method for positioning and transmitting continuous recording data provided by the present invention accurately positions the position of required data in the continuous recording file and extracts the data based on the configuration file information stored locally in the broadband measuring device. Through a reliable data transmission protocol and application layer breakpoint resumption, rapid query, precise positioning and efficient and reliable transmission of the recording data in the broadband measuring device are achieved, thereby improving the response speed and stability of the system. Furthermore, through local storage at the master station, the query pressure on back-end equipment such as the broadband measuring device is reduced, thereby improving data query efficiency.

[0060] The present invention also provides a method for positioning and transmitting continuous recording data, such as Figure 4 As shown, applied to the master station side, the method includes: Step S410: convert the query request received from the client into a query instruction including data information, and send the query instruction to the broadband measurement device. The data information includes the measurement point name, query start and end time, and message format.

[0061] Specifically, after the master station receives the query request sent by the client, it extracts the master station side measurement point name, master station side measurement point ID, query start and end time, query data sampling density and other information in the query request, determines the IP address of the corresponding broadband measurement device according to the master station side measurement point name, and converts the master station side measurement point name and the master station side measurement point ID into the measurement point name at the broadband measurement device. After that, the data information including the broadband measurement device IP address, measurement point name, query start and end time and message format is organized into an instruction frame, and the instruction frame is sent to the broadband measurement device.

[0062] Step S420: receiving a message sent by the broadband measurement device.

[0063] Specifically, when the broadband measurement device completes the extraction and packaging of required data and sends relevant messages to the master station, the master station receives the corresponding messages.

[0064] Step S430: parse the message to generate measurement point data.

[0065] Specifically, the master station parses the message received from the broadband measurement device and extracts the measurement point data in the message.

[0066] Step S440: sending the measurement point data to the client.

[0067] Specifically, the master station sends the measurement point data in the extracted message to the client.

[0068] In some embodiments, the method for positioning and transmitting continuous recording data further includes: when it is detected that no message is received within a specified time or that the message is damaged, sending transmission abnormality feedback to the broadband measurement device so that the broadband measurement device resends the message with the transmission abnormality and re-receives the message with the transmission abnormality.

[0069] In some embodiments, when the master station receives the message, in order to ensure the complete transmission of the message data, the TCP protocol is used in the data transmission layer. The specific details and use effect of the TCP protocol are similar to the positioning and transmission method of the continuous recording data on the broadband measurement device side. Therefore, the above embodiment can be referred to, and the TCP protocol related embodiments will not be repeated here.

[0070] In other embodiments, application layer breakpoint resume transmission is further adopted to meet the continuous recording data reception requirements of the master station, thereby further enhancing the reliability and stability of data transmission.

[0071] Specifically, Figure 3 As shown, the master station sends a query instruction with a request identifier of RID, a measurement point name of DataA, and a start and end time range of [T1, T2] to the broadband measurement device (for example, in reference Figure 4 In step S410 described in the description). The message sent by the broadband measurement device and received by the master station is attached with SequenceNumber and TotalSequences information. In the process of receiving N frames of messages sent by the broadband measurement device, the master station detects each received message. When it is detected that the message is not received within the specified time or the message is damaged (for example, the reception of the k-th frame data fails, and the transmission link is closed), the master station sends a feedback of a resume query request (for example, resume query [k, N]@RID) to the broadband measurement device, requesting the broadband measurement device to resend the message of a specific SequenceNumber (for example, the message of the k-th frame and later, that is, the N-k+1 frame message), so that the broadband measurement device resends the specific message (for example, in reference to Figure 4 4. In step S420 described above). Optionally, a checksum may be added to each data message to verify the integrity and correctness of the data after the message transmission is completed. When the master station detects that a transmission anomaly occurs during the transmission of a data packet, that is, when an abnormality such as transmission interruption or data packet damage occurs, the master station sends a transmission anomaly feedback such as a resume query request to the broadband measurement device, so that the broadband measurement device only retransmits the data packet with the transmission anomaly.

[0072] The specific details of the application layer breakpoint resume transmission and the embodiments of the use effect are similar to the positioning and transmission method of the continuous recording data on the broadband measurement device side, so the above-mentioned related embodiments can also be referred to.

[0073] In some embodiments, the method for positioning and transmitting continuous wave recording data further includes: storing the measurement point data in a time series database or other data storage module or device existing in the master station or based on the present invention. Taking the time series database as an example, through the partition management and time period archiving of the local database of the master station, the cached data can be efficiently managed to ensure a good balance between storage space and query speed, further improving the overall operation efficiency of the system.

[0074] The continuous recording data positioning and transmission system provided by the present invention is described below. The continuous recording data positioning and transmission system described below can be referenced to the continuous recording data positioning and transmission method described above according to different components in the system.

[0075] The present invention also provides a continuous recording data positioning and transmission system, such as Figure 5 As shown, it includes: a client module 510, a first query service module 520 and a second query service module 530.

[0076] Specifically, the client module 510 is located in the user workstation and is configured to: generate a query request according to user needs, including information such as the master station side measurement point name, master station side measurement point ID, query start and end time, query data sampling density, etc. defined by the master station; and send the generated query request to the first query service module 520.

[0077] The first query service module 520 is located at the master station side and is configured to: convert the received query request into a query instruction including data information, the data information including the measurement point name, query start and end time and message format defined by the broadband measurement device side; send the query instruction to the second query service module 530 in the broadband measurement device; receive the message sent by the second query service module 530; parse the message to generate measurement point data; and send the measurement point data to the client module 510. As an example, the first query service module 520 can implement reference Figures 2 to 4The various embodiments of the method for positioning and transmitting the continuous recording data on the master station side described in the present invention have been referred to in Figures 2 to 4 Various embodiments of the method for positioning and transmitting the continuous recording data on the master station side have been described in detail, so they will not be repeated here.

[0078] The second query service module 530 is located at the broadband measurement device side and is configured to: parse and extract data information in the received query instruction; calculate the position of the measurement point data within the query start and end time range in the continuous recording data based on the data information and the configuration file stored at the broadband measurement device; extract the measurement point data based on the position of the measurement point data in the continuous recording data; pre-process the measurement point data to generate a message; and send the message to the first query service module 520 of the master station. As an example, the second query service module 530 can implement reference Figures 1 to 3 The various embodiments of the method for positioning and transmitting the continuous recording data on the broadband measuring device side described in the present invention have been referred to in Figures 1 to 3 Various embodiments of the method for positioning and transmitting the continuous recording data on the master station side have been described in detail, so they will not be repeated here.

[0079] In some embodiments, the first query service module 520 is further configured to send transmission exception feedback to the second query service module 530 when it detects that no message is received within a specified time or detects that the message is damaged, so that the second query service module 530 resends the message with the transmission exception and re-receives the message with the transmission exception from the second query service module 530; the second query service module 530 is further configured to resend the message with the transmission exception when it receives the transmission exception feedback sent by the first query service module 520 during the process of sending the message to the first query service module 520.

[0080] In some embodiments, the system further includes a data storage module 540, which is located at the master station side and is used to store the measurement point data received and parsed from the second query service module 530 according to the above embodiment locally at the master station. The data storage module 540 can be an existing master station or can be set based on the present invention. As an example, the data storage module 540 can be an existing time series database locally at the master station. As another example, the data storage module 540 can also be set based on the present invention, and its non-limiting examples can include magnetic storage media such as floppy disks and hard disks, optical storage media such as CD-ROMs and DVDs, and semiconductor memories such as flash memory.

[0081] The continuous recording data positioning and transmission system provided by the present invention accurately locates the position of required data in the continuous recording file and extracts the data based on the configuration file information locally stored in the broadband measuring device. Through a reliable data transmission protocol and application layer breakpoint resumption, it realizes rapid query, precise positioning and efficient and reliable transmission of the recording data in the broadband measuring device, improves the response speed and stability of the system, and through local storage at the master station, reduces the query pressure on back-end equipment such as the broadband measuring device, thereby improving data query efficiency.

[0082] Figure 6 is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Figure 6 As shown, the electronic device may include: a processor 610, a communication interface 620, a memory 630 and a communication bus 640, wherein the processor 610, the communication interface 620 and the memory 630 communicate with each other via the communication bus 640. The processor 610 may call the logic instructions in the memory 630 to execute the positioning and transmission method of the continuous wave recording data on the master station side and / or the broadband measurement device side as described above.

[0083] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0084] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0085] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for positioning and transmitting continuous wave recording data, applied to a broadband measurement device, characterized in that: include: Receiving a query instruction sent by the master station, parsing and extracting data information in the query instruction, the data information including the measuring point name, query start and end time and message format, the query instruction is generated by the master station according to the query request sent by the client; Based on the data information and the configuration file stored in the broadband measurement device, calculating the position of the measurement point data within the range of the query start and end time in the continuous recording data; Extracting the measuring point data based on the position of the measuring point data in the continuous wave recording data; Preprocessing the measuring point data to generate a message; and The message is sent to the master station, so that the master station parses the message to generate the measurement point data and sends the measurement point data to the client.

2. The method according to claim 1, characterized in that Further including: In the process of sending the message to the master station, when a transmission abnormality feedback sent by the master station is received, the message with the transmission abnormality is resent.

3. The method according to claim 1 or 2, characterized in that: Further including: The message is sent to the master station, so that the master station parses the message to generate the measuring point data and stores the measuring point data locally at the master station.

4. The method according to claim 1 or 2, characterized in that: The preprocessing includes organizing data and packaging data; The organizing data includes organizing the measuring point data according to the time sequence and the measuring point names; and The packaging of data includes packaging data according to the message format, and the message format is a JSON format or a binary format.

5. A method for positioning and transmitting continuous wave recording data, applied to a master station, characterized in that: include: Converting the query request received from the client into a query instruction including data information, and sending the query instruction to the broadband measurement device, wherein the data information includes the measurement point name, query start and end time, and message format; receiving a message sent by the broadband measurement device; parsing the message to generate measurement point data; and The measuring point data is sent to the client.

6. The method according to claim 5, characterized in that Further including: When it is detected that no message is received within the specified time or that the message is damaged, a transmission abnormality feedback is sent to the broadband measurement device, so that the broadband measurement device resends the message with the transmission abnormality and re-receives the message with the transmission abnormality.

7. The method according to claim 5 or 6, characterized in that: Further including: The measuring point data is stored locally at the master station.

8. A positioning and transmission system for continuous wave recording data, characterized in that: include: The client module is located in the user workstation and is configured to generate query requests according to user needs; The first query service module, located in the main station, is configured as follows: The query request is converted into a query instruction including data information, wherein the data information includes the measurement point name, query start and end time, and message format, sending the query instruction to a second query service module in the broadband measurement device, receiving a message sent by the second query service module, Parse the message to generate measurement point data, and sending the measurement point data to the client module; and The second query service module is located in the broadband measurement device and is configured to: Parsing and extracting the data information in the query instruction, Based on the data information and the configuration file stored in the broadband measurement device, the position of the measurement point data within the query start and end time range in the continuous recording data is calculated, extracting the measuring point data based on the position of the measuring point data in the continuous wave recording data, Preprocess the measurement point data to generate a message, and The message is sent to the first query service module of the master station.

9. The system according to claim 8, characterized in that The first query service module is further configured to: when it is detected that no message is received within a specified time or that the message is damaged, send a transmission abnormality feedback to the second query service module, so that the second query service module resends the message with the transmission abnormality and re-receives the message with the transmission abnormality; and The second query service module is further configured to: in the process of sending the message to the first query service module, when receiving the transmission abnormality feedback sent by the first query service module, resend the message with the transmission abnormality.

10. The system according to claim 8 or 9, characterized in that The system further comprises a data storage module, the data storage module is located at the main station, and the first query service module is further configured to store the measurement point data in the data storage module.

Images