Data cutting method for underwater acoustic equipment

Abstract

The present invention provides a method for cutting underwater acoustic equipment data, which comprehensively analyzes and reads all types of underwater acoustic equipment data that may be collected, cuts and classifies various types of data according to task time periods, and uniformly converts and reorganizes various types of data as needed. All types of data are associated according to the unique attribute of the timestamp, laying the foundation for subsequent data compilation, joint playback, comprehensive analysis, and data storage. On the technical level, it is necessary to automatically identify, process, cut, and store various types of complex data. Some of the data need to be automatically interpolated and singular values ​​modified. Automatically identify and extract information tags of various types of data, and save the cutting / conversion products according to the storage rules of the five-level folder hierarchy. During the data reading / cutting process, the processing process is displayed in real time to show the processing progress. After the processing is completed, the product type and size are automatically counted, and a cutting processing report is automatically given.

Description

Technical Field

[0001] The invention relates to the reading, conversion and cutting of underwater acoustic equipment data, and mainly relates to an underwater acoustic equipment data cutting method. Background Art

[0002] Sonar equipment data includes a range of sea trial data, including sonar array data, sonar scene data, track data, buoy data, and more. Previously, after the sea trial, each subsystem typically analyzed its own data independently. Without combining and analyzing these various data types to support each other, the analysis results were often incomplete, imprecise, and incorrect. We are now proposing a comprehensive analysis of all possible types of sonar equipment data, such as a ship's sonar array data, sonar scene data, buoy data, shift logs, and detected target reporting data. This will verify whether detected characteristic highlights are the designated sea trial targets, summarize the target's characteristic information, and provide data support for the joint playback of configuration data within the overall sea trial environment. Due to the complex types and various data formats of raw data, in order to meet the needs of data compilation, playback, and comprehensive analysis, we must develop an underwater acoustic equipment data cutting platform to pre-process the complex raw data, automatically extract and cut the raw data, and produce useful data containing key information. The cutting and conversion products are stored in the form of a six-level folder hierarchy to facilitate subsequent secondary processing and data warehousing. Summary of the Invention

[0003] The purpose of the present invention is to overcome the deficiencies in the prior art and to provide a method for cutting underwater acoustic equipment data.

[0004] The object of the present invention is achieved through the following technical solution: A method for cutting underwater acoustic equipment data, comprising the following steps:

[0005] (1) After different types of raw data are pre-sorted, the data is read to obtain the timestamps of various types of raw data and determine the start and end times of various types of raw data;

[0006] (2) Set the subtask time period, i.e., the cutting time period; cut out the product with the cutting time period as the new start and end time without changing the data playback properties, while retaining the original data; convert all times into Unix timestamps, so that all times become values ​​in seconds; use the algorithm of taking the minimum absolute value of the subtraction result of two series to quickly locate the position of the cutting time point on the original data timestamp;

[0007] (3) Cutting preview, check whether the cutting preview image meets the task requirements;

[0008] (4) Cutting data;

[0009] (5) Store / convert data; store the raw data in a folder hierarchy similar to "platform number" - "data type" - "sonar type" - "raw data", and write the corresponding information tags in the folder name in a specific format; when each piece of raw data is automatically read, various corresponding information tags will be obtained from the path where the data is located; the finished cutting product will be stored in a six-layer folder hierarchy of "main task" - "subtask_start and end time" - "platform number_platform type" - "sonar type" - "data type" - "cutting product";

[0010] (6) Generate product statistical reports.

[0011] The beneficial effects of the present invention are:

[0012] 1. The entire cutting process is completed as automatically as possible, and the raw data can be pre-processed efficiently, removing invalid data and reorganizing valid data.

[0013] 2. Establish a six-level folder storage hierarchy in accordance with the military's data processing habits, and divide and classify the cutting products based on sub-task time. This will facilitate the subsequent use of sub-task time spans as data playback project units to playback the sea trials of the task at that time, from the overall task to each level of the platform.

[0014] 3. Automatically generate the intermediate data products required for secondary data processing of other subsystems, and preliminarily form data statistical reports and related data labels, providing technical support for subsequent data storage. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 Schematic diagram of data processing flow;

[0016] Figure 2 A preview of the cutting product is shown. DETAILED DESCRIPTION

[0017] The present invention will be described in detail below with reference to the accompanying drawings and embodiments:

[0018] The present invention proposes a comprehensive analysis of all possible types of underwater acoustic equipment data that may be collected, such as the ship's sonar array data, sonar scene data, buoy data, duty logs, detection target reporting data, etc., to verify whether the detected characteristic bright spots are the established targets of the sea trial, summarize the characteristic information of the targets, and provide data support for the joint playback of configuration data in the overall sea trial environment.

[0019] This invention proposes a method for data segmentation of underwater acoustic equipment. This method segments and categorizes various data types by mission time period and uniformly converts and organizes them as needed. This method associates all data types based on their unique timestamp attribute, paving the way for subsequent data integration, joint playback, comprehensive analysis, and data storage. During the data reading and segmentation process, the processing progress is displayed in real time. After processing is complete, product type and size are automatically counted, and a segmentation report is automatically generated.

[0020] Figure 1 The following is a schematic diagram of the data processing flow of the present invention: First, the collected raw data is manually organized by platform (hull number), with key information tags annotated in the folder or file name. Since these information tags are not recorded in the data, the software cannot automatically perform this processing. The software then reads the raw data, sets the subtask time period, and checks whether the cutting preview image meets the task requirements. After clicking Start Cutting, the software automatically cuts the data and saves the data according to the specified storage rules. Finally, the cutting product and statistical report are generated.

[0021] The present invention compiles corresponding reading algorithms based on different types of raw data, obtains timestamps of various types of data, and determines the start and end times of various types of raw data. When reading data, the software will obtain the start and end times of the raw data based on various data interfaces, and then draw a blue data bar on the display control. The length of the blue bar is determined by the span of the start and end times of the raw data. When reading data, the software will also automatically exclude erroneous data and damaged data, and count the size and number of readable data. Among them, non-cuttable description type files will also be stored in the corresponding path according to the corresponding rules. The writing of data reading algorithms and format conversion algorithms requires the use of data interfaces or customized data interfaces provided by various subsystems. For text data without data interfaces, regular expressions are used to extract keywords and locate data information, thereby realizing the function of automatic reading / conversion.

[0022] Set the subtask time period, that is, the cutting time period; you can enter the cutting time on the keyboard, or click the calendar with the mouse to select the cutting time, or you can directly drag the cutting timeline to determine the cutting time. Cut out the product with the cutting time period as the new start and end time without changing the data playback properties, while retaining the original data. In order to quickly locate the position of the cutting time in the original data timestamp, the present invention can uniformly convert all times into Unix timestamps, so that all times become values ​​in seconds. This avoids the problem of date changes such as leap months, long and short months when the data crosses days, months, and years. Finally, the algorithm of taking the minimum absolute value of the subtraction result of two series is used to quickly locate the position of the cutting time point on the data timestamp.

[0023] To enable the software to automatically identify the information tags for each data type, the present invention stores raw data in a folder hierarchy similar to "Platform Number" - "Data Type" - "Sonar Type" - "Raw Data," with the corresponding information tags written in a specific format within the folder names. As the software automatically reads each piece of raw data, it retrieves the corresponding information tags from the data's path. The finished cutting products are stored in a six-fold folder hierarchy: "Main Task" - "Subtask_Start and End Time" - "Platform Number_Platform Type" - "Sonar Type" - "Data Type" - "Cut Product."

[0024] like Figure 2 As shown, after submitting a cutting task, the software automatically draws a preview of the cutting. Six levels of folders are created according to the specified storage rules. These storage rules can be customized in the software's "Edit Rules" option. To allow for user-defined storage folder hierarchy settings, a storage rule modification interface is included in the software. When a cutting product is generated, the software uses its information tags and customized storage rules to calculate the final storage path, creating a folder hierarchy that meets your needs.

[0025] The present invention specifically designs a progress bar for the reading and cutting process to monitor the cutting progress and record various information tags of the original data, including but not limited to: platform hull number, data start and end time, platform icon type, platform type, data path, data type, data size, etc. During cutting, the processing progress of each data item is displayed, and the total processing progress of all files is displayed. The estimated remaining processing time and total processing time are also given. After cutting is completed, the information tags of the products are counted, a statistical table is drawn, and a cutting statistical report is automatically generated. A statistical report is generated based on the cut products, and the size and type of various data types are counted. An Excel spreadsheet report is automatically generated. The algorithm automatically identifies similar items and merges cells, automatically converts file size units (MB, GB, TB), and automatically fills in the background color. This makes the report display more concise and intuitive.

[0026] It is understandable that for those skilled in the art, any equivalent replacement or change to the technical solution and inventive concept of the present invention should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A method for cutting underwater acoustic equipment data, characterized by: The steps include: (1) After different types of raw data are pre-sorted, the data is read to obtain the timestamps of various types of raw data and determine the start and end times of various types of raw data; (2) Set the subtask time period, i.e., the cutting time period; cut out the product with the cutting time period as the new start and end time without changing the data playback properties, while retaining the original data; convert all times into Unix timestamps, so that all times become values ​​in seconds; use the algorithm of taking the minimum absolute value of the subtraction result of two series to quickly locate the position of the cutting time point on the original data timestamp; (3) Cutting preview; (4) Cutting data; (5) Store / convert data; store the raw data in the folder hierarchy of "platform number" - "data type" - "sonar type" - "raw data", and write the corresponding information tags in the folder name according to the set format; when each piece of raw data is automatically read, various corresponding information tags will be obtained from the path where the data is located; the finished cutting product will be stored in the six-layer folder hierarchy of "main task" - "subtask_start and end time" - "platform number_platform type" - "sonar type" - "data type" - "cutting product"; (6) Generate product statistical reports.

2. The underwater acoustic equipment data cutting method according to claim 1, characterized in that: The writing of raw data reading algorithms and format conversion algorithms relies on the data interfaces provided by each subsystem or custom data interfaces; for text data without data interfaces, regular expressions are used to extract keywords and locate data information, thereby realizing the function of automatic reading / conversion.

3. The underwater acoustic equipment data cutting method according to claim 1, characterized in that: Custom settings for storage folder hierarchy, and an interface for setting storage rule modifications. When a cutting product is generated, its own information tags plus customized storage rules will be used to calculate the final storage path, generating a folder hierarchy that meets the requirements.

4. The underwater acoustic equipment data cutting method according to claim 1, characterized in that: During the data reading / cutting process, the processing process is displayed in real time and the processing progress is reported; after the processing is completed, the product type and size are automatically counted and a cutting processing report is automatically given.

Images