A node seismograph mass data extraction system and extraction method
By using a data management computer and a download computer system, and by using a shot point gather mapping table to determine valid data segments, the problems of low efficiency and storage waste in the extraction of massive amounts of data from nodal seismographs were solved, and efficient data download and storage were achieved.
Patent Information
- Application Number
- CN202011495442.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-12-17
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2040-12-17
AI Technical Summary
Existing methods for extracting data from nodal seismographs are inefficient and consume a lot of storage space, especially in high-precision exploration where downloading massive amounts of data wastes time and storage resources.
A data management computer and a data download computer system are used to determine whether there is valid data in the data files of each node seismograph through the shot point gather mapping table. Only valid data segments are downloaded and stored, reducing the download and storage of invalid data.
It improved data extraction efficiency, reduced storage space usage and download time, and optimized the data processing workflow.
Smart Images

Figure CN112612055B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of geological exploration data extraction, in particular to a node seismograph mass data extraction system and extraction method. Background Art
[0002] Node seismometers are also called cable-free self-storage seismometers. Compared with cable seismometers, there are no transmission lines between node seismometers, which greatly improves the convenience of construction. Each node seismometer records independently, and is synchronized by combining satellite timing and local clock timekeeping. The data is stored in the internal memory of each node seismometer. After the construction is completed, the data stored in the node seismometer is downloaded and recycled, and the valid data is extracted according to the shot point log file of the source system.
[0003] Node seismometers continuously collect data during the construction process, which will generate a large amount of data. Currently, most node seismometers have a battery life of about one month and an internal storage space of 8GB to 64GB. Due to the file system's restrictions on the size of a single file and considerations for data storage security, node seismometers generally use multiple data files for storage during a continuous data collection process. Each node seismometer will generate at least hundreds of single-station data files. Although node seismometers have the convenience of efficient construction, there are still time gaps between shot points due to the movement or switching of the source. At the beginning and end of the operation, there will be a lot of time when effective collection is not carried out. During this time, the node seismometer collects useless data.
[0004] As the requirements for exploration accuracy become higher and higher, the demand for seismic acquisition channels in oil and gas resource exploration continues to increase. The number of field receiving channels has developed from hundreds and thousands to tens of thousands of channels at present. The use of node seismometers in large-scale active source seismic exploration is becoming more and more popular. Node seismometers are usually single-station single-channel, that is, a node seismometer only collects one data channel. Since each node seismometer stores hundreds of single-station data files, the total number of files reaches millions. Extracting effective shot data from these massive single-station data files consumes considerable computing resources.
[0005] When extracting data according to the conventional method, the data files in the node seismometer need to be downloaded to the server first. For this purpose, the server needs to install a large-capacity RAID disk array to save these massive data. Due to the low power consumption characteristics of the node seismometer, its computing power is limited, and the single-station rate during data download is also limited. The data download of a single node seismometer usually takes about several minutes. When thousands of node seismometers are downloaded simultaneously through multiple data download racks, it takes at least several hours to complete the data download. After the download is completed, the data management tool is used to analyze and extract these data to obtain a single shot data file. However, only the data at the time of the blasting is valid, and the rest is useless data. Using this method to extract data not only wastes storage space, but also wastes a lot of time on downloading useless data. Summary of the invention
[0006] The technical problem to be solved by the present invention is to provide a node seismograph mass data extraction system and extraction method, so as to solve the problems that the existing data extraction method is low in efficiency and occupies a large amount of storage space.
[0007] The technical solution of the present invention is:
[0008] A node seismograph mass data extraction system includes a data management computer and a plurality of data download computers, wherein the plurality of node seismographs are divided into a plurality of groups, and the plurality of node seismographs in each group of node seismographs are all connected to a corresponding data download computer for communication, and the plurality of data download computers are all connected to the data management computer for communication;
[0009] The data management computer includes a management module, a parameter input setting module, a host communication module, an information management display module, a parameter database module and a data cache module respectively connected to the management module, and a storage module connected to the data cache module;
[0010] Each data download computer includes a download control module, a node seismograph communication module, a lower communication module and a download information display module respectively connected to the download control module; multiple node seismographs in each group of node seismographs are connected to the node seismograph communication module of a corresponding data download computer, and the lower communication module of each data download computer is communicatively connected to the upper communication module of the data management computer.
[0011] The multiple node seismometers in each group of node seismometers are connected to a corresponding data download rack, and each data download rack is communicatively connected to a corresponding data download computer.
[0012] A method for extracting massive data from node seismographs, specifically comprising the following steps:
[0013] (1) Importing observation system files, node seismometer deployment files and shot point log files through the parameter input setting module of the data management computer, reading and parsing the contents of the above files and saving them in the parameter database module;
[0014] (2) The management module of the data management computer queries the node seismograph number and receiving point number information corresponding to the common shot point gather of each shot point from the parameter database module, establishes a shot point gather mapping table and stores it in the parameter database module;
[0015] (3) The data download computer establishes communication with the data management computer to obtain the record length and the firing time and firing point number of all the firing points;
[0016] (4) The data download computer sequentially obtains the file header information of the data file collected by each node seismograph, and determines whether there is valid blasting data in the data file according to the file start time, file length, single shot record length, and blasting time of each blasting point;
[0017] (5) When there is valid blasting data in the collected data file, the data download computer requests the node seismograph to download the valid data segment in the collected data file, and sends the blasting point number, node seismograph number and valid data segment to the data management computer;
[0018] (6) The data management computer searches the receiving point node seismograph number list of this shot point from the shot point channel set mapping table according to the shot point number, and then searches the receiving point node seismograph number list to find which channel this node seismograph number belongs to. The offset is calculated according to the channel number, the number of bytes per channel, the shot point time, and the data segment time. The storage module writes the data into the single shot data file according to the offset.
[0019] In the step (1), the observation system file includes a shot point file, a receiving point file and a relationship file; the shot point file includes the numbers and coordinate information of all designed shot points; the receiving point file includes the numbers and coordinate information of all designed receiving points; the relationship file includes the receiving point number range corresponding to the designed shot points; the observation system file is parsed and stored in the designed shot point record table, the receiving point record table and the relationship record table respectively, and is saved in the parameter database module.
[0020] In the step (1), the node seismograph deployment file contains the serial number and deployment time information of the node seismograph used by each receiving point when the operation is deployed at this receiving point; the node seismograph deployment file is parsed and stored in the deployment record table and saved in the parameter database module.
[0021] In the step (1), the shot point log file contains the precise firing time of each actual shot point and the shot point number and coordinate information of the firing position; the shot point log file is parsed and stored in the actual shot point record table and saved in the parameter database module.
[0022] In the step (2), the specific steps of the data management computer establishing the shot gather mapping table are:
[0023] a. Query all actual shot point information from the actual shot point record table of the parameter database module;
[0024] b. Check whether these actual shot points are the designed shot points from the designed shot point record table of the parameter database module;
[0025] c. Query the receiving point number range corresponding to each shot point number from the relation record table of the parameter database module;
[0026] d. Query all receiving point numbers that match the receiving point number range corresponding to the above-mentioned shot points from the receiving point record table of the parameter database module;
[0027] e. Find the firing time of the above-mentioned shot point from the deployment record table of the parameter database module, and find the number of the node seismograph used by the receiving point of the above-mentioned receiving point number from the node seismograph deployment file;
[0028] f. Store the shot point information of each shot point, the node seismograph number list corresponding to the shot point, and the receiving point information list into the shot point gather mapping table.
[0029] The data in the shot point gather mapping table is a two-level Map data structure, namely Map (shot point information, Map (node seismograph number, receiving point information)); wherein the key of the first-level Map is the shot point information, and the value is the second-level Map data, the key of the second-level Map data is the node seismograph number, and the value is the receiving point information; the shot point information includes the shot point number, the firing time, and the shot point coordinates, and the receiving point information includes the receiving point number, the track number, and the receiving point coordinates; when querying data from the shot point gather mapping table, the shot point information and the node seismograph number two-level query conditions are used to obtain the receiving point information corresponding to this node seismograph.
[0030] In the step (4), the step in which the data download computer determines whether there is valid blasting data in the collected data file is as follows: assuming that the blasting time of shot point x is Tx, the record length is Lx, the file start time is T1, and the file length is L1, then the condition for the file to contain data of shot point x is: (Tx>=T1&&Tx<=T1+L1)||(Tx+Lx>=T1&&Tx+Lx<=T1+L1); when there is a valid data segment of the above-mentioned shot point x in the collected data file, the starting position of the valid data segment in the file is Max(Tx,T1), and the ending position is Min(Tx+Lx,T1+L1).
[0031] In the step (6), the specific steps of calculating the offset by the data management computer are as follows: assuming that the firing time of the single-shot data file is Tx, the recording time of each channel is Lx, the sampling rate is sr, each sampling point occupies 4 bytes, the starting time of the data segment is Tm, the data segment length is Lm, this data segment is the data of the kth channel in the single-shot data file, the file header length is SizeH, the number of channel header bytes is SizeT, and the offset in the single-shot data file is Offset=SizeH+(k-1)*(SizeT+Lx*sr*4)+(Tm-Tx)*sr*4.
[0032] Advantages of the present invention:
[0033] The present invention determines whether there is valid blasting data in each single-station data file by a data download computer during data download, and only downloads valid data segments according to their positions in the files, which can greatly reduce the amount of data downloaded, avoid wasting time on downloading invalid data, and avoid wasting time and storage space on storing invalid data. The present invention can reduce the total time consumption of data downloading and data extraction by synchronizing data downloading and data storage, and improve the extraction efficiency of mass data of node seismographs. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 It is a structural block diagram of the node seismograph mass data extraction system of the present invention.
[0035] Figure 2 It is a principle block diagram of the node seismograph mass data extraction system of the present invention.
[0036] Figure 3 It is a schematic diagram of the node seismograph single station data file.
[0037] Figure 4 It is a schematic diagram of a single-shot data file stored in a data management computer. DETAILED DESCRIPTION
[0038] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0039] See Figure 1 , a node seismograph mass data extraction system, comprising a data management computer 1 and a plurality of data download computers 2, the plurality of node seismographs are divided into a plurality of groups, the plurality of node seismographs in each group of node seismographs are connected to a corresponding data download rack 3, each data download rack 3 is connected to a corresponding data download computer 2 for communication, and the plurality of data download computers 2 are connected to the data management computer 1 for communication;
[0040] See Figure 2 The data management computer 1 includes a management module 11, a parameter input setting module 12, an upper communication module 13, an information management display module 14, a parameter database module 15 and a data cache module 16 respectively connected to the management module 11, and a storage module 17 connected to the data cache module 16; the management module 11 is used to centrally manage the valid data segments and related information; the parameter input setting module 12 is used to import the observation system file, the gun point log file, the deployment file, and set some other parameters for extracting data; the upper communication module 13 is used to communicate with multiple data download computers 2, and the parameter file input by the parameter input setting module 12 is sent to each data download computer 2, and the valid data segment and related information are received from the data download computer 2; the information management display module 14 is used to display the information of the imported file and the data extraction information; the parameter database module 15 is used to save and query the various parameters imported by the parameter input setting module; the data cache module 16 is used to cache the valid data segment and related information to avoid the storage module 17 from being unable to store in time when the instantaneous large amount of data is large, resulting in data loss; the storage module 17 obtains the valid data segment and related information and stores the valid data segment in the single gun data file according to the correct position;
[0041] Each data download computer 2 includes a download control module 21, a node seismograph communication module 22, a lower communication module 23 and a download information display module 24 respectively connected to the download control module 21; the data download racks 3 are connected to the node seismograph communication module 22 of a corresponding data download computer, and the lower communication module 23 of each data download computer is communicatively connected to the upper communication module 13 of the data management computer; the download control module 21 is used to control the data download process, send control commands to the node seismograph through the node seismograph communication module 22, receive download data, and upload the downloaded valid data segments and related information to the data management computer 1 through the lower communication module 23; the download information display module 24 is used to display the node seismograph information and download status.
[0042] A method for extracting mass data from a node seismograph comprises the following steps:
[0043] (1) Import the observation system file, node seismograph deployment file and shot point log file through the parameter input setting module 12 of the data management computer, read and parse the contents of the above files and save them in the parameter database module data cache module 16; wherein the observation system file includes a shot point file, a receiving point file and a relationship file; the shot point file includes the number and coordinate information of all designed shot points; the receiving point file includes the number and coordinate information of all designed receiving points; the relationship file includes the receiving point number range corresponding to the designed shot point; the node seismograph deployment file includes the number and deployment time information of the node seismograph used by a certain receiving point when the operation is deployed at this receiving point; the shot point log file includes the precise blasting time of each actual shot point and the shot point number and coordinate information of the blasting position; the shot point file, the receiving point file and the relationship file of the observation system file are parsed and stored in the designed shot point record table, the receiving point record table and the relationship record table respectively, and stored in the parameter database module; the node seismograph deployment file is parsed and stored in the deployment record table and stored in the parameter database module; the shot point log file is parsed and stored in the actual shot point record table and stored in the parameter database module;
[0044] (2) The management module 11 of the data management computer queries the node seismograph number and receiving point number information corresponding to the common shot point gather of each shot point from the parameter database module 15, establishes a shot point gather mapping table and stores it in the parameter database module 15;
[0045] (3) The data download computer 2 establishes communication with the data management computer 1 to obtain the record length and the firing time and firing point number of all the firing points;
[0046] (4) The data download computer 2 sequentially obtains the file header information of the data file collected by the seismograph of each node, and determines whether there is valid blasting data in the data file according to the file start time, file length, single shot record length, and blasting time of each blasting point;
[0047] (5) When there is valid blasting data in the collected data file, the data download computer 2 requests the node seismograph to download the valid data segment in the collected data file, and sends the blasting point number, node seismograph number and valid data segment to the data management computer 1;
[0048] (6) The data management computer 2 searches the receiving point node seismograph number list of this shot point from the shot point track set mapping table according to the shot point number, and then searches the receiving point node seismograph number list to find which channel this node seismograph number belongs to. The offset is calculated according to the channel sequence number, the number of bytes per channel, the shot point time, and the data segment time. The storage module 17 writes the data into the single shot data file according to the offset.
[0049] In step (2), the specific steps of the data management computer 1 establishing the shot gather mapping table are:
[0050] a. Query all actual shot point information from the actual shot point record table of the parameter database module;
[0051] b. Check whether these actual shot points are the designed shot points from the designed shot point record table of the parameter database module;
[0052] c. Query the receiving point number range corresponding to each shot point number from the relation record table of the parameter database module;
[0053] d. Query all receiving point numbers that match the receiving point number range corresponding to the above-mentioned shot points from the receiving point record table of the parameter database module;
[0054] e. Find the firing time of the above-mentioned shot point from the deployment record table of the parameter database module, and find the number of the node seismograph used by the receiving point of the above-mentioned receiving point number from the node seismograph deployment file;
[0055] f. Store the shot point information of each shot point, the node seismograph number list corresponding to the shot point, and the receiving point information list into the shot point gather mapping table.
[0056] Since the same receiving point may use multiple node seismometers for collection in one operation, that is, there are multiple records with the same receiving point number but different deployment times in the node seismometer deployment file, so when searching for a node seismometer used by a certain receiving point in the node seismometer deployment file, it is necessary to specify the blasting time. If there are multiple node seismometer records at the receiving point number in the node seismometer deployment file, the deployment record with a deployment time less than the blasting time and the latest deployment time is the correct one.
[0057] The data in the shot point gather mapping table is a two-level Map data structure, namely Map (shot point information, Map (node seismograph number, receiving point information)); wherein, the key of the first-level Map is the shot point information, and the value is the second-level Map data, the key of the second-level Map data is the node seismograph number, and the value is the receiving point information; the shot point information includes the shot point number, firing time, and shot point coordinates, and the receiving point information includes the receiving point number, track number, and receiving point coordinates; when querying data from the shot point gather mapping table, the shot point information and node seismograph number two-level query conditions are used to obtain the receiving point information corresponding to this node seismograph.
[0058] See Figure 3 During each long-term continuous acquisition process, the node seismograph will save multiple single-station data files with continuous time. Each file has a file header, which is used to record the data start time, sampling rate and other information of this file. In each single-station data file, there are multiple discontinuous valid data segments, which record the seismic signal of this receiving point. Other data except the valid data segment is invalid data. The data segment has a certain start time and data segment length. Each valid data segment corresponds to a shot point, and the data segment length is the single shot record length. The valid data segment may be divided into two continuous single-station data files, so the start time of the data segment needs to be known when storing data.
[0059] In step (4), the data download computer 2 determines whether there is valid blasting data in the acquisition data file as follows: assuming that the blasting time of shot point x is Tx, the record length is Lx, the file start time is T1, and the file length is L1, the condition for the file to contain data of shot point x is: (Tx>=T1&&Tx<=T1+L1)||(Tx+Lx>=T1&&Tx+Lx<=T1+L1); when there is a valid data segment of the above-mentioned shot point x in the acquisition data file, the starting position of the valid data segment in the file is Max(Tx,T1), and the ending position is Min(Tx+Lx,T1+L1).
[0060] See Figure 4 A single-shot data file has a file header, and each subsequent data track is preceded by a track header. The number of bytes in the file header and track header is fixed, and the length of each data track is the same.
[0061] In step (6), the specific steps for the data management computer 1 to calculate the offset are: assuming that the firing time of the single-shot data file is Tx, the recording time of each channel is Lx, the sampling rate is sr, each sampling point occupies 4 bytes, the starting time of the data segment is Tm, the data segment length is Lm, this data segment is the data of the kth channel in the single-shot data file, the file header length is SizeH, the number of header bytes is SizeT, and the offset in the single-shot data file is Offset=SizeH+(k-1)*(SizeT+Lx*sr*4)+(Tm-Tx)*sr*4.
[0062] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. A node seismograph mass data extraction system, characterized in that: It includes a data management computer and multiple data download computers, multiple node seismographs are divided into multiple groups, multiple node seismographs in each group of node seismographs are connected to a corresponding data download computer for communication, and the multiple data download computers are connected to the data management computer for communication; The data management computer includes a management module, a parameter input setting module, a host communication module, an information management display module, a parameter database module and a data cache module respectively connected to the management module, and a storage module connected to the data cache module; Each data download computer includes a download control module, a node seismograph communication module, a lower communication module and a download information display module respectively connected to the download control module; multiple node seismographs in each group of node seismographs are connected to the node seismograph communication module of a corresponding data download computer, and the lower communication module of each data download computer is connected to the upper communication module of the data management computer for communication; The extraction method of the node seismograph mass data extraction system specifically includes the following steps: (1) Importing observation system files, node seismometer deployment files and shot point log files through the parameter input setting module of the data management computer, reading and parsing the contents of the above files and saving them in the parameter database module; (2) The management module of the data management computer queries the node seismograph number and receiving point number information corresponding to the common shot point gather of each shot point from the parameter database module, establishes a shot point gather mapping table and stores it in the parameter database module; (3) The data download computer establishes communication with the data management computer to obtain the record length and the firing time and firing point number of all the firing points; (4) The data download computer sequentially obtains the file header information of the data file collected by each node seismograph, and determines whether there is valid blasting data in the data file according to the file start time, file length, single shot record length, and blasting time of each blasting point; (5) When there is valid blasting data in the collected data file, the data download computer requests the node seismograph to download the valid data segment in the collected data file, and sends the blasting point number, node seismograph number and valid data segment to the data management computer; (6) The data management computer searches the receiving point node seismograph number list of this shot point from the shot point channel set mapping table according to the shot point number, and then searches the receiving point node seismograph number list to find which channel this node seismograph number belongs to. The offset is calculated according to the channel number, the number of bytes per channel, the shot point time, and the data segment time. The storage module writes the data into the single shot data file according to the offset.
2. A node seismograph mass data extraction system according to claim 1, characterized in that: The multiple node seismometers in each group of node seismometers are connected to a corresponding data download rack, and each data download rack is communicatively connected to a corresponding data download computer.
3. A node seismograph mass data extraction system according to claim 1, characterized in that: In the step (1), the observation system file includes a shot point file, a receiving point file and a relationship file; the shot point file includes the numbers and coordinate information of all designed shot points; the receiving point file includes the numbers and coordinate information of all designed receiving points; the relationship file includes the receiving point number range corresponding to the designed shot points; the observation system file is parsed and stored in the designed shot point record table, the receiving point record table and the relationship record table respectively, and is saved in the parameter database module.
4. A node seismograph mass data extraction system according to claim 3, characterized in that: In the step (1), the node seismograph deployment file contains the serial number and deployment time information of the node seismograph used by each receiving point when the operation is deployed at this receiving point; the node seismograph deployment file is parsed and stored in the deployment record table and saved in the parameter database module.
5. A node seismograph mass data extraction system according to claim 4, characterized in that: In the step (1), the shot point log file contains the precise firing time of each actual shot point and the shot point number and coordinate information of the firing position; the shot point log file is parsed and stored in the actual shot point record table and saved in the parameter database module.
6. A node seismograph mass data extraction system according to claim 5, characterized in that: In the step (2), the specific steps of the data management computer establishing the shot gather mapping table are: a. Query all actual shot point information from the actual shot point record table of the parameter database module; b. Check whether these actual shot points are the designed shot points from the designed shot point record table of the parameter database module; c. Query the receiving point number range corresponding to each shot point number from the relation record table of the parameter database module; d. Query all receiving point numbers that match the receiving point number range corresponding to the above-mentioned shot points from the receiving point record table of the parameter database module; e. Find the firing time of the above-mentioned shot point from the deployment record table of the parameter database module, and find the number of the node seismograph used by the receiving point of the above-mentioned receiving point number from the node seismograph deployment file; f. Store the shot point information of each shot point, the node seismograph number list corresponding to the shot point, and the receiving point information list into the shot point gather mapping table.
7. A node seismograph mass data extraction system according to claim 1, characterized in that: The data in the shot point gather mapping table is a two-level Map data structure, namely Map (shot point information, Map (node seismograph number, receiving point information)); wherein the key of the first-level Map is the shot point information, and the value is the second-level Map data, the key of the second-level Map data is the node seismograph number, and the value is the receiving point information; the shot point information includes the shot point number, the firing time, and the shot point coordinates, and the receiving point information includes the receiving point number, the track number, and the receiving point coordinates; when querying data from the shot point gather mapping table, the shot point information and the node seismograph number two-level query conditions are used to obtain the receiving point information corresponding to this node seismograph.
8. A node seismograph mass data extraction system according to claim 1, characterized in that: In the step (4), the step in which the data download computer determines whether there is valid blasting data in the collected data file is as follows: assuming that the blasting time of shot point x is Tx, the record length is Lx, the file start time is T1, and the file length is L1, then the condition for the file to contain data of shot point x is: (Tx>=T1&&Tx<=T1+L1)||(Tx+Lx>=T1&&Tx+Lx<=T1+L1); when there is a valid data segment of the above-mentioned shot point x in the collected data file, the starting position of the valid data segment in the file is Max(Tx,T1), and the ending position is Min(Tx+Lx,T1+L1).
9. A node seismograph mass data extraction system according to claim 1, characterized in that: In the step (6), the specific steps of calculating the offset by the data management computer are as follows: assuming that the firing time of the single-shot data file is Tx, the recording time of each channel is Lx, the sampling rate is sr, each sampling point occupies 4 bytes, the starting time of the data segment is Tm, the data segment length is Lm, this data segment is the data of the kth channel in the single-shot data file, the file header length is SizeH, the number of channel header bytes is SizeT, and the offset in the single-shot data file is Offset=SizeH+(k-1)*(SizeT+Lx*sr*4)+(Tm-Tx)*sr*4.
