Seismic exploration project data online migration system, method, equipment and medium

Abstract

The present invention belongs to the field of seismic exploration technology and discloses a system, method, device, and medium for online migration of seismic exploration project data. The system comprises a data file server and a seismic data migration client. The data file server is configured to respond to requests from the seismic data migration client for data directory structure information, database data, and disk file data, convert the data into corresponding byte streams, and transmit them to the seismic data migration client. The seismic data migration client is configured to receive the corresponding byte streams sent by the data file server and complete data migration for the seismic exploration project. The present invention is applicable to migrating data for seismic exploration projects and solves the problem of data non-interoperability and migration difficulties among multiple projects during seismic exploration.

Description

Technical Field

[0001] The present invention belongs to the technical field of seismic exploration, and relates to a system, method, equipment and medium for online migration of seismic exploration project data. Background Art

[0002] Seismic exploration project data is a systematic process that generates a variety of data, including seismic data, horizons, faults, and mapping data for interpretation projects. This vast array of data is stored separately within a single project, resulting in large volumes and diverse data types within a single seismic exploration project.

[0003] Currently, data from seismic exploration projects is often stored in a combination of databases and disk files. Regularized data, such as observation system and seismic head data, is often stored in databases, while larger, less structured data, such as common seismic data volumes, is often stored in disk files. While this data storage method improves data readability, as exploration progresses, the data volume within a single seismic exploration project is growing into petabytes. With this increase in data volume, existing data storage methods for some seismic exploration projects are no longer sufficient for this massive data storage, necessitating a storage replacement to migrate seismic exploration project data. Furthermore, with changes to GeoEast models and version upgrades, data from older seismic exploration projects also needs to be migrated to new projects. Therefore, research on seismic exploration project data migration methods is crucial to address the challenges of data incompatibility and migration difficulties across multiple projects during seismic exploration. Summary of the Invention

[0004] The purpose of the present invention is to provide an online migration system for seismic exploration project data, which can realize the mutual migration and efficient flow of seismic exploration project data in a network interconnected environment;

[0005] Another object of the present invention is to provide a method, device and storage medium for online migration of seismic exploration project data.

[0006] In order to achieve the above-mentioned purpose, the present invention adopts the following technical solutions:

[0007] An online migration system for seismic exploration project data, comprising: a data file server and a seismic data migration client;

[0008] The data file server is used to read the data directory structure information of the seismic exploration project and store it in the project structure file; respond to the seismic data migration client's request for data directory structure information, read the project structure file, convert it into a directory information byte stream and send it to the seismic data migration client; respond to the seismic data migration client's request for disk file data, read the corresponding disk file data, convert it into a disk file byte stream and send it to the seismic data migration client; respond to the seismic data migration client's request for database data, read the database data, convert it into a database data byte stream and send it to the seismic data migration client;

[0009] The seismic data migration client is used to request the data directory structure information of the seismic exploration project from the data file server and receive the directory information byte stream sent by the data file server; request the corresponding disk file data from the data file server based on the received data directory structure information and receive the disk file byte stream sent by the data file server; and request database data from the data file server and receive the database data byte stream sent by the data file server;

[0010] The database data includes database model information and database physical table data, and the database data byte stream includes database model data byte stream and database physical table data byte stream.

[0011] As a limitation, the data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port and a progress controller;

[0012] The server disk file processing handle is used to read the data directory structure information of the seismic exploration project, store the data directory structure information in the project structure file, and record the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; it is also used to read the project structure file and convert it into a directory information byte stream and transmit it to the server IO port when processing the data directory structure information request of the seismic data migration client; the server disk file processing handle is also used to read the disk file data on the data file server and convert the disk file data into a disk file byte stream and transmit it to the server IO port when processing the disk file data request of the seismic data migration client;

[0013] The data model parser is used to parse the corresponding database model information in the database data when processing the database model information in the database data requested by the seismic data migration client, and convert it into a database model data byte stream and transmit it to the server IO port; the data model parser is also used to parse the corresponding database physical table data in the database data when processing the database physical table data in the database data requested by the seismic data migration client, and convert it into a database physical table data byte stream and transmit it to the server IO port;

[0014] The task scheduler is used to respond to the request tasks of the seismic data migration client transmitted by the server IO port in real time, monitor and schedule the busy and idle status of the current working thread in real time, and assign the request tasks of the seismic data migration client to the idle working thread when there is an idle working thread; based on the data type of the request, the server disk file processing handle is adaptively called within the working thread to read the project structure file or the corresponding disk file data, or the data model parser is called to parse the database data, and the server IO port is called to send the corresponding byte stream to the seismic data migration client;

[0015] The server IO port includes a network SOCKET, which is used for communication connection with the seismic data migration client. After the directory information byte stream, disk file byte stream or database data byte stream sent by the server disk file processing handle enters the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol, thereby realizing data connectivity between the data file server and the seismic data migration client;

[0016] The progress controller is used to count the progress of the seismic exploration project migration operation and echo the migration operation progress information to the seismic data migration client in real time through the server IO port.

[0017] As a further limitation, the process by which the data model parser parses the corresponding database physical table data in the database data is as follows:

[0018] Establish a connection with the database and initialize the database operation handle;

[0019] Based on the field names of the database physical table data requested by the seismic data migration client, the SQL statement for data query is assembled according to the field names, the SQL statement is executed through the database operation handle, and the queried data information is sent to the data file server;

[0020] After traversing and executing all the database physical table data, the database operation handle is released, and the process of the data model parser parsing the database physical table data is completed.

[0021] As a further limitation, the data file server also includes a breakpoint resume transmission scheduling system;

[0022] The breakpoint resume scheduling system is used to load the breakpoint record file. After the server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path when the server disk file processing handle processes the task, the size of each disk file byte stream read into the network SOCKET, and the original size of the disk file data. The breakpoint record file is updated in real time to control the data migration process of the seismic exploration project. After restarting under abnormal system conditions, the breakpoint controller automatically loads the breakpoint record file and compares the disk file byte stream size of each record with the original size of the disk file data. When the two sizes are consistent, the file processing is skipped. When the two sizes are inconsistent, it is a system abnormality point. The task scheduler is used to call the server disk file processing handle again from the system abnormality point to read the subsequent disk file data, thereby realizing the recovery of the disk file data migration process in the seismic exploration project.

[0023] As a second limitation, the information contained in the database model information includes: data schema information, data table information, data index information, and data uniqueness information.

[0024] As a third limitation, the seismic data migration client includes a client data file processing handle, a client IO port and a model reconstructor;

[0025] The client data file processing handle is used to request the data file server to send the directory structure information of the seismic exploration project data through the client IO port, and store the directory structure information in the local project structure file according to the directory information byte stream sent by the data file server; read the local project structure file and parse the attributes of the nodes in the file, and request the corresponding disk file data in the data file server according to the attributes of the nodes. After receiving the disk file byte stream of the relevant disk file data sent by the data file server, the client data file processing handle writes the disk file byte stream into the corresponding file created in the disk directory of the seismic data migration client and sets the corresponding file permissions;

[0026] The client IO port is used to establish a connection and data communication with the data file server through the SOCKET protocol, and receive the relevant byte stream sent by the data file server;

[0027] The model reconstructor is used to request the database model information in the database data from the data file server through the client IO port, store the obtained database model data byte stream into the local data table structure XML file, and rebuild the database structure model through the database model data byte stream; the model reconstructor is also used to request the database physical table data from the data file server through the client IO port, and write the obtained database physical table data byte stream into the physical table corresponding to the local project database of the seismic data migration client in real time.

[0028] As a further limitation, the model reconstructor is used to request database physical table data from the data file server through the client IO port, and write the obtained database physical table data byte stream into the physical table corresponding to the local project database of the seismic data migration client in real time. The specific process is as follows:

[0029] Establish a connection with the local project database of the seismic data migration client and initialize the local project database operation handle;

[0030] Read the local data table structure XML file in the model reconstructor and obtain all the data table information in the file;

[0031] Traverse all data tables, and for each data table, request the corresponding database physical table data from the data file server through the client IO port, and parse the field name of the database physical table data;

[0032] Splice the SQL statement for data insertion based on all the field names of the corresponding database physical table data, use the local project database operation handle to execute the SQL statement, and insert the parsed field names of the database physical table data into the corresponding physical table of the local project database in sequence;

[0033] After traversing all data tables and migrating physical database data, the local project database operation handle is released.

[0034] The present invention also provides a method for online migration of seismic exploration project data, which uses the above-mentioned online migration system for seismic exploration project data. The method includes:

[0035] Read the data directory structure information of the seismic exploration project through the data file server and store it in the project structure file; respond to the seismic data migration client's request for data directory structure information, read the project structure file, convert it into a directory information byte stream and send it to the seismic data migration client; respond to the seismic data migration client's request for disk file data, read the corresponding disk file data, convert it into a disk file byte stream and send it to the seismic data migration client; respond to the seismic data migration client's request for database data, read the database data, convert it into a database data byte stream and send it to the seismic data migration client;

[0036] The seismic data migration client requests the data directory structure information of the seismic exploration project from the data file server and receives the directory information byte stream sent by the data file server; based on the received data directory structure information, the client requests the corresponding disk file data from the data file server and receives the disk file byte stream sent by the data file server; the client requests database data from the data file server and receives the database data byte stream sent by the data file server;

[0037] The database data includes database model information and database physical table data, and the database data byte stream includes database model data byte stream and database physical table data byte stream.

[0038] As a limitation, the data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port and a progress controller; the server IO port includes a network SOCKET;

[0039] The data directory structure information of the seismic exploration project is read through the data file server and stored in the project structure file; in response to the seismic data migration client's request for data directory structure information, the project structure file is read and converted into a directory information byte stream and sent to the seismic data migration client; in response to the seismic data migration client's request for disk file data, the corresponding disk file data is read and converted into a disk file byte stream and sent to the seismic data migration client; in response to the seismic data migration client's request for database data, the database data is read and converted into a database data byte stream and sent to the seismic data migration client. The specific process is as follows:

[0040] The data directory structure information of the seismic exploration project is read through the server disk file processing handle, and the data directory structure information is stored in the project structure file. For different types of exploration data, the exploration data type and exploration data file permission information are recorded in the project structure file respectively; when processing the data directory structure information requested by the seismic data migration client, the project structure file is read and converted into a directory information byte stream and transmitted to the server IO port; when processing the disk file data requested by the seismic data migration client, the disk file data on the data file server is read through the server disk file processing handle, and the disk file data is converted into a disk file byte stream and transmitted to the server IO port;

[0041] When processing the database model information in the database data requested by the seismic data migration client, the data model parser parses the corresponding database model information in the database data, converts it into a database model data byte stream and transmits it to the server IO port; when processing the database physical table data in the database data requested by the seismic data migration client, the data model parser parses the corresponding database physical table data in the database data, converts it into a database physical table data byte stream and transmits it to the server IO port;

[0042] The task scheduler responds to the request task of the seismic data migration client transmitted by the server IO port in real time, monitors and schedules the busy and idle status of the current working thread in real time, and assigns the request task of the seismic data migration client to the idle working thread when there is an idle working thread; within the working thread, based on the requested data type, the server disk file processing handle is adaptively called to read the project structure file or the corresponding disk file data, or the data model parser is called to parse the database data, and the server IO port is called to send the corresponding byte stream to the seismic data migration client;

[0043] The server is connected to the seismic data migration client through the IO port of the server. After the directory information byte stream, disk file byte stream or database data byte stream sent by the server disk file processing handle enters the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol, thereby realizing data connectivity between the data file server and the seismic data migration client.

[0044] The progress controller is used to count the progress of the seismic exploration project migration operation, and the migration operation progress information is echoed to the seismic data migration client in real time through the server IO port.

[0045] As a further limitation, the process of the data model parser parsing the corresponding database physical table data in the database data is as follows:

[0046] Establish a connection with the database and initialize the database operation handle;

[0047] Based on the field names of the database physical table data requested by the seismic data migration client, the SQL statement for data query is assembled according to the field names, the SQL statement is executed through the database operation handle, and the queried data information is sent to the data file server;

[0048] After traversing and executing all the database physical table data, the database operation handle is released, and the process of the data model parser parsing the database physical table data is completed.

[0049] As a further limitation, the data file server also includes a breakpoint resume transmission scheduling system;

[0050] The online migration method of seismic exploration project data starts by loading the breakpoint record file through the breakpoint resume scheduling system. After the server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path, the byte stream size of each disk file read into the network SOCKET and the original size of the disk file data when the server disk file processing handle processes the task. The breakpoint record file is updated in real time to control the seismic exploration project data migration process. After the system is restarted under abnormal conditions, the breakpoint controller automatically loads the breakpoint record file and compares the disk file byte stream size of each record with the original size of the disk file data. When the two sizes are consistent, the file processing is skipped. When the two sizes are inconsistent, it is a system abnormal point. The task scheduler is used to call the server disk file processing handle again from the system abnormal point to read the subsequent disk file data, thereby realizing the recovery of the disk file data migration process in the seismic exploration project.

[0051] The present invention also provides an application of the above-mentioned online migration method for seismic exploration project data in seismic exploration project data migration.

[0052] The present invention also provides a computer device, which includes a processor and a memory, wherein the memory is used to store at least one computer program, and the at least one computer program is loaded by the processor and executes the above-mentioned online migration method for seismic exploration project data.

[0053] The present invention also provides a storage medium, which is used to store at least one computer program, and the at least one computer program is used to execute the above-mentioned online migration method for seismic exploration project data.

[0054] Due to the adoption of the above technical solution, the present invention has achieved the following technical advancements compared with the prior art:

[0055] The online migration system for seismic exploration project data of the present invention can realize the mutual migration of seismic exploration project data in different network-connected production environments, and further realize the mutual migration and efficient flow of data on different operating system platforms, such as the migration of Linux seismic exploration project data to Windows projects, breaking through data barriers and solving the data island problem to a certain extent; the online migration system for seismic exploration project data of the present invention can be applied to any stage of seismic exploration production, and the integration of relevant software of this system can realize the efficient flow of seismic exploration project data.

[0056] In summary, the present invention is applicable to migrating seismic exploration project data, and solves the problem of data incompatibility and difficulty in migration of multiple projects during the seismic exploration process. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 FIG2 is a structural block diagram of an online migration system for seismic exploration project data in Example 1 of the present invention;

[0058] Figure 2 FIG2 is a block diagram of a data file server in Embodiment 1 of the present invention;

[0059] Figure 3 The figure shows a structural block diagram of the seismic data migration client in Example 1 of the present invention;

[0060] Figure 4 FIG2 is a flowchart of the overall method of online migration of seismic exploration project data in Example 2 of the present invention;

[0061] Figure 5 FIG2 is a schematic diagram showing the structure of a computer device in Embodiment 2 of the present invention;

[0062] Figure 6 The figure shows a schematic diagram of the structure of the computer storage medium in embodiment 2 of the present invention. DETAILED DESCRIPTION

[0063] In order to better explain the present invention and facilitate understanding, the present invention is described in detail below through specific implementation methods in conjunction with the accompanying drawings.

[0064] Example 1

[0065] This embodiment is an online migration system for seismic exploration project data, which is applicable to data migration of seismic exploration projects of various exploration software developed based on the GeoEast-iEco platform, such as GeoEast geophysical software.

[0066] In this embodiment, the seismic exploration project data that needs to be migrated is stored in the form of a joint database and disk files. The database can be a PostgreSQL database. When implementing the mutual migration of seismic exploration project data in different production environments, it is necessary to migrate the database data to the local database of the seismic data migration client, and migrate the disk file data to the corresponding file created in the disk directory of the seismic data migration client.

[0067] This embodiment is described in detail below.

[0068] like Figure 1 As shown, this embodiment includes: a data file server and a seismic data migration client.

[0069] The data file server is used to read the data directory structure information of the seismic exploration project and store it in the project structure file; respond to the seismic data migration client's request for data directory structure information, read the project structure file, convert it into a directory information byte stream and send it to the seismic data migration client; respond to the seismic data migration client's request for disk file data, read the corresponding disk file data, convert it into a disk file byte stream and send it to the seismic data migration client; respond to the seismic data migration client's request for database data, read the database data, convert it into a database data byte stream and send it to the seismic data migration client;

[0070] The seismic data migration client is used to request the data directory structure information of the seismic exploration project from the data file server and receive the directory information byte stream sent by the data file server; request the corresponding disk file data from the data file server based on the received data directory structure information and receive the disk file byte stream sent by the data file server; and request database data from the data file server and receive the database data byte stream sent by the data file server.

[0071] Among them, the database data includes database model information and database physical table data, and the database data byte stream includes database model data byte stream and database physical table data byte stream; the information contained in the database model information includes: data schema information, data table information, data index information, and data uniqueness information.

[0072] like Figure 2 As shown, the data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port and a progress controller.

[0073] Among them, the server disk file processing handle is used to read the data directory structure information of the seismic exploration project, store the data directory structure information in the project structure file, and record the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; it is also used to read the project structure file and convert it into a directory information byte stream and transmit it to the server IO port when processing the seismic data migration client requesting data directory structure information; the server disk file processing handle is also used to read the disk file data on the data file server and convert the disk file data into a disk file byte stream and transmit it to the server IO port when processing the seismic data migration client requesting disk file data.

[0074] The data model parser is used to parse the corresponding database model information in the database data when processing the database model information in the database data requested by the seismic data migration client, and convert it into a database model data byte stream and transmit it to the server IO port; the data model parser is also used to parse the corresponding database physical table data in the database data when processing the database physical table data in the database data requested by the seismic data migration client, and convert it into a database physical table data byte stream and transmit it to the server IO port.

[0075] The process by which the data model parser parses the corresponding database physical table data in the database data is as follows:

[0076] Establish a connection with the database to be migrated on the data file server and initialize the database operation handle;

[0077] Based on the field names of the database physical table data requested by the seismic data migration client, the SQL statement for data query is assembled according to the field names, the SQL statement is executed through the database operation handle, and the queried data information is sent to the data file server;

[0078] After traversing and executing all the database physical table data, the database operation handle is released, and the process of the data model parser parsing the database physical table data is completed.

[0079] The task scheduler is used to respond to the request tasks of the seismic data migration client transmitted by the server IO port in real time, monitor and schedule the busy and idle status of the current working thread in real time, and assign the request tasks of the seismic data migration client to the idle working thread when there is an idle working thread; within the working thread, based on the requested data type, adaptively call the server disk file processing handle to read the project structure file or read the corresponding disk file data, or call the data model parser to parse the database data, and call the server IO port to send the corresponding byte stream to the seismic data migration client.

[0080] The server IO port includes a network SOCKET, which is used to communicate with the seismic data migration client. After the directory information byte stream, disk file byte stream or database data byte stream sent by the server disk file processing handle enters the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol to realize data connectivity between the data file server and the seismic data migration client.

[0081] The progress controller is used to count the progress of seismic exploration project migration operations and display the migration operation progress information to the seismic data migration client in real time through the server IO port.

[0082] In this embodiment, the data file server further includes a breakpoint resume scheduling system, through which the disk file data migration process in the seismic exploration project can be restored when the system is abnormal.

[0083] The breakpoint resume scheduling system is used to load the breakpoint record file. After the server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path when the server disk file processing handle processes the task, the size of each disk file byte stream read into the network SOCKET, and the original size of the disk file data. The breakpoint record file is updated in real time to control the data migration process of the seismic exploration project. After restarting under abnormal system conditions, the breakpoint controller automatically loads the breakpoint record file and compares the disk file byte stream size of each record with the original size of the disk file data. When the two sizes are consistent, the file processing is skipped. When the two sizes are inconsistent, it is a system abnormality point. The task scheduler is used to call the server disk file processing handle again from the system abnormality point to read the subsequent disk file data, thereby realizing the recovery of the disk file data migration process in the seismic exploration project.

[0084] like Figure 3 As shown, the seismic data migration client includes a client data file processing handle, a client IO port and a model reconstructor.

[0085] Among them, the client data file processing handle is used to request the data file server to send the directory structure information of the seismic exploration project data through the client IO port, and store the directory structure information in the local project structure file according to the directory information byte stream sent by the data file server; read the local project structure file and parse the attributes of the nodes in the file, request the corresponding disk file data in the data file server according to the attributes of the nodes, and after receiving the disk file byte stream of the relevant disk file data sent by the data file server, the client data file processing handle writes the disk file byte stream into the corresponding file created in the disk directory of the seismic data migration client, and sets the corresponding file permissions.

[0086] The client IO port is used to establish a connection and data communication with the data file server through the SOCKET protocol, and receive the relevant byte stream sent by the data file server.

[0087] The model reconstructor is used to request the database model information in the database data from the data file server through the client IO port, store the obtained database model data byte stream into the local data table structure XML file, and rebuild the database structure model through the database model data byte stream; the model reconstructor is also used to request the database physical table data from the data file server through the client IO port, and write the obtained database physical table data byte stream into the physical table corresponding to the local project database of the seismic data migration client in real time.

[0088] In this embodiment, the model reconstructor is used to request database physical table data from the data file server through the client IO port, and write the obtained database physical table data byte stream into the physical table corresponding to the local project database of the seismic data migration client in real time. The specific process is as follows:

[0089] Establish a connection with the local project database of the seismic data migration client and initialize the local project database operation handle;

[0090] Read the local data table structure XML file in the model reconstructor and obtain all the data table information in the file;

[0091] Traverse all data tables, and for each data table, request the corresponding database physical table data from the data file server through the client IO port, and parse the field name of the database physical table data;

[0092] Splice the SQL statement for data insertion based on all the field names of the corresponding database physical table data, use the local project database operation handle to execute the SQL statement, and insert the parsed field names of the database physical table data into the corresponding physical table of the local project database in sequence;

[0093] After traversing all data tables and migrating physical database data, the local project database operation handle is released.

[0094] Example 2

[0095] This embodiment is a method for online migration of seismic exploration project data, which is implemented by the online migration system for seismic exploration project data of embodiment 1. Figure 4 As shown, the method includes the following steps:

[0096] S1. Reading data directory structure information of a seismic exploration project through a data file server and storing it in a project structure file; responding to a request from a seismic data migration client for data directory structure information, reading the project structure file, converting it into a directory information byte stream, and sending it to the seismic data migration client; responding to a request from the seismic data migration client for disk file data, reading the corresponding disk file data, converting it into a disk file byte stream, and sending it to the seismic data migration client; responding to a request from the seismic data migration client for database data, reading the database data, converting it into a database data byte stream, and sending it to the seismic data migration client;

[0097] The database data includes database model information and database physical table data, and the database data byte stream includes database model data byte stream and database physical table data byte stream.

[0098] In this step, the data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port, and a progress controller; the server IO port includes a network socket; the specific process of this step is:

[0099] S11. Respond to the request task of the seismic data migration client transmitted by the server IO port in real time through the task scheduler, monitor and schedule the busy and idle status of the current working thread in real time, and assign the request task of the seismic data migration client to the idle working thread when there is an idle working thread; adaptively call the server disk file processing handle to read the project structure file or the corresponding disk file data based on the requested data type within the working thread, or call the data model parser to parse the database data, and call the server IO port to send the corresponding byte stream to the seismic data migration client;

[0100] S12. Reading data directory structure information of the seismic exploration project through the server disk file processing handle, storing the data directory structure information in the project structure file, and recording the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; when processing the data directory structure information requested by the seismic data migration client, reading the project structure file and converting it into a directory information byte stream and transmitting it to the server IO port; when processing the disk file data requested by the seismic data migration client, reading the disk file data on the data file server through the server disk file processing handle, converting the disk file data into a disk file byte stream and transmitting it to the server IO port;

[0101] S13. When processing the database model information in the database data requested by the seismic data migration client, the data model parser parses the corresponding database model information in the database data, converts the information into a database model data byte stream, and transmits the stream to the server IO port; when processing the database physical table data in the database data requested by the seismic data migration client, the data model parser parses the corresponding database physical table data in the database data, converts the information into a database physical table data byte stream, and transmits the data to the server IO port;

[0102] The process of the data model parser parsing the corresponding database physical table data in the database data is as follows:

[0103] Establish a connection with the database and initialize the database operation handle;

[0104] Based on the field names of the database physical table data requested by the seismic data migration client, the SQL statement for data query is assembled according to the field names, the SQL statement is executed through the database operation handle, and the queried data information is sent to the data file server;

[0105] After traversing and executing all the database physical table data, the database operation handle is released, and the data model parser completes the process of parsing the database physical table data;

[0106] S14, communicating with the seismic data migration client through the server IO port, after the directory information byte stream, disk file byte stream or database data byte stream sent by the server disk file processing handle enters the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol, thereby realizing data connectivity between the data file server and the seismic data migration client;

[0107] S15. The progress controller is used to count the progress of the seismic exploration project migration operation, and the migration operation progress information is echoed to the seismic data migration client in real time through the server IO port.

[0108] S2. Request the data directory structure information of the seismic exploration project from the data file server through the seismic data migration client, and receive the directory information byte stream sent by the data file server; request the corresponding disk file data from the data file server based on the received data directory structure information, and receive the disk file byte stream sent by the data file server; request database data from the data file server, and receive the database data byte stream sent by the data file server.

[0109] In this step, the seismic data migration client includes a client data file processing handle, a client IO port, and a model reconstructor. The client IO port also uses a network socket. The specific process of this step is as follows:

[0110] S21, the client IO port establishes a connection and data communication with the data file server through the SOCKET protocol;

[0111] S22. The client data file processing handle requests the data file server to send directory structure information of the seismic exploration project data through the client IO port, and stores the directory structure information in the local project structure file according to the directory information byte stream sent by the data file server; reads the local project structure file and parses the attributes of the nodes in the file, requests the corresponding disk file data in the data file server according to the attributes of the nodes, and after receiving the disk file byte stream of the relevant disk file data sent by the data file server, the client data file processing handle writes the disk file byte stream into the corresponding file created in the disk directory of the seismic data migration client, and sets the corresponding file permissions;

[0112] S23. The model reconstructor requests the database model information in the database data from the data file server through the client IO port, stores the obtained database model data byte stream into the local data table structure XML file, and rebuilds the database structure model through the database model data byte stream; the model reconstructor also requests the database physical table data from the data file server through the client IO port, and writes the obtained database physical table data byte stream into the physical table corresponding to the local project database of the seismic data migration client in real time;

[0113] In this step, the model reconstructor requests database physical table data from the data file server through the client IO port, and writes the obtained database physical table data byte stream into the physical table corresponding to the local project database of the seismic data migration client in real time. The specific process is as follows:

[0114] Establish a connection with the local project database of the seismic data migration client and initialize the local project database operation handle;

[0115] Read the local data table structure XML file in the model reconstructor and obtain all the data table information in the file;

[0116] Traverse all data tables, and for each data table, request the corresponding database physical table data from the data file server through the client IO port, and parse the field name of the database physical table data;

[0117] Splice the SQL statement for data insertion based on all the field names of the corresponding database physical table data, use the local project database operation handle to execute the SQL statement, and insert the parsed field names of the database physical table data into the corresponding physical table of the local project database in sequence;

[0118] After traversing all data tables and migrating physical database data, the local project database operation handle is released.

[0119] In this embodiment, when a breakpoint occurs due to a system exception, a breakpoint resume scheduling system is set up in the data file server to ensure the recovery of the disk file data migration process in the seismic exploration project. The breakpoint record file of the breakpoint resume scheduling system always exists and is also recorded when the system is operating normally. Every time the server disk file processing handle processes a disk file data task, it will add a record to the breakpoint record file. The implementation process of the breakpoint resume scheduling system is as follows:

[0120] The online migration method of seismic exploration project data starts by loading the breakpoint record file through the breakpoint resume scheduling system; after the server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path when the server disk file processing handle processes the task, the size of each disk file byte stream read into the network SOCKET and the original size of the disk file data, and updates the breakpoint record file in real time to control the seismic exploration project data migration process; after restarting under abnormal system conditions, the breakpoint controller automatically loads the breakpoint record file and compares the disk file byte stream size of each record with the original size of the disk file data. When the two sizes are consistent, the file processing is skipped. When the two sizes are inconsistent, it is a system abnormal point. The task scheduler re-calls the server disk file processing handle from the system abnormal point to read the subsequent disk file data, thereby realizing the recovery of the disk file data migration process in the seismic exploration project.

[0121] This embodiment also provides an application of the online migration method for seismic exploration project data in data migration of seismic exploration projects.

[0122] Based on the same inventive concept, Figure 5 As shown, this embodiment further provides a computer device, including: at least a processor and a memory, the memory is used to store at least one computer program, and the at least one computer program is loaded by the processor and executes the online migration method of seismic exploration project data of this embodiment.

[0123] Based on the same inventive concept, Figure 6 As shown, this embodiment further provides a computer-readable storage medium, which is used to store at least one computer program, and the at least one computer program is used to execute the online migration method for seismic exploration project data of this embodiment.

[0124] Finally, it should be noted that a person skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods.

[0125] Furthermore, it should be appreciated that the computer-readable storage media (eg, memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory.

[0126] It should be noted that the above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art may still modify the technical solutions described in the above embodiments or replace some of the technical features therein with equivalents. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the scope of protection of the present invention.

Claims

1. A seismic exploration project data online migration system, characterized in that: include: Data file server and seismic data migration client; Data file server, used to read the data directory structure information of the seismic exploration project and store it in the project structure file; In response to the request for data directory structure information from the seismic data migration client, the project structure file is read and converted into a directory information byte stream and sent to the seismic data migration client; In response to the seismic data migration client's request for disk file data, read the corresponding disk file data, convert it into a disk file byte stream and send it to the seismic data migration client; in response to the seismic data migration client's request for database data, read the database data, convert it into a database data byte stream and send it to the seismic data migration client; The seismic data migration client is used to request the data directory structure information of the seismic exploration project from the data file server and receive the directory information byte stream sent by the data file server; request the corresponding disk file data from the data file server according to the received data directory structure information and receive the disk file byte stream sent by the data file server; Used to request database data from the data file server and receive the database data byte stream sent by the data file server; The database data includes database model information and database physical table data, and the database data byte stream includes database model data byte stream and database physical table data byte stream; The seismic data migration client includes a client data file processing handle, a client IO port and a model reconstructor; The client data file processing handle is used to request the data file server to send the directory structure information of the seismic exploration project data through the client IO port, and store the directory structure information in the local project structure file according to the directory information byte stream sent by the data file server; Read the local project structure file and parse the attributes of the nodes in the file, request the corresponding disk file data in the data file server according to the attributes of the nodes, receive the disk file byte stream of the relevant disk file data sent by the data file server, and then the client data file processing handle writes the disk file byte stream into the corresponding file created in the disk directory of the seismic data migration client and sets the corresponding file permissions; The client IO port is used to establish a connection and data communication with the data file server through the SOCKET protocol, and receive the relevant byte stream sent by the data file server; The model reconstructor is used to request the database model information in the database data from the data file server through the client IO port, store the obtained database model data byte stream into the local data table structure XML file, and rebuild the database structure model through the database model data byte stream; the model reconstructor is also used to request the database physical table data from the data file server through the client IO port, and write the obtained database physical table data byte stream into the physical table corresponding to the local project database of the seismic data migration client in real time.

2. The online migration system for seismic exploration project data according to claim 1, characterized in that: The data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port and a progress controller; The server disk file processing handle is used to read the data directory structure information of the seismic exploration project, store the data directory structure information in the project structure file, and record the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; It is also used to read the project structure file and convert it into a directory information byte stream and transmit it to the server IO port when processing the data directory structure information requested by the seismic data migration client; The server disk file processing handle is also used to read the disk file data on the data file server when processing the disk file data request from the seismic data migration client, and convert the disk file data into a disk file byte stream and transmit it to the server IO port; The data model parser is used to parse the corresponding database model information in the database data when processing the database model information in the database data requested by the seismic data migration client, and convert it into a database model data byte stream and transmit it to the server IO port; the data model parser is also used to parse the corresponding database physical table data in the database data when processing the database physical table data in the database data requested by the seismic data migration client, and convert it into a database physical table data byte stream and transmit it to the server IO port; The task scheduler is used to respond to the request tasks of the seismic data migration client transmitted by the server IO port in real time, monitor and schedule the busy and idle status of the current working thread in real time, and assign the request tasks of the seismic data migration client to the idle working thread when there is an idle working thread; based on the data type of the request, the server disk file processing handle is adaptively called within the working thread to read the project structure file or the corresponding disk file data, or the data model parser is called to parse the database data, and the server IO port is called to send the corresponding byte stream to the seismic data migration client; The server IO port includes a network SOCKET, which is used for communication connection with the seismic data migration client. After the directory information byte stream, disk file byte stream or database data byte stream sent by the server disk file processing handle enters the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol, thereby realizing data connectivity between the data file server and the seismic data migration client; The progress controller is used to count the progress of seismic exploration project migration operations and display the migration operation progress information to the seismic data migration client in real time through the server IO port.

3. The online migration system for seismic exploration project data according to claim 2, characterized in that: The process by which the data model parser parses the corresponding database physical table data in the database data is as follows: Establish a connection with the database and initialize the database operation handle; Based on the field names of the database physical table data requested by the seismic data migration client, the SQL statement for data query is assembled according to the field names, the SQL statement is executed through the database operation handle, and the queried data information is sent to the data file server; After traversing and executing all the database physical table data, the database operation handle is released, and the process of the data model parser parsing the database physical table data is completed.

4. The online migration system for seismic exploration project data according to claim 2 or 3, characterized in that: The data file server also includes a breakpoint resume scheduling system; The breakpoint resume scheduling system is used to load the breakpoint record file. After the server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path when the server disk file processing handle processes the task, the size of each disk file byte stream read into the network SOCKET, and the original size of the disk file data. The breakpoint record file is updated in real time to control the data migration process of the seismic exploration project. After restarting under abnormal system conditions, the breakpoint controller automatically loads the breakpoint record file and compares the disk file byte stream size of each record with the original size of the disk file data. When the two sizes are consistent, the file processing is skipped. When the two sizes are inconsistent, it is a system abnormality point. The task scheduler is used to call the server disk file processing handle again from the system abnormality point to read the subsequent disk file data, thereby realizing the recovery of the disk file data migration process in the seismic exploration project.

5. The online migration system for seismic exploration project data according to claim 1, characterized in that: The information contained in the database model information includes: data schema information, data table information, data index information, and data uniqueness information.

6. The online migration system for seismic exploration project data according to claim 1, characterized in that: The model reconstructor is used to request database physical table data from the data file server through the client IO port, and write the obtained database physical table data byte stream into the physical table corresponding to the local project database of the seismic data migration client in real time. The specific process is as follows: Establish a connection with the local project database of the seismic data migration client and initialize the local project database operation handle; Read the local data table structure XML file in the model reconstructor and obtain all the data table information in the file; Traverse all data tables, and for each data table, request the corresponding database physical table data from the data file server through the client IO port, and parse the field name of the database physical table data; Splice the SQL statement for data insertion based on all the field names of the corresponding database physical table data, use the local project database operation handle to execute the SQL statement, and insert the parsed field names of the database physical table data into the corresponding physical table of the local project database in sequence; After traversing all data tables and migrating physical database data, the local project database operation handle is released.

7. A method for online migration of seismic exploration project data, characterized in that: Using the seismic exploration project data online migration system according to any one of claims 1 to 6, the method comprises: Read the data directory structure information of the seismic exploration project through the data file server and store it in the project structure file; respond to the seismic data migration client's request for data directory structure information, read the project structure file, convert it into a directory information byte stream and send it to the seismic data migration client; respond to the seismic data migration client's request for disk file data, read the corresponding disk file data, convert it into a disk file byte stream and send it to the seismic data migration client; respond to the seismic data migration client's request for database data, read the database data, convert it into a database data byte stream and send it to the seismic data migration client; The seismic data migration client requests the data directory structure information of the seismic exploration project from the data file server and receives the directory information byte stream sent by the data file server; based on the received data directory structure information, the client requests the corresponding disk file data from the data file server and receives the disk file byte stream sent by the data file server; the client requests database data from the data file server and receives the database data byte stream sent by the data file server; The database data includes database model information and database physical table data, and the database data byte stream includes database model data byte stream and database physical table data byte stream.

8. The method for online migration of seismic exploration project data according to claim 7, characterized in that: The data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port and a progress controller; the server IO port includes a network SOCKET; Read the data directory structure information of the seismic exploration project through the data file server and store it in the project structure file; In response to the request for data directory structure information from the seismic data migration client, the project structure file is read and converted into a directory information byte stream and sent to the seismic data migration client; In response to the seismic data migration client's request for disk file data, the corresponding disk file data is read, converted into a disk file byte stream and sent to the seismic data migration client; in response to the seismic data migration client's request for database data, the database data is read, converted into a database data byte stream and sent to the seismic data migration client. The specific process is as follows: Read the data directory structure information of the seismic exploration project through the server disk file processing handle, store the data directory structure information in the project structure file, and record the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; When processing the data directory structure information requested by the seismic data migration client, the project structure file is read and converted into a directory information byte stream and transmitted to the server IO port; When processing the disk file data requested by the seismic data migration client, the server disk file processing handle reads the disk file data on the data file server, converts the disk file data into a disk file byte stream and transmits it to the server IO port; When processing the database model information in the database data requested by the seismic data migration client, the data model parser parses the corresponding database model information in the database data, converts it into a database model data byte stream and transmits it to the server IO port; when processing the database physical table data in the database data requested by the seismic data migration client, the data model parser parses the corresponding database physical table data in the database data, converts it into a database physical table data byte stream and transmits it to the server IO port; The task scheduler responds to the request task of the seismic data migration client transmitted by the server IO port in real time, monitors and schedules the busy and idle status of the current working thread in real time, and assigns the request task of the seismic data migration client to the idle working thread when there is an idle working thread; within the working thread, based on the requested data type, the server disk file processing handle is adaptively called to read the project structure file or the corresponding disk file data, or the data model parser is called to parse the database data, and the server IO port is called to send the corresponding byte stream to the seismic data migration client; The server is connected to the seismic data migration client through the IO port of the server. After the directory information byte stream, disk file byte stream or database data byte stream sent by the server disk file processing handle enters the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol, thereby realizing data connectivity between the data file server and the seismic data migration client. The progress controller is used to count the progress of the seismic exploration project migration operation, and the migration operation progress information is echoed to the seismic data migration client in real time through the server IO port.

9. The method for online migration of seismic exploration project data according to claim 8, characterized in that: The process of the data model parser parsing the corresponding database physical table data in the database data is as follows: Establish a connection with the database and initialize the database operation handle; Based on the field names of the database physical table data requested by the seismic data migration client, the SQL statement for data query is assembled according to the field names, the SQL statement is executed through the database operation handle, and the queried data information is sent to the data file server; After traversing and executing all the database physical table data, the database operation handle is released, and the process of the data model parser parsing the database physical table data is completed.

10. The method for online migration of seismic exploration project data according to claim 8 or 9, characterized in that: The data file server also includes a breakpoint resume scheduling system; The online migration method of seismic exploration project data starts by loading the breakpoint record file through the breakpoint resume scheduling system; after the server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path when the server disk file processing handle processes the task, the size of each disk file byte stream read into the network SOCKET and the original size of the disk file data, and updates the breakpoint record file in real time to control the seismic exploration project data migration process; after restarting under abnormal system conditions, the breakpoint controller automatically loads the breakpoint record file and compares the disk file byte stream size of each record with the original size of the disk file data. When the two sizes are consistent, the file processing is skipped. When the two sizes are inconsistent, it is a system abnormal point. The task scheduler re-calls the server disk file processing handle from the system abnormal point to read the subsequent disk file data, thereby realizing the recovery of the disk file data migration process in the seismic exploration project.

11. An application of the online migration method for seismic exploration project data according to any one of claims 7 to 10, characterized in that: The online migration method for seismic exploration project data is used for data migration of seismic exploration projects.

12. A computer device, characterized in that: The computer device includes a processor and a memory, the memory is used to store at least one computer program, and the at least one computer program is loaded by the processor and executes the online migration method for seismic exploration project data according to any one of claims 7 to 10.

13. A storage medium, characterized in that: The storage medium is used to store at least one computer program, and the at least one computer program is used to execute the online migration method for seismic exploration project data according to any one of claims 7 to 10.

Images