Seismic exploration project data online migration system, method, device and medium

Abstract

The invention belongs to the technical field of seismic exploration, and discloses a seismic exploration project data online migration system, method and device and a medium, and the seismic exploration project data online migration system comprises a data file server and a seismic data migration client. The data file server is used for responding to requests of the seismic data migration client for data directory structure information, database data and disk file data, converting the requests into corresponding byte streams and sending the byte streams to the seismic data migration client; and the seismic data migration client is used for receiving the corresponding byte stream sent by the data file server and completing data migration of the seismic exploration project. The method is suitable for migrating the data of the seismic exploration project, and solves the problem that the data of a plurality of projects are not intercommunicated and are difficult to migrate in the seismic exploration process.

Description

Technical Field

[0001] The present invention belongs to the technical field of seismic exploration, and relates to an online migration system, method, device and medium for seismic exploration project data. Background Art

[0002] Seismic exploration project data is a systematic project that generates various types of data, such as seismic data, horizons, faults, mapping data of interpretation projects, etc. A variety of miscellaneous data is stored in a project in a classified manner, resulting in a large amount of data and multiple data types in a single seismic exploration project data.

[0003] Currently, the data of seismic exploration projects mostly adopts a combined storage form of a database and disk files. Some regularized data, such as well-structured data like acquisition systems and seismic headers, are mostly stored in the database, while some other data with a large amount and poor data structure, such as common seismic data volume data, are mostly stored in disk files. Although this data storage method improves the readability of the data, with the gradual deepening of exploration, the data volume of a single project in seismic exploration projects shows a trend of PB-level growth. As the data volume increases, the original data storage method of some seismic exploration projects cannot meet the needs of storing massive data, and it is necessary to replace the storage for migrating seismic exploration project data. In addition, with the change of the GeoEast model and version upgrade, the old seismic exploration project data also needs to be migrated to the new project. Therefore, it is of great significance to carry out research on the method of migrating seismic exploration project data to solve the problems of non-interoperability and difficult migration of data in multiple projects during the seismic exploration process. Summary of the Invention

[0004] The object of the present invention is to provide an online migration system for seismic exploration project data to realize the mutual migration and efficient flow of seismic exploration project data in an environment with network interoperability; Another object of the present invention is to provide an online migration method, device and storage medium for seismic exploration project data.

[0005] To achieve the above object, the technical solution adopted by the present invention is as follows: An online migration system for seismic exploration project data includes: a data file server and a seismic data migration client; A data file server is used to read the data directory structure information of a seismic exploration project and store it in a project structure file; in response to a request from a seismic data migration client for the data directory structure information, read the project structure file, convert it into a directory information byte stream, and send it to the seismic data migration client; in response to a request from the seismic data migration client for disk file data, read the corresponding disk file data, convert it into a disk file byte stream, and send it to the seismic data migration client; in response to a request from the seismic data migration client for database data, read the database data, convert it into a database data byte stream, and send it to the seismic data migration client; A seismic data migration client is used to request the data directory structure information of a seismic exploration project from the data file server and receive the directory information byte stream sent by the data file server; according to the received data directory structure information, request the corresponding disk file data from the data file server and receive the disk file byte stream sent by the data file server; it is used to request database data from the data file server and receive the database data byte stream sent by the data file server; The database data includes database model information and database physical table data, and the database data byte stream includes a database model data byte stream and a database physical table data byte stream.

[0006] As a limitation, the data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port, and a progress controller; The server disk file processing handle is used to read the data directory structure information of a seismic exploration project, store the data directory structure information in a project structure file, and respectively record the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; it is also used to read the project structure file and convert it into a directory information byte stream and transmit it to the server IO port when processing a request from the seismic data migration client for the data directory structure information; the server disk file processing handle is also used to read the disk file data on the data file server and convert the disk file data into a disk file byte stream and transmit it to the server IO port when processing a request from the seismic data migration client for disk file data; The data model parser is used to parse the corresponding database model information in the database data and convert it into a database model data byte stream and transmit it to the server IO port when processing the database model information in the database data requested by the seismic data migration client; the data model parser is also used to parse the corresponding database physical table data in the database data and convert it into a database physical table data byte stream and transmit it to the server IO port when processing the database physical table data in the database data requested by the seismic data migration client; A task scheduler is used to respond in real time to the request tasks of the seismic data migration client transmitted by the server IO port, monitor and schedule the busy and idle conditions of the current working threads in real time. When there are idle working threads, it assigns the request tasks of the seismic data migration client to the idle working threads; within the working threads, it adaptively calls the server disk file processing handle to read the project structure file or read the corresponding disk file data based on the requested data type, or calls the data model parser to parse the database data, and calls the server IO port to send the corresponding byte stream to the seismic data migration client. The server IO port includes a network SOCKET for communication connection with the seismic data migration client. After the directory information byte stream, disk file byte stream sent by the server disk file processing handle, or the database data byte stream sent by the data model converter enters the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol to achieve data connectivity between the data file server and the seismic data migration client. A progress controller is used to count the progress of the seismic exploration project migration operation and echo the migration operation progress information to the seismic data migration client in real time through the server IO port.

[0007] As a further limitation, the process of the data model parser parsing the corresponding database physical table data in the database data is as follows: Establish a connection with the database and initialize the database operation handle; Based on the field names of the database physical table data requested by the seismic data migration client, concatenate the SQL statements for data query according to the field names, execute the SQL statements through the database operation handle, and send the queried data information to the data file server; After traversing and executing all the database physical table data, release the database operation handle, and the process of the data model parser parsing the database physical table data is completed.

[0008] As a further limitation, the data file server further includes a breakpoint resume transfer scheduling system; The breakpoint resuming scheduling system is used to load the breakpoint record file. After the server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path when the server disk file processing handle processes this task, the size of each disk file byte stream read into the network SOCKET, and the original size of the disk file data, and updates the breakpoint record file in real time to control the data migration process of the seismic exploration project. After restarting in case of system anomaly, the breakpoint controller automatically loads the breakpoint record file, and compares the size of each recorded disk file byte stream with the original size of the disk file data. When the two sizes are the same, the file processing is skipped. When the two are inconsistent, it is the system anomaly point. The task scheduler starts from the system anomaly point to re - call the server disk file processing handle to read the subsequent disk file data, so as to realize the recovery of the disk file data migration process in the seismic exploration project.

[0009] As a second limitation, the information included in the database model information includes: data schema information, data table information, data index information, and data uniqueness information.

[0010] As a third limitation, the seismic data migration client includes a client data file processing handle, a client IO port, and a model reconstructor; The client data file processing handle is used to request and send the directory structure information of the seismic exploration project data to the data file server through the client IO port, store the directory structure information in the local project structure file according to the directory information byte stream sent by the data file server; read the local project structure file and parse the attributes of the nodes in the file, request the corresponding disk file data in the data file server according to the attributes of the nodes, after receiving the disk file byte stream of the relevant disk file data sent by the data file server, the client data file processing handle writes the disk file byte stream into the corresponding file created in the disk directory of the seismic data migration client, and sets the corresponding file permissions; The client IO port is used to establish a connection and data communication with the data file server through the SOCKET protocol, and receive the relevant byte stream sent by the data file server; The model reconstructor is used to request the database model information in the database data from the data file server through the client IO port, store the obtained database model data byte stream in the local data table structure XML file, and reconstruct the database structure model through the database model data byte stream; the data reconstructor is also used to request the database physical table data from the data file server through the client IO port, and write the obtained database physical table data byte stream into the corresponding physical table of the local project database of the seismic data migration client in real time.

[0011] As a further limitation, the data reconstructor is used to request the database physical table data from the data file server through the client IO port, and the specific process of writing the obtained database physical table data byte stream into the corresponding physical table of the local project database of the seismic data migration client is as follows: Establish a connection with the local project database of the seismic data migration client and initialize the local project database operation handle; Read the local data table structure XML file in the model reconstructor to obtain all the data table information in the file; Traverse all the data tables. For each data table, request the corresponding database physical table data from the data file server through the client IO port, and parse the field names of the database physical table data; Based on all the field names of the corresponding database physical table data, splice the SQL statement for data insertion, use the local project database operation handle to execute the SQL statement, and insert the parsed database physical table data in the order of field names into the corresponding physical table of the local project database; After traversing all the data tables, the migration of the database physical table data is completed, and the local project database operation handle is released.

[0012] The present invention also provides a method for online migration of seismic exploration project data. Using the above-mentioned online migration system for seismic exploration project data, the method includes: Read the data directory structure information of the seismic exploration project through the data file server and store it in the project structure file; in response to the request of the seismic data migration client for the data directory structure information, read the project structure file and convert it into a directory information byte stream to send to the seismic data migration client; in response to the request of the seismic data migration client for the disk file data, read the corresponding disk file data and convert it into a disk file byte stream to send to the seismic data migration client; in response to the request of the seismic data migration client for the database data, read the database data and convert it into a database data byte stream to send to the seismic data migration client; Request the data directory structure information of the seismic exploration project from the data file server through the seismic data migration client, and receive the directory information byte stream sent by the data file server; request the corresponding disk file data from the data file server according to the received data directory structure information, and receive the disk file byte stream sent by the data file server; request the database data from the data file server and receive the database data byte stream sent by the data file server; The database data includes database model information and database physical table data, and the database data byte stream includes a database model data byte stream and a database physical table data byte stream.

[0013] As a limitation, the data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port, and a progress controller; the server IO port includes a network SOCKET; Read the data directory structure information of the seismic exploration project through the data file server and store it in the project structure file; in response to the request of the seismic data migration client for the data directory structure information, read the project structure file and convert it into a directory information byte stream to send to the seismic data migration client; in response to the request of the seismic data migration client for the disk file data, read the corresponding disk file data and convert it into a disk file byte stream to send to the seismic data migration client; in response to the request of the seismic data migration client for the database data, read the database data and convert it into a database data byte stream to send to the seismic data migration client. The specific process is as follows: Read the data directory structure information of the seismic exploration project through the server disk file processing handle, store the data directory structure information in the project structure file, and record the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; when processing the request for the data directory structure information from the seismic data migration client, read the project structure file and convert it into a directory information byte stream to transmit to the server IO port; when processing the request for the disk file data from the seismic data migration client through the server disk file processing handle, read the disk file data on the data file server and convert the disk file data into a disk file byte stream to transmit to the server IO port; When processing the database model information in the request for the database data from the seismic data migration client through the data model parser, parse the corresponding database model information in the database data and convert it into a database model data byte stream to transmit to the server IO port; when processing the database physical table data in the request for the database data from the seismic data migration client through the data model parser, parse the corresponding database physical table data in the database data and convert it into a database physical table data byte stream to transmit to the server IO port; Through the task scheduler, respond in real time to the request tasks of the seismic data migration client transmitted by the server IO port, monitor and schedule the busy and idle conditions of the current working threads in real time. When there are idle working threads, allocate the request tasks of the seismic data migration client to the idle working threads; within the working threads, adaptively call the server disk file processing handle to read the project structure file or the corresponding disk file data based on the requested data type, or call the data model parser to parse the database data, and call the server IO port to send the corresponding byte stream to the seismic data migration client; Communicate and connect with the seismic data migration client through the server IO port. After the directory information byte stream, disk file byte stream sent by the server disk file processing handle, or the database data byte stream sent by the data model converter is input into the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol to achieve data connectivity between the data file server and the seismic data migration client; Statistically analyze the migration operation progress of the seismic exploration project through the progress controller, and echo the migration operation progress information to the seismic data migration client in real time through the server IO port.

[0014] As a further limitation, the process of the data model parser parsing the corresponding database physical table data in the database data is as follows: Establish a connection with the database and initialize the database operation handle; Based on the field names of the database physical table data requested by the seismic data migration client, splice the SQL statements for data query according to the field names, execute the SQL statements through the database operation handle, and send the queried data information to the data file server; After traversing and executing all the database physical table data, release the database operation handle, and the process of the data model parser parsing the database physical table data is completed.

[0015] As a further limitation, the data file server further includes a breakpoint resume scheduling system; When the online migration method of seismic exploration project data starts, load the breakpoint record file through the breakpoint resume scheduling system. After the server disk file processing handle processes a disk file data task, record the absolute file path, the size of each disk file byte stream read into the network SOCKET, and the original size of the disk file data when the server disk file processing handle processes this task through the breakpoint controller, and update the breakpoint record file in real time to control the migration process of seismic exploration project data; after restarting in case of system exception, the breakpoint controller automatically loads the breakpoint record file, and compares the size of each recorded disk file byte stream with the original size of the disk file data. When the two sizes are the same, skip file processing. When the two are inconsistent, it is the system exception point. The task scheduler starts from the system exception point to re - call the server disk file processing handle to read the subsequent disk file data to achieve the recovery of the disk file data migration process in the seismic exploration project.

[0016] The present invention also provides an application based on the above - mentioned online migration method of seismic exploration project data, and the online migration method of seismic exploration project data is used for data migration of seismic exploration projects.

[0017] The present invention also provides a computer device, which includes a processor and a memory. The memory is used to store at least one segment of computer program, and the at least one segment of computer program is loaded and executed by the processor to perform the above-mentioned online migration method for seismic exploration project data.

[0018] The present invention also provides a storage medium, which is used to store at least one segment of computer program, and the at least one segment of computer program is used to perform the above-mentioned online migration method for seismic exploration project data.

[0019] Due to the adoption of the above technical solution, compared with the prior art, the technical progress achieved by the present invention lies in: The online migration system for seismic exploration project data of the present invention can realize the mutual migration of seismic exploration project data in different production environments with network interconnection, and further realize the mutual migration and efficient flow of data on different operating system platforms, such as the migration of Linux seismic exploration project data to Windows projects, breaking through data barriers and solving the data island problem to a certain extent; the online migration system for seismic exploration project data of the present invention can be applied to any stage of seismic exploration production, and the relevant software integrating this system can realize the efficient flow of seismic exploration project data.

[0020] In summary, the present invention is applicable to migrating seismic exploration project data and solves the problems of non-interoperability and difficult migration of multiple project data in the process of seismic exploration. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 The block diagram of the online migration system for seismic exploration project data in Embodiment 1 of the present invention is shown; Figure 2 The block diagram of the data file server in Embodiment 1 of the present invention is shown; Figure 3 The block diagram of the seismic data migration client in Embodiment 1 of the present invention is shown; Figure 4 The overall method flowchart of the online migration method for seismic exploration project data in Embodiment 2 of the present invention is shown; Figure 5 The structural schematic diagram of the computer device in Embodiment 2 of the present invention is shown; Figure 6 The structural schematic diagram of the computer-readable storage medium in Embodiment 2 of the present invention is shown. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0022] In order to better explain the present invention for easy understanding, the present invention will be described in detail below with reference to the accompanying drawings and through specific embodiments. Embodiment 1

[0023] This embodiment is an online data migration system for seismic exploration projects, applicable to data migration of seismic exploration projects of various exploration software developed based on the GeoEast-iEco platform, such as GeoEast geophysical software, etc.

[0024] In this embodiment, the seismic exploration project data to be migrated is stored in a combined form of a database and disk files. The database can be a PostgreSQL database. When migrating the data of seismic exploration projects in different production environments, it is necessary to migrate the database data to the local database of the seismic data migration client, and migrate the disk file data to the corresponding files created in the disk directory of the seismic data migration client.

[0025] The following is a detailed description of this embodiment.

[0026] As Figure 1 shown, this embodiment includes: a data file server and a seismic data migration client.

[0027] The data file server is used to read the data directory structure information of the seismic exploration project and store it in the project structure file; in response to the request of the seismic data migration client for the data directory structure information, read the project structure file and convert it into a directory information byte stream and send it to the seismic data migration client; in response to the request of the seismic data migration client for the disk file data, read the corresponding disk file data and convert it into a disk file byte stream and send it to the seismic data migration client; in response to the request of the seismic data migration client for the database data, read the database data and convert it into a database data byte stream and send it to the seismic data migration client; The seismic data migration client is used to request the data directory structure information of the seismic exploration project from the data file server and receive the directory information byte stream sent by the data file server; request the corresponding disk file data from the data file server according to the received data directory structure information and receive the disk file byte stream sent by the data file server; used to request the database data from the data file server and receive the database data byte stream sent by the data file server.

[0028] Among them, the database data includes database model information and database physical table data, and the database data byte stream includes a database model data byte stream and a database physical table data byte stream; the information included in the database model information includes: data schema information, data table information, data index information, and data uniqueness information.

[0029] As Figure 2 shown, the data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port, and a progress controller.

[0030] Among them, the server disk file processing handle is used to read the data directory structure information of the seismic exploration project, store the data directory structure information into the project structure file, and record the exploration data type and exploration data file permission information respectively in the project structure file for different types of exploration data; it is also used to read the project structure file and convert it into a directory information byte stream and transmit it to the server IO port when processing the seismic data migration client's request for data directory structure information; the server disk file processing handle is also used to read the disk file data on the data file server and convert the disk file data into a disk file byte stream and transmit it to the server IO port when processing the seismic data migration client's request for disk file data.

[0031] The data model parser is used to parse the corresponding database model information in the database data and convert it into a database model data byte stream and transmit it to the server IO port when processing the database model information in the database data requested by the seismic data migration client; the data model parser is also used to parse the corresponding database physical table data in the database data and convert it into a database physical table data byte stream and transmit it to the server IO port when processing the database physical table data in the database data requested by the seismic data migration client.

[0032] The process of the data model parser parsing the corresponding database physical table data in the database data is as follows: Establish a connection with the database to be migrated by the data file server and initialize the database operation handle; Based on the field names of the database physical table data requested by the seismic data migration client, splice the SQL statements for data query according to the field names, execute the SQL statements through the database operation handle, and send the queried data information to the data file server; After traversing and executing all the database physical table data, release the database operation handle, and the process of the data model parser parsing the database physical table data is completed.

[0033] The task scheduler is used to respond in real time to the request tasks of the seismic data migration client transmitted by the server IO port, monitor and schedule the busy and idle conditions of the current working threads in real time. When there are idle working threads, allocate the request tasks of the seismic data migration client to the idle working threads; adaptively call the server disk file processing handle to read the project structure file or read the corresponding disk file data, or call the data model parser to parse the database data within the working thread, and call the server IO port to send the corresponding byte stream to the seismic data migration client.

[0034] The server I / O port, including a network SOCKET, is used for communication connection with the seismic data migration client. After the directory information byte stream, disk file byte stream sent by the server disk file handle, or the database data byte stream sent by the data model converter is input into the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol, realizing data connectivity between the data file server and the seismic data migration client.

[0035] The progress controller is used to count the progress of the seismic exploration project migration operation and echo the migration operation progress information to the seismic data migration client in real time through the server I / O port.

[0036] In this embodiment, the data file server further includes a breakpoint resume scheduling system. Through the breakpoint resume scheduling system, when the system is abnormal, the recovery of the disk file data migration process in the seismic exploration project can be realized.

[0037] The breakpoint resume scheduling system is used to load the breakpoint record file. After the server disk file handle processes a disk file data task, the breakpoint controller records the absolute file path when the server disk file handle processes this task, the size of each disk file byte stream read into the network SOCKET, and the original size of the disk file data, and updates the breakpoint record file in real time to control the data migration process of the seismic exploration project; after restarting in case of system abnormality, the breakpoint controller automatically loads the breakpoint record file and compares the size of each recorded disk file byte stream with the original size of the disk file data. When the two sizes are the same, the file processing is skipped. When the two are inconsistent, it is the system abnormality point. The task scheduler starts from the system abnormality point to re - call the server disk file handle to read the subsequent disk file data, realizing the recovery of the disk file data migration process in the seismic exploration project.

[0038] As Figure 3 shown, the seismic data migration client includes a client data file handle, a client I / O port, and a model reconstructor.

[0039] Among them, the client data file handle is used to request and send the directory structure information of the seismic exploration project data to the data file server through the client I / O port, store the directory structure information in the local project structure file according to the directory information byte stream sent by the data file server; read the local project structure file and parse the attributes of the nodes in the file, request the corresponding disk file data in the data file server according to the attributes of the nodes, after receiving the disk file byte stream of the relevant disk file data sent by the data file server, the client data file handle writes the disk file byte stream into the corresponding file created in the disk directory of the seismic data migration client and sets the corresponding file permissions.

[0040] The client IO port is used to establish a connection and data communication with the data file server through the SOCKET protocol, and receive the relevant byte stream sent by the data file server.

[0041] The model reconstructor is used to request the database model information in the database data from the data file server through the client IO port, store the obtained database model data byte stream into the local data table structure XML file, and reconstruct the database structure model through the database model data byte stream; the data reconstructor is also used to request the database physical table data from the data file server through the client IO port, and write the obtained database physical table data byte stream into the corresponding physical table of the local project database of the seismic data migration client in real time.

[0042] In this embodiment, the specific process of the data reconstructor for requesting the database physical table data from the data file server through the client IO port and writing the obtained database physical table data byte stream into the corresponding physical table of the local project database of the seismic data migration client is as follows: Establish a connection with the local project database of the seismic data migration client and initialize the local project database operation handle; Read the local data table structure XML file in the model reconstructor to obtain all the data table information in the file; Traverse all the data tables. For each data table, request the corresponding database physical table data from the data file server through the client IO port, and parse the field names of the database physical table data; Concatenate the SQL statements for data insertion based on all the field names of the corresponding database physical table data, use the local project database operation handle to execute the SQL statements, and insert the parsed field names of the database physical table data into the corresponding physical table of the local project database in sequence; After traversing all the data tables, the migration of the database physical table data is completed, and the local project database operation handle is released. Embodiment 2

[0043] This embodiment is a method for online migration of seismic exploration project data, which is implemented by using the online migration system of seismic exploration project data in Embodiment 1. As Figure 4 shown, this method includes the following steps: S1. Read the data directory structure information of the seismic exploration project through the data file server and store it in the project structure file; in response to the request of the seismic data migration client for the data directory structure information, read the project structure file, convert it into a directory information byte stream, and send it to the seismic data migration client; in response to the request of the seismic data migration client for the disk file data, read the corresponding disk file data, convert it into a disk file byte stream, and send it to the seismic data migration client; in response to the request of the seismic data migration client for the database data, read the database data, convert it into a database data byte stream, and send it to the seismic data migration client; Among them, the database data includes database model information and database physical table data, and the database data byte stream includes a database model data byte stream and a database physical table data byte stream.

[0044] In this step, the data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port, and a progress controller; the server IO port includes a network SOCKET; the specific process of this step is as follows: S11. Through the task scheduler, respond in real time to the request tasks of the seismic data migration client transmitted by the server IO port, monitor and schedule the busy and idle conditions of the current working threads in real time. When there are idle working threads, allocate the request tasks of the seismic data migration client to the idle working threads; within the working threads, adaptively call the server disk file processing handle to read the project structure file or the corresponding disk file data based on the requested data type, or call the data model parser to parse the database data, and call the server IO port to send the corresponding byte stream to the seismic data migration client; S12. Read the data directory structure information of the seismic exploration project through the server disk file processing handle, store the data directory structure information in the project structure file, and respectively record the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; when processing the request of the seismic data migration client for the data directory structure information, read the project structure file and convert it into a directory information byte stream and transmit it to the server IO port; when processing the request of the seismic data migration client for the disk file data through the server disk file processing handle, read the disk file data on the data file server and convert the disk file data into a disk file byte stream and transmit it to the server IO port; S13. When the data model parser processes the database model information in the database data requested by the seismic data migration client, it parses the corresponding database model information in the database data and converts it into a database model data byte stream for transmission to the server IO port. When the data model parser processes the database physical table data in the database data requested by the seismic data migration client, it parses the corresponding database physical table data in the database data and converts it into a database physical table data byte stream for transmission to the server IO port. Among them, the process by which the data model parser parses the corresponding database physical table data in the database data is as follows: Establish a connection with the database and initialize the database operation handle. Based on the field names of the database physical table data requested by the seismic data migration client, a SQL statement for data query is concatenated according to the field names, and the SQL statement is executed through the database operation handle, and the queried data information is sent to the data file server. After traversing and executing all the database physical table data, release the database operation handle, and the process of the data model parser parsing the database physical table data is completed. S14. Communicate and connect with the seismic data migration client through the server IO port. After the directory information byte stream, disk file byte stream sent by the server disk file processing handle, or the database data byte stream sent by the data model converter is introduced into the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol to achieve data connectivity between the data file server and the seismic data migration client. S15. The progress controller counts the migration job progress of the seismic exploration project and displays the migration job progress information to the seismic data migration client in real time through the server IO port.

[0045] S2. The seismic data migration client requests the data directory structure information of the seismic exploration project from the data file server and receives the directory information byte stream sent by the data file server. According to the received data directory structure information, it requests the corresponding disk file data from the data file server and receives the disk file byte stream sent by the data file server. It requests the database data from the data file server and receives the database data byte stream sent by the data file server.

[0046] In this step, the seismic data migration client includes a client data file processing handle, a client IO port, and a model reconstructor. The client IO port also uses a network SOCKET. The specific process of this step is as follows: S21. The client IO port establishes a connection and data communication with the data file server through the SOCKET protocol. S22. The client data file processing handle requests the directory structure information of the seismic exploration project data from the data file server through the client IO port, stores the directory structure information in the local project structure file according to the directory information byte stream sent by the data file server; reads the local project structure file and parses the attributes of the nodes in the file, requests the corresponding disk file data in the data file server according to the attributes of the nodes, and after receiving the disk file byte stream of the relevant disk file data sent by the data file server, the client data file processing handle writes the disk file byte stream into the corresponding file created in the disk directory of the seismic data migration client, and sets the corresponding file permissions; S23. The model reconstructor requests the database model information in the database data from the data file server through the client IO port, stores the obtained database model data byte stream in the local data table structure XML file, and reconstructs the database structure model through the database model data byte stream; the data reconstructor also requests the database physical table data from the data file server through the client IO port, and writes the obtained database physical table data byte stream into the corresponding physical table of the local project database of the seismic data migration client in real time; Among them, in this step, the specific process of the data reconstructor requesting the database physical table data from the data file server through the client IO port and writing the obtained database physical table data byte stream into the corresponding physical table of the local project database of the seismic data migration client in real time is as follows: Establish a connection with the local project database of the seismic data migration client and initialize the local project database operation handle; Read the local data table structure XML file in the model reconstructor and obtain all the data table information in the file; Traverse all the data tables. For each data table, request the corresponding database physical table data from the data file server through the client IO port and parse the field names of the database physical table data; Concatenate the SQL statements for data insertion based on all the field names of the corresponding database physical table data, use the local project database operation handle to execute the SQL statements, and insert the field names of the parsed database physical table data into the corresponding physical table of the local project database in sequence; After traversing all the data tables and completing the migration of the database physical table data, release the local project database operation handle.

[0047] In this embodiment, when a breakpoint occurs due to system anomalies, in order to ensure the recovery of the disk file data migration process in a seismic exploration project, a breakpoint resumption scheduling system is also set up in the data file server. The breakpoint record file in the breakpoint resumption scheduling system always exists and will also be recorded under normal system operation. Each time the server disk file processing handle processes a disk file data task, a record will be added to the breakpoint record file. The implementation process of the breakpoint resumption scheduling system is as follows: At the beginning of the online migration method for seismic exploration project data, the breakpoint record file is loaded through the breakpoint resumption scheduling system. After the server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path of the file when the server disk file processing handle processes the task, the size of each disk file byte stream read into the network SOCKET, and the original size of the disk file data, and updates the breakpoint record file in real time to control the data migration process of the seismic exploration project. After the system is restarted in case of anomalies, the breakpoint controller automatically loads the breakpoint record file and compares the size of each disk file byte stream with the original size of the disk file data. When the two sizes are the same, the file processing is skipped. When the two are inconsistent, it is the system anomaly point. The task scheduler starts from the system anomaly point and recalls the server disk file processing handle to read the subsequent disk file data, realizing the recovery of the disk file data migration process in the seismic exploration project.

[0048] This embodiment also provides an application of the online migration method for seismic exploration project data in the data migration of a seismic exploration project.

[0049] Based on the same inventive concept, as Figure 5 shown, this embodiment also provides a computer device, including: at least a processor and a memory. The memory is used to store at least one segment of computer program, and at least one segment of computer program is loaded and executed by the processor to perform the online migration method for seismic exploration project data of this embodiment.

[0050] Based on the same inventive concept, as Figure 6 shown, this embodiment also provides a computer-readable storage medium. The storage medium is used to store at least one segment of computer program, and at least one segment of computer program is used to perform the online migration method for seismic exploration project data of this embodiment.

[0051] Finally, it should be noted that those of ordinary skill in the art can understand that all or part of the processes of implementing the methods in the above embodiments can be completed by instructing relevant hardware through a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments.

[0052] In addition, it should be understood that the computer-readable storage medium (e.g., memory) herein can be a volatile memory or a non-volatile memory, or can include both volatile memory and non-volatile memory.

[0053] It should be noted that the above are only the preferred embodiments of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art can still modify the technical solutions recorded in the above embodiments or perform equivalent replacements on some of the technical features. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An online data migration system for seismic exploration projects, characterized in that, Comprising: A data file server and a seismic data migration client; The data file server is used to read the data directory structure information of a seismic exploration project and store it in a project structure file; In response to the request of the seismic data migration client for the data directory structure information, read the project structure file, convert it into a directory information byte stream, and send it to the seismic data migration client; In response to the request of the seismic data migration client for disk file data, read the corresponding disk file data, convert it into a disk file byte stream, and send it to the seismic data migration client; in response to the request of the seismic data migration client for database data, read the database data, convert it into a database data byte stream, and send it to the seismic data migration client; The seismic data migration client is used to request the data directory structure information of a seismic exploration project from the data file server and receive the directory information byte stream sent by the data file server; according to the received data directory structure information, request the corresponding disk file data from the data file server and receive the disk file byte stream sent by the data file server; It is used to request database data from the data file server and receive the database data byte stream sent by the data file server; The database data includes database model information and database physical table data, and the database data byte stream includes a database model data byte stream and a database physical table data byte stream.

2. The online migration system for seismic exploration project data according to claim 1, wherein The data file server includes a server disk file handling handle, a data model parser, a task scheduler, a server IO port, and a progress controller; The server disk file handling handle is used to read the data directory structure information of a seismic exploration project, store the data directory structure information in a project structure file, and respectively record the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; It is also used to read the project structure file and convert it into a directory information byte stream and transmit it to the server IO port when processing the request of the seismic data migration client for the data directory structure information; The server disk file handling handle is also used to read the disk file data on the data file server and convert the disk file data into a disk file byte stream and transmit it to the server IO port when processing the request of the seismic data migration client for disk file data; The data model parser is used to parse the corresponding database model information in the database data and convert it into a database model data byte stream and transmit it to the server IO port when processing the database model information in the database data requested by the seismic data migration client; the data model parser is also used to parse the corresponding database physical table data in the database data and convert it into a database physical table data byte stream and transmit it to the server IO port when processing the database physical table data in the database data requested by the seismic data migration client; A task scheduler, which is used to respond in real time to the request tasks of the seismic data migration client transmitted by the server IO port, monitor and schedule the busy and idle conditions of the current working threads in real time. When there are idle working threads, it assigns the request tasks of the seismic data migration client to the idle working threads; within the working threads, it adaptively calls the server disk file processing handle to read the project structure file or read the corresponding disk file data based on the requested data type, or calls the data model parser to parse the database data, and calls the server IO port to send the corresponding byte stream to the seismic data migration client. The server IO port includes a network SOCKET, which is used for communication connection with the seismic data migration client. After the directory information byte stream, disk file byte stream sent by the server disk file processing handle or the database data byte stream sent by the data model converter enters the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol, realizing the data connection between the data file server and the seismic data migration client. A progress controller, which is used to count the progress of the seismic exploration project migration operation and display the migration operation progress information to the seismic data migration client in real time through the server IO port.

3. The online migration system for seismic exploration project data according to claim 2, wherein The process of the data model parser parsing the corresponding database physical table data in the database data is as follows: Establish a connection with the database and initialize the database operation handle; Based on the field names of the database physical table data requested by the seismic data migration client, splice the SQL statements for data query according to the field names, execute the SQL statements through the database operation handle, and send the queried data information to the data file server; After traversing and executing all the database physical table data, release the database operation handle, and the process of the data model parser parsing the database physical table data is completed.

4. The online migration system for seismic exploration project data according to claim 2 or 3, characterized in that The data file server further includes a breakpoint resumption scheduling system; The breakpoint resumption scheduling system is used to load the breakpoint record file. When the server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path when the server disk file processing handle processes this task, the size of each disk file byte stream read into the network SOCKET, and the original size of the disk file data, and updates the breakpoint record file in real time to control the seismic exploration project data migration process; after restarting in case of system exception, the breakpoint controller automatically loads the breakpoint record file, and compares the size of each recorded disk file byte stream with the original size of the disk file data. When the two sizes are the same, skip the file processing. When the two are inconsistent, it is the system exception point, and the task scheduler is used to start from the system exception point to re-call the server disk file processing handle to read the subsequent disk file data, realizing the recovery of the disk file data migration process in the seismic exploration project.

5. The online migration system for seismic exploration project data according to claim 1, wherein, The information included in the database model information includes: data schema information, data table information, data index information, and data uniqueness information.

6. The online migration system for seismic exploration project data according to claim 1, wherein, The seismic data migration client includes a client data file processing handle, a client IO port, and a model reconstructor; The client data file processing handle is used to request and send the directory structure information of seismic exploration project data to the data file server through the client IO port, and store the directory structure information in the local project structure file according to the directory information byte stream sent by the data file server; Read the local project structure file and parse the attributes of the nodes in the file. According to the attributes of the nodes, request the corresponding disk file data in the data file server. After receiving the disk file byte stream of the relevant disk file data sent by the data file server, the client data file processing handle writes the disk file byte stream into the corresponding file created in the disk directory of the seismic data migration client, and sets the corresponding file permissions; The client IO port is used to establish a connection and data communication with the data file server through the SOCKET protocol, and receive the relevant byte stream sent by the data file server; The model reconstructor is used to request the database model information in the database data from the data file server through the client IO port, store the obtained database model data byte stream in the local data table structure XML file, and reconstruct the database structure model through the database model data byte stream; The data reconstructor is also used to request the database physical table data from the data file server through the client IO port, and write the obtained database physical table data byte stream into the corresponding physical table of the local project database of the seismic data migration client in real time.

7. The online migration system for seismic exploration project data according to claim 6, wherein The specific process of the data reconstructor for requesting the database physical table data from the data file server through the client IO port and writing the obtained database physical table data byte stream into the corresponding physical table of the local project database of the seismic data migration client in real time is as follows: Establish a connection with the local project database of the seismic data migration client and initialize the local project database operation handle; Read the local data table structure XML file in the model reconstructor to obtain all the data table information in the file; Traverse all the data tables. For each data table, request the corresponding database physical table data from the data file server through the client IO port, and parse the field names of the database physical table data; Concatenate the SQL statements for data insertion based on all the field names of the corresponding database physical table data, use the local project database operation handle to execute the SQL statements, and insert the field names of the parsed database physical table data into the corresponding physical table of the local project database in sequence; After traversing all the data tables, the migration of the database physical table data is completed, and the local project database operation handle is released.

8. An online data migration method for seismic exploration projects, characterized in that, Adopt the online migration system for seismic exploration project data described in any one of claims 1 to 7. The method includes: Read the data directory structure information of the seismic exploration project through the data file server and store it in the project structure file; in response to the request of the seismic data migration client for the data directory structure information, read the project structure file, convert it into a directory information byte stream, and send it to the seismic data migration client; in response to the request of the seismic data migration client for the disk file data, read the corresponding disk file data, convert it into a disk file byte stream, and send it to the seismic data migration client; in response to the request of the seismic data migration client for the database data, read the database data, convert it into a database data byte stream, and send it to the seismic data migration client; Request the data directory structure information of the seismic exploration project from the data file server through the seismic data migration client, and receive the directory information byte stream sent by the data file server; request the corresponding disk file data from the data file server according to the received data directory structure information, and receive the disk file byte stream sent by the data file server; request the database data from the data file server, and receive the database data byte stream sent by the data file server; The database data includes database model information and database physical table data, and the database data byte stream includes a database model data byte stream and a database physical table data byte stream.

9. The online migration method for seismic exploration project data according to claim 8, characterized in that The data file server includes a server disk file processing handle, a data model parser, a task scheduler, a server IO port, and a progress controller; the server IO port includes a network SOCKET; Read the data directory structure information of the seismic exploration project through the data file server and store it in the project structure file; In response to the request of the seismic data migration client for the data directory structure information, read the project structure file, convert it into a directory information byte stream, and send it to the seismic data migration client; In response to the request of the seismic data migration client for the disk file data, read the corresponding disk file data, convert it into a disk file byte stream, and send it to the seismic data migration client; in response to the request of the seismic data migration client for the database data, read the database data, convert it into a database data byte stream, and send it to the seismic data migration client. The specific process is as follows: Read the data directory structure information of the seismic exploration project through the server disk file processing handle, store the data directory structure information in the project structure file, and record the exploration data type and exploration data file permission information in the project structure file for different types of exploration data; When processing the request of the seismic data migration client for the data directory structure information, read the project structure file and convert it into a directory information byte stream to be transmitted to the server IO port; When processing the request of the seismic data migration client for the disk file data through the server disk file processing handle, read the disk file data on the data file server, and convert the disk file data into a disk file byte stream to be transmitted to the server IO port; When the data model parser processes the database model information in the database data of the seismic data migration client request, it parses the corresponding database model information in the database data and converts it into a database model data byte stream to be transmitted to the server IO port; when the data model parser processes the database physical table data in the database data of the seismic data migration client request, it parses the corresponding database physical table data in the database data and converts it into a database physical table data byte stream to be transmitted to the server IO port; The task scheduler responds in real time to the request tasks of the seismic data migration client transmitted by the server IO port, monitors and schedules the busy and idle conditions of the current working threads in real time. When there are idle working threads, it assigns the request tasks of the seismic data migration client to the idle working threads; within the working threads, it adaptively calls the server disk file processing handle to read the project structure file or the corresponding disk file data based on the requested data type, or calls the data model parser to parse the database data, and calls the server IO port to send the corresponding byte stream to the seismic data migration client; It communicates and connects with the seismic data migration client through the server IO port. After the directory information byte stream, disk file byte stream sent by the server disk file processing handle or the database data byte stream sent by the data model converter enters the network SOCKET, it is sent to the seismic data migration client in real time through the SOCKET protocol, realizing the data connection between the data file server and the seismic data migration client; The progress controller counts the migration job progress of the seismic exploration project and displays the migration job progress information to the seismic data migration client in real time through the server IO port.

10. The method for online migration of seismic exploration project data according to claim 9, characterized in that, The process of the data model parser parsing the corresponding database physical table data in the database data is as follows: Establish a connection with the database and initialize the database operation handle; Based on the field names of the database physical table data requested by the seismic data migration client, splice the SQL statements for data query according to the field names, execute the SQL statements through the database operation handle, and send the queried data information to the data file server; After traversing and executing all the database physical table data, release the database operation handle, and the process of the data model parser parsing the database physical table data is completed.

11. The method for online migration of seismic exploration project data according to claim 9 or 10, characterized in that, The data file server also includes a breakpoint resume transfer scheduling system; At the beginning of the online migration method for seismic exploration project data, a breakpoint record file is loaded through a breakpoint resuming scheduling system; after a server disk file processing handle processes a disk file data task, the breakpoint controller records the absolute file path when the server disk file processing handle processes the task, the size of each disk file byte stream read into the network SOCKET, and the original size of the disk file data, and updates the breakpoint record file in real time to control the data migration process of the seismic exploration project; after the system restarts in case of an anomaly, the breakpoint controller automatically loads the breakpoint record file, and compares the size of each recorded disk file byte stream with the original size of the disk file data. When the two sizes are the same, the file processing is skipped. When the two are inconsistent, it is the system anomaly point. The task scheduler is used to start from the system anomaly point and re-call the server disk file processing handle to read the subsequent disk file data, so as to realize the recovery of the disk file data migration process in the seismic exploration project.

12. Application of the online migration method for seismic exploration project data according to any one of claims 8 to 11, characterized in that, The online migration method for seismic exploration project data is used for data migration of seismic exploration projects.

13. A computer device, characterized in that, The computer device includes a processor and a memory. The memory is used to store at least one segment of computer program, and the at least one segment of computer program is loaded and executed by the processor to perform the online migration method for seismic exploration project data according to any one of claims 8 to 11.

14. A storage medium, characterized in that, The storage medium is used to store at least one segment of computer program, and the at least one segment of computer program is used to perform the online migration method for seismic exploration project data according to any one of claims 8 to 11.

Images