Data transmission load control system and method

Abstract

The invention provides a data transmission load control system and method, and belongs to the field of oil-gas exploration. The method comprises the following steps of data acquisition, real-time flow monitoring, permission application, data transmission, dynamic permission adjustment and starting of an exception handling plan. According to the method, through real-time flow monitoring, a permission application mechanism, dynamic permission adjustment and an exception handling plan, the stability and efficiency of data transmission are remarkably improved, and network congestion and server overload can be effectively prevented. The continuity and reliability of data transmission are ensured while the system is ensured to efficiently utilize resources, and the waste of manpower and material resources is reduced.

Description

Technical Field

[0001] This invention belongs to the field of oil and gas exploration and relates to a data backhaul technology for intelligent nodes, and more specifically to a data transmission load control system and method. Background Technology

[0002] Existing smart node data recovery technologies used in the oil and gas exploration industry have significant limitations, particularly in load control. When a large number of nodes simultaneously connect to storage devices, network congestion and server overload often occur. This not only severely impacts data transmission speed but can also lead to system instability and data loss.

[0003] Current solutions typically rely on batch transmission, but this method is inefficient and wastes a lot of human and material resources. Therefore, there is an urgent need for a new method that can effectively prevent network congestion and server overload to ensure efficient and reliable data transmission. Summary of the Invention

[0004] The purpose of this invention is to solve the problems existing in the prior art and provide a data transmission load control system and method to improve the stability and efficiency of data transmission and prevent network congestion and server overload.

[0005] This invention is achieved through the following technical solution:

[0006] A first aspect of the present invention provides a data transmission load control method, the method comprising the following steps:

[0007] Data acquisition, real-time traffic monitoring, permission request, data transmission, dynamic permission adjustment, and activation of contingency plans for handling anomalies.

[0008] A further improvement of the present invention is that the data acquisition step includes: the intelligent node acquires seismic data through sensors and places it on the data transmission cabinet.

[0009] A further improvement of the present invention is that the real-time traffic monitoring step includes: real-time traffic monitoring of the communication channel between the data transmission cabinet and the NAS storage, and detection of abnormal network fluctuations.

[0010] A further improvement of the present invention is that the step of requesting permission includes:

[0011] Before data transmission, the smart node requests transmission permission from the permission server. The permission server decides whether to grant permission based on the current network and NAS storage load.

[0012] A further improvement of the present invention is that the data transmission cabinet listens for the insertion event of the intelligent node;

[0013] When the data transmission cabinet is set to data transmission mode and a smart node is inserted, the smart node will request permissions from the permission server.

[0014] If there are remaining permissions on the server at this time, the permission request will be successfully granted; otherwise, the server will remain in a waiting state and continue to request permissions.

[0015] A further improvement of the present invention is that the data transmission step includes:

[0016] Once authorized, the intelligent node transmits seismic data to the data transmission cabinet, which then transmits the seismic data to the NAS storage via fiber optic cable or network cable.

[0017] A further improvement of the present invention is that the step of dynamically adjusting permissions includes:

[0018] When the permission server detects network congestion or NAS storage overload, it reduces the number of permissions granted, thereby reducing the number of nodes transmitting data simultaneously.

[0019] When the permissions server detects that the network and NAS storage load have returned to normal, it gradually increases the number of permissions granted to restore normal transmission speed.

[0020] A further improvement of the present invention is that the step of activating the abnormal handling plan includes: if a long-term network congestion or NAS storage overload occurs during data transmission, the system will activate the abnormal handling plan.

[0021] A further improvement of the present invention is that the duration of prolonged network congestion or NAS storage overload is set to a preset duration.

[0022] The average transmission speed is monitored and recorded every minute by the authorization server. If the transmission speed is abnormal for a period of time exceeding the preset duration, the exception handling plan will be activated.

[0023] A second aspect of the present invention provides a data transmission load control system, the system comprising:

[0024] Intelligent nodes: Deployed at oil and gas exploration sites, they are responsible for seismic data acquisition and connect to data transmission cabinets via wired networks;

[0025] Data transmission cabinet: Used to receive seismic data from intelligent nodes and transmit the data to NAS storage. The data transmission cabinet is connected to the NAS storage via fiber optic cable or network cable.

[0026] NAS storage: Used to store and manage transmitted seismic data, and to monitor data transmission traffic and network status in real time;

[0027] Permission server: Used to control data transmission permissions for nodes;

[0028] The data transmission cabinet, NAS storage, and access control server form a local area network via a switch and communicate with each device through its IP address.

[0029] Compared with the prior art, the beneficial effects of the present invention are:

[0030] This invention significantly improves the stability and efficiency of data transmission through real-time traffic monitoring, permission request mechanisms, dynamic permission adjustments, and contingency plans for handling anomalies, effectively preventing network congestion and server overload. It ensures that the system utilizes resources efficiently while guaranteeing the continuity and reliability of data transmission, reducing waste of human and material resources. Attached Figure Description

[0031] Figure 1 This is a network topology diagram of the present invention;

[0032] Figure 2 This is a flowchart of the process of the present invention. Detailed Implementation

[0033] The present invention will now be described in further detail with reference to the accompanying drawings:

[0034] This invention aims to solve the load (actually referring to intelligent nodes) control problem in the existing intelligent node data recovery technology in the oil and gas exploration industry, especially the network congestion and server overload caused when a large number of nodes are connected to the storage device at the same time.

[0035] This invention provides a data transmission load control system and method that performs real-time traffic monitoring of the communication channel between the data transmission cabinet and NAS storage to detect abnormal network fluctuations; establishes an authorization server, where nodes request authorization from the server before transmission, thereby controlling the number of nodes simultaneously transmitting data; when network congestion or NAS storage overload is detected, the authorization server reduces the number of authorizations to prevent congestion; if prolonged network congestion or NAS storage overload occurs during transmission, the system activates an emergency handling plan, including buffered storage and delayed transmission.

[0036] like Figure 1 As shown, the data transmission load control system provided by the present invention includes:

[0037] Intelligent nodes: Deployed at oil and gas exploration sites, they are responsible for seismic data acquisition and connect to data transmission cabinets via wired networks.

[0038] Data transmission cabinets: Each data transmission cabinet has multiple node ports for receiving seismic data from intelligent nodes and transmitting the data to NAS storage. Multiple data transmission cabinets are connected to the NAS storage via fiber optic cables or network cables.

[0039] NAS storage: Used to store and manage transmitted seismic data, and to monitor data transmission traffic and network status in real time.

[0040] Permission server: Used to control data transmission permissions for nodes. The permission server dynamically adjusts the number of nodes granted permissions based on actual conditions, such as network bandwidth and NAS storage load.

[0041] If abnormal data transmission speed is detected, the number of permissions on the permission server will be gradually reduced to reduce the number of nodes performing data transmission at the same time, thereby reducing the NAS storage load.

[0042] The data transmission cabinet, NAS storage, and access control server form a local area network via a switch and communicate with each device through its IP address.

[0043] This invention is mainly achieved through the following methods:

[0044] (1) Real-time traffic monitoring of the communication channel between the data transmission cabinet and the NAS storage to detect abnormal network fluctuations, such as network congestion or NAS storage overload.

[0045] (2) Before transmitting data, a node needs to apply for permission from the server. After obtaining permission, it can transmit data, effectively controlling the number of nodes transmitting data at the same time.

[0046] Specifically, the data transmission cabinet can listen for node insertion events. When the data transmission cabinet is set to data transmission mode and a node is inserted, the node will request permissions from the permission server. If there are remaining permissions on the server at this time, the request will be successful and permissions will be granted; otherwise, it will remain in a waiting state and continue to request permissions.

[0047] (3) When the permission server detects network congestion or NAS storage overload, the permission server appropriately reduces the number of permissions issued, thereby reducing the number of nodes that transmit data at the same time.

[0048] When the permission server detects that the network and NAS storage load have returned to normal, it gradually increases the number of permissions granted, restores the normal transmission speed, and puts the system in optimal operating condition.

[0049] (4) If network congestion or NAS storage overload occurs during data transmission, the system will implement an emergency handling plan, including buffer storage and delayed transmission.

[0050] like Figure 2 As shown, the specific process of data recycling using the described method is as follows:

[0051] The intelligent node collects seismic data through sensors and places it on the data transmission cabinet;

[0052] Real-time traffic monitoring of the communication channel between the data transmission cabinet and the NAS storage is performed to detect abnormal network fluctuations, such as network congestion or NAS storage overload.

[0053] Before data transmission, the smart node requests transmission permission from the permission server. The permission server decides whether to grant permission based on the current network and NAS storage load.

[0054] The authorized smart node transmits the seismic data to the data transmission cabinet, which then transmits the data to the NAS storage via fiber optic cable or network cable.

[0055] When the permission server detects network congestion or NAS storage overload, it reduces the number of permissions granted, thereby reducing the number of nodes transmitting data simultaneously.

[0056] When the permission server detects that the network and NAS storage load have returned to normal, it gradually increases the number of permissions granted and restores the normal transmission speed.

[0057] If prolonged network congestion or NAS storage overload occurs during data transmission, the system will activate the contingency plan for handling such incidents.

[0058] The embodiments of the present invention are as follows:

[0059] This embodiment demonstrates a data recycling technology for intelligent nodes, including detailed aspects such as real-time traffic monitoring, permission request mechanisms, dynamic permission adjustments, and the activation of contingency plans for handling anomalies. It is primarily applied in the oil and gas exploration field, particularly for data transmission load control of intelligent nodes.

[0060] Example 1

[0061] The data transmission load control system of the intelligent node includes:

[0062] Intelligent Node: This is a seismic data acquisition device, which can be considered a data storage device. After acquisition, it is placed on a data transmission cabinet for data transmission. Simply exporting the seismic data from the node is sufficient. Data transmission is achieved via USB connection between the contacts on the data transmission cabinet and the contacts on the node.

[0063] Data transfer cabinets: Each data transfer cabinet has 40 node ports, each consisting of an Orange Pi and a charging module. Five data transfer cabinets are connected to the NAS storage in a star topology via gigabit Ethernet cables.

[0064] NAS storage: This is a purchased commercial server with an embedded monitoring module. It is used to store and manage the transmitted seismic data, and to monitor data transmission traffic and network conditions in real time.

[0065] Permission server: Composed of a Raspberry Pi and a charging module, used to control the data transmission permissions of nodes.

[0066]

Example 2

[0067] The data transmission load control method for the intelligent node includes:

[0068] 1) Data Acquisition: The intelligent nodes collect oil and gas exploration data through sensors. In this embodiment, each node stores approximately 1GB of seismic data over four days.

[0069] 2) Real-time traffic monitoring: The communication channel between the data transmission cabinet and the NAS storage is monitored in real time by the monitoring module, and abnormal fluctuations are detected in a timely manner.

[0070] Specifically, the total write speed of the hard drives in the NAS storage is considered the total bandwidth. If the transfer speed remains too low for an extended period, it is considered abnormal. For example, a normal total write speed is 100MB / s. If the speed remains below 1MB / s for an extended period, the transfer speed is considered abnormal.

[0071] 3) Permission Request: Before data transmission, the smart node requests transmission permission from the permission server. The permission server decides whether to grant permission based on the current network and NAS storage load.

[0072] Specifically, the total number of permissions can be set in the permission server. Before a node is about to transmit data, it must request permissions from the server. Data transmission can only proceed after the permissions are successfully granted.

[0073] Once a node requests permission and begins data transmission, the number of permissions on the permission server decreases accordingly (reducing the total number of permissions). After the node completes the data transmission, it returns the permissions. If no permissions are available on the server when a node requests permissions, the node will not transmit data and will remain in a waiting state.

[0074] 4) Data Transmission: Authorized smart nodes transmit data to the data transmission cabinet via USB connection. The data transmission cabinet performs preliminary data processing (parses the data to extract information such as GPS coordinates, timestamps, node IDs, and operating modes), and then transmits the data to NAS storage via fiber optic cable or network cable.

[0075] 5) Dynamic permission adjustment: When the monitoring module detects network congestion or NAS storage overload (prolonged low data transfer rates), it immediately notifies the permission server. The permission server reduces the number of permissions granted, thereby reducing the number of nodes transmitting data simultaneously and preventing further congestion.

[0076] Once the permission server detects that the network and NAS storage load have returned to normal, it gradually increases the number of granted permissions, restoring normal transfer speeds. This is implemented by the Raspberry Pi used as the permission server.

[0077] 6) Contingency Plan: If prolonged network congestion or NAS storage overload occurs during data transmission, the system will activate the contingency plan, which will be implemented by each Orange Pie.

[0078] The duration of prolonged network congestion or NAS storage overload can be set to a preset duration (usually half an hour). The authorization server monitors and records the average transmission speed per minute. If the transmission speed is abnormal for a longer period than the preset duration, the exception handling plan will be activated.

[0079] This invention monitors the communication channel traffic between the data transmission cabinet and the NAS storage in real time, detecting and preventing abnormal network fluctuations to ensure the stability and efficiency of data transmission. Simultaneously, it dynamically adjusts the number of parallel working transmission ports based on transmission speed fluctuations, effectively preventing network congestion and NAS storage overload, thereby improving data transmission efficiency and reliability.

[0080] Compared to traditional batch data transmission methods, this invention reduces manual intervention and resource waste, and enhances system stability through an intelligent data transmission load control mechanism. It provides an efficient, reliable, and intelligent smart node data recovery solution to overcome the shortcomings of existing technologies and meet the needs of practical applications. This invention can also be extended to fields such as mineral exploration, environmental monitoring, and smart agriculture, and has broad application prospects and market potential.

[0081] In the description of this invention, it should be noted that, unless otherwise explicitly specified and limited, the terms "connected" and "linked" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0082] In the description of this invention, unless otherwise stated, the terms "upper," "lower," "left," "right," "inner," "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.

[0083] The above technical solution is only one embodiment of the present invention. For those skilled in the art, based on the principles disclosed in the present invention, it is easy to make various types of improvements or modifications, and not limited to the technical solutions described in the specific embodiments of the present invention. Therefore, the foregoing description is only a preferred option and is not restrictive.

Claims

1. A data transmission load control method, characterized in that: The method includes the following steps: data acquisition, real-time traffic monitoring, permission application, data transmission, dynamic permission adjustment, and activation of anomaly handling contingency plans.

2. The data transmission load control method according to claim 1, characterized in that: The data acquisition steps include: the intelligent node collects seismic data through sensors and places it on the data transmission cabinet.

3. The data transmission load control method according to claim 2, characterized in that: The real-time traffic monitoring steps include: real-time traffic monitoring of the communication channel between the data transmission cabinet and the NAS storage, and detection of abnormal network fluctuations.

4. The data transmission load control method according to claim 3, characterized in that: The permission application process includes: before data transmission, the smart node requests transmission permission from the permission server, and the permission server decides whether to grant permission based on the current network and NAS storage load.

5. The data transmission load control method according to claim 4, characterized in that: The data transmission cabinet listens for smart node insertion events. When the data transmission cabinet is set to data transmission mode and a smart node is inserted, the smart node requests permissions from the permission server. If there are remaining permissions on the server at this time, the request is successful and permissions are granted; otherwise, it remains in a waiting state and continues to request permissions.

6. The data transmission load control method according to claim 4, characterized in that: The data transmission steps include: an authorized smart node transmitting seismic data to a data transmission cabinet, which then transmits the seismic data to NAS storage via fiber optic cable or network cable.

7. The data transmission load control method according to claim 6, characterized in that: The steps for dynamically adjusting permissions include: When the permission server detects network congestion or NAS storage overload, it reduces the number of permissions granted, thereby reducing the number of nodes transmitting data simultaneously. When the permissions server detects that the network and NAS storage load have returned to normal, it gradually increases the number of permissions granted to restore normal transmission speed.

8. The data transmission load control method according to claim 6, characterized in that: The steps for activating the contingency plan include: if prolonged network congestion or NAS storage overload occurs during data transmission, the system will activate the contingency plan.

9. The data transmission load control method according to claim 8, characterized in that: Set the duration of prolonged network congestion or NAS storage overload to a preset duration; The average transmission speed is monitored and recorded every minute by the authorization server. If the transmission speed is abnormal for a period of time exceeding the preset duration, the exception handling plan will be activated.

10. A data transmission load control system, characterized in that: The system includes: Intelligent nodes: Deployed at oil and gas exploration sites, they are responsible for seismic data acquisition and connect to data transmission cabinets via wired networks; Data transmission cabinet: Used to receive seismic data from intelligent nodes and transmit the data to NAS storage. The data transmission cabinet is connected to the NAS storage via fiber optic cable or network cable. NAS storage: Used to store and manage transmitted seismic data, and to monitor data transmission traffic and network status in real time; Permission server: Used to control data transmission permissions for nodes; The data transmission cabinet, NAS storage, and access control server form a local area network via a switch and communicate with each device through its IP address.

Images