Connection Mapping Table for Distributed Database Overhead Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed database systems, establishing and managing connections between computing nodes and storage nodes leads to significant data acquisition overheads, potential memory errors, and inefficient use of connections, resulting in reduced system performance.
Innovation Solution
A data management method and apparatus that utilize a connection mapping table and connection stacks to efficiently manage connections between computing nodes and storage nodes, allowing for the reuse of connections and reducing the need for frequent connection establishment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If connections are established for each service data request, then data acquisition can be performed, but data acquiring overheads increase and system performance decreases
Solution Approach 1:
The patent pre-establishes multiple connections between computing nodes and storage nodes before actual data acquisition operations. These connections are maintained in a connection pool and can be reused for multiple service data requests, eliminating the need to establish connections repeatedly and reducing connection establishment overhead.
Solution Approach 2:
The patent creates a connection pool where a single connection can serve multiple service data requests. Instead of dedicating a new connection for each request, the same connection can be reused across different requests, making the connection resource universal and multi-functional.
2Productivity
If a large quantity of connections are established in a short time, then data acquisition capacity increases, but memory errors occur
Solution Approach 1:
The system pre-establishes a limited number of connections in advance and stores them in a connection pool. This prevents the system from establishing a large quantity of connections simultaneously, thereby avoiding memory errors while maintaining adequate data acquisition capacity through connection reuse.
Solution Approach 2:
The patent implements connection recycling by maintaining connections in an idle state within the connection pool after use. Instead of discarding connections immediately, they are recovered and kept available for future requests, reducing the need to continuously establish new connections and preventing memory exhaustion.
3Productivity
If connections are maintained all the time, then connection reuse is enabled, but idle connections accumulate and performance decreases
Solution Approach 1:
The patent implements dynamic connection management where connections are maintained in an idle state within the connection pool only when needed and for limited periods. The system dynamically adjusts connection availability based on actual demand, preventing excessive accumulation of idle connections while enabling efficient reuse when needed.
Solution Approach 2:
The system recycles connections by keeping them in the connection pool after use, but implements mechanisms to discard connections that remain idle beyond certain thresholds. This balance ensures connections are reused efficiently when needed while preventing excessive accumulation of permanently idle connections that would waste system resources.
Data Source
AI summary
A data management method includes: receiving a node access request for a target storage node, and acquiring a target storage node primary key of the target storage node; traversing a connection mapping table based on the target storage node primary key; one connection stack including N pieces of network connection information in an idle connection state; N being a natural number; acquiring, in response to identifying a target connection stack corresponding to the target storage node primary key from the connection mapping table, target network connection information from N pieces of network connection information included in the target connection stack, establishing a target connection relationship with the target storage node based on the target network connection information, and acquiring, from the target storage node based on the target connection relationship, service data requested by the node access request.