Supercomputer Administration Server with Pre-loaded Environment Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The administration of large-scale supercomputers is hindered by the significant latency caused by loading vast volumes of environmental information into memory for each administration task, making existing tools unusable due to delays of several seconds or minutes, especially as supercomputers approach tens of millions of interconnected items.
Innovation Solution
A method and system where an administration server pre-loads environmental information into memory and uses a dedicated process for each client to execute administration tasks, leveraging a copy-on-write mechanism to ensure updates do not affect ongoing tasks and minimize network traffic, with a remote procedure call mechanism managing competing client requests.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If environmental information is loaded into memory for each administration task, then the task can be executed with access to complete supercomputer environment data, but the latency time increases to several seconds or minutes
Solution Approach 1:
The system pre-loads the complete environmental information of the supercomputer into the administration server's memory before any administration tasks are executed. This preliminary action ensures that when administration tasks are submitted, the required environment data is already available in memory, eliminating the need to load it for each individual task and thus reducing latency time.
Solution Approach 2:
The pre-loaded environmental information in the administration server serves multiple administration tasks simultaneously. Instead of loading separate copies of environment data for each task, a single loaded instance is shared across multiple clients and tasks, making the system more efficient and reducing overall memory usage while maintaining fast access.
2Speed
If all environment information is loaded into memory, then administration tasks can execute quickly, but memory consumption increases significantly
Solution Approach 1:
Instead of each administration client loading and storing complete copies of the supercomputer environment information in its own memory, the system creates a centralized copy in the administration server's memory. Multiple clients access this single copy through the server, eliminating redundant storage across multiple systems while maintaining fast access speeds.
3Reliability
If environment information is updated, then the supercomputer reflects current state, but ongoing administration tasks may be affected by the update
Solution Approach 1:
The system implements dynamic versioning of environment information. When updates occur, the administration server maintains multiple versions of the environment data and dynamically assigns the appropriate version to each administration task based on when it was submitted. This allows the system to reflect current state accuracy while ensuring that ongoing tasks operate on a stable, consistent snapshot of the environment.
Data Source
AI summary
The invention relates in particular to an administration server (S) of a supercomputer suitable for first loading information on the environment of said supercomputer; receiving an administration task transmitted by an administration client (C1, C2); executing said administration task in collaboration with said information, previously loaded; and transmitting the results of the execution of said administration task to said administration client.