Parallel Processing Runtime System with Intermediate Representation

The patent introduces a runtime system as an intermediary layer between the application and the parallel-processing computer system. This runtime system includes a language-specific interface that translates various programming languages into a common intermediate representation, and a front end that converts this intermediate representation into execution instructions for different processing architectures. This mediator approach enables the system to support multiple programming languages and architectures without requiring complex direct integration of each language and architecture combination, thus improving adaptability while managing device complexity.

The patent implements dynamic arrangement of compute kernels on processing elements through the runtime system's execution scheduler. The scheduler dynamically determines which compute kernels to execute on which processing elements based on current system state, workload characteristics, and resource availability. This dynamic allocation mechanism improves productivity by optimizing execution efficiency in real-time, while the modular design of the runtime system manages the associated complexity through standardized interfaces and algorithms.

The patent employs caches to store pre-compiled compute kernels and intermediate representations. When the same computation is needed again, the system retrieves it from the cache instead of recompiling, significantly reducing compilation time. The front end of the runtime system includes compilation caches that store intermediate representations and execution caches that store optimized machine code. This preliminary action of caching compilation results eliminates redundant compilation work, reducing time loss while the structured cache management approach keeps the added complexity manageable.