Object Storage Arithmetic Logic Execution for Data Processing Speed
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional load distribution systems experience reduced data processing efficiency when handling large amounts of continuous data, such as several gigabytes, due to inefficient data supply and processing methods.
Innovation Solution
A system that reverses the data supply direction by executing arithmetic logic directly on storage devices, using a user application with predetermined arithmetic logic stored in object storage, which compiles and stores execution images for various heterogeneous devices, allowing direct data processing without intermediate code or virtual machines.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If data is supplied from storage to computer processor to execute jobs, then computing power can be maximized, but data processing efficiency is significantly reduced when handling large amounts of continuous data of several gigabytes or more
Solution Approach 1:
The patent inverts the conventional data processing direction by enabling the storage device to execute arithmetic logic directly on stored data, rather than supplying all data to the computer processor. This is achieved through a system where the storage device contains an execution unit that can run arithmetic logic locally, eliminating the need to transfer large amounts of continuous data to the computer for processing.
2Adaptability or versatility
If data is divided into small units for processing, then processing can be distributed, but data processing efficiency is reduced for large amounts of continuous data
Solution Approach 1:
The patent segments the processing function by dividing it between the storage device's execution unit and the computer. The storage device handles arithmetic operations directly on stored data, while the computer manages higher-level control and coordination. This segmentation allows continuous data to be processed efficiently without requiring division into small transfer units.
Data Source
AI summary
Provided are a system, an information processing method, and a program capable of improving a speed of information processing without using an intermediate code or the like even in a case where a plurality of heterogeneous devices are used. A system 1 includes: a source acquisition part 200 that acquires a source code; an arithmetic logic identification part 202 that identifies an arithmetic logic from the source code by using a predetermined API; an arithmetic logic supply part 208 that supplies the arithmetic logic to a compiler of a processor designated on the basis of the source code; a correspondence table creation part 210 that, when an object storage 400 stores a result obtained by compiling of the compiler of the designated processor as an execution image, creates a processor correspondence table in which a path to the execution image, which is stored in the object storage 400, in the designated processor is associated with the designated processor and stores the processor correspondence table in the object storage 400; and a correspondence relation determination part 212 that stores a correspondence relation, in which the arithmetic logic supplied by the arithmetic logic supply part 202 is associated with a storage path of the processor correspondence table stored in the object storage 400, in the object storage 400.