Agent-Based Data Acquisition and Analysis Automation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional computer systems face inefficiencies in data analysis due to the need for users to wait for large data transmissions to complete before issuing analysis instructions, which can take several tens of hours, and are prone to delays due to network or system states.
Innovation Solution
A computer system with a first computer for data accumulation and a second computer for data analysis, where a fetching agent manages data acquisition and analysis processes, allowing for parallel processing and automatic execution of data fetching and analysis without user intervention, by defining a minimum analysis dataset and repetition units for each analysis target.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data transmission is performed manually and analysis instruction is issued after transmission completion, then data accuracy is ensured, but operation efficiency deteriorates due to waiting time of several tens of hours
Solution Approach 1:
The system performs preliminary actions by automatically monitoring data transmission progress and preparing analysis instructions in advance. The agent continuously checks transmission status and automatically issues analysis instructions as soon as transmission completes, eliminating the need for users to wait and manually initiate analysis.
Solution Approach 2:
The system provides self-service functionality where the agent autonomously manages the entire workflow from data transmission monitoring to analysis instruction issuance. The agent independently tracks transmission progress, determines completion status, and triggers analysis without requiring user intervention, thereby improving operational efficiency.
2Ease of operation
If users manually monitor data transmission completion, then transmission accuracy is ensured, but device complexity increases due to user intervention requirements
Solution Approach 1:
The agent serves as an intermediary between the data transmission process and the analysis system. It automatically monitors transmission progress, determines completion status, and triggers analysis instructions, thereby simplifying user operations while managing the complexity of automated monitoring and coordination internally.
Solution Approach 2:
The system implements automatic feedback mechanisms where the agent continuously monitors data transmission progress and receives status updates. Based on this feedback, the agent automatically determines when transmission is complete and triggers the appropriate analysis instructions, eliminating the need for manual user monitoring.
3Productivity
If data transmission starts at midnight and analysis is performed the next morning, then power consumption is reduced, but productivity decreases due to delayed analysis processing
Solution Approach 1:
The system dynamically adjusts its operation timing based on real-time conditions. Instead of fixed overnight batch processing, the agent monitors data transmission continuously and triggers analysis immediately upon completion, regardless of the time of day. This dynamic approach maximizes productivity while allowing flexible power management based on actual operational needs.
Data Source
AI summary
A computer system includes a first computer and a second computer. The second computer includes, a minimum analysis dataset in which a data item serving as an analysis target and a repetition unit are defined in advance for each analysis target and an agent. The agent receives an analysis target data fetching designation including the minimum analysis dataset, a repetition range of repeating acquisition of data, and a repetition unit. The agent generates a first process that acquires data from the first computer and a first instance that executes processing within the first process on the basis of the repetition range and the repetition unit and activate the first instance to acquire the accumulated data from the first computer. When the processing of the first instance is completed, the agent generates a second process that executes analysis processing and a second instance that executes processing within the second process.