Logical Thread Quantity Adjustment for Real-Time Data Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In real-time computing systems, the fixed pre-allocation of logical thread resources leads to inefficiencies when data volumes fluctuate, resulting in either underutilization or overutilization of resources, affecting data processing efficiency.
Innovation Solution
A method to dynamically adjust the number of logical threads based on the load state of data processing queues, determining whether adjustments are needed by assessing the utilization rate and making adjustments to prevent excessive or insufficient thread allocation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If a small number of logical thread resources are pre-allocated to one component, then resource waste is reduced, but execution efficiency becomes low affecting real-time computing of data
Solution Approach 1:
The patent implements dynamic adjustment of logical thread resources based on real-time load states. The system monitors data volume in processing queues and automatically adjusts the number of logical threads allocated to each component, transitioning from static pre-allocation to dynamic allocation that adapts to changing workloads, thereby resolving the contradiction between resource utilization and execution efficiency
Solution Approach 2:
The system establishes a feedback mechanism that continuously monitors the load state of logical threads through data processing queue metrics. Based on this feedback, the system determines whether to increase or decrease thread allocation, creating a closed-loop control system that optimizes both resource utilization and execution efficiency through iterative adjustment
2Productivity
If many logical thread resources are pre-allocated to one component, then execution efficiency is improved, but resources are wasted when data amount is small
Solution Approach 1:
The system dynamically reduces logical thread allocation when load demand decreases. By monitoring queue depths and processing rates, the system automatically scales down thread resources during low-utilization periods, preventing resource waste while maintaining high execution efficiency during peak demand through real-time adaptation
Solution Approach 2:
The patent changes the parameter of logical thread count based on measured load conditions. When monitoring indicates low data volume or idle queue states, the system adjusts the thread count parameter downward, optimizing resource utilization without compromising execution efficiency when high performance is needed
3Device complexity
If fixed logical thread resources are pre-allocated to each component, then resource allocation is simple, but adaptability to data volume changes is poor
Solution Approach 1:
The system implements self-service resource allocation where each component autonomously monitors its own load state and requests appropriate thread resources. The master device coordinates these self-service requests, allowing components to automatically adapt to data volume changes without complex centralized control, thus maintaining simplicity while improving adaptability
Solution Approach 2:
The system performs preliminary monitoring of data queue states to anticipate resource needs. By detecting trends in data volume before they impact processing capacity, the system proactively adjusts thread allocation in advance, improving adaptability while maintaining relatively simple allocation mechanisms through predictive rather than reactive adjustments
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method and an apparatus for adjusting the number of component logical threads. The method includes: acquiring a plurality of logical threads that is callable by a component (S11); determining a load state of each logical thread according to a utilization rate of a data processing queue corresponding to each logical thread (S12), the load state including a normal load state and an abnormal load state; determining, according to the load states of the logical threads of the component, whether the number of logical threads of the component needs to be adjusted (S13); and adjusting the number of logical threads of the component according to the determination result if the number of logical threads of the component needs to be adjusted (S14). By using the method and the apparatus, the utilization rate of resources is improved while ensuring real-time calculation of data.