Logical Thread Quantity Adjustment for Real-Time Data Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In real-time computing systems, the fixed pre-allocation of logical thread resources leads to inefficiencies when data volumes fluctuate, resulting in either underutilization or overutilization of resources, affecting data processing efficiency.

Innovation Solution

A method to dynamically adjust the number of logical threads based on the load state of data processing queues, determining whether adjustments are needed by assessing the utilization rate and making adjustments to prevent excessive or insufficient thread allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If a small number of logical thread resources are pre-allocated to one component, then resource waste is reduced, but execution efficiency becomes low affecting real-time computing of data

Engineering Contradiction:
Improveresource utilization rateVSAvoidexecution efficiency
Core Design Contradiction:
Loss of energyVSProductivity

Solution Approach 1:

The patent implements dynamic adjustment of logical thread resources based on real-time load states. The system monitors data volume in processing queues and automatically adjusts the number of logical threads allocated to each component, transitioning from static pre-allocation to dynamic allocation that adapts to changing workloads, thereby resolving the contradiction between resource utilization and execution efficiency

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system establishes a feedback mechanism that continuously monitors the load state of logical threads through data processing queue metrics. Based on this feedback, the system determines whether to increase or decrease thread allocation, creating a closed-loop control system that optimizes both resource utilization and execution efficiency through iterative adjustment

Inventive Principle:
Principle #23Feedback

2Productivity

If many logical thread resources are pre-allocated to one component, then execution efficiency is improved, but resources are wasted when data amount is small

Engineering Contradiction:
Improveexecution efficiencyVSAvoidresource utilization rate
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The system dynamically reduces logical thread allocation when load demand decreases. By monitoring queue depths and processing rates, the system automatically scales down thread resources during low-utilization periods, preventing resource waste while maintaining high execution efficiency during peak demand through real-time adaptation

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of logical thread count based on measured load conditions. When monitoring indicates low data volume or idle queue states, the system adjusts the thread count parameter downward, optimizing resource utilization without compromising execution efficiency when high performance is needed

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If fixed logical thread resources are pre-allocated to each component, then resource allocation is simple, but adaptability to data volume changes is poor

Engineering Contradiction:
Improveresource allocation complexityVSAvoidadaptability to data volume
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system implements self-service resource allocation where each component autonomously monitors its own load state and requests appropriate thread resources. The master device coordinates these self-service requests, allowing components to automatically adapt to data volume changes without complex centralized control, thus maintaining simplicity while improving adaptability

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary monitoring of data queue states to anticipate resource needs. By detecting trends in data volume before they impact processing capacity, the system proactively adjusts thread allocation in advance, improving adaptability while maintaining relatively simple allocation mechanisms through predictive rather than reactive adjustments

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3399413B1Component logical threads quantity adjustment method and device
Publication Date: 2021.05.05 ALIBABA GROUP HOLDING LTD
  • EP3399413B1 patent drawingFigure 1
  • EP3399413B1 patent drawingFigure 2
  • EP3399413B1 patent drawingFigure 3

AI summary

A method and an apparatus for adjusting the number of component logical threads. The method includes: acquiring a plurality of logical threads that is callable by a component (S11); determining a load state of each logical thread according to a utilization rate of a data processing queue corresponding to each logical thread (S12), the load state including a normal load state and an abnormal load state; determining, according to the load states of the logical threads of the component, whether the number of logical threads of the component needs to be adjusted (S13); and adjusting the number of logical threads of the component according to the determination result if the number of logical threads of the component needs to be adjusted (S14). By using the method and the apparatus, the utilization rate of resources is improved while ensuring real-time calculation of data.