Data Collection System Priority-Based Resource Allocation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In large-scale data collection systems, the use of a first-in, first-out (FIFO) queuing method for managing processes can significantly impact throughput performance due to equal access to computing resources, leading to inefficiencies and delays in critical processes.

Innovation Solution

A system that assigns priority levels to data collection processes and calculates a query interval for requesting processing resources based on priority, releasing resources when utilization exceeds a threshold and re-computing intervals upon triggering events, ensuring efficient allocation and balancing between data collection and data mining activities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a FIFO queuing method is used to manage data collection processes, then simplicity of process management is improved, but throughput performance of critical processes deteriorates due to equal access to computing resources

Engineering Contradiction:
Improveprocess management simplicityVSAvoidthroughput performance
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent changes the parameter of process access by introducing priority levels and query intervals. Instead of uniform FIFO access, processes are assigned different priority levels (1-10) and corresponding query intervals, allowing critical processes to access computing resources more frequently and with higher probability, thereby improving throughput performance while maintaining manageable complexity through structured parameter assignment

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If all processes are given equal access to computing resources, then fairness in resource allocation is improved, but execution speed of high-priority processes deteriorates

Engineering Contradiction:
Improveresource allocation fairnessVSAvoidexecution speed
Core Design Contradiction:
Ease of operationVSSpeed

Solution Approach 1:

The patent applies local quality by assigning different access characteristics to different processes based on their priority levels. High-priority processes (priority 8-10) receive shorter query intervals and higher access probability, while low-priority processes (priority 1-3) receive longer query intervals. This localized differentiation ensures that each process type receives appropriate resource access speed while maintaining an overall fair allocation framework

Inventive Principle:
Principle #3Local quality

3Speed

If priority levels and query intervals are assigned to processes, then execution speed of high-priority processes is improved, but system complexity deteriorates

Engineering Contradiction:
Improveexecution speedVSAvoidsystem complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent introduces dynamics by making query intervals adjustable and modifiable based on system conditions and triggering events. The controller can dynamically recalculate and update query intervals for processes based on current system state, allowing the system to adapt to changing conditions without requiring complete redesign of the priority management structure, thus managing complexity through flexible dynamic adjustment

Inventive Principle:
Principle #15Dynamics

4Speed

If query intervals are frequently recalculated, then responsiveness to system changes is improved, but computational overhead deteriorates

Engineering Contradiction:
ImproveresponsivenessVSAvoidcomputational overhead
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by triggering query interval recalculation only upon occurrence of specific triggering events rather than continuously or at fixed intervals. This event-driven approach allows the system to respond promptly to meaningful changes in system state while avoiding unnecessary computational overhead from frequent or routine recalculations, balancing responsiveness with energy efficiency

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS8719297B2System for managing data collection processes
Publication Date: 2014.05.06 UBER TECHNOLOGIES INC
  • US8719297B2 patent drawing
  • US8719297B2 patent drawing
  • US8719297B2 patent drawing

AI summary

A system and process for managing data collection processes is disclosed. An apparatus that incorporates teachings of the present disclosure can include, a data collection system having a controller element that assigns to each of the processes a query interval according to a priority level of the data collection process for requesting use of processing resources, receiving one or more requests from the processes, once per respective query interval, for use of at least a portion of available processing resources, releases at least a portion of the available processing resources to a requesting one of the processes when the use of the available processing resources exceeds a utilization threshold. Additional embodiments are disclosed.