Isolating Traffic Composition in Performance Metrics
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The performance of content provisioning systems, such as advertisement systems, is challenging to measure effectively due to the influence of traffic composition changes, which can mask the true effects of changes in performance requirements, making it difficult to isolate traffic-independent and traffic-related changes in performance metrics.
Innovation Solution
A method is developed to isolate traffic composition changes by determining overall and reference traffic changes in performance metrics, allowing for the quantification of traffic-independent and traffic-related changes, enabling accurate attribution of performance changes to either quality or traffic factors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If performance requirements are changed to improve system performance, then system performance can be increased, but the true effect of changes cannot be accurately measured due to traffic composition changes
Solution Approach 1:
The patent segments the overall performance metric into two distinct components: traffic-independent performance change and traffic-related performance change. By calculating a reference performance metric that isolates traffic-independent changes using reference traffic values, the system can separately measure the true effect of performance requirement changes without contamination from traffic composition variations.
Solution Approach 2:
The patent introduces reference traffic values as an intermediary element that remains constant across different time periods. These reference values serve as a stable baseline to calculate reference performance metrics, allowing the system to filter out the confounding effects of traffic composition changes and accurately attribute performance variations to the actual performance requirement changes.
2Adaptability or versatility
If traffic composition factors vary between time periods, then system performance may change, but it becomes difficult to distinguish traffic effects from quality changes
Solution Approach 1:
The patent segments performance changes into traffic-independent and traffic-related components. By calculating the reference performance metric using stable reference traffic values, the system isolates traffic-independent changes (quality improvements). The traffic-related changes are then derived as the difference between overall changes and reference changes, preserving complete performance attribution information.
Solution Approach 2:
The patent uses reference traffic values as an intermediary to maintain stable comparison across varying traffic conditions. This intermediary allows the system to track performance changes while accounting for traffic composition variations, preventing loss of attribution information by separately identifying both traffic and quality contributions to performance changes.
Data Source
AI summary
Apparatus, systems and methods for isolation of traffic composition in performance metrics are disclosed. A change in a performance metric of a content provisioning system is determined. The change in the performance metric is compared to a weighted change expected from the content provisioning system if traffic was not a factor. A traffic independent change is determined from the weighted change. A traffic related change is determined.