Benchmark Test System for Over-the-Top Traffic Reliability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing benchmark testing methods for devices under test, such as mobile phones, rely on estimations from separate hardware and operating system tests, lacking reliability in assessing over-the-top behavior, particularly in wireless network environments.

Innovation Solution

A test system comprising a device under test with hardware components and an over-the-top traffic unit, a network unit, and a control unit that simultaneously tests hardware and operating system combinations to identify the best configuration for handling over-the-top traffic applications, using an over-the-top traffic simulation component to simulate realistic traffic scenarios.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If separate hardware and operating system tests are performed offline and combined for estimation, then the testing process is simplified and can be performed separately, but the reliability of benchmark results is reduced

Engineering Contradiction:
Improvetesting process simplicityVSAvoidbenchmark result reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent merges hardware testing, operating system testing, and over-the-top behavior testing into a single integrated benchmark test. The control unit coordinates all components to perform simultaneous testing, eliminating the need for separate offline tests and their subsequent combination. This integration directly measures the complete system's performance together, resolving the contradiction by maintaining operational simplicity while achieving reliable results through unified measurement rather than separate estimations.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of time

If estimations are used to combine separate test results, then the testing can be performed separately, but the accuracy of over-the-top behavior assessment is reduced

Engineering Contradiction:
Improvetesting time efficiencyVSAvoidover-the-top behavior measurement accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The patent implements a feedback mechanism where the control unit continuously monitors and coordinates hardware components, operating system, and over-the-top traffic unit during simultaneous testing. The measurement unit captures real-time performance data from the integrated system, providing accurate feedback on actual over-the-top behavior. This eliminates estimation errors by directly measuring the complete system's performance together, achieving both time efficiency and measurement precision through coordinated unified testing.

Inventive Principle:
Principle #23Feedback

3Device complexity

If hardware and operating system are tested separately offline, then the testing setup is simpler, but the ability to identify best working combinations is reduced

Engineering Contradiction:
Improvetesting system complexityVSAvoidconfiguration optimization capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal testing system where the control unit can coordinate multiple hardware components and operating system configurations within a single integrated test framework. The system is designed to handle various device configurations simultaneously, testing different hardware-OS combinations and identifying optimal pairings. This multi-functional approach maintains manageable system complexity while significantly enhancing the ability to evaluate and optimize different configuration combinations for over-the-top behavior.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10581695B2Test system and method for benchmark testing a device under test
Publication Date: 2020.03.03 ROHDE & SCHWARZ GMBH & CO KG
  • US10581695B2 patent drawing

AI summary

A test system for benchmark testing a device under test is described. The test system comprises a device under test having hardware components, an operating system and at least one over-the-top traffic unit. The test system also has at least one network unit providing a network for the benchmark testing. The test system further comprises at least one control unit controlling the benchmark testing. In addition, the test system has at least one measurement unit configured to acquire benchmark data of the device under test. The control unit is configured to control the measurement unit and the over-the-top traffic unit. Further, a method for benchmark testing a device under test is described.