Automated Test Case Generation from Application Telemetry

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Software test teams face challenges in manually collecting and analyzing data on customer usage of applications, which is tedious, inefficient, and often unreliable due to inconsistent and incomplete information.

Innovation Solution

An information handling system that collects telemetry data from applications, processes it to derive patterns, and generates test cases based on identified test data and scenarios, thereby providing automated application feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual data collection and analysis methods are used, then test teams can gather customer usage information, but the process becomes tedious, inefficient, and unreliable

Engineering Contradiction:

Improvereliability of test dataVSAvoidefficiency of data collection

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The system enables automated self-service data collection where the information handling system automatically collects, processes, and analyzes telemetry data without requiring manual intervention from test teams. The automated generation of test cases from analyzed patterns eliminates the need for manual test case creation, thereby improving both reliability and efficiency simultaneously

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual process of data collection and test case creation with an automated electronic system. The information handling system uses software agents and algorithms to collect telemetry data, analyze patterns, and generate test cases automatically, substituting human manual labor with computational processes that are more efficient and reliable

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If manual test case writing and maintenance is performed, then test coverage can be achieved, but resource intensity increases significantly

Engineering Contradiction:

Improvecompleteness of test coverageVSAvoidresource intensity

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The system creates automated copies of test cases by analyzing telemetry data patterns and generating test case templates that can be repeatedly applied. Instead of manually writing each test case from scratch, the system generates multiple test cases by copying and adapting patterns from analyzed customer usage scenarios, significantly reducing the resources required while maintaining comprehensive test coverage

Inventive Principle:

Principle #26Copying

3Productivity

If automated test case generation is implemented, then efficiency and reliability improve, but system complexity increases

Engineering Contradiction:

Improveautomation efficiencyVSAvoidsystem complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The automated system is segmented into distinct functional modules: a telemetry data collection module, a pattern analysis module, and a test case generation module. This segmentation allows each component to perform its specific function independently, making the overall complex system more manageable and maintainable while preserving automation efficiency and reliability

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS20250130925A1Providing automated application feedback for software testing

Publication Date: 2025.04.24 DELL PROD LP

AI summary

An information handling system collects telemetry data associated with an application, and processes the telemetry data of the application to derive a pattern. The system analyzes the telemetry data to identify test data and a test scenario based on the pattern, and generates a test case based on the test data and the test scenario.