Correlating UI Video with CPU Stacks for Profiling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Profiling tools face challenges in efficiently analyzing large profiling traces to identify issues in computer processes, as they lack direct correlation with user interface activities, leading to time-consuming debugging processes.

Innovation Solution

A method that captures both profiling traces and video of the user interface during process execution, correlating the two to pinpoint problems by determining window handles and storing the data in a profiling trace object for enhanced analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If profiling tools capture and analyze large profiling traces without UI correlation, then comprehensive process analysis is achieved, but debugging time and effort increase significantly

Engineering Contradiction:
Improveprofiling trace analysis accuracyVSAvoiddebugging time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent introduces video recording of UI activities as an intermediary medium that bridges the gap between profiling trace data and human analysis. The video serves as a mediator that visually represents user interactions, making it easier to correlate with technical profiling data and quickly identify problematic time periods without manually analyzing extensive trace logs.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds a temporal-visual dimension to traditional profiling analysis by recording video of UI activities alongside profiling traces. This transforms the analysis from purely text-based trace examination to a multi-dimensional approach combining visual video footage with technical trace data, enabling faster identification of issues through visual cues.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If profiling tools use only trace data without video correlation, then data storage requirements are reduced, but issue identification becomes less efficient

Engineering Contradiction:
Improveissue identification efficiencyVSAvoiddata storage volume
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent performs preliminary action by recording video of UI activities during the profiling session itself, capturing relevant visual information at the source. This preliminary video capture allows developers to later quickly identify problematic time periods by reviewing video footage rather than searching through extensive trace data, improving issue identification efficiency without requiring storage of every possible trace detail.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10455188B2Correlating UI with CPU stacks for profiling sessions
Publication Date: 2019.10.22 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10455188B2 patent drawing
  • US10455188B2 patent drawing
  • US10455188B2 patent drawing

AI summary

Methods, systems, apparatuses, and computer program products are provided for correlating a user interface (UI) of an executing process with a profiling trace generated for the process. A profiling trace of a process is captured during execution of the process. A window handle associated with the process is determined. Video of a displayed window having the window handle is captured simultaneous with the capturing of the profiling trace. The displayed window displays a user interface (e.g., a graphical user interface) of the process. The captured profiling trace and the video are stored in a profiling trace object, and may be analyzed together to diagnose any problems/issues with the process.