Synchronized Trace and Video Log Playback for Software Debugging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current debugging tools, such as logfiles, often lack sufficient context and are time-consuming to review, making it difficult to diagnose software errors due to insufficient information about user interactions leading up to crashes.

Innovation Solution

A method and system for recording and playback of trace log data and video log data that synchronizes visual user interactions with program execution messages, allowing for enhanced diagnosis of software errors by providing a visual context of user actions during program execution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional logfile tracing is used to record program execution, then detailed execution steps are captured, but the information lacks context and is difficult to review

Engineering Contradiction:
Improvecontext informationVSAvoidreview time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent combines video recording of the graphical user interface with trace logfile data into a single synchronized playback presentation. The video captures visual context of user actions while the trace provides execution details, and both are played back together with temporal synchronization to show low-level actions alongside high-level visual context, thereby preventing information loss and reducing review time

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent adds a visual dimension to traditional text-based logging by recording and playing back video of the graphical user interface. This transforms the debugging experience from reviewing text traces to watching a visual replay of user interactions synchronized with execution steps, providing intuitive context without increasing review time

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If comprehensive trace logging is implemented to capture all execution steps, then detailed debugging information is available, but the log becomes very large and time-consuming to review

Engineering Contradiction:
Improvediagnostic capabilityVSAvoiddata volume
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges video recording with trace logging to create a unified debugging presentation. The video provides visual context that helps reviewers understand user actions without needing to interpret every trace entry, thereby maintaining high diagnostic capability while reducing the effective data volume that needs detailed analysis

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a visual copy of the user's interaction experience through video recording of the graphical interface. This video copy serves as a simplified representation that conveys contextual information more efficiently than detailed text traces, reducing the complexity of debugging data while preserving diagnostic reliability

Inventive Principle:
Principle #26Copying

3Loss of information

If detailed trace logging is used to capture user actions, then execution steps are recorded, but context information about user intent is missing

Engineering Contradiction:
Improveuser contextVSAvoiddebugging efficiency
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent combines video recording of the graphical user interface with trace logfile data into a single synchronized playback presentation. The video captures visual context of user actions while the trace provides execution details, and both are played back together with temporal synchronization to show low-level actions alongside high-level visual context

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent adds a visual dimension to traditional text-based logging by recording and playing back video of the graphical user interface. This transforms the debugging experience from reviewing text traces to watching a visual replay of user interactions synchronized with execution steps, providing intuitive context without increasing review time

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10133653B2Recording and playback of trace and video log data for programs
Publication Date: 2018.11.20 CADENCE DESIGN SYST INC
  • US10133653B2 patent drawing
  • US10133653B2 patent drawing
  • US10133653B2 patent drawing

AI summary

Recording and playback of trace log data and video log data for programs is described. In one aspect, a method for viewing log data recorded during execution of a program includes causing a display of recorded images depicting prior visual user interaction with the program during a particular time period. The method also includes causing a display of messages tracing and describing prior execution of the program during the particular time period. The display of the messages and the display of the recorded images are synchronized.