Session Recording Clip Extraction via Application Transition Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current recording technologies do not efficiently allow users to quickly identify and access specific application usage within session recordings, leading to user frustration and increased computing resource consumption due to manual searching and playback adjustments.

Innovation Solution

The recording service detects transitions in the desktop environment to generate metadata for extracting clips corresponding to application usage, including start and end frames, allowing for the construction of video clips that can be quickly viewed by users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual searching and playback adjustments are used to locate specific application usage in recordings, then users can find the desired portions, but user frustration increases and computing resource consumption increases

Engineering Contradiction:
Improveease of locating specific application usageVSAvoidtime to locate specific application usage
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary action by automatically generating metadata during the recording process that identifies start and end frames for each application usage. This preprocessing eliminates the need for manual searching during playback, as the desired portions are already marked and ready for immediate access.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces metadata as an intermediary between the recording and the user. This metadata layer contains structured information about application usage boundaries, allowing users to quickly navigate to specific portions without manually scanning through the entire recording.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If manual searching and playback adjustments are used to locate specific application usage, then users can find the desired portions, but computing resource consumption increases

Engineering Contradiction:
Improveease of locating specific application usageVSAvoidcomputing resource consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system performs the computationally intensive task of analyzing and marking application usage boundaries during the recording phase. By completing this preprocessing work beforehand, the playback phase requires minimal computing resources, as the system only needs to read and follow the pre-generated metadata markers.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The metadata acts as an intermediary that stores the results of complex analysis work. Instead of repeatedly performing resource-intensive analysis during each playback session, the system stores the analysis results in metadata that can be quickly read and used for navigation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If the entire recording is played back to find specific application usage, then users can locate the desired portions, but the process is inefficient and frustrating

Engineering Contradiction:
Improvecompleteness of application usage informationVSAvoidefficiency of locating specific application usage
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system extracts specific application usage portions from the entire recording by identifying and marking their boundaries in the metadata. Users can then extract and play only the relevant portions corresponding to specific applications, rather than watching the complete recording.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary identification and marking of application usage boundaries during recording. This preprocessing enables efficient extraction of specific portions during playback, maintaining information completeness while dramatically improving access efficiency.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11900680B2Extracting clips of application use from recordings of sessions
Publication Date: 2024.02.13 CITRIX SYSTEMS INC
  • US11900680B2 patent drawing
  • US11900680B2 patent drawing
  • US11900680B2 patent drawing

AI summary

Described embodiments provide systems and methods for defining a clip within a recording. A device may generate a recording of a session of a user via which a plurality of applications is accessible. The device may detect a transition of an application of the plurality of applications in a foreground of the session. The device may identify, from the recording, a frame corresponding to the transition in the foreground. The device may store an identification of the frame corresponding to the transition to define a clip of the user within the recording using the application in the session.