Screen Capture Timing Correction for User Operation Recording

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing user operation recording technologies face delays in screen capture, making it difficult to accurately acquire screen captures at the time of user operations.

Innovation Solution

A user operation recording apparatus that includes an acquisition unit for capturing screen images at predetermined intervals, a detection unit to detect user operations, an estimation unit to calculate the delay time, and a selection unit to select the appropriate image data based on the estimated delay time, ensuring accurate capture of user operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If screen capture is performed at the timing when user operation is detected, then the screen capture timing is synchronized with operation detection, but there is a delay from the time of operation to screen capture making it difficult to appropriately acquire the screen capture at the time of operation

Engineering Contradiction:

Improvescreen capture timing accuracyVSAvoiddelay time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs screen capture at predetermined intervals before user operation detection occurs. By continuously capturing screens in advance and storing them with timestamps, the system ensures that the actual operation moment is already captured when detection happens, eliminating the delay between operation and capture.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system uses the detected user operation timing as feedback to select the appropriate screen capture image. By comparing the operation detection timestamp with the timestamps of captured images, the system identifies and selects the image that corresponds to the operation moment, ensuring accurate timing correlation.

Inventive Principle:

Principle #23Feedback

2Reliability

If screen capture is performed at predetermined intervals, then continuous screen monitoring is achieved, but the delay from user operation to screen capture timing increases

Engineering Contradiction:

Improvescreen capture availabilityVSAvoidcapture delay

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

Inventive Principle:

Principle #10Preliminary action

3Measurement precision

If screen capture is performed continuously at high frequency, then accurate operation timing capture is achieved, but data storage requirements and system resource consumption increase

Engineering Contradiction:

Improveoperation timing accuracyVSAvoidimage data volume

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The system performs screen capture at predetermined intervals that may be more frequent than strictly necessary, but not continuously. This partial action approach captures enough images to ensure the operation moment is included while avoiding the excessive resource consumption of continuous high-frequency capture. The detection unit then selects only the relevant image based on timing comparison.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS11875024B2User operation recording device and user operation recording method

Publication Date: 2024.01.16 NIPPON TELEGRAPH & TELEPHONE CORP

AI summary

An acquisition unit acquires image data by performing screen capture of a screen operated by a user, at a predetermined interval. A detection unit detects the user operation. An estimation unit estimates an amount of delay time from a user operation time point to a time point at which the user operation is detected by the detection unit. The selection unit selects image data of the user operation time point out of the acquired image data.